Drone archery. Credit: Pavel Odinev/Skoltech
Skoltech researchers have developed an effective — and pretty dramatic — way for positioning a swarm of rescue or research drones. The operator wears a virtual reality helmet and a tactile interface to imitate shooting a bow to guide each drone toward its intended position with a series of shots. The technique is enhanced by deep reinforcement learning, which serves to prevent the robots from colliding with each other.
The study was presented at the 21st IEEE International Symposium on Mixed and Augmented Reality
“Steve Jobs radically changed our idea of an intuitive interaction with the digital world when he championed touch screens and gestures. The goal of our research is even more ambitious in that it seeks to address the challenge of how to enable a user with no drone piloting experience to deploy an entire swarm within mere seconds,” commented the study’s principal investigator, Skoltech Associate Professor Dzmitry Tsetserukou, who heads the Intelligent Space Robotics Laboratory.
“Right now, there aren’t that many interfaces for deploying a swarm of drones,” the study’s lead author, Skoltech MSc graduate Ekaterina Dorzhieva, commented. “A joystick is convenient for controlling one drone, but once you have a whole swarm, you either need multiple operators or very complex software with code that explicitly accounts for a lot of stuff in a nonintuitive way. We offer an alternative to this.”
The alternative solution presented by the researchers from the Institute’s Engineering Center is a tactile interface proposed by Skoltech PhD student ?Miguel Altamirano Cabrera and inspired by LinkTouch, an earlier design created by Tsetserukou in Japan.
The operator (video) wears a virtual reality helmet, a pair of gloves with markers, and a tactile interface. A motion capture system incorporating several IR cameras is set up around the “shooter” to track the positions of the gloves and drones. The tactile interface allows the wearer to feel the tension of the virtual bowstring based on how far from each other the gloves are and use this feedback to adjust the distance to the location they are about to deploy a drone to. Meanwhile, the VR helmet keeps visualizing the ballistic trajectory of the drone in real time. When the operator is satisfied with the trajectory, they unclench the fist. This is registered by the camera, locking the trajectory and sending the drone to traverse it.
Once the destination is reached, some conventional form of control has to take over, guiding the drone on its mission, which might involve a rescue operation, natural resource management, forest fire detection, vegetation index-based crop monitoring, pollution detection, infrastructure inspection or maintenance.
“The benefit of using an arrowlike ballistic trajectory is that it feels natural for a person, and that way a human operator can quickly find a way to deploy drones while avoiding obstacles. It’s a fairly natural task for humans,” Dorzhieva said. “You could use software to set the coordinates for drones to travel to, but then they would have to figure out the path that avoids the obstacles on their own, and that means each machine must be equipped with a camera.”
There are two more twists to this. First, using virtual reality tech means the operator does not have to be anywhere close to the actual location where the swarm is being deployed. Whatever harsh conditions the drones are built to withstand — raging fire, radioactive contamination, freezing temperatures in a remote location, etc. — the VR helmet could be used to simulate operator presence on location and position the robots. Also, once you put virtual reality and bow shooting together, there’s clearly potential for the entertainment and video game industry. Second, the new method is bolstered by reinforcement learning, enabling the drones to foresee possible collisions with each other and adapt the trajectories they are on accordingly.
Original Article: Virtual bow deploys drone swarm in a series of shots
More from: Skolkovo Institute of Science and Technology
The Latest Updates from Bing News
Go deeper with Bing News on:
Drone swarm
- AFSOC Autonomy Effort Looks To Connect MQ-9s, Drone Swarms
AFSOC Autonomy Effort Looks To Connect MQ-9s, Drone Swarms is published in Aerospace Daily & Defense Report, an Aviation Week Intelligence Network (AWIN) Market Briefing and is included with your AWIN ...
- Drone Swarm Attack Russian Federation Oil Depot Near Anapa
An oil depot in the village of Yurovka near Anapa in the Krasnodar Territory of the Russian Federation was attacked on the night of May 9. Several tanks were damaged. In addition, explosions and fires ...
- Dazzling drone display flies straight into the record books
A San Francisco-based company called UVify has set a new world record for the most drones used in an aerial display. The Latest Tech News, Delivered to Your Inbox ...
- Tesseract will build warfighting drones for military client
An Overland Park tech company continues its rapid growth with a military contract to develop a compact warfighting drone.
- New Study Simulates 3D Printing with UAV Swarms
3D printing is the act of intelligently depositing or solidifying material in an additive sequence to gradually build up an object. This is done using a variety of processes, including dropping ...
Go deeper with Bing News on:
Drone swarm launch
- AFSOC Autonomy Effort Looks To Connect MQ-9s, Drone Swarms
AFSOC Autonomy Effort Looks To Connect MQ-9s, Drone Swarms is published in Aerospace Daily & Defense Report, an Aviation Week Intelligence Network (AWIN) Market Briefing and is included with your AWIN ...
- Dazzling drone display flies straight into the record books
A San Francisco-based company called UVify has set a new world record for the most drones used in an aerial display.
- Tesseract will build warfighting drones for military client
An Overland Park tech company continues its rapid growth with a military contract to develop a compact warfighting drone.
- Armies need their own drone air force flown by specialist soldiers, study says
Experience in Ukraine suggests that armies should concentrate drones in special battalions that have the skills pilots to fly them and the programmers to rapidly adapt to constant jamming, according ...
- Prof Angela Schoellig Utilizes ChatGPT to Choreograph Drone Swarms Safely
Professor Angela Schoellig from the Technical University of Munich (TUM) has harnessed the power of ChatGPT to develop choreographies for swarms ...