
Drone archery. Credit: Pavel Odinev/Skoltech
Skoltech researchers have developed an effective — and pretty dramatic — way for positioning a swarm of rescue or research drones. The operator wears a virtual reality helmet and a tactile interface to imitate shooting a bow to guide each drone toward its intended position with a series of shots. The technique is enhanced by deep reinforcement learning, which serves to prevent the robots from colliding with each other.
The study was presented at the 21st IEEE International Symposium on Mixed and Augmented Reality

“Steve Jobs radically changed our idea of an intuitive interaction with the digital world when he championed touch screens and gestures. The goal of our research is even more ambitious in that it seeks to address the challenge of how to enable a user with no drone piloting experience to deploy an entire swarm within mere seconds,” commented the study’s principal investigator, Skoltech Associate Professor Dzmitry Tsetserukou, who heads the Intelligent Space Robotics Laboratory.
“Right now, there aren’t that many interfaces for deploying a swarm of drones,” the study’s lead author, Skoltech MSc graduate Ekaterina Dorzhieva, commented. “A joystick is convenient for controlling one drone, but once you have a whole swarm, you either need multiple operators or very complex software with code that explicitly accounts for a lot of stuff in a nonintuitive way. We offer an alternative to this.”
The alternative solution presented by the researchers from the Institute’s Engineering Center is a tactile interface proposed by Skoltech PhD student ?Miguel Altamirano Cabrera and inspired by LinkTouch, an earlier design created by Tsetserukou in Japan.
The operator (video) wears a virtual reality helmet, a pair of gloves with markers, and a tactile interface. A motion capture system incorporating several IR cameras is set up around the “shooter” to track the positions of the gloves and drones. The tactile interface allows the wearer to feel the tension of the virtual bowstring based on how far from each other the gloves are and use this feedback to adjust the distance to the location they are about to deploy a drone to. Meanwhile, the VR helmet keeps visualizing the ballistic trajectory of the drone in real time. When the operator is satisfied with the trajectory, they unclench the fist. This is registered by the camera, locking the trajectory and sending the drone to traverse it.
Once the destination is reached, some conventional form of control has to take over, guiding the drone on its mission, which might involve a rescue operation, natural resource management, forest fire detection, vegetation index-based crop monitoring, pollution detection, infrastructure inspection or maintenance.
“The benefit of using an arrowlike ballistic trajectory is that it feels natural for a person, and that way a human operator can quickly find a way to deploy drones while avoiding obstacles. It’s a fairly natural task for humans,” Dorzhieva said. “You could use software to set the coordinates for drones to travel to, but then they would have to figure out the path that avoids the obstacles on their own, and that means each machine must be equipped with a camera.”
There are two more twists to this. First, using virtual reality tech means the operator does not have to be anywhere close to the actual location where the swarm is being deployed. Whatever harsh conditions the drones are built to withstand — raging fire, radioactive contamination, freezing temperatures in a remote location, etc. — the VR helmet could be used to simulate operator presence on location and position the robots. Also, once you put virtual reality and bow shooting together, there’s clearly potential for the entertainment and video game industry. Second, the new method is bolstered by reinforcement learning, enabling the drones to foresee possible collisions with each other and adapt the trajectories they are on accordingly.
Original Article: Virtual bow deploys drone swarm in a series of shots
More from: Skolkovo Institute of Science and Technology
The Latest Updates from Bing News
Go deeper with Bing News on:
Drone swarm
- Record drone attack on Ukraine: Russia deploys 75 UAVs, most shot down
During recent nighttime and morning attacks on Ukraine, Russia utilized 75 unmanned drones primarily targeting Kyiv. Ukrainian observers noticed the deployed machines were different from the previously used Shahed 131 and 136 attack drones,
- Swarms of killer AI drones could soon be deployed by US military - without human say so
The technological advancements of AI-controlled drones have sparked a heated debate among nations, including the US and China. Some believe they pose a risk, while others see them as a necessary means
- 'Killer robots': Pentagon seeks AI-powered drones to take out enemies
The Pentagon is reportedly developing a network of hundreds or even thousands of AI-enhanced, autonomous drones.
- China Shows Off New Anti-Drone Gun
China's new system resembles a rifle with a scope and is designed to effectively detect, track, locate, and recognize drones flying at low altitudes, Global Times reported. The anti-drone gun will target small surveillance and attack drones rather than large reconnaissance aircraft.
- From Land Mines to Drones, Tech Has Driven Fears About Autonomous Arms
Land mines, which are designed to discharge automatically when a person or object passes on top of them, were used as early as the 1800s during the Civil War in the United States, apparently first invented by a Confederate general named Gabriel J. Rains, who called them a “subterra shell.”
Go deeper with Bing News on:
Drone swarm launch
- Pentagon pushes A.I. research toward lethal autonomous weapons
Industry experts and Pentagon officials agree that the U.S. will within the next few years have fully autonomous lethal weapons ready to deploy.
- Pentagon's AI initiatives accelerate hard decisions on lethal autonomous weapons.
Artificial intelligence employed by the U.S. military has piloted pint-sized surveillance drones in special operations forces’ missions and helped Ukraine in its war against Russia .
- Pentagon steps on AI accelerator as age of lethal autonomy looms
Artificial intelligence employed by the U.S. military has piloted pint-sized surveillance drones in special operations forces’ missions and helped Ukraine in its war against Russia .
- Swarms of killer AI drones could soon be deployed by US military - without human say so
The technological advancements of AI-controlled drones have sparked a heated debate among nations, including the US and China. Some believe they pose a risk, while others see them as a necessary means
- From Land Mines to Drones, Tech Has Driven Fears About Autonomous Arms
Land mines, which are designed to discharge automatically when a person or object passes on top of them, were used as early as the 1800s during the Civil War in the United States, apparently first invented by a Confederate general named Gabriel J. Rains, who called them a “subterra shell.”