
Drone archery. Credit: Pavel Odinev/Skoltech
Skoltech researchers have developed an effective — and pretty dramatic — way for positioning a swarm of rescue or research drones. The operator wears a virtual reality helmet and a tactile interface to imitate shooting a bow to guide each drone toward its intended position with a series of shots. The technique is enhanced by deep reinforcement learning, which serves to prevent the robots from colliding with each other.
The study was presented at the 21st IEEE International Symposium on Mixed and Augmented Reality

“Steve Jobs radically changed our idea of an intuitive interaction with the digital world when he championed touch screens and gestures. The goal of our research is even more ambitious in that it seeks to address the challenge of how to enable a user with no drone piloting experience to deploy an entire swarm within mere seconds,” commented the study’s principal investigator, Skoltech Associate Professor Dzmitry Tsetserukou, who heads the Intelligent Space Robotics Laboratory.
“Right now, there aren’t that many interfaces for deploying a swarm of drones,” the study’s lead author, Skoltech MSc graduate Ekaterina Dorzhieva, commented. “A joystick is convenient for controlling one drone, but once you have a whole swarm, you either need multiple operators or very complex software with code that explicitly accounts for a lot of stuff in a nonintuitive way. We offer an alternative to this.”
The alternative solution presented by the researchers from the Institute’s Engineering Center is a tactile interface proposed by Skoltech PhD student ?Miguel Altamirano Cabrera and inspired by LinkTouch, an earlier design created by Tsetserukou in Japan.
The operator (video) wears a virtual reality helmet, a pair of gloves with markers, and a tactile interface. A motion capture system incorporating several IR cameras is set up around the “shooter” to track the positions of the gloves and drones. The tactile interface allows the wearer to feel the tension of the virtual bowstring based on how far from each other the gloves are and use this feedback to adjust the distance to the location they are about to deploy a drone to. Meanwhile, the VR helmet keeps visualizing the ballistic trajectory of the drone in real time. When the operator is satisfied with the trajectory, they unclench the fist. This is registered by the camera, locking the trajectory and sending the drone to traverse it.
Once the destination is reached, some conventional form of control has to take over, guiding the drone on its mission, which might involve a rescue operation, natural resource management, forest fire detection, vegetation index-based crop monitoring, pollution detection, infrastructure inspection or maintenance.
“The benefit of using an arrowlike ballistic trajectory is that it feels natural for a person, and that way a human operator can quickly find a way to deploy drones while avoiding obstacles. It’s a fairly natural task for humans,” Dorzhieva said. “You could use software to set the coordinates for drones to travel to, but then they would have to figure out the path that avoids the obstacles on their own, and that means each machine must be equipped with a camera.”
There are two more twists to this. First, using virtual reality tech means the operator does not have to be anywhere close to the actual location where the swarm is being deployed. Whatever harsh conditions the drones are built to withstand — raging fire, radioactive contamination, freezing temperatures in a remote location, etc. — the VR helmet could be used to simulate operator presence on location and position the robots. Also, once you put virtual reality and bow shooting together, there’s clearly potential for the entertainment and video game industry. Second, the new method is bolstered by reinforcement learning, enabling the drones to foresee possible collisions with each other and adapt the trajectories they are on accordingly.
Original Article: Virtual bow deploys drone swarm in a series of shots
More from: Skolkovo Institute of Science and Technology
The Latest Updates from Bing News
Go deeper with Bing News on:
Drone swarm
- Russian drones swarm Ukraine's Kyiv in display of force as Xi leaves Moscow
Hosting Chinese President Xi Jinping this week was Putin's grandest diplomatic gesture since he launched the war a year ago and became a pariah in the West.
- Russia hits Ukraine with drones, missiles
Ukraine’s President Volodymyr Zelensky tweeted security camera video of a residential apartment block in the southern city of Zaporizhzhia exploding as it was struck by a missile in broad daylight ...
- Russian launches drone strike in Kyiv as China’s Xi Jinping leaves Moscow
Despite the bloodiest fighting of the war, which both sides describe as a meat grinder, the front line has barely moved for four months.
- Ukraine's President Volodymyr Zelenskyy visits troops on the frontline, as Russia launches drone and missile strikes
Ukraine's President Zelenskyy meets with troops near the frontline town of Bukhmut in eastern Ukraine, as Russia renews attacks following a solidarity visit by China's leader.
- Russia hits Ukraine with drones, missiles after solidarity visit from Xi
Russia blasted an apartment block in Ukraine with missiles on Wednesday (22 March) after launching a swarm of drones at cities overnight, a deadly display of force following a solidarity visit by ...
Go deeper with Bing News on:
Drone swarm launch
- Russia launches fresh attack on Ukraine
Russia blasted an apartment block in Ukraine with missiles yesterday after launching a swarm of drones at cities overnight, a deadly display of force following a solidarity visit by China’s leader Xi ...
- Russia launches fresh attack on Ukrainian cities
Russia blasted an apartment block in Ukraine with missiles yesterday after launching a swarm of drones at cities overnight, a deadly display of force following a solidarity visit by China’s leader Xi ...
- Russian launches drone strike in Kyiv as China’s Xi Jinping leaves Moscow
Despite the bloodiest fighting of the war, which both sides describe as a meat grinder, the front line has barely moved for four months.
- Ukraine's President Volodymyr Zelenskyy visits troops on the frontline, as Russia launches drone and missile strikes
Ukraine's President Zelenskyy meets with troops near the frontline town of Bukhmut in eastern Ukraine, as Russia renews attacks following a solidarity visit by China's leader.
- Russia’s war on Ukraine latest: Russia launches drone strikes on Ukraine as Xi leaves Moscow
Russia launched a swarm of drones into Ukraine overnight, killing at least four people near Kyiv in a display of force as China's President Xi Jinping left Moscow with ...