Your torso is more intuitive – and more precise – than joysticks for piloting drones, both simulated and real, according to a recent study by EPFL scientists. Work is already underway to implement this new body-machine-interface technology for search and rescue with drones.
Imagine piloting a drone using the movements of your torso only and leaving your head free to look around, much like a bird. EPFL research has just shown that using your torso to pilot flying machines is indeed more immersive – and more effective – than using the long-established joystick. The results are published in today’s issue of PNAS.
“Our aim was to design a control method which would be easy to learn and therefore require less mental focus from the users so that they can focus on more important issues, like search and rescue,” says lead author Jenifer Miehlbradt of EPFL’s Translational Neuroengineering Laboratory led by Bertarelli Foundation Chair Silvestro Micera. “Using your torso really gives you the feeling that you are actually flying. Joysticks, on the other hand, are of simple design but mastering their use to precisely control distant objects can be challenging.”
The scientists wanted to observe how people use their bodies to pilot a flying object, in this case a drone, and determine which movements are most intuitive and natural – approaching the pilot problem from a completely new perspective.
They started by monitoring the body movements of 17 individuals thanks to 19 infrared markers placed all over the upper body as well as their muscular activity. Each participant followed the actions of a virtual drone through simulated landscapes that passed-by as viewed through virtual reality goggles.
Motion patterns emerged and the scientists quickly established torso-related strategies for piloting drones: they found that only 4 markers – located on the torso – were needed to pilot flight simulators and real drones through a circuit of obstacles effectively.
Overall, the scientists compared their torso strategies to joystick control in 39 individuals. They found that torso drone control outperformed joystick control in precision, reliability and with minimal training sessions.
“Data analysis allowed us to develop a very simple and intuitive approach which could also be used with other populations, machines, and operations,” says Micera, also at the Scuola Superiore Sant’Anna in Italy in Biomedical Engineering. He adds, “The approach significantly improves the teleoperation of robots with non-human mechanical attributes.”
While the PNAS results provide a truly new and completely immersive piloting strategy with a focus on characterizing the relevant torso parameters, leaving the head, limbs, hands and feet free to perform other actions, their proof-of-concept system still requires body markers and external motion detectors in order to work.
The next steps are to make the torso strategy completely wearable for piloting flying objects. The application range is huge, from flight simulators to piloting drones and even perhaps planes of the future. A garment that implements the torso strategy into drone control without external motion detectors was developed at EPFL’s Laboratory of Intelligent Systems led by co-author Dario Floreano based on the PNAS findings.
A jacket for flying like a bird
The Fly Jacket, a first implementation of the torso strategy for piloting flying objects.
Drone pilots can now achieve an unprecedented level of immersion thanks to Fly Jacket developed by Carine Rognon, a researcher at EPFL’s Laboratory of Intelligent Systems led by Dario Floreano. The Fly Jacket appeared in the July 2018 issue of IEEE Robotics and Automation Letters.
Rognon came up with a very lightweight garment that translates the torso strategy described in the PNAS article into drone control commands without external motion detectors. It allows pilots to control their drone intuitively with their body movements – such as leaning forward and backward and pivoting their upper body – rather than with a hand-held device.
Thanks to an embedded motion sensor developed by EPFL Laboratory of Embedded systems led by David Atienza, the fly jacket makes the drone control extremely responsive. Furthermore, the fly jacket has an arm support system that prevents fatigue. This, together with the use of first-person view (FPV) goggles connected to an on-board camera, allows pilots to navigate the skies naturally while keeping their arms spread out as wings.
“The Fly Jacket not only produces an immersive and intuitive flight control experience, but also frees the human hands for other tasks. For example, we have shown that humans could wear data gloves to give additional commands to the drone, like for take-off and landing, or to indicate points of interest seen from the drone perspective that would immediately appear on a map. This could be very useful for fire fighters or rescuers to quickly and precisely identify locations where help is needed,” says Floreano.
Learn more: Forget joysticks, use your torso to pilot drones
The Latest on: Torso drone control
via Google News
The Latest on: Torso drone control
- Leonardo delivers counter-drone technology to the Royal Air Force to support the research and development programme SYNERGIAon January 20, 2021 at 12:00 am
Leonardo in the UK has delivered the first of four complete baseline counter-drone systems to the Royal Air Force in support of the next stage of its Counter-Unmanned Aerial System (C-UAS) ...
- Oh Snap! How Click Beetles Use A Basic Principle of Mechanical Engineeringon January 19, 2021 at 10:40 am
University of Illinois r esearchers can now explain the physical mechanisms behind click beetles’ clicking maneuver. Belonging to the Elateroidea family, a click beetle (or snap ...
- University of Bristol: Smart Internet Lab helps accelerate UK’s capabilities in drone operationson January 18, 2021 at 4:37 pm
Experts from the University of Bristol are among a UK-wide consortium that is pushing the boundaries of drone development and aviation capabilities.The consortium of 16 entities, led by specialist ...
- FAA Announces $5.8 Million in 33 Unmanned Aircraft System Research Grantson January 16, 2021 at 5:28 am
The U.S. Department of Transportation’s Federal Aviation Administration (FAA) has announced $5.8 million in research, education and training grants to universities that comprise FAA’s Air ...
- 10 Cool Things from the Virtual CESon January 15, 2021 at 5:25 am
CES was held virtually this year, meaning the big Las Vegas Convention Center was empty and everyone attended online. The same thing happened with the SEMA show. There were more than 1,500 exhibitors ...
- Cadillac flying car and autonomous pod concepts hint at electric roadmapon January 12, 2021 at 3:54 pm
Cadillac may have its Celestiq hyper-luxury EV in mind for the near future, but two new concepts – an autonomous lounge pod and a flying car – at CES 2021 today show it’s looking ...
- Sony reveals Airpeak drone at CES 2021, to be launched this yearon January 12, 2021 at 1:03 am
The first Sony Airpeak will be launched in the spring of 2021. The drone will be equipped with an Alpha mirrorless camera to capture high-quality images and videos.
- Sony starts its own drone company, Airpeak, to fly Alpha camerason January 11, 2021 at 8:04 pm
Sony's mirrorless Alpha series cameras have become hugely popular filmmaking tools, thanks in large part to the company's excellent sensors. At this year's CES, Sony announced it's starting up a drone ...
- Eye in the sky: See the West Elmira drone, a first for a Chemung County fire departmenton January 7, 2021 at 4:00 pm
Town of Elmira Fire District No. 1 recently purchased a drone for use by the West Elmira police and fire departments, and other agencies.
via Bing News