ASU researcher creates system to control robots with the brain
A researcher at Arizona State University has discovered how to control multiple robotic drones using the human brain.
A controller wears a skull cap outfitted with 128 electrodes wired to a computer. The device records electrical brain activity. If the controller moves a hand or thinks of something, certain areas light up.
“I can see that activity from outside,” said Panagiotis Artemiadis (pictured above), director of the Human-Oriented Robotics and Control Lab and an assistant professor of mechanical and aerospace engineering in the School for Engineering of Matter, Transport and Energy in the Ira A. Fulton Schools of Engineering. “Our goal is to decode that activity to control variables for the robots.”
If the user is thinking about decreasing cohesion between the drones — spreading them out, in other words — “we know what part of the brain controls that thought,” Artemiadis said.
A wireless system sends the thought to the robots. “We have a motion-capture system that knows where the quads are, and we change their distance, and that’s it,” he said.
Up to four small robots, some of which fly, can be controlled with brain interfaces. Joysticks don’t work, because they can only control one craft at a time.
“You can’t do something collectively” with a joystick, Artemiadis said. “If you want to swarm around an area and guard that area, you cannot do that.”
To make them move, the controller watches on a monitor and thinks and pictures the drones performing various tasks.
Artemiadis has been working on the brain-to-machine interface since he earned his doctorate in 2009, specifically neural interfaces with robot hands and arms.
“During the last two to three decades there has been a lot of research on single brain/machine interface, where you control a single machine,” he said.
A few years ago, he had the idea to go to a lot of machines. It’s part of a trend in robotics and space exploration: Instead of building one giant expensive machine or plane or spacecraft, researchers build a lot of little cheap ones.
“If you lose half of them, it doesn’t really matter,” Artemiadis said.
He already knew what area of the brain controlled what motions. One discovery jumped out at him.
“I was surprised the brain cares about swarms and collective behaviors,” he said.
“What I didn’t know — or hypothesized — is that the brain cares about things we are not doing ourselves,” he added. “We don’t have a swarm we control. We have hands and limbs and all that stuff, but we don’t control swarms.”
In other words, our brains are not used to all of our fingers and toes running off on their own and then returning.
“I was surprised the brain cares about that, and that the brain can adapt,” he said.
He worked with Air Force pilots on this; the two-year project was funded by the Defense Advanced Research Projects Agency of the U.S. Department of Defense and the Air Force. The pilots were skeptical. Their main objection was what would happen if they thought of something else while controlling the drones.
Artemiadis said controllers have to stay focused. If it’s close to lunch and all you can think about it is pizza, it doesn’t work. Fatigue and stress also play a part. Artemiadis said he can tell when subjects are tired or need a break.
“We tell the subject to think of two things,” he said. “Focus on breathing, or we tell them to imagine closing their left hand into a fist.”
Each subject is different. The system has to be calibrated to individual controllers, and it has to be done every day, because brain signals change from day to day.
The next step in Artemiadis’ research is multiple people controlling multiple robots. He plans to move to a much larger experimental space to refine the proof of concept. In the future, he sees drone swarms performing complex operations, such as search-and-rescue missions.
The Latest on: Controlling multiple robot drones with the brain
via Google News
The Latest on: Controlling multiple robot drones with the brain
- This Jet Will Turn AI Into a Real-World Top Gunon January 24, 2021 at 6:42 am
AI could dogfight in the skies, but first it needs to get inside a real cockpit and learn the basics. Artificial intelligence has arrived on the battlefield. Powerful algorithms are decoding vast ...
- Brain-computer interface makes thought-controlled tech a realityon January 21, 2021 at 3:43 am
Researchers in north China Tianjin University are developing multiple applications for brain-computer interface BCI technologyBC ...
- Huge Chinese Drone Swarms Could Block Out the Sunon January 20, 2021 at 4:52 am
Now, China may have a modern iteration on that tactic: swarms of tiny rocket-armed helicopter drones that will swamp enemy forces like angry bees. “China’s domestically develo ...
- Target Drones Market to Reach USD 7.26 Billion By 2027 Growing at a CAGR of 6.8% | Emergen Researchon January 19, 2021 at 10:00 am
The Global Target Drones Market is estimated to be worth USD 7.26 billion by 2027, according to a recent analysis by Emergen Research. The market is remarkably driven by surging adoption of the target ...
- The best tech of CES 2021 isn't realon January 15, 2021 at 10:13 am
Even though CES 2021 was fully virtual, we still saw tons of new devices, including laptops, drones, TVs, wearables, smart home gadgets, and more. But this was also the year we saw a lot of product ...
- A pilot in Orlando, Florida completes the first commercial remote UAV flighton January 15, 2021 at 8:40 am
In this week’s roundup from the Association for Unmanned Vehicle Systems International, which highlights some of the latest news and headlines in unmanned vehicles and robotics, a pilot in Florida ...
- This Week in Logistics News (January 9 – 15)on January 15, 2021 at 5:36 am
The company announced this week that it is discontinuing its Amazon Pantry service. The service, which was launched in 2014 as Prime Pantry, charged customers a flat fee of $5.99 per box of groceries; ...
- CES 2021 Awards: This Is The Tech To Look Forward To In 2021on January 13, 2021 at 5:39 pm
As the all-digital CES 2021 comes to a close, we got the official best of CES 2021 awards, and it is all the tech you can get this year.
- CES 2021 Highlights: 79 Gadgets and Glimpses Into the Futureon January 13, 2021 at 9:42 am
The consumer tech show is virtual this year, and the WIRED Gear crew is watching all the Zooms to bring you up-to-the-minute highlights of news from CES.
- Ambarella unveils 8K AI vision processor for car, drone, and robot camerason January 11, 2021 at 10:00 am
Ambarella has unveiled the CV5 AI Vision Processor to handle 8K image processing for car, consumer, crone, and robot cameras.
via Bing News