A team of researchers from Carnegie Mellon University, in collaboration with the University of Minnesota, has made a breakthrough in the field of noninvasive robotic device control. Using a noninvasive brain-computer interface (BCI), researchers have developed the first-ever successful mind-controlled robotic arm exhibiting the ability to continuously track and follow a computer cursor.
Being able to noninvasively control robotic devices using only thoughts will have broad applications, in particular benefiting the lives of paralyzed patients and those with movement disorders.
BCIs have been shown to achieve good performance for controlling robotic devices using only the signals sensed from brain implants. When robotic devices can be controlled with high precision, they can be used to complete a variety of daily tasks. Until now, however, BCIs successful in continuously controlling robotic arms have used invasive brain implants. These implants require a substantial amount of medical and surgical expertise to correctly install and operate, not to mention cost and potential risks to subjects. As such, their use has been limited to just a few clinical cases.
A grand challenge in BCI research is to develop less invasive or even totally noninvasive technology that would allow paralyzed patients to control their environment or robotic limbs using their own “thoughts.” Such noninvasive BCI technology, if successful, would bring such much-needed technology to numerous patients and even potentially to the general population.
However, BCIs that use noninvasive external sensing, rather than brain implants, receive “dirtier” signals, leading to lower resolution and less precise control. Thus, when using only the brain to control a robotic arm, a noninvasive BCI doesn’t stand up to using implanted devices. Despite this, BCI researchers have forged ahead, their eye on the prize of a less- or non-invasive technology that could help patients everywhere on a daily basis.
“There have been major advances in mind controlled robotic devices using brain implants. It’s excellent science,” says He. “But noninvasive is the ultimate goal. Advances in neural decoding and the practical utility of noninvasive robotic arm control will have major implications on the eventual development of noninvasive neurorobotics.”
Using novel sensing and machine learning techniques, He and his lab have been able to access signals deep within the brain, achieving a high resolution of control over a robotic arm. With noninvasive neuroimaging and a novel continuous pursuit paradigm, He is overcoming the noisy EEG signals leading to significantly improve EEG-based neural decoding, and facilitating real-time continuous 2D robotic device control.
Using a noninvasive BCI to control a robotic arm that’s tracking a cursor on a computer screen, for the first time ever, He has shown in human subjects that a robotic arm can now follow the cursor continuously. Whereas robotic arms controlled by humans noninvasively had previously followed a moving cursor in jerky, discrete motions—as though the robotic arm was trying to “catch up” to the brain’s commands—now, the arm follows the cursor in a smooth, continuous path.
In a paper published in Science Robotics, the team established a new framework that addresses and improves upon the “brain” and “computer” components of BCI by increasing user engagement and training, as well as spatial resolution of noninvasive neural data through EEG source imaging.
The paper, “Noninvasive neuroimaging enhances continuous neural tracking for robotic device control,” shows that the team’s unique approach to solving this problem not only enhanced BCI learning by nearly 60% for traditional center-out tasks, it also enhanced continuous tracking of a computer cursor by more than 500%.
This work represents an important step in noninvasive brain-computer interfaces, a technology which someday may become a pervasive assistive technology aiding everyone, like smartphones.
Bin He, Department Head, Biomedical Engineering
The technology also has applications that could help a variety of people, by offering safe, noninvasive “mind control” of devices that can allow people to interact with and control their environments. The technology has, to date, been tested in 68 able-bodied human subjects (up to 10 sessions for each subject), including virtual device control and controlling of a robotic arm for continuous pursuit. The technology is directly applicable to patients, and the team plans to conduct clinical trials in the near future.
“Despite technical challenges using noninvasive signals, we are fully committed to bringing this safe and economic technology to people who can benefit from it,” says He. “This work represents an important step in noninvasive brain-computer interfaces, a technology which someday may become a pervasive assistive technology aiding everyone, like smartphones.”
The Latest on: Mind-controlled robotic arm
via Google News
The Latest on: Mind-controlled robotic arm
- Remote-Controlled Surgical Robot to Board International Space Stationon August 2, 2022 at 1:18 pm
No matter how mentally and physically prepared they are, future astronauts bound for deep space can't escape their mortal restrictions. At some point during their long and isolated journeys, these ...
- Some California farmers are using robots to harvest fruiton July 29, 2022 at 9:15 pm
In a strawberry field surrounded by strawberry fields on the outskirts of Santa Maria, a pair of robots have been picking berries all summer.
- How to help assembly-line robots shift gears and pick up almost anythingon July 29, 2022 at 8:44 am
In addition, the gripper's shape is linked to the path the robot arm takes to pick up the object. If designed incorrectly, a gripper could crash into the object en route to picking it up.
- AI Ethics And That Viral Story Of The Chess Playing Robot That Broke The Finger Of A Seven-Year-Old During A Heated...on July 27, 2022 at 5:00 am
AI Ethics issues arise in a recent viral news story about a young boy playing tournament chess that got his finger broken by a chess playing robotic arm.
- Leveraging Robots to Find Lost Items in Crowded Places in Smart Citieson July 26, 2022 at 12:28 pm
Rapid urbanization and hectic schedules have led to an increase in misplaced items in cities. RFusion and mind-controlled robotics in smart cities are designed to rapidly shift clutter to find such ...
- California’s strawberry fields may not be forever. Could robots help?on July 26, 2022 at 4:59 am
Each robot, made by a Colorado company called Tortuga AgTech, trundles between the elevated beds on rugged wheels, then stops in front of a plant. An articulated arm maneuvers its sensor array ...
- What could be better than a robot vac? The LG All-In-One Toweron July 20, 2022 at 8:14 pm
The CordZero A9 differs from the numerous other WiFi-enabled, auto-emptying vacuum cleaners we’ve reviewed here in the labs in one important respect: it’s not controlled by a robot “brain”.
- Science fiction to reality: Chinese robots controlled by the mindon July 10, 2022 at 6:06 am
It might sound like a science fiction story, but the ability to control a robot with the mind is increasingly gaining ... be possible to control a robotic arm with the human brain.
- WiiBot – Armed And Pointyon July 7, 2022 at 5:00 pm
[Brian] sent in his Wiimote hacking project – he and his cohort used it to control an industrial sized robot arm. Then they armed it. Keep in mind that the sword is full size. [Aaron] ended up ...
- Brain-Reading Prosthetics That Are Total Game Changerson July 6, 2022 at 7:50 am
Choi went to work building a mind-controlled robotic arm of his own, (via Smithsonian Magazine). He used his sister's at-home 3D printer, building the arm one piece at a time and stringing it ...
via Bing News