Three people with paralysis participating in the BrainGate clinical trial, an effort that includes Brown University researchers, chatted with family and friends, shopped online and used other tablet computer applications, all by just thinking about pointing and clicking a mouse.
Tablets and other mobile computing devices are part of everyday life, but using them can be difficult for people with paralysis. New research from the BrainGate* consortium shows that a brain-computer interface (BCI) can enable people with paralysis to directly operate an off-the-shelf tablet device just by thinking about making cursor movements and clicks.
In a study published November 21 in PLOS ONE, three clinical trial participants with tetraplegia, each of whom was using the investigational BrainGate BCI that records neural activity directly from a small sensor placed in the motor cortex, were able to navigate through commonly used tablet programs, including email, chat, music-streaming and video-sharing apps. The participants messaged with family, friends, members of the research team and their fellow participants. They surfed the web, checked the weather and shopped online. One participant, a musician, played a snippet of Beethoven’s “Ode to Joy” on a digital piano interface.
“For years, the BrainGate collaboration has been working to develop the neuroscience and neuroengineering know-how to enable people who have lost motor abilities to control external devices just by thinking about the movement of their own arm or hand,” said Dr. Jaimie Henderson, a senior author of the paper and a Stanford University neurosurgeon. “In this study, we’ve harnessed that know-how to restore people’s ability to control the exact same everyday technologies they were using before the onset of their illnesses. It was wonderful to see the participants express themselves or just find a song they want to hear.”
The investigational BrainGate BCI includes a baby aspirin-sized implant that detects the signals associated with intended movements produced in the brain’s motor cortex. Those signals are then decoded and routed to external devices. BrainGate researchers and other groups using similar technologies have shown that the device can enable people to move robotic arms or to regain control of their own limbs, despite having lost motor abilities from illness or injury. This study from the collaboration includes scientists, engineers and physicians from Brown University’s Carney Institute for Brain Science, the Providence Veterans Affairs Medical Center (PVAMC), Massachusetts General Hospital (MGH) and Stanford University.
Two of the participants in this latest study had weakness or loss of movement of their arms and legs due to amyotrophic lateral sclerosis (ALS), a progressive disease affecting the nerves in the brain and spine that control movement. The third participant was paralyzed due to a spinal cord injury. All were enrolled in a clinical trial aimed at assessing the safety and feasibility of the investigational BrainGate system.
For this study, neural signals from the BrainGate BCI were routed to a Bluetooth interface configured to work like a wireless mouse. The virtual mouse was then paired to an unmodified Google Nexus 9 tablet. The participants were then asked to perform a set of tasks designed to see how well they were able to navigate within a variety of commonly used apps, and move from app to app. The participants browsed through music selections on a streaming service, searched for videos on YouTube, scrolled through a news aggregator and composed emails and chats.
The study showed that participants were able to make up to 22 point-and-click selections per minute while using a variety of apps. In text apps, the participants were able to type up to 30 effective characters per minute using standard email and text interfaces.
The participants reported finding the interface intuitive and fun to use, the study noted. One said, “It felt more natural than the times I remember using a mouse.” Another reported having “more control over this than what I normally use.”
The researchers were pleased to see how quickly the participants used the tablet interface to explore their hobbies and interests.
“It was great to see our participants make their way through the tasks we asked them to perform, but the most gratifying and fun part of the study was when they just did what they wanted to do — using the apps that they liked for shopping, watching videos or just chatting with friends,” said lead author Dr. Paul Nuyujukian, a bioengineer at Stanford. “One of the participants told us at the beginning of the trial that one of the things she really wanted to do was play music again. So to see her play on a digital keyboard was fantastic.”
The fact that the tablet devices were entirely unaltered and had all preloaded accessibility software turned off was an important part of the study, the researchers said.
“The assistive technologies that are available today, while they’re important and useful, are all inherently limited in terms of either the speed of use they enable, or the flexibility of the interface,” said Krishna Shenoy, a senior author of the paper and an electrical engineer and neuroscientist at Stanford University and Howard Hughes Medical Institute. “That’s largely because of the limited input signals that are available. With the richness of the input from the BCI, we were able to just buy two tablets on Amazon, turn on Bluetooth and the participants could use them with our investigational BrainGate system right out of the box.”
The researchers say that the study also has the potential to open important new lines of communication between patients with severe neurological deficits and their health care providers.
“This has great potential for restoring reliable, rapid and rich communication for somebody with locked-in syndrome who is unable to speak,” said Jose Albites Sanabria, who performed this research as a graduate student in biomedical engineering at Brown University. “That not only could provide increased interaction with their family and friends, but can provide a conduit for more thoroughly describing ongoing health issues with caregivers.”
As a neuroscientist and practicing critical care neurologist, senior author Dr. Leigh Hochberg of Brown University, Massachusetts General Hospital and the Providence VA Medical Center sees tremendous potential for the restorative capabilities of BCIs exemplified in this study.
“When I see somebody in the neuro-intensive care unit who has had an acute stroke and has lost the ability to move or communicate, I’d like to be able to say, ‘I’m very sorry this has happened, but we can restore your ability to use the technologies you were using before this happened, and you’ll be able to use them again tomorrow,’” Hochberg said. “And we are getting closer to being able to tell someone who has been diagnosed with ALS, ‘even while we continue to seek out a cure, you will never lose the ability to communicate.’ This work is a step toward those goals.”
Learn more: Brain-computer interface enables people with paralysis to control tablet devices
The Latest on: BrainGate
[google_news title=”” keyword=”BrainGate” num_posts=”10″ blurb_length=”0″ show_thumb=”left”]
via Google News
The Latest on: BrainGate
- There Are Two Sides to the Brain Implant Storyon March 27, 2024 at 3:26 am
In January, Neuralink, Elon Musk’s brain-computer interface company, implanted a device in a quadriplegic man in the region of his brain that controls the intention to move. Now, according to videos ...
- Neuralink Patient Shows Off His Sick Mind-Controlled Mario Kart Racing Skillson March 25, 2024 at 10:50 am
Neuralink, Elon Musk’s brain-computer interface company, kicked off 2024 by announcing its first successful human trial. There was some skepticism about the surgery, so last week that human came ...
- Elon Musk’s Neuralink patient plays chess: ‘It was like using the Force’on March 21, 2024 at 4:01 pm
The brain implant company released a video of Noland Arbaugh, who lost the use of his arms and legs in a diving accident, moving a cursor using just his mind ...
- The brain chip pioneers who paved the way for Elon Musk's Neuralink: Brave patients have been getting devices implanted in their skulls SINCE 2006on March 21, 2024 at 1:43 pm
Doctors surgically implanted the BrainGate device, a tiny array of 100 electrodes, onto his brain's primary motor cortex. This is the part of the brain involved in movement. The electrode was ...
- Elon Musk’s Neuralink shows quadriplegic patient playing online chess with his mindon March 21, 2024 at 12:04 am
Noland Arbaugh, who injured his spinal cord in a diving accident, said in a live-stream update that the brain implant also allows him to play video games.
- Man With Elon Musk's Neuralink Brain Chip Uses Mind Control To Play Chesson March 20, 2024 at 6:36 pm
Elon Musk's Neuralink Corp. livestreamed an update with its first brain implant patient Wednesday, showing a quadriplegic man who was able to play video games and online chess using his mind.
- Brain Implants: What Can We Expect?on March 15, 2024 at 9:48 am
Neuralink’s recent announcement of the successful implantation of the company’s new chip in a human brain seems to move the dial. The device should one day permit people to operate a computer using ...
- Brain Implants: What Can We Expect?on March 14, 2024 at 5:00 pm
The BrainGate Neural Interface System, also approved by FDA as an investigational device, has its origins at Brown University. It uses a brain-implantable sensor to detect neural signals that are ...
- Thought Control of a Robotic Arm Using the BrainGate System (IMAGE)on June 12, 2022 at 3:08 am
In a clinical trial, a woman used the BrainGate system to mentally control a robotic arm and reach for a drink.
via Bing News