Recent research shows Brain-to-text device capable of decoding speech from brain signals
Ever wonder what it would be like if a device could decode your thoughts into actual speech or written words? While this might enhance the capabilities of already existing speech interfaces with devices, it could be a potential game-changer for those with speech pathologies, and even more so for “locked-in” patients who lack any speech or motor function.
“So instead of saying ‘Siri, what is the weather like today’ or ‘Ok Google, where can I go for lunch?’ I just imagine saying these things,” explains Christian Herff, author of a review recently published in the journal Frontiers in Human Neuroscience.
While reading one’s thoughts might still belong to the realms of science fiction, scientists are already decoding speech from signals generated in our brains when we speak or listen to speech.
In their review, Herff and co-author, Dr. Tanja Schultz, compare the pros and cons of using various brain imaging techniques to capture neural signals from the brain and then decode them to text.
The technologies include functional MRI and near infrared imaging that can detect neural signals based on metabolic activity of neurons, to methods such as EEG and magnetoencephalography (MEG) that can detect electromagnetic activity of neurons responding to speech. One method in particular, called electrocorticography or ECoG, showed promise in Herff’s study.
This study presents the Brain-to-text system in which epilepsy patients who already had electrode grids implanted for treatment of their condition participated. They read out texts presented on a screen in front of them while their brain activity was recorded. This formed the basis of a database of patterns of neural signals that could now be matched to speech elements or “phones”.
When the researchers also included language and dictionary models in their algorithms, they were able to decode neural signals to text with a high degree of accuracy. “For the first time, we could show that brain activity can be decoded specifically enough to use ASR technology on brain signals,” says Herff. “However, the current need for implanted electrodes renders it far from usable in day-to-day life.”
So, where does the field go from here to a functioning thought detection device? “A first milestone would be to actually decode imagined phrases from brain activity, but a lot of technical issues need to be solved for that,” concedes Herff.
Learn more: Can a Brain-Computer Interface Convert Your Thoughts to Text?
The Latest on: Brain-to-text system
[google_news title=”” keyword=”Brain-to-text system” num_posts=”10″ blurb_length=”0″ show_thumb=”left”]
via Google News
The Latest on: Brain-to-text system
- How RFK Jr. Could Open a Can of Brain Worms at the Debateson May 16, 2024 at 9:29 pm
But if Kennedy can actually make the debates, it could open a can of brain worms for President Joe Biden and former ... That leaves Kennedy in the same bind he would have otherwise faced had the old ...
- Brain Injury Newson May 15, 2024 at 5:00 pm
Older Brain Cells Linger Unexpectedly Before Their Death Mar. 28, 2024 — Researchers report that mature oligodendrocytes -- the central nervous system cells ... AI processed text from health ...
- Scientists are working on a machine which can read your brain and translate thoughts into text in real timeon May 15, 2024 at 12:59 am
Caltech's researchers have developed a machine that can translate thoughts into text in real time. This device has the potential to revolutionise communication for individuals with speech impairments, ...
- A brain tumor took away this 21-year-old’s voice. She’s gained a version of it back thanks to A.I.on May 14, 2024 at 6:26 am
Doctors in August removed a life-threatening tumor lodged near the back of her brain. When the breathing tube came out ... to find a suitable recording of her voice to “train” the AI system on how she ...
- Elon Musk’s Neuralink Had a Brain Implant Setback. It May Come Down to Designon May 9, 2024 at 1:10 pm
Neuralink experienced a mechanical issue with its first human brain-computer interface implant. Its novel design may make it more prone to failure.
- Does Drinking Alcohol Kill Brain Cells? Expert Doctors Explainon May 2, 2024 at 12:33 pm
You may already know the serious impact alcohol can have on your liver, but now experts are breaking down what alcohol does to your brain.
- How sleep affects human health, explainedon May 2, 2024 at 8:04 am
Among many other things, sleep plays a crucial role in memory consolidation and other brain functions, supporting the immune system and healing after injury ... has long been considered a foundational ...
- Brain imaging study reveals connections critical to human consciousnesson April 30, 2024 at 5:00 pm
The study involved high-resolution scans that enabled the researchers to visualize brain connections at submillimeter spatial resolution. Together, these pathways form a “default ascending arousal ...
- When technology can read your brain waves, who owns your thoughts?on April 18, 2024 at 10:34 am
Critics warn companies may already possess the ability to “decode” consumers’ data presented in brain scans and translate that into written text. That decoded data can reveal highly ...
via Bing News