A new technique developed by neuroscientists at U of T Scarborough can, for the first time, reconstruct images of what people perceive based on their brain activity gathered by EEG.
The technique developed by Dan Nemrodov, a postdoctoral fellow in Assistant Professor Adrian Nestor’s lab at U of T Scarborough, is able to digitally reconstruct images seen by test subjects based on electroencephalography (EEG) data.
“When we see something, our brain creates a mental percept, which is essentially a mental impression of that thing. We were able to capture this percept using EEG to get a direct illustration of what’s happening in the brain during this process,” says Nemrodov.
For the study, test subjects hooked up to EEG equipment were shown images of faces. Their brain activity was recorded and then used to digitally recreate the image in the subject’s mind using a technique based on machine learning algorithms.
It’s not the first time researchers have been able to reconstruct images based on visual stimuli using neuroimaging techniques. The current method was pioneered by Nestor who successfully reconstructed facial images from functional magnetic resonance imaging (fMRI) data in the past, but this is the first time EEG has been used.
And while techniques like fMRI – which measures brain activity by detecting changes in blood flow – can grab finer details of what’s going on in specific areas of the brain, EEG has greater practical potential given that it’s more common, portable, and inexpensive by comparison. EEG also has greater temporal resolution, meaning it can measure with detail how a percept develops in time right down to milliseconds, explains Nemrodov.
“fMRI captures activity at the time scale of seconds, but EEG captures activity at the millisecond scale. So we can see with very fine detail how the percept of a face develops in our brain using EEG,” he says. In fact, the researchers were able to estimate that it takes our brain about 170 milliseconds (0.17 seconds) to form a good representation of a face we see.
This study provides validation that EEG has potential for this type of image reconstruction notes Nemrodov, something many researchers doubted was possible given its apparent limitations. Using EEG data for image reconstruction has great theoretical and practical potential from a neurotechnological standpoint, especially since it’s relatively inexpensive and portable.
In terms of next steps, work is currently underway in Nestor’s lab to test how image reconstruction based on EEG data could be done using memory and applied to a wider range of objects beyond faces. But it could eventually have wide-ranging clinical applications as well.
“It could provide a means of communication for people who are unable to verbally communicate. Not only could it produce a neural-based reconstruction of what a person is perceiving, but also of what they remember and imagine, of what they want to express,” says Nestor.
“It could also have forensic uses for law enforcement in gathering eyewitness information on potential suspects rather than relying on verbal descriptions provided to a sketch artist.”
The research, which is published in the journal eNeuro, was funded by the Natural Sciences and Engineering Research Council of Canada (NSERC) and by a Connaught New Researcher Award.
“What’s really exciting is that we’re not reconstructing squares and triangles but actual images of a person’s face, and that involves a lot of fine-grained visual detail,” adds Nestor.
“The fact we can reconstruct what someone experiences visually based on their brain activity opens up a lot of possibilities. It unveils the subjective content of our mind and it provides a way to access, explore and share the content of our perception, memory and imagination.”
The Latest on: Neuroimaging
[google_news title=”” keyword=”Neuroimaging” num_posts=”10″ blurb_length=”0″ show_thumb=”left”]
via Google News
The Latest on: Neuroimaging
- Global Brain Imaging and Neuroimaging Market is poised for significant expansion, projecting to hit a remarkable US$ 22.41 Billion by 2033on February 26, 2024 at 6:45 pm
The global brain imaging and neuroimaging market size is anticipated to thrive at an average CAGR of 5.1% between 2023 and 2033. The market is expected to have a market share of US$ 22.41 billion by ...
- Grief Is a Learning Experienceon February 26, 2024 at 4:00 pm
What happens in your brain as it strives to cope? Pioneering psychologist Mary-Frances O’Connor worked on one of the first neuroimaging studies of grief more than two decades ago. She and her ...
- Neuroimaging of Ischemic Stroke With CT and MRI: Advancing Towards Physiology-Based Diagnosis and Therapyon February 26, 2024 at 4:00 pm
There is substantial variability in the cerebral circulation in individual patients; this is readily appreciated with modern angiographic neuroimaging.  Expert Rev Cardiovasc Ther. 2009;7(1 ...
- Making associations: Yale-developed tool helps personalize psychiatric careon February 23, 2024 at 1:39 pm
A new generative modeling framework can help neuropsychiatrists better predict the relationship between multiple neural readings and patient symptoms.
- Translating brain activity data into audiovisual experienceson February 21, 2024 at 7:00 pm
Complex neuroimaging data can be explored through translation into an audiovisual format – a video with accompanying musical soundtrack – to help interpret what happens in the brain when performing ...
- Watch: Scientists create fascinating “brain movies” using neuroimaging dataon February 21, 2024 at 2:16 pm
Researchers at Columbia University developed a method to translate brain imaging data into audiovisual formats, or "brain movies," making it easier to understand brain activity during behaviors. This ...
- Using neuroimaging, researchers confirm cumulative, brain-wide effects of ADHDon January 30, 2024 at 4:00 pm
With this dataset, researchers used neuroimaging data to construct a polyneuro risk score, or PNRS, a method that calculates the likelihood of a health outcome based on a patient's brain activity ...
- Use of Neuroimaging in Acute Stroke Trialson January 7, 2024 at 4:00 pm
New neuroimaging techniques for pretreatment thrombolysis should have the same sensitivity as a CT scan for ruling out ICH, but should add information about the ischemic penumbra and the vascular ...
- Neuroimaging – News and Featureson November 2, 2023 at 7:58 pm
Spatial navigation and spatial memory play a central role in our lives. Without these abilities, we would hardly be able to find our way around our surroundings and would find it difficult to remember ...
- Neuroimaging Coreon October 18, 2023 at 1:36 pm
A neuroimaging partnership with Renown Health has been in place since 2014. The newer scanner (Siemens Skyra) is currently being equipped to improve capabilities and access for University researchers.
via Bing News