A new technique developed by neuroscientists at U of T Scarborough can, for the first time, reconstruct images of what people perceive based on their brain activity gathered by EEG.
The technique developed by Dan Nemrodov, a postdoctoral fellow in Assistant Professor Adrian Nestor’s lab at U of T Scarborough, is able to digitally reconstruct images seen by test subjects based on electroencephalography (EEG) data.
“When we see something, our brain creates a mental percept, which is essentially a mental impression of that thing. We were able to capture this percept using EEG to get a direct illustration of what’s happening in the brain during this process,” says Nemrodov.
For the study, test subjects hooked up to EEG equipment were shown images of faces. Their brain activity was recorded and then used to digitally recreate the image in the subject’s mind using a technique based on machine learning algorithms.
It’s not the first time researchers have been able to reconstruct images based on visual stimuli using neuroimaging techniques. The current method was pioneered by Nestor who successfully reconstructed facial images from functional magnetic resonance imaging (fMRI) data in the past, but this is the first time EEG has been used.
And while techniques like fMRI – which measures brain activity by detecting changes in blood flow – can grab finer details of what’s going on in specific areas of the brain, EEG has greater practical potential given that it’s more common, portable, and inexpensive by comparison. EEG also has greater temporal resolution, meaning it can measure with detail how a percept develops in time right down to milliseconds, explains Nemrodov.
“fMRI captures activity at the time scale of seconds, but EEG captures activity at the millisecond scale. So we can see with very fine detail how the percept of a face develops in our brain using EEG,” he says. In fact, the researchers were able to estimate that it takes our brain about 170 milliseconds (0.17 seconds) to form a good representation of a face we see.
This study provides validation that EEG has potential for this type of image reconstruction notes Nemrodov, something many researchers doubted was possible given its apparent limitations. Using EEG data for image reconstruction has great theoretical and practical potential from a neurotechnological standpoint, especially since it’s relatively inexpensive and portable.
In terms of next steps, work is currently underway in Nestor’s lab to test how image reconstruction based on EEG data could be done using memory and applied to a wider range of objects beyond faces. But it could eventually have wide-ranging clinical applications as well.
“It could provide a means of communication for people who are unable to verbally communicate. Not only could it produce a neural-based reconstruction of what a person is perceiving, but also of what they remember and imagine, of what they want to express,” says Nestor.
“It could also have forensic uses for law enforcement in gathering eyewitness information on potential suspects rather than relying on verbal descriptions provided to a sketch artist.”
The research, which is published in the journal eNeuro, was funded by the Natural Sciences and Engineering Research Council of Canada (NSERC) and by a Connaught New Researcher Award.
“What’s really exciting is that we’re not reconstructing squares and triangles but actual images of a person’s face, and that involves a lot of fine-grained visual detail,” adds Nestor.
“The fact we can reconstruct what someone experiences visually based on their brain activity opens up a lot of possibilities. It unveils the subjective content of our mind and it provides a way to access, explore and share the content of our perception, memory and imagination.”
Learn more: Do you see what I see? Researchers harness brain waves to reconstruct images of what we perceive
The Latest on: Neuroimaging
[google_news title=”” keyword=”Neuroimaging” num_posts=”10″ blurb_length=”0″ show_thumb=”left”]
via Google News
The Latest on: Neuroimaging
- New Study Links Balanced Diet to Improved Brain Health, Cognition, and Intelligenceon April 26, 2024 at 3:05 am
A new study highlights the profound link between dietary choices and brain health. Published in Nature, the study revealed that a healthy, balanced diet is associated with enhanced brain health, ...
- Florida Man's Mystery Migraine Traced to Rare Case of Parasite in His Brainon April 25, 2024 at 11:33 pm
A 52-year-old Florida man presented to hospital with complaints that his usual migraines had worsened over the past four months. On closer inspection using a CT scan, the doctors discovered his severe ...
- APS Editorial Fellows to Help Build a Pipeline of Diverse Editorson April 25, 2024 at 12:18 pm
Meet the six psychological scientists representing different cultures and nationalities who have been named inaugural APS Editorial Fellows.
- High BMI associated with changes in physiological brain pulsationson April 25, 2024 at 11:18 am
A recent study from the University of Oulu reveals that high body mass index (BMI) is associated with changes in physiological brain pulsations.
- Tiziana Life Sciences Reports Positive 3-Month Neuroimaging Scores in Multiple Sclerosis Patients Receiving Intranasal Foralumabon April 25, 2024 at 9:00 am
*EA5 showed a worsening in their White Matter Z-Score at three months during a pseudo-exacerbation of the patient’s trigeminal neuralgia.
- Brock Kirwan appointed as inaugural executive director of MindCORE Neuroimaging Facilityon April 24, 2024 at 7:40 pm
Kirwan was previously a professor in the Department of Psychology and Neuroscience and the director of the MRI Research Facility at Brigham Young University.
- Cortechs.ai Announces Major FDA 510(k)-Pending Update to NeuroQuant Software, Expanding Capabilities in Neuroimagingon April 24, 2024 at 5:00 am
Cortechs.ai, a pioneer in AI-driven healthcare solutions, proudly announces a major update for its flagship product, NeuroQuant® v5.0, which is currently FDA 510(k) pending. This cutting-edge ...
- From politics to the lab: The push for psychedelics in Mass.on April 23, 2024 at 12:33 pm
New research, a potential state ballot measure and pending decisions from the FDA are putting psychedelics are on a path that could lead them to become an integral part of mental health care in ...
- Neuroscientists Reveal Link Between Your Brain and What You Eaton April 22, 2024 at 12:00 pm
Research reveals a connection between BMI and the brain states necessary to achieve a goal, such as eating healthy foods.
- ‘ScanFest’ sessions teach students the ins and outs of using an MRI machine for researchon April 18, 2024 at 9:36 am
As part of a class taught by Brown neuroscientist David Badre, undergraduates embrace the rare opportunity to conduct experiments and engage in research with state-of-the-art MRI technology.
via Bing News