Carnegie Mellon University scientists can now use brain activation patterns to identify complex thoughts, such as, “The witness shouted during the trial.”
This latest research led by CMU’s Marcel Just builds on the pioneering use of machine learning algorithms with brain imaging technology to “mind read.” The findings indicate that the mind’s building blocks for constructing complex thoughts are formed by the brain’s various sub-systems and are not word-based. Published in Human Brain Mapping and funded by the Intelligence Advanced Research Projects Activity (IARPA), the study offers new evidence that the neural dimensions of concept representation are universal across people and languages.
“One of the big advances of the human brain was the ability to combine individual concepts into complex thoughts, to think not just of ‘bananas,’ but ‘I like to eat bananas in evening with my friends,'” said Just, the D.O. Hebb University Professor of Psychology in the Dietrich College of Humanities and Social Sciences. “We have finally developed a way to see thoughts of that complexity in the fMRI signal. The discovery of this correspondence between thoughts and brain activation patterns tells us what the thoughts are built of.”
Previous work by Just and his team showed that thoughts of familiar objects, like bananas or hammers, evoke activation patterns that involve the neural systems that we use to deal with those objects. For example, how you interact with a banana involves how you hold it, how you bite it and what it looks like.
The new study demonstrates that the brain’s coding of 240 complex events, sentences like the shouting during the trial scenario uses an alphabet of 42 meaning components, or neurally plausible semantic features, consisting of features, like person, setting, size, social interaction and physical action. Each type of information is processed in a different brain system—which is how the brain also processes the information for objects. By measuring the activation in each brain system, the program can tell what types of thoughts are being contemplated.
For seven adult participants, the researchers used a computational model to assess how the brain activation patterns for 239 sentences corresponded to the neurally plausible semantic features that characterized each sentence. Then the program was able to decode the features of the 240th left-out sentence. They went through leaving out each of the 240 sentences in turn, in what is called cross-validation.
The model was able to predict the features of the left-out sentence, with 87 percent accuracy, despite never being exposed to its activation before. It was also able to work in the other direction, to predict the activation pattern of a previously unseen sentence, knowing only its semantic features.
“Our method overcomes the unfortunate property of fMRI to smear together the signals emanating from brain events that occur close together in time, like the reading of two successive words in a sentence,” Just said. “This advance makes it possible for the first time to decode thoughts containing several concepts. That’s what most human thoughts are composed of.”
He added, “A next step might be to decode the general type of topic a person is thinking about, such as geology or skateboarding. We are on the way to making a map of all the types of knowledge in the brain.”
The Latest on: Mind reading technology
- Coinbase calls for new regulator and framework for the crypto sectoron October 14, 2021 at 1:45 pm
Coinbase is calling for vast changes in how the crypto sector is regulated. On Thursday the company released a digital asset proposal in which its Chief Policy Officer Faryar Shirzad called for ...
- How Investors Can Grab Better Returns for Computer and Technology Using the Zacks ESP Screeneron October 14, 2021 at 5:50 am
Two factors often determine stock prices in the long run: earnings and interest rates. Investors can't control the latter, but they can focus on a company's earnings results every quarter. We know ...
- Burj Khalifa’s Peace of Mind: ANPR Access Control System by Adaptive Recognitionon October 14, 2021 at 1:53 am
In a city of almost 16 million yearly visitors, security is of utmost importance. One pillar of Dubai’s peace of mind is the way safety & security of local residents/visitors is ensured.
- Perceptive Automata Announces the Hire of Jen Gilburg as Vice President of Business Developmenton October 13, 2021 at 6:30 am
Perceptive Automata, the leading provider of software that allows machines to understand the state of mind of people, is pleased ...
- The Man Who Finally Made a ‘Dune’ That Fans Will Loveon October 13, 2021 at 2:00 am
He understood the pressures of the pandemic, but he had made “Dune” as a love letter to the big screen. The decision to stream the film seemed to Villeneuve symptomatic of threats to the cinematic ...
- Are these women on another planet? Never mind the quips about Mars and Venus, some wives genuinely believe they are 'starseeds' - spirits from the depths of space. We boldly go ...on October 11, 2021 at 2:04 pm
SAMANTHA BRICK spoke to four women who are convinced they are starseeds - aliens in human form. So are they heaven-sent or space cadets? And what do their husbands think?
- Technology and Society: Privacy and Security Revisitedon October 9, 2021 at 2:00 am
I wrote the following back in 2010 (In my very first column, “Privacy is not explicitly mentioned as a citizen’s right in the Constitution but most of us would consider our personal privacy an ...
- I set my mind on first class from day one, worked hard, achieved it – Ogundare, CU architecture graduateon October 8, 2021 at 4:54 pm
Faith Ogundare, who studied Architecture at Covenant University and graduated with first class honours, speaks to TOLUWALOPE KAREEM about her academic feat Would you say it was easy having a first ...
- Cultivate good reading culture, Okowa tells Nigerianson October 8, 2021 at 10:31 am
DELTA State Governor, Dr Ifeanyi Okowa has urged Nigerians to cultivate good reading culture to encourage writers in the country as well ...
- Same-day biopsy offers women greater peace of mind in breast cancer treatmenton October 7, 2021 at 8:03 pm
Recent advancements in screening and treatment are making it possible for people to be treated for breast cancer more easily and successfully. One Utah woman is grateful she didn't delay care.
via Google News and Bing News