This latest research led by CMU’s Marcel Just builds on the pioneering use of machine learning algorithms with brain imaging technology to “mind read.” The findings indicate that the mind’s building blocks for constructing complex thoughts are formed by the brain’s various sub-systems and are not word-based. Published in Human Brain Mapping and funded by the Intelligence Advanced Research Projects Activity (IARPA), the study offers new evidence that the neural dimensions of concept representation are universal across people and languages.
“One of the big advances of the human brain was the ability to combine individual concepts into complex thoughts, to think not just of ‘bananas,’ but ‘I like to eat bananas in evening with my friends,'” said Just, the D.O. Hebb University Professor of Psychology in the Dietrich College of Humanities and Social Sciences. “We have finally developed a way to see thoughts of that complexity in the fMRI signal. The discovery of this correspondence between thoughts and brain activation patterns tells us what the thoughts are built of.”
Previous work by Just and his team showed that thoughts of familiar objects, like bananas or hammers, evoke activation patterns that involve the neural systems that we use to deal with those objects. For example, how you interact with a banana involves how you hold it, how you bite it and what it looks like.
The new study demonstrates that the brain’s coding of 240 complex events, sentences like the shouting during the trial scenario uses an alphabet of 42 meaning components, or neurally plausible semantic features, consisting of features, like person, setting, size, social interaction and physical action. Each type of information is processed in a different brain system—which is how the brain also processes the information for objects. By measuring the activation in each brain system, the program can tell what types of thoughts are being contemplated.
For seven adult participants, the researchers used a computational model to assess how the brain activation patterns for 239 sentences corresponded to the neurally plausible semantic features that characterized each sentence. Then the program was able to decode the features of the 240th left-out sentence. They went through leaving out each of the 240 sentences in turn, in what is called cross-validation.
The model was able to predict the features of the left-out sentence, with 87 percent accuracy, despite never being exposed to its activation before. It was also able to work in the other direction, to predict the activation pattern of a previously unseen sentence, knowing only its semantic features.
“Our method overcomes the unfortunate property of fMRI to smear together the signals emanating from brain events that occur close together in time, like the reading of two successive words in a sentence,” Just said. “This advance makes it possible for the first time to decode thoughts containing several concepts. That’s what most human thoughts are composed of.”
He added, “A next step might be to decode the general type of topic a person is thinking about, such as geology or skateboarding. We are on the way to making a map of all the types of knowledge in the brain.”
The Latest on: Mind reading
- Prime Video’s The Rings of Power is boring me out of my mindon September 25, 2022 at 7:23 am
Ahead of Friday's fifth episode of Prime Video's Lord of the Rings "The Rings of Power" prequel, a critique of the series.
- The World's Master Mind Reader - The Reader Reality Twister hits Glendale AZon September 23, 2022 at 8:35 am
Johnathan Smith aka The Reality Twister is going to be preforming mentalism GLENDALE, Ariz. - Sept. 23, 2022 - PRLog -- Don't miss out on some free mentalism, Johnathan Smith aka Reality Twister is ...
- Trevor Noah Roasts Trump for Saying He Can Declassify Documents in His Mind: ‘He Can’t Even Read’ (Video)on September 23, 2022 at 8:17 am
Donald Trump can declassify documents with his brain? How? He can’t even read documents with his brain. How does this happen?” the late night host joked at the top of his monologue. “I really hope ...
- The ethics of mind-readingon September 23, 2022 at 4:23 am
Tapping into someone’s thoughts may soon be technologically possible. Our institutions are ill-equipped to deal with the resulting human rights violations, writes Jared Genser ...
- Brain–machine interfaces - The ethics of mind-readingon September 22, 2022 at 8:51 pm
It was once science fiction but brain-machine interfaces — devices which connect a person’s brain to a computer, machine, or to another device, such as a smartphone — are making rapid technological ...
- Why You Can’t Read Your Partner’s Mindon September 22, 2022 at 3:46 am
Read our article - Why You Can't Read Your Partner's Mind. The School Of Life has a huge collection of interesting articles, read now.
- Mind reading by Champions of Magic’s Alex McAleeron September 21, 2022 at 1:55 pm
Champions of Magic, a show featuring five different UK-based illusionists, is coming to the Murat Theater at Old National Centre in November. One of the performers, Alex McAleer, ...
- Meta is working on ways to read minds using AIon September 6, 2022 at 1:17 am
In a pre-print study, Meta scientists said their AI model was able to decode speech segmengs from three seconds of brain activity. New exploratory research at Meta is looking at ways to understand ...
- ‘Mind-Reading’ Technology Can Turn Brain Activity Into Imageson August 26, 2022 at 3:04 pm
Researchers at Radboud University in the Netherlands have developed technology that can “read minds” by turning a person’s neurological activity into stunningly accurate pictures.
- What Are YOU Looking At? Mind-Reading AI Knowson March 6, 2018 at 4:04 am
Using an artificial intelligence (AI) system alongside fMRI scans, researchers were able to create an apparently mind-reading AI — "or perhaps at this point just mind skimming,” said Umut ...
via Google News and Bing News