A team of researchers at UC San Diego and San Diego State University has developed a pair of “4-D goggles” that allows wearers to be physically “touched” by a movie when they see a looming object on the screen, such as an approaching spacecraft.
The device was developed based on a study conducted by the neuroscientists to map brain areas that integrate the sight and touch of a looming object and aid in their understanding of the perceptual and neural mechanisms of multisensory integration.
But for the rest of us, the researchers said, it has a more practical purpose: The device can be synchronized with entertainment content, such as movies, music, games and virtual reality, to deliver immersive multisensory effects near the face and enhance the sense of presence.
The advance is described in a paper published online February 6 in the journal Human Brain Mapping by Ruey-Song Huang and Ching-fu Chen, neuroscientists at UC San Diego’s Institute for Neural Computation, and Martin Sereno, the former chair of neuroimaging at University College London and a former professor at UC San Diego, now at San Diego State University.
“We perceive and interact with the world around us through multiple senses in daily life,” said Huang, the first author of the paper. “Though an approaching object may generate visual, auditory, and tactile signals in an observer, these must be picked apart from the rest of world, originally colorfully described by William James as a ‘blooming buzzing confusion.’ To detect and avoid impending threats, it is essential to integrate and analyze multisensory looming signals across space and time and to determine whether they originate from the same sources.”
In the researchers’ experiments, subjects assessed the subjective synchrony between a looming ball (simulated in virtual reality) and an air puff delivered to the same side of the face. When the onset of ball movement and the onset of an air puff were nearly simultaneous (with a delay of 100 milliseconds), the air puff was perceived as completely out of sync with the looming ball. With a delay between 800 to 1,000 milliseconds, the two stimuli were perceived as one (in sync), as if an object had passed near the face generating a little wind.
In experiments using functional Magnetic Resonance Imaging, or fMRI, the scientists delivered tactile-only, visual-only, tactile-visual out-of-sync, and tactile-visual in-sync stimuli to either side of the subject’s face in randomized events. More than a dozen of brain areas were found to respond more strongly to lateralized multisensory stimuli than to lateralized unisensory stimuli, the scientists reported in their paper, and the response was further enhanced when the multisensory stimuli are in perceptual sync.
The Latest on: Multisensory effects
via Google News
The Latest on: Multisensory effects
- Are you drinking too much? The signs to look out foron December 3, 2021 at 3:44 am
Are you drinking too much? We all have our own idea of what alcoholism looks like but don’t be deceived. Recovering alcoholic Ben Robinson says: "We have a stereotypical view of an alcoholic as ...
- Neurobiology of agingon December 1, 2021 at 4:00 pm
Gray matter volume in the right angular gyrus is associated with differential patterns of multisensory integration ... for the cognitive enhancing effects of Centella asiatica during aging.
- Frequency and Pitchon November 20, 2021 at 4:49 am
What is common to all sound is a pattern of change over time called an oscillation ... Take a bottle of any size with a narrow neck that contains something you can drink (this is an multi-sensory ...
- Diamond Packaging Wins Three Awards in 2021 Paperboard Packaging Competitionon November 18, 2021 at 3:00 am
The subtle overall multi-level embossed linear pattern adds unusual dimension ... An exquisite, glitter pearl flexo coating delivers a multisensory product experience through unusual visual depth and ...
- Effect of tai chi exercise on proprioception of ankle and knee joints in old peopleon November 8, 2021 at 5:24 am
An ankle inflatable cuff was applied and inflated to 20 mm Hg to reduce multisensory afferent discharge at the ... few have examined the effects of exercise on proprioception of old people, especially ...
- Nerve Cells and Animal Behaviouron May 28, 2021 at 6:17 pm
Comer, Christopher and Baba, Yoshichika 2011. Active touch in orthopteroid insects: behaviours, multisensory substrates and evolution . Philosophical Transactions of ...
- Dr Helen Coulthardon May 13, 2020 at 12:31 pm
A developmental psychologist who is primarily interested in the development of eating behaviour and psychopathology. Particular areas of interest include fruit and vegetable consumption, and food ...
- Graduate Student Accomplishments (2019-2020)on April 5, 2018 at 5:00 am
Effects of Minimal Grouping On Implicit Prejudice ... Feeling the Beat (and Seeing It, Too): Vibrotactile, Visual, and Bimodal Rate Discrimination. Multisensory Research, 33(1), 31-59. Villalonga M.B.
- Dr. Evangelos Paraskevopouloson February 20, 2016 at 6:58 am
This project aims at investigating short- and long-term effects of musical training on neuronal processing ... responses to oddball paradigms related with uni- and multisensory processing of music.
via Bing News