A team of researchers at UC San Diego and San Diego State University has developed a pair of “4-D goggles” that allows wearers to be physically “touched” by a movie when they see a looming object on the screen, such as an approaching spacecraft.
The device was developed based on a study conducted by the neuroscientists to map brain areas that integrate the sight and touch of a looming object and aid in their understanding of the perceptual and neural mechanisms of multisensory integration.
But for the rest of us, the researchers said, it has a more practical purpose: The device can be synchronized with entertainment content, such as movies, music, games and virtual reality, to deliver immersive multisensory effects near the face and enhance the sense of presence.
The advance is described in a paper published online February 6 in the journal Human Brain Mapping by Ruey-Song Huang and Ching-fu Chen, neuroscientists at UC San Diego’s Institute for Neural Computation, and Martin Sereno, the former chair of neuroimaging at University College London and a former professor at UC San Diego, now at San Diego State University.
“We perceive and interact with the world around us through multiple senses in daily life,” said Huang, the first author of the paper. “Though an approaching object may generate visual, auditory, and tactile signals in an observer, these must be picked apart from the rest of world, originally colorfully described by William James as a ‘blooming buzzing confusion.’ To detect and avoid impending threats, it is essential to integrate and analyze multisensory looming signals across space and time and to determine whether they originate from the same sources.”
In the researchers’ experiments, subjects assessed the subjective synchrony between a looming ball (simulated in virtual reality) and an air puff delivered to the same side of the face. When the onset of ball movement and the onset of an air puff were nearly simultaneous (with a delay of 100 milliseconds), the air puff was perceived as completely out of sync with the looming ball. With a delay between 800 to 1,000 milliseconds, the two stimuli were perceived as one (in sync), as if an object had passed near the face generating a little wind.
In experiments using functional Magnetic Resonance Imaging, or fMRI, the scientists delivered tactile-only, visual-only, tactile-visual out-of-sync, and tactile-visual in-sync stimuli to either side of the subject’s face in randomized events. More than a dozen of brain areas were found to respond more strongly to lateralized multisensory stimuli than to lateralized unisensory stimuli, the scientists reported in their paper, and the response was further enhanced when the multisensory stimuli are in perceptual sync.
The Latest on: Multisensory effects
via Google News
The Latest on: Multisensory effects
- Today’s Premium Storieson October 11, 2021 at 9:00 pm
Reducing news to hard lines and side-taking leaves a lot of the story untold. Progress comes from challenging what we hear and considering different views.
- The Staying Power of the "At-Home Economy" and the Exciting Brand Opportunities Withinon October 7, 2021 at 5:00 pm
The at-home economy boom is enjoying the lingering effects of a drawn-out pandemic, and the home remains a valuable space for brands to explore Editor's Note: The unabridged version of this ...
- Is Your Brain Wired for Numbers?on October 1, 2021 at 7:11 am
Our perception of quantity, separate from counting or estimation of magnitude more generally, is foundational to human cognition, according to some neuroscientists.
- "No Time To Die" To Debut In The Visually Immersive 270-Degree Panoramic ScreenXon September 29, 2021 at 6:03 am
In the multi-sensory 4DX format, the film will feature over 20 different motion and environmental effects enhancing the action and drawing audiences closer to the story on-screen. Moviegoers will ...
- Virtual Reality Affects Children Differently Than Adultson September 27, 2021 at 3:11 pm
Summary: Immersive virtual reality could disrupt a child’s default coordination strategy, researchers report. While very little is known on the effects of immersive VR on adults, there is next to no ...
- Best Hardwood Floor Cleaners For a Radiant Homeon September 16, 2021 at 6:03 am
Why It Made The Cut: Awarded the Safer Choice certificate from the Environmental Protection Agency (EPA), this cleaner gets hardwood floors spotless while eliminating the harmful effects of ...
- BOV and Esplora prioritising hidden disabilitieson December 13, 2020 at 10:31 pm
MCST will be transforming a 4.5m by 2.6m enclosure into a multisensory room. The room will contain an array of lighting effects, such as projectors with wheels that emit light patterns throughout ...
- Fine-Tuning the Brainon December 8, 2012 at 2:42 pm
For example, the multisensory skills required of musicians make their ... and these neural changes are retained into adulthood. Looking at brainwave patterns using scalp electrodes, Kraus and her team ...
via Bing News