A team of researchers at UC San Diego and San Diego State University has developed a pair of “4-D goggles” that allows wearers to be physically “touched” by a movie when they see a looming object on the screen, such as an approaching spacecraft.
The device was developed based on a study conducted by the neuroscientists to map brain areas that integrate the sight and touch of a looming object and aid in their understanding of the perceptual and neural mechanisms of multisensory integration.
But for the rest of us, the researchers said, it has a more practical purpose: The device can be synchronized with entertainment content, such as movies, music, games and virtual reality, to deliver immersive multisensory effects near the face and enhance the sense of presence.
The advance is described in a paper published online February 6 in the journal Human Brain Mapping by Ruey-Song Huang and Ching-fu Chen, neuroscientists at UC San Diego’s Institute for Neural Computation, and Martin Sereno, the former chair of neuroimaging at University College London and a former professor at UC San Diego, now at San Diego State University.
“We perceive and interact with the world around us through multiple senses in daily life,” said Huang, the first author of the paper. “Though an approaching object may generate visual, auditory, and tactile signals in an observer, these must be picked apart from the rest of world, originally colorfully described by William James as a ‘blooming buzzing confusion.’ To detect and avoid impending threats, it is essential to integrate and analyze multisensory looming signals across space and time and to determine whether they originate from the same sources.”
In the researchers’ experiments, subjects assessed the subjective synchrony between a looming ball (simulated in virtual reality) and an air puff delivered to the same side of the face. When the onset of ball movement and the onset of an air puff were nearly simultaneous (with a delay of 100 milliseconds), the air puff was perceived as completely out of sync with the looming ball. With a delay between 800 to 1,000 milliseconds, the two stimuli were perceived as one (in sync), as if an object had passed near the face generating a little wind.
In experiments using functional Magnetic Resonance Imaging, or fMRI, the scientists delivered tactile-only, visual-only, tactile-visual out-of-sync, and tactile-visual in-sync stimuli to either side of the subject’s face in randomized events. More than a dozen of brain areas were found to respond more strongly to lateralized multisensory stimuli than to lateralized unisensory stimuli, the scientists reported in their paper, and the response was further enhanced when the multisensory stimuli are in perceptual sync.
The Latest on: Multisensory effects
[google_news title=”” keyword=”multisensory effects” num_posts=”10″ blurb_length=”0″ show_thumb=”left”]
via Google News
The Latest on: Multisensory effects
- A 360-degree art experienceon February 23, 2024 at 6:52 pm
KOCHI: Imagine stepping into a painting and letting yourself be surrounded by its vibrant colours while blissfully drowning in its emotion. This may bear resemblance to a million childhood fantasies, ...
- A multi-sensory experience at Fivesparks and on the trailon February 22, 2024 at 9:35 pm
Created by an Ayer married couple, visual artist Lisa Nelson and engineer-musician Christopher Johnson, the current exhibit at Fivesparks lured me in with its bright, warm colors and shapes, a variety ...
- Apple Vision Pro Apps to Check Outon February 22, 2024 at 8:51 am
The Vision Pro is available today with a whole new App Store, and developers large and small have created apps optimized for the spatial computing device. Optimized apps are those that take ...
- Largest multicountry COVID study links vaccines to potential adverse effectson February 20, 2024 at 8:54 am
A new study on COVID-19 vaccines that looked at nearly 100 million vaccinated individuals affirmed the vaccines’ previously observed links to increased risks for certain adverse effects ...
- How global warming is disrupting life on Earthon February 16, 2024 at 3:19 am
This warming reduces critical ice habitat and it disrupts the flow of the jet stream, creating more unpredictable weather patterns around the globe. (Learn more about the jet stream.) A warmer ...
- Understanding the dynamics of texting in relationshipson February 10, 2024 at 11:18 am
An ongoing investigation delves into the nuanced dimensions of text-based communication within relationships, elucidating its effects, patterns, and potential ramifications. In contemporary ...
- Male pattern baldness: What you need to knowon February 5, 2024 at 4:01 pm
In some, finasteride causes side effects, such as: There is some evidence that certain medicated shampoos can reduce male pattern hair loss. However, it is worth noting that one of the researchers ...
- Drug Addiction: Understanding the Patterns, Effects, and Treatment Optionson January 30, 2024 at 4:00 pm
Drug addiction, or substance use disorder, is a mental health condition that can have lifelong impacts. Though it's a treatable illness, substance use disorder recovery often involves a lifelong ...
- CBD For Sleep: How It Works, Benefits And Riskson January 26, 2024 at 1:41 am
The hypothalamus plays a role in several sleep-related functions, including regulating body temperature and synchronizing sleep patterns ... the intoxicating effects of THC, CBD—ingested ...
via Bing News