A team of researchers at UC San Diego and San Diego State University has developed a pair of “4-D goggles” that allows wearers to be physically “touched” by a movie when they see a looming object on the screen, such as an approaching spacecraft.
The device was developed based on a study conducted by the neuroscientists to map brain areas that integrate the sight and touch of a looming object and aid in their understanding of the perceptual and neural mechanisms of multisensory integration.
But for the rest of us, the researchers said, it has a more practical purpose: The device can be synchronized with entertainment content, such as movies, music, games and virtual reality, to deliver immersive multisensory effects near the face and enhance the sense of presence.
The advance is described in a paper published online February 6 in the journal Human Brain Mapping by Ruey-Song Huang and Ching-fu Chen, neuroscientists at UC San Diego’s Institute for Neural Computation, and Martin Sereno, the former chair of neuroimaging at University College London and a former professor at UC San Diego, now at San Diego State University.
“We perceive and interact with the world around us through multiple senses in daily life,” said Huang, the first author of the paper. “Though an approaching object may generate visual, auditory, and tactile signals in an observer, these must be picked apart from the rest of world, originally colorfully described by William James as a ‘blooming buzzing confusion.’ To detect and avoid impending threats, it is essential to integrate and analyze multisensory looming signals across space and time and to determine whether they originate from the same sources.”
In the researchers’ experiments, subjects assessed the subjective synchrony between a looming ball (simulated in virtual reality) and an air puff delivered to the same side of the face. When the onset of ball movement and the onset of an air puff were nearly simultaneous (with a delay of 100 milliseconds), the air puff was perceived as completely out of sync with the looming ball. With a delay between 800 to 1,000 milliseconds, the two stimuli were perceived as one (in sync), as if an object had passed near the face generating a little wind.
In experiments using functional Magnetic Resonance Imaging, or fMRI, the scientists delivered tactile-only, visual-only, tactile-visual out-of-sync, and tactile-visual in-sync stimuli to either side of the subject’s face in randomized events. More than a dozen of brain areas were found to respond more strongly to lateralized multisensory stimuli than to lateralized unisensory stimuli, the scientists reported in their paper, and the response was further enhanced when the multisensory stimuli are in perceptual sync.
Learn more: New ‘4-D Goggles’ Allow Wearers to be ‘Touched’ by Approaching Objects
The Latest on: Multisensory effects
[google_news title=”” keyword=”multisensory effects” num_posts=”10″ blurb_length=”0″ show_thumb=”left”]
via Google News
The Latest on: Multisensory effects
- The 2024 NHL Draft Heads to the Vegas Sphereon May 8, 2024 at 11:05 am
Welcome to 2024, where the Vegas Sphere is still one of the largest talking points in Pro AV. The Pro AV wonder has now hosted U2, helped enhance the first-ever Super Bowl weekend in Las Vegas, and ...
- Met Gala 2024: Why Is The Carpet For Fashion's Biggest Night Green This Year? Explainedon May 6, 2024 at 11:03 pm
Reawakening Fashion, found themselves treading upon an off-white carpet adorned with delicate touches of airbrushed green foliage.
- Exclusive Preview of The Met's ‘Sleeping Beauties: Reawakening Fashion'on May 6, 2024 at 5:15 am
Continue reading While the earliest known version of the makings of the narrative "Sleeping Beauty" traces back to 1330, The Met's multi-sensory and digitally-enhanced show is very much about the ...
- Intermittent Fasting 101 — The Ultimate Beginner’s Guideon May 2, 2024 at 5:00 pm
Read on to learn more about intermittent fasting and how to do it safely. Intermittent fasting (IF) is an eating pattern that cycles between periods of fasting and eating. It’s currently very ...
- Films you can feel: How 4DX went from silly gimmick to the saviour of cinemaon April 26, 2024 at 10:00 am
Netflix can’t recreate a Dune sandstorm, or the smell of Willy Wonka’s chocolate – but 4DX can. Is it worth the price of admission?
- Cutting-Edge Technologies for Multi-Sensory Research at the Frontier Between Disciplineson April 6, 2024 at 1:40 am
The human experience is inherently multi-sensory, and our understanding of the world is shaped by the interplay of our senses. In recent years, there has been a growing interest in the development of ...
- The Best 3D Light Panels for Your Gaming Setup in 2024on March 14, 2024 at 7:10 pm
This nine-piece triangular light panel kit works with Alexa and delivers mesmeric lighting effects that synchronize ... providing you with a multisensory experience. Use the app to create scenes ...
- The effects of climate changeon August 11, 2023 at 3:41 am
The effects won't just be felt by the habitats and species such ... Warmer air can hold a higher water content, which makes rainfall patterns more extreme. Rivers and lakes supply drinking water for ...
- Cup and Handle Pattern: How to Trade and Target with an Exampleon March 10, 2016 at 11:02 am
A cup and handle price pattern on a security's price chart is a technical indicator that resembles a cup with a handle, where the cup is in the shape of a "u" and the handle has a slight downward ...
via Bing News