A team of researchers at UC San Diego and San Diego State University has developed a pair of “4-D goggles” that allows wearers to be physically “touched” by a movie when they see a looming object on the screen, such as an approaching spacecraft.
The device was developed based on a study conducted by the neuroscientists to map brain areas that integrate the sight and touch of a looming object and aid in their understanding of the perceptual and neural mechanisms of multisensory integration.
But for the rest of us, the researchers said, it has a more practical purpose: The device can be synchronized with entertainment content, such as movies, music, games and virtual reality, to deliver immersive multisensory effects near the face and enhance the sense of presence.
The advance is described in a paper published online February 6 in the journal Human Brain Mapping by Ruey-Song Huang and Ching-fu Chen, neuroscientists at UC San Diego’s Institute for Neural Computation, and Martin Sereno, the former chair of neuroimaging at University College London and a former professor at UC San Diego, now at San Diego State University.
“We perceive and interact with the world around us through multiple senses in daily life,” said Huang, the first author of the paper. “Though an approaching object may generate visual, auditory, and tactile signals in an observer, these must be picked apart from the rest of world, originally colorfully described by William James as a ‘blooming buzzing confusion.’ To detect and avoid impending threats, it is essential to integrate and analyze multisensory looming signals across space and time and to determine whether they originate from the same sources.”
In the researchers’ experiments, subjects assessed the subjective synchrony between a looming ball (simulated in virtual reality) and an air puff delivered to the same side of the face. When the onset of ball movement and the onset of an air puff were nearly simultaneous (with a delay of 100 milliseconds), the air puff was perceived as completely out of sync with the looming ball. With a delay between 800 to 1,000 milliseconds, the two stimuli were perceived as one (in sync), as if an object had passed near the face generating a little wind.
In experiments using functional Magnetic Resonance Imaging, or fMRI, the scientists delivered tactile-only, visual-only, tactile-visual out-of-sync, and tactile-visual in-sync stimuli to either side of the subject’s face in randomized events. More than a dozen of brain areas were found to respond more strongly to lateralized multisensory stimuli than to lateralized unisensory stimuli, the scientists reported in their paper, and the response was further enhanced when the multisensory stimuli are in perceptual sync.
The Latest on: Multisensory effects
[google_news title=”” keyword=”multisensory effects” num_posts=”10″ blurb_length=”0″ show_thumb=”left”]
via Google News
The Latest on: Multisensory effects
- The effects of climate changeon February 7, 2023 at 7:03 am
The effects won't just be felt by the habitats and species such ... Warmer air can hold a higher water content, which makes rainfall patterns more extreme. Rivers and lakes supply drinking water for ...
- We may be headed toward an El Niño year — here’s what to know about the strange, world-changing weather patternon February 1, 2023 at 11:00 am
El Niño is a weather pattern that occurs in a region of the eastern Pacific Ocean near the equator. It usually happens once every two to seven years, according to National Geographic. The name El Niño ...
- Biological patterns: Directed by intracellular flowson January 31, 2023 at 2:19 pm
"The membrane-bound patterns can propagate against the flow because the bulk flow shifts the protein concentrations in the cytoplasm but has no direct effects on proteins that are already bound to ...
- What are the effects of global warming?on January 27, 2023 at 10:09 am
weather patterns are changing. An immediate consequence of global warming is extreme weather. These extremes come in a lot of different flavors. Paradoxically, one effect of climate change can be ...
- What is an ascending triangle pattern and how to trade it?on January 27, 2023 at 1:34 am
Market analysts rely on many technical indicators to anticipate future trends, one of which is the very-popular ascending triangle chart pattern. As the name indicates, an ascending triangle on a ...
- Side Effects of Viibryd: What You Need to Knowon January 23, 2023 at 4:01 pm
And these digestive side effects could lead to weight loss. Note that depression often affects appetite and eating patterns, and this can lead to weight changes. As your depression eases from ...
- Increases in sensory noise predict attentional disruptions to audiovisual speech perceptionon January 21, 2023 at 4:00 pm
Multisensory integration has been shown to be dependent on attention; however, the neural mechanisms underlying this effect are poorly understood. The current study investigates whether changes in ...
- Stress patternon January 17, 2023 at 11:58 pm
See an explanation of the term ‘Stress pattern’. The stress pattern of a word is the way all the syllables are stressed in it. There can be main and secondary stress, or unstressed sounds. There are ...
- 15 Crochet Patterns for Beginnerson January 17, 2023 at 11:25 pm
But with so many patterns out there, it can feel overwhelming to choose what to make first. To help, we’ve compiled a list of easy crochet patterns for beginners. These crochet stitch patterns ...
via Bing News