A team of researchers at UC San Diego and San Diego State University has developed a pair of “4-D goggles” that allows wearers to be physically “touched” by a movie when they see a looming object on the screen, such as an approaching spacecraft.
The device was developed based on a study conducted by the neuroscientists to map brain areas that integrate the sight and touch of a looming object and aid in their understanding of the perceptual and neural mechanisms of multisensory integration.
But for the rest of us, the researchers said, it has a more practical purpose: The device can be synchronized with entertainment content, such as movies, music, games and virtual reality, to deliver immersive multisensory effects near the face and enhance the sense of presence.
The advance is described in a paper published online February 6 in the journal Human Brain Mapping by Ruey-Song Huang and Ching-fu Chen, neuroscientists at UC San Diego’s Institute for Neural Computation, and Martin Sereno, the former chair of neuroimaging at University College London and a former professor at UC San Diego, now at San Diego State University.
“We perceive and interact with the world around us through multiple senses in daily life,” said Huang, the first author of the paper. “Though an approaching object may generate visual, auditory, and tactile signals in an observer, these must be picked apart from the rest of world, originally colorfully described by William James as a ‘blooming buzzing confusion.’ To detect and avoid impending threats, it is essential to integrate and analyze multisensory looming signals across space and time and to determine whether they originate from the same sources.”
In the researchers’ experiments, subjects assessed the subjective synchrony between a looming ball (simulated in virtual reality) and an air puff delivered to the same side of the face. When the onset of ball movement and the onset of an air puff were nearly simultaneous (with a delay of 100 milliseconds), the air puff was perceived as completely out of sync with the looming ball. With a delay between 800 to 1,000 milliseconds, the two stimuli were perceived as one (in sync), as if an object had passed near the face generating a little wind.
In experiments using functional Magnetic Resonance Imaging, or fMRI, the scientists delivered tactile-only, visual-only, tactile-visual out-of-sync, and tactile-visual in-sync stimuli to either side of the subject’s face in randomized events. More than a dozen of brain areas were found to respond more strongly to lateralized multisensory stimuli than to lateralized unisensory stimuli, the scientists reported in their paper, and the response was further enhanced when the multisensory stimuli are in perceptual sync.
Learn more: New ‘4-D Goggles’ Allow Wearers to be ‘Touched’ by Approaching Objects
The Latest on: Multisensory effects
[google_news title=”” keyword=”multisensory effects” num_posts=”10″ blurb_length=”0″ show_thumb=”left”]
via Google News
The Latest on: Multisensory effects
- Reimagining Memory: New Research Reveals That Superconducting Loops Mimic the Brainon April 19, 2024 at 6:10 am
Superconducting loops could allow computers to retain and retrieve information more efficiently. Computers work in digits — 0s and 1s to be exact. Their calculations are digital; their processes are ...
- Total solar eclipse 2024on April 8, 2024 at 2:27 pm
A total solar eclipse, which was experienced Monday by millions of skygazers in parts of Mexico, the United States and Canada, has concluded its path over North America.
- Everything you need to know about the total solar eclipse on April 8 & how Aditya-L1 observes the sunon April 7, 2024 at 8:47 pm
Solar eclipses will ultimately stop happening. In the meantime, they are of endless interest to scientists, historian, cultural and religious leaders, and people from all walks. Stands to reason that ...
- America gets ready for the total solar eclipseon April 7, 2024 at 6:12 pm
NASA’s Eclipse Soundscapes Project will collect observations from the public on animal behaviors as well as human reactions to the eclipse through written multisensory reports ... each other to create ...
- The April 8 solar eclipse will bring weird sights, sounds and feelingson April 6, 2024 at 3:00 am
The darkening of the sky on April 8 will bring with it a plethora of strange phenomena. On Monday (April 8), the sky over a swathe of North America will briefly darken as the moon covers the sun ...
- Bedroom color affects sleep time and quality, research showson April 5, 2024 at 12:21 pm
The effects of color on the human brain have widely ... specifically blue light displays, on sleep patterns. They are described as throwing “the body’s biological clock – the circadian ...
- Astronauts surprisingly good at judging distances without gravityon March 30, 2024 at 9:30 am
This process was repeated across multiple trials and distances, without providing any feedback on performance to ensure that learning effects did ... flow refers to the pattern of apparent motion ...
- 25 Best Meditation Tools for a Powerful Practiceon March 19, 2024 at 8:48 am
Raking the sand into patterns or arranging the rocks can be ... With the right soundtrack, meditation becomes a multi-sensory experience that engages the mind, body, and spirit.
- Cup and Handle Pattern: How to Trade and Target with an Exampleon May 27, 2015 at 10:46 am
A cup and handle price pattern on a security's price chart is a technical indicator that resembles a cup with a handle, where the cup is in the shape of a "u" and the handle has a slight downward ...
via Bing News