Inspired by Star Trek, biologists are enabling new experiments in virtual reality
How do people orient themselves when they are in a new area? How do we use street signs or houses, for instance, to estimate the distance we have traveled? Put simply: how do we update our mental map? Neuroscientists have been studying such questions in animals to learn about the basic principles of spatial cognition. “Until now, we have envied an invention from the world of science fiction: a holodeck like they have in Star Trek,” says Prof. Dr. Andrew Straw. The holodeck is a space which can simulate any desired virtual world. “Something like the holodeck from Star Trek would enable key experiments in which we could artificially decouple an animal’s movement from its perception,” says the Freiburg professor of biology. Together with his colleague Prof. Dr. Kristin Tessmar-Raible from the Max F. Perutz Laboratories, a joint venture of the University of Vienna and Medical University of Vienna, Austria, and an international team, Straw has constructed a kind of holodeck and with it created new opportunities for researching spatial cognition. The animals perceived the simulated objects as real and changed their behavior in different visual environments. The research team describes its results in the Nature Methods journal.
Animals and humans use every available sensation to update their mental map. However, every movement is inextricably linked to sensation. So the researchers had to decouple the two processes in order to understand how the brain processes different information. The group built a flexible system for mice, flies and fish – three species commonly used in neurobiology and behavior research. “We created an immersive, 3-D virtual reality in which the animals could move freely,” explains Straw, “because we wanted our visual scenery to tie in naturally with the animal’s own action-perception cycle.” The visual landscapes included for example vertical pillars, multiple plants, and a swarm of video game space invaders. Multiple high-speed cameras tracked and recorded the precise 3-D position of the animal. A computer program registered each movement of the animal within milliseconds allowing an updated video to be constantly projected on the walls.
The researchers created experiments using visual stimuli to change and control flies’ direction of flight, to test if mice are afraid of virtual heights, or to make fish move virtually between two different worlds and change their behavior depending on the visual environment. In another experiment they simulated a swarm of space invaders for a real fish to swim in. The computer-controlled swarm was programmed to react to the fish as one of their own and the fish’s own behavior was clearly influenced by the swarm. In addition, the team was able to solve a fundamental problem in collective behavior research: historically, it has been impossible to directly manipulate interaction between multiple individuals. Together with the group of Prof. Dr. Iain Couzin of the University of Konstanz and the Max Planck Institute for Ornithology, the researchers developed a photo-realistic model of a swimming fish that could be computer controlled, and showed that real fish most reliably follow the virtual fish when the virtual fish matches its swim direction to the real fish.
Learn more: A holodeck for flies, fish and mice
The Latest on: Virtual reality
[google_news title=”” keyword=”virtual reality” num_posts=”10″ blurb_length=”0″ show_thumb=”left”]- Virtual reality could make seeing your favorite band less expensive, if these artists have their wayon April 27, 2024 at 6:06 am
Heavy-metal band Avenged Sevenfold and rapper T-Pain are among a growing number of artists who are using virtual reality to connect with their fans at a ...
- The Rise of Virtual Reality Slots: What Gamers Can Expect in the Next Decadeon April 27, 2024 at 4:50 am
Future VR slots will leverage more intuitive and user-friendly interfaces. Integrating hand tracking and gesture recognition technology will allow players to interact with the virtual slot machine ...
- Alien: Rogue Incursion - A New Virtual Reality Horror Adventure Announcedon April 26, 2024 at 11:15 am
Marking the celebration of Alien Day, publisher 20th Century Games, in collaboration with developer Survios, has unveiled their latest project, Alien: Rogue Incursion. This new entry in the storied ...
- 4 Tips for Navigating Virtual Reality Safelyon April 26, 2024 at 6:47 am
Virtual reality (VR) has taken major leaps forward in recent years. With the release of the Apple Vision Pro in early 2024, people are starting to realize how truly powerful this technology is and how ...
- Virtual reality headsets ease treatments for young patients at Advocate Children’s Hospitalson April 26, 2024 at 3:05 am
At Advocate Children’s Hospitals in Oak Lawn and Park Ridge, virtual reality systems are helping young patients deal with the discomfort of invasive treatments such as chemotherapy.
- Virtual Reality Training for Soccer Playerson April 25, 2024 at 1:44 pm
VR technologies have emerged as a transformative force in most sectors, including soccer. Virtual reality has changed player development, training techniques, and how fans engage with the game. Its ...
- ‘Be the Witness’ virtual reality project features five Oct. 7th survivorson April 25, 2024 at 8:24 am
It all started after I joined the fight on October 7 against Hamas terrorists invading the Israeli communities bordering the Gaza Strip,” says Nimrod Palmach, CEO of Israel-is, which ...
- MSNBC Will Use Virtual-Reality Supreme Court Bench During Trump Insurrection Argumentson April 25, 2024 at 6:10 am
The average person won’t be able to see the nation’s Supreme Court justices contemplating arguments Thursday over whether Donald Trump’s efforts to undo his loss in the 2020 election to President Joe ...
- Virtual reality can motivate people to donate to refugee crises regardless of politicson April 24, 2024 at 12:20 pm
Political conservatives who watched a documentary on Syrian refugees with a virtual reality headset had far more sympathy for the people depicted in the film than those who viewed the same film on a ...
- Mark Zuckerberg says Meta will offer its virtual reality OS to hardware companies, creating iPhone versus Android dynamicon April 22, 2024 at 11:16 am
The move will create new hardware devices that run the same operating system and software as Quest 3 and Quest Pro.
via Google News and Bing News