Inspired by Star Trek, biologists are enabling new experiments in virtual reality
How do people orient themselves when they are in a new area? How do we use street signs or houses, for instance, to estimate the distance we have traveled? Put simply: how do we update our mental map? Neuroscientists have been studying such questions in animals to learn about the basic principles of spatial cognition. “Until now, we have envied an invention from the world of science fiction: a holodeck like they have in Star Trek,” says Prof. Dr. Andrew Straw. The holodeck is a space which can simulate any desired virtual world. “Something like the holodeck from Star Trek would enable key experiments in which we could artificially decouple an animal’s movement from its perception,” says the Freiburg professor of biology. Together with his colleague Prof. Dr. Kristin Tessmar-Raible from the Max F. Perutz Laboratories, a joint venture of the University of Vienna and Medical University of Vienna, Austria, and an international team, Straw has constructed a kind of holodeck and with it created new opportunities for researching spatial cognition. The animals perceived the simulated objects as real and changed their behavior in different visual environments. The research team describes its results in the Nature Methods journal.
Animals and humans use every available sensation to update their mental map. However, every movement is inextricably linked to sensation. So the researchers had to decouple the two processes in order to understand how the brain processes different information. The group built a flexible system for mice, flies and fish – three species commonly used in neurobiology and behavior research. “We created an immersive, 3-D virtual reality in which the animals could move freely,” explains Straw, “because we wanted our visual scenery to tie in naturally with the animal’s own action-perception cycle.” The visual landscapes included for example vertical pillars, multiple plants, and a swarm of video game space invaders. Multiple high-speed cameras tracked and recorded the precise 3-D position of the animal. A computer program registered each movement of the animal within milliseconds allowing an updated video to be constantly projected on the walls.
The researchers created experiments using visual stimuli to change and control flies’ direction of flight, to test if mice are afraid of virtual heights, or to make fish move virtually between two different worlds and change their behavior depending on the visual environment. In another experiment they simulated a swarm of space invaders for a real fish to swim in. The computer-controlled swarm was programmed to react to the fish as one of their own and the fish’s own behavior was clearly influenced by the swarm. In addition, the team was able to solve a fundamental problem in collective behavior research: historically, it has been impossible to directly manipulate interaction between multiple individuals. Together with the group of Prof. Dr. Iain Couzin of the University of Konstanz and the Max Planck Institute for Ornithology, the researchers developed a photo-realistic model of a swimming fish that could be computer controlled, and showed that real fish most reliably follow the virtual fish when the virtual fish matches its swim direction to the real fish.
Learn more: A holodeck for flies, fish and mice
The Latest on: Virtual reality
[google_news title=”” keyword=”virtual reality” num_posts=”10″ blurb_length=”0″ show_thumb=”left”]- Royal Navy advances warship training with virtual realityon May 10, 2024 at 3:40 am
Royal Navy is now using Virtual Reality (VR) technology to train its sailors for warships. According to the Royal Navy, the Navy’s warfare school at HMS Collingwood in Fareham has installed nine ...
- UNL program using virtual reality to enhance researchon May 9, 2024 at 5:16 pm
It’s a new way to look at our everyday world. Edgeworks offers research through virtual and augmented reality, artificial intelligence, physical immersive installations, and more. “Through engaging ...
- Virtual reality used as a tool for brain health at assisted living centeron May 9, 2024 at 2:15 pm
SOUTH WINDSOR, CT (WFSB) - Many of us know that virtual reality is commonly used for gaming, but for those at an assisted living center in South Windsor it’s a tool used for brain health. Virtual ...
- Thanks to Virtual Reality, I Climbed Mount Everest on My Lunch Breakon May 8, 2024 at 5:00 pm
I’m now eagerly awaiting Nepali officials to mail me my summit certificate. My Everest summit came while watching the new immersive virtual reality documentary The QUEST: Everest VR. The 26-minute ...
- Virtual reality helping Louisville doctors perform safer surgerieson May 8, 2024 at 9:46 am
The ground-breaking technology allows surgeons to use virtual reality to practice on their patients before they're on the operating table.
- TV host opens university's virtual reality centreon May 7, 2024 at 10:40 pm
Writer and broadcaster Sandi Toksvig has opened a university's virtual reality educational experience. The £5.7m Extended Reality Peterborough (XRP) extended reality facility at Anglia Ruskin ...
- Alstom Foundation, Instituto Jô Clemente launch 'Virtual Reality for Inclusion' projecton May 7, 2024 at 10:13 am
The Virtual Reality for Inclusion' project aims to prepare people with disabilities to overcome physical accessibility obstacles and understand basic safety for walking and ...
- Apple and Meta still think virtual reality is the future — even if nobody else doeson May 3, 2024 at 10:58 am
Meta CEO Mark Zuckerberg and Apple chief Tim Cook are still hyped up on virtual reality, even if consumers aren’t all excited about their headsets.
- Virtual reality could revolutionize mental-health treatments, including ketamine therapy, for conditions like depression and anxietyon May 2, 2024 at 7:25 am
Here's how virtual reality is transforming mental-health treatments such as ketamine therapy for conditions like depression, PTSD, and body dysmorphia.
- 3 Virtual Reality Stocks Worth Strapping Into Nowon April 30, 2024 at 11:08 am
InvestorPlace - Stock Market News, Stock Advice & Trading Tips The virtual reality (VR) stocks and trends are lukewarm, even cold, compared ...
via Google News and Bing News