The experimenters control the fly’s position (red circles) and its flight direction by providing strong visual motion stimuli. Left: live camera footage, right: plot of flight positions. Photo: https://strawlab.org/freemovr
Inspired by Star Trek, biologists are enabling new experiments in virtual reality
How do people orient themselves when they are in a new area? How do we use street signs or houses, for instance, to estimate the distance we have traveled? Put simply: how do we update our mental map? Neuroscientists have been studying such questions in animals to learn about the basic principles of spatial cognition. “Until now, we have envied an invention from the world of science fiction: a holodeck like they have in Star Trek,” says Prof. Dr. Andrew Straw. The holodeck is a space which can simulate any desired virtual world. “Something like the holodeck from Star Trek would enable key experiments in which we could artificially decouple an animal’s movement from its perception,” says the Freiburg professor of biology. Together with his colleague Prof. Dr. Kristin Tessmar-Raible from the Max F. Perutz Laboratories, a joint venture of the University of Vienna and Medical University of Vienna, Austria, and an international team, Straw has constructed a kind of holodeck and with it created new opportunities for researching spatial cognition. The animals perceived the simulated objects as real and changed their behavior in different visual environments. The research team describes its results in the Nature Methods journal.
Animals and humans use every available sensation to update their mental map. However, every movement is inextricably linked to sensation. So the researchers had to decouple the two processes in order to understand how the brain processes different information. The group built a flexible system for mice, flies and fish – three species commonly used in neurobiology and behavior research. “We created an immersive, 3-D virtual reality in which the animals could move freely,” explains Straw, “because we wanted our visual scenery to tie in naturally with the animal’s own action-perception cycle.” The visual landscapes included for example vertical pillars, multiple plants, and a swarm of video game space invaders. Multiple high-speed cameras tracked and recorded the precise 3-D position of the animal. A computer program registered each movement of the animal within milliseconds allowing an updated video to be constantly projected on the walls.
The researchers created experiments using visual stimuli to change and control flies’ direction of flight, to test if mice are afraid of virtual heights, or to make fish move virtually between two different worlds and change their behavior depending on the visual environment. In another experiment they simulated a swarm of space invaders for a real fish to swim in. The computer-controlled swarm was programmed to react to the fish as one of their own and the fish’s own behavior was clearly influenced by the swarm. In addition, the team was able to solve a fundamental problem in collective behavior research: historically, it has been impossible to directly manipulate interaction between multiple individuals. Together with the group of Prof. Dr. Iain Couzin of the University of Konstanz and the Max Planck Institute for Ornithology, the researchers developed a photo-realistic model of a swimming fish that could be computer controlled, and showed that real fish most reliably follow the virtual fish when the virtual fish matches its swim direction to the real fish.
Learn more: A holodeck for flies, fish and mice
The Latest on: Virtual reality
- Molestation in the metaverse: MHA studying sexual assaults that occur in virtual realityon August 1, 2022 at 8:36 pm
The issue of crime in the metaverse is worrying enough for the authorities here to be studying it. Read more at straitstimes.com.
- Conjoined twins separated in successful operation via virtual realityon August 1, 2022 at 6:49 pm
The surgery was described by one surgeon as "space-age stuff" as surgeons in separate countries wore headsets and operated in a "virtual reality room." ...
- Conjoined twins separated with help of virtual reality in Brazilon August 1, 2022 at 1:31 pm
Conjoined twins born in Brazil with a fused head and brain have been separated in what doctors described Monday as the most complex surgery of its kind, which they prepared for using virtual reality.
- 3-Year-Old Conjoined Twins with Fused Brains Separated in Historic Virtual Reality Surgeryon August 1, 2022 at 8:50 am
Pediatric surgeon Noor ul Owase Jeelani from London's Great Ormond Street Hospital directed the surgery on the twins at the Instituto Estadual do Cerebro Paulo Niemeyer in Rio de Janeiro, Brazil ...
- Virtual reality headsets can lead to 'cybersickness' but new research in Scotland may have discovered a world-leading solution – Dr Gang Lion August 1, 2022 at 8:45 am
From lawn bowls to playing poker on your phone, humans of all ages are drawn to games for recreation and relaxation. With the rapid development of new gaming platforms, virtual reality (VR) headsets ...
- Virtual reality helps UK doctors separate twins joined at the brain in Brazilon August 1, 2022 at 6:59 am
About 100 medical staff were involved in the procedures and surgeons spent months trying out techniques using virtual reality before beginning the real surgery.
- Virtual reality: The new frontier in reaching prospects and clientson August 1, 2022 at 4:21 am
He urges advisors to try reaching clients and prospects through virtual reality. Virtual reality can be a tool to make insurance attractive to younger generations, Leledakis said. “Virtual reality and ...
- Reaching the 4Cs with 3D and virtual realityon August 1, 2022 at 3:00 am
Holding fast to the prospect that the virtual reality headsets would be the key to pushing past the passive consumption of video and games by providing impactful immersive learning, I patiently ...
- Virtual reality: Hospice uses headsets for pain relief, reducing anxietyon July 30, 2022 at 5:35 am
A new hospice company in the area is preparing to roll out a virtual reality experience for its patients next month. Dan Miller, marketing and business development liaison for Affinity Care of ...
- ‘We Met in Virtual Reality’ Review: An Immersive Look at How Some Folks Escaped the Pandemicon July 30, 2022 at 5:21 am
Virtual reality is as good a place as any to meet people, especially during a pandemic. In documentary helmer Joe Hunting’s nonjudgmental plunge into the fast-evolving metaverse — set entirely in ...
via Google News and Bing News