The best thing to give first responders before they enter a smoky room or the site of a chemical spill, or to soldiers before they enter a hostile bunker, is a picture of what’s inside. Exploring an unsecured space in 3D from a safe distance could be a matter of life or death.
A team at the Defense Advanced Research Projects Agency (DARPA) is helping to make that possible by funding efforts to combine powerful 3D imaging software, GPUs and pretty much any camera to generate a VR view of a potentially dangerous environment.
The intention of the system, dubbed Virtual Eye, is to let soldiers, firefighters and search and rescue personnel walk around a room or other enclosed area — virtually — before entering, enabling them to scope out the situation while avoiding potential dangers.
“The question for us is, can we do more with the information we have?” says Trung Tran, the program manager leading Virtual Eye’s development for DARPA’s Microsystems technology office. “Can we extract more information from the cameras we’re using today?”
The answer is a resounding yes. Even more impressive: any camera will suffice. Tran says the system is “camera agnostic.”
How Virtual Eye Works
Emergency responders who have determined that a room is too dangerous to enter without more information would insert drones or robots. These would wield or position two cameras in different parts of the room. The Virtual Eye software then fuses the separate images into a 3D virtual reality view in real time by extrapolating the data needed to fill in any blanks.
So, in a firefighting scenario, this could enable firefighters to look into a room, determine where a child in peril is located — perhaps behind a bed or other piece of furniture — see where flames are active, and plan their approach.
On the battlefield, soldiers could use Virtual Eye to detect if they might be ambushed, if an explosive is in a room or if a boobytrap awaits them.
“Understanding what we see is critical to making the right decisions in the battlefield,” says Tran. “We can create a 3D image by looking at the differences between two images, understanding the differences and fusing them together.”
A Real-Time 3D Video Experience
The Virtual Eye system under development relies on NIVIDIA mobile Quadro and GeForce GTX GPUs to stitch the images together, and to extrapolate 3D data from the images captured by the cameras. Tran says the NVIDIA GPUs were chosen because they’re small enough to fit into a laptop.
The Latest on: 3D virtual reality
[google_news title=”” keyword=”3D virtual reality” num_posts=”10″ blurb_length=”0″ show_thumb=”left”]
via Google News
The Latest on: 3D virtual reality
- Kirin Sinha Shares How Generative AI Has Fueled Augmented Realityon February 28, 2024 at 4:56 pm
Kirin Sinha, of Illumix, shares the advancements in artificial intelligence that have allowed augmented reality to become much more accessible to everyday consumers.
- Meta Quest 3: 8 Best Mixed Reality Games, Rankedon February 28, 2024 at 1:31 pm
The Meta Quest 3 has introduced Mixed Reality capabilities with its latest headset, with these games taking full advantage of this innovative tech.
- Avenged Sevenfold enter virtual reality with a concert on Apple Vision Pro and Meta Queston February 28, 2024 at 3:56 am
American heavy metal band Avenged Sevenfold are holding an immersive virtual reality concert today, 28th February at 5pm PST / 1am GMT.The event is being run by AmazeVR Concerts and is available on ...
- 3D Scanning Market Report 2024-2032, Industry Growth Opportunity, And Forecaston February 28, 2024 at 12:00 am
As these technologies evolve, they expand the market size by enabling new applications and use cases, from reverse engineering to virtual reality. Market analysis indicates that ongoing innovation in ...
- Virtual Reality in Cancer Care: Bridging Gaps in Education and Trainingon February 27, 2024 at 7:24 am
Medical professionals training with the IAEA’s virtual reality tool during a course on High Dose Rate Brachytherapy at Maputo Hospital, Mozambique, 17-21 July 2023. (Photos: P. A. Varela Melendez and ...
- Create stunning 3D scans with photogrammetryon February 25, 2024 at 1:00 pm
Photogrammetry is a process that uses overlapping photos to reconstruct either 3D models or scenes. It relies on the principle of triangulation, where software such as Capturing Reality or Metashape ...
- STMicroelectronics expands into 3D depth sensing with latest time-of-flight sensorson February 22, 2024 at 1:00 am
Building on a leading position in direct Time-of-Flight sensors, with two billion FlightSense™ devices sold, ST reveals new direct and indirect Time-of-Flight sensors for key applications like camera ...
- Medical students at the West Virginia School of Osteopathic Medicine use virtual reality to study anatomyon February 21, 2024 at 6:29 am
Medical students at the West Virginia School of Osteopathic Medicine can now study anatomy through the use of virtual reality. The West Virginia School of Osteopathic Medicine (WVSOM) started using ...
- Virtual Reality Simulator Provides Realistic Training Scenarios, Part 2on February 21, 2024 at 12:17 am
An answer to this void came from the team at Loft Dynamics (formerly VRM Switzerland), which has focused on the development and certification of an Airbus H125 Level 3 Flight Simulation Training ...
- Sora, Groq, and Virtual Realityon February 20, 2024 at 8:52 am
OpenAI’s new video model and a new chip for Groq are important developments in not just AI but also virtual reality.
via Bing News