An interactive swarm of flying 3D pixels (voxels) developed at Queen’s University’s Human Media Lab is set to revolutionize the way people interact with virtual reality. The system, called BitDrones, allows users to explore virtual 3D information by interacting with physical self-levitating building blocks.
Queen’s professor Roel Vertegaal and his students are unveiling the BitDrones system on Monday, Nov. 9 at the ACM Symposium on User Interface Software and Technology in Charlotte, North Carolina. BitDrones is the first step towards creating interactive self-levitating programmable matter – materials capable of changing their 3D shape in a programmable fashion – using swarms of nano quadcopters. The work highlights many possible applications for the new technology, including real-reality 3D modeling, gaming, molecular modeling, medical imaging, robotics and online information visualization.
“BitDrones brings flying programmable matter, such as featured in the futuristic Disney movie Big Hero 6, closer to reality,” says Dr. Vertegaal. “It is a first step towards allowing people to interact with virtual 3D objects as real physical objects.”
Dr. Vertegaal and his team at the Human Media Lab created three types of BitDrones, each representing self-levitating displays of distinct resolutions. “PixelDrones” are equipped with one LED and a small dot matrix display. “ShapeDrones” are augmented with a light-weight mesh and a 3D printed geometric frame, and serve as building blocks for complex 3D models. “DisplayDrones” are fitted with a curved flexible high resolution touchscreen, a forward-facing video camera and Android smartphone board. All three BitDrone types are equipped with reflective markers, allowing them to be individually tracked and positioned in real time via motion capture technology. The system also tracks the user’s hand motion and touch, allowing users to manipulate the voxels in space.
“We call this a Real Reality interface rather than a Virtual Reality interface. This is what distinguishes it from technologies such as Microsoft HoloLens and the Oculus Rift: you can actually touch these pixels, and see them without a headset,” says Dr. Vertegaal.
Dr. Vertegaal and his team describe a number of possible applications for this technology. In one scenario, users could physically explore a file folder by touching the folder’s associated PixelDrone. When the folder opens, its contents are shown by other PixelDrones flying in a horizontal wheel below it. Files in this wheel are browsed by physically swiping drones to the left or right.
Users would also be able to manipulate ShapeDrones to serve as building blocks for a real-time 3D model. Finally, the BitDrone system will allow for remote telepresence by allowing users to appear locally through a DisplayDrone with Skype. The DisplayDrone would be capable of automatically tracking and replicating all of the remote user’s head movements, allowing a remote user to virtually inspect a location and making it easier for the local user to understand the remote user’s actions.
While their system currently only supports dozens of comparatively large 2.5” – 5” sized drones, the team at the Human Media Lab are working to scale up their system to support thousands of drones. These future drones would measure no more than a half inch in size, allowing users to render more seamless, high resolution programmable matter.
The Latest on: Virtual Reality
[google_news title=”” keyword=”Virtual Reality” num_posts=”10″ blurb_length=”0″ show_thumb=”left”]
via Google News
The Latest on: Virtual Reality
- Virtual reality used as a tool for brain health at assisted living centeron May 9, 2024 at 2:15 pm
SOUTH WINDSOR, CT (WFSB) - Many of us know that virtual reality is commonly used for gaming, but for those at an assisted living center in South Windsor it’s a tool used for brain health. Virtual ...
- Global Launch of the First Vision Pro Sports App Leads the Growth of Virtual Sports Events Indexon May 9, 2024 at 8:12 am
The PitPat team states that PitPat Pro is an effective supplement and in-depth exploration of the sports and health industry, pushing home fitness onto a new innovative track. By integrating virtual ...
- Virtual reality helping Louisville doctors perform safer surgerieson May 8, 2024 at 9:46 am
The ground-breaking technology allows surgeons to use virtual reality to practice on their patients before they're on the operating table.
- TV host opens university's virtual reality centreon May 7, 2024 at 10:40 pm
Writer and broadcaster Sandi Toksvig has opened a university's virtual reality educational experience. The £5.7m Extended Reality Peterborough (XRP) extended reality facility at Anglia Ruskin ...
- Alstom Foundation, Instituto Jô Clemente launch 'Virtual Reality for Inclusion' projecton May 7, 2024 at 10:13 am
The Virtual Reality for Inclusion' project aims to prepare people with disabilities to overcome physical accessibility obstacles and understand basic safety for walking and ...
- Virtual Reality Shows Promise in Treating Depressionon May 6, 2024 at 2:18 pm
Summary: A new study demonstrates the potential of virtual reality (VR) in treating major depressive disorder (MDD). Using extended reality-enhanced behavioral activation (XR-BA), researchers found ...
- Apple and Meta still think virtual reality is the future — even if nobody else doeson May 3, 2024 at 10:58 am
Meta CEO Mark Zuckerberg and Apple chief Tim Cook are still hyped up on virtual reality, even if consumers aren’t all excited about their headsets.
- Virtual reality could revolutionize mental-health treatments, including ketamine therapy, for conditions like depression and anxietyon May 2, 2024 at 7:25 am
Here's how virtual reality is transforming mental-health treatments such as ketamine therapy for conditions like depression, PTSD, and body dysmorphia.
- 3 Virtual Reality Stocks Worth Strapping Into Nowon April 30, 2024 at 11:08 am
InvestorPlace - Stock Market News, Stock Advice & Trading Tips The virtual reality (VR) stocks and trends are lukewarm, even cold, compared ...
- Shhh! 3 Secret Virtual Reality Stocks Flying Below Wall Street’s Radaron April 30, 2024 at 3:35 am
InvestorPlace - Stock Market News, Stock Advice & Trading Tips Thanks to weaker-than-expected forecasts, top virtual reality (VR) stocks ...
via Bing News