An interactive swarm of flying 3D pixels (voxels) developed at Queen’s University’s Human Media Lab is set to revolutionize the way people interact with virtual reality. The system, called BitDrones, allows users to explore virtual 3D information by interacting with physical self-levitating building blocks.
Queen’s professor Roel Vertegaal and his students are unveiling the BitDrones system on Monday, Nov. 9 at the ACM Symposium on User Interface Software and Technology in Charlotte, North Carolina. BitDrones is the first step towards creating interactive self-levitating programmable matter – materials capable of changing their 3D shape in a programmable fashion – using swarms of nano quadcopters. The work highlights many possible applications for the new technology, including real-reality 3D modeling, gaming, molecular modeling, medical imaging, robotics and online information visualization.
“BitDrones brings flying programmable matter, such as featured in the futuristic Disney movie Big Hero 6, closer to reality,” says Dr. Vertegaal. “It is a first step towards allowing people to interact with virtual 3D objects as real physical objects.”
Dr. Vertegaal and his team at the Human Media Lab created three types of BitDrones, each representing self-levitating displays of distinct resolutions. “PixelDrones” are equipped with one LED and a small dot matrix display. “ShapeDrones” are augmented with a light-weight mesh and a 3D printed geometric frame, and serve as building blocks for complex 3D models. “DisplayDrones” are fitted with a curved flexible high resolution touchscreen, a forward-facing video camera and Android smartphone board. All three BitDrone types are equipped with reflective markers, allowing them to be individually tracked and positioned in real time via motion capture technology. The system also tracks the user’s hand motion and touch, allowing users to manipulate the voxels in space.
“We call this a Real Reality interface rather than a Virtual Reality interface. This is what distinguishes it from technologies such as Microsoft HoloLens and the Oculus Rift: you can actually touch these pixels, and see them without a headset,” says Dr. Vertegaal.
Dr. Vertegaal and his team describe a number of possible applications for this technology. In one scenario, users could physically explore a file folder by touching the folder’s associated PixelDrone. When the folder opens, its contents are shown by other PixelDrones flying in a horizontal wheel below it. Files in this wheel are browsed by physically swiping drones to the left or right.
Users would also be able to manipulate ShapeDrones to serve as building blocks for a real-time 3D model. Finally, the BitDrone system will allow for remote telepresence by allowing users to appear locally through a DisplayDrone with Skype. The DisplayDrone would be capable of automatically tracking and replicating all of the remote user’s head movements, allowing a remote user to virtually inspect a location and making it easier for the local user to understand the remote user’s actions.
While their system currently only supports dozens of comparatively large 2.5” – 5” sized drones, the team at the Human Media Lab are working to scale up their system to support thousands of drones. These future drones would measure no more than a half inch in size, allowing users to render more seamless, high resolution programmable matter.
The Latest on: Virtual Reality
via Google News
The Latest on: Virtual Reality
- Axon holds virtual reality, TASER training event at Northern Colorado Law Enforcement Training Centeron October 13, 2021 at 5:43 pm
The roadshow, which stopped at the Northern Colorado Law Enforcement Training Center Wednesday, brought along their Voyager 1 mobile unit – a large trailer split into three internal rooms that ...
- Harvard MedTech to Present New Approach to Patient Care Leveraging Virtual Reality at National Workers Compensation and Disability Conferenceon October 13, 2021 at 10:00 am
Harvard MedTech, a breakthrough digital health company, will host a panel presentation highlighting virtual reality technology and the biopsychosocial approach to patient care at the National Workers’ ...
- Virtual reality offers an unprecedented look at the universe (and you can take a peek)on October 13, 2021 at 9:45 am
Researchers have released open-source beta software that allows people to make virtual visits through the cosmos. Imagine it as a sort of Google Earth for the entire universe.
- New study improves the mental health of cancer patients through virtual realityon October 13, 2021 at 8:10 am
As featured on BBC News, over 75 percent of cancer patients involved in a study at Katharine House Hospice in Stafford say their mental health has been given a boost thanks to a virtual reality ...
- Virtual reality paint simulator enhances classroom experienceon October 13, 2021 at 8:07 am
Aircraft painters in the Warner Robins Air Logistics Complex can now hone their trade virtually.Painters with the 588th Aircraft Maintenance Support Squadron Corrosion Control shop at Robins Air Force ...
- 'Empathy machine' or false hope? How virtual reality is being used to try to stop domestic violenceon October 13, 2021 at 7:56 am
The French government has just announced a trial using virtual reality to try to prevent domestic violence. There has been considerable excitement about this, with claims the virtual reality ...
- SenseGlove Nova brings a sense of touch to virtual reality trainingon October 13, 2021 at 7:31 am
Donning VR headsets for training can bring some realism to a simulated training environment, but it would be better if you could feel objects you interact with in the virtual realm. That's precisely ...
- How virtual reality can be used to treat anxiety and PTSDon October 13, 2021 at 3:40 am
Patients can confront the situations that cause them fear and anxiety, but in a safe and controlled environment.
- Corby theatre group hopes virtual reality festival attracts new audienceon October 12, 2021 at 8:09 am
Organisers of a virtual reality festival hope it will be an "exciting" way of bringing theatre to a new audience. The festival, organised by charity theatre group The Core, is taking place on ...
- One man’s endless hunt for a dopamine rush in virtual realityon October 11, 2021 at 6:00 am
Virtual reality technology may be another step closer to a mass market, with Facebook heralding the arrival of a digital world referred to as “the metaverse.” But is virtual reality truly ready for ...
via Bing News