A new platform enables high-quality 3-D video communication on mobile devices such as smartphones and tablets using existing standard wireless networks.
“To our knowledge, this system is the first of its kind that can deliver dense and accurate 3-D video content in real time across standard wireless networks to remote mobile devices such as smartphones and tablets,” said Song Zhang, an associate professor in Purdue University’s School of Mechanical Engineering.
The platform, called Holostream, drastically reduces the data size of 3-D video without substantially sacrificing data quality, allowing transmission within the bandwidths provided by existing wireless networks, he said.
It improves the quality and expands the capabilities of popular applications already harnessing real-time 3-D data delivery, such as teleconferencing and “telepresence,” which uses virtual reality and other interactive technologies, allowing people to feel or appear as if they were present in a remote location.
“This technology also could enable emerging applications that may require high-resolution, high-accuracy 3-D video data delivery, such as remote robotic surgery and telemedicine,” said Zhang, director of Purdue’s XYZT Lab.
Findings are detailed in a research paper to be presented during the Electronic Imaging 2018 conference, Jan. 28-Feb. 2 in Burlingame, Calif. The paper was authored by doctoral student Tyler Bell; Jan P. Allebach, Purdue’s Hewlett-Packard Distinguished Professor of Electrical and Computer Engineering; and Zhang. (A YouTube video is available at https://www.youtube.com/watch?v=NhSbWqEcmQg)
Existing 3-D video communication technologies have limited applications, in part because of they require specialized and often expensive hardware, complex system setup, and highly demanding computational resources for operation in real-time, or without delay.Before 3-D video can be transmitted it must be compressed. However, it has been difficult to compress 3-D video for transmission in real time using conventional methods. The new platform solves the problem by first converting 3-D video to 2-D format.
“Standard 2-D image and video compression techniques are quite mature and enable today’s modern 2-D video communications over standard wireless networks,” Zhang said. “If 3-D geometry can be efficiently and precisely converted into standard 2-D images, existing 2-D video communication platforms can be immediately leveraged for low bandwidth 3-D video communications.”
The 3-D objects are represented by a mesh of intersecting lines that form triangles. On top of this geometry is a “texture” of features that make the objects look realistic.
“This paper presents a novel method for the efficient and precise encoding of 3-D video data and color texture into a regular 2-D video format,” Zhang said. “We developed a novel 3-D video compression method that can drastically reduce 3-D video data size without substantially sacrificing data quality.”
The framework was tested using standard medium-bandwidth networks to simultaneously deliver high-quality 3-D videos to multiple mobile devices.
Holostream is made possible through a new pipeline for 3-D video recording, compression, transmission, decompression and visualization.
The team developed both the hardware and software for the pipeline including a 3-D video capture system. A 3-D camera captures the images, using an LED light to project structured patterns of stripes onto the object being scanned. These stripes allow the system to determine the depth and shape of the object.
The platform could enable applications where real-time delivery of high-resolution, high accuracy of 3-D video data is especially critical, such as collaborative design and online “facial behavior analysis,” which could reveal a person’s mental state and medical conditions such as depression and post-traumatic stress disorder.
The Latest on: 3-D video communication
- RevenueWell completes acquisition of leading dental digital marketing company PBHSon February 23, 2021 at 1:30 pm
RevenueWell, the Chicago-based developer of Dental Patient Relationship Management and Communication software, today announced it has completed its acquisition of PBHS, the ADA ...
- Student video on COVID-19 safetyon February 23, 2021 at 9:03 am
A video created by a group of communications students last week warns classmates about the serious consequences of violating SUNY COVID-19 guidelines and urges them to make safe decisions. In just ...
- ‘Angry Patriot Hippie’ suspected in Capitol riots arrested for threatening to shoot FBI agents in TikTok videoon February 22, 2021 at 3:10 am
Suzanne Kaye, who calls herself the “Angry Patriot Hippie" on social media, allegedly threatened to shoot FBI agents in a TikTok video.
- WFH diaries: Employees need masterclass on professional communicationon February 20, 2021 at 2:16 am
Amidst WFH, contactability is a challenge. Hence there are rising instances improper communication channels for contacting customers, clients which is an unacceptable behaviour.
- 3-D biopsies to better understand brain tumorson February 19, 2021 at 10:06 am
obtained a highly accurate recreation of human glioblastoma's features using a novel 3-D microscopy analysis. The study, published in the journal Acta Neuropathologica Communications, provides new ...
- Stratasys (SSYS) Enhances 3D Printing Portfolio on RPS Buyouton February 19, 2021 at 6:34 am
Want the latest recommendations from Zacks Investment Research? Today, you can download 7 Best Stocks for the Next 30 Days. Click to get this ...
- 3D Animated Video Production Revolutionizes Communication Across Languageson February 18, 2021 at 3:30 am
D animation and visualization has become increasingly popular in recent times, as more businesses across different industries look to leverage its features to reach their target audience with relative ...
- 3D Printed Video Terminal Dials C For Cyberpunkon February 15, 2021 at 3:59 pm
Created for the Disobey 2020 hacker conference in Finland, this Blade Runner inspired communications terminal ... to do now is figure out how to make video calls with it.
- Video: A signal from beyondon February 15, 2021 at 1:42 pm
UConn astrophysicist Chiara Mingarelli is part of a team of researchers who recently published data on a hint of a signal that sent ripples of excitement through the physics community. These ...
- Slack Randoms: Concept Bikes, Bobsleigh Tracks and Centaurson February 14, 2021 at 5:12 am
We've been spending a lot of time thinking about high pivot bikes this week and we're clearly not the only ones as Matus Prochaczka, CEO of Product and Concept Design studio Wekow ...
via Google News and Bing News