A new platform enables high-quality 3-D video communication on mobile devices such as smartphones and tablets using existing standard wireless networks.
“To our knowledge, this system is the first of its kind that can deliver dense and accurate 3-D video content in real time across standard wireless networks to remote mobile devices such as smartphones and tablets,” said Song Zhang, an associate professor in Purdue University’s School of Mechanical Engineering.
The platform, called Holostream, drastically reduces the data size of 3-D video without substantially sacrificing data quality, allowing transmission within the bandwidths provided by existing wireless networks, he said.
It improves the quality and expands the capabilities of popular applications already harnessing real-time 3-D data delivery, such as teleconferencing and “telepresence,” which uses virtual reality and other interactive technologies, allowing people to feel or appear as if they were present in a remote location.
“This technology also could enable emerging applications that may require high-resolution, high-accuracy 3-D video data delivery, such as remote robotic surgery and telemedicine,” said Zhang, director of Purdue’s XYZT Lab.
Findings are detailed in a research paper to be presented during the Electronic Imaging 2018 conference, Jan. 28-Feb. 2 in Burlingame, Calif. The paper was authored by doctoral student Tyler Bell; Jan P. Allebach, Purdue’s Hewlett-Packard Distinguished Professor of Electrical and Computer Engineering; and Zhang. (A YouTube video is available at https://www.youtube.com/watch?v=NhSbWqEcmQg)
Existing 3-D video communication technologies have limited applications, in part because of they require specialized and often expensive hardware, complex system setup, and highly demanding computational resources for operation in real-time, or without delay.Before 3-D video can be transmitted it must be compressed. However, it has been difficult to compress 3-D video for transmission in real time using conventional methods. The new platform solves the problem by first converting 3-D video to 2-D format.
“Standard 2-D image and video compression techniques are quite mature and enable today’s modern 2-D video communications over standard wireless networks,” Zhang said. “If 3-D geometry can be efficiently and precisely converted into standard 2-D images, existing 2-D video communication platforms can be immediately leveraged for low bandwidth 3-D video communications.”
The 3-D objects are represented by a mesh of intersecting lines that form triangles. On top of this geometry is a “texture” of features that make the objects look realistic.
“This paper presents a novel method for the efficient and precise encoding of 3-D video data and color texture into a regular 2-D video format,” Zhang said. “We developed a novel 3-D video compression method that can drastically reduce 3-D video data size without substantially sacrificing data quality.”
The framework was tested using standard medium-bandwidth networks to simultaneously deliver high-quality 3-D videos to multiple mobile devices.
Holostream is made possible through a new pipeline for 3-D video recording, compression, transmission, decompression and visualization.
The team developed both the hardware and software for the pipeline including a 3-D video capture system. A 3-D camera captures the images, using an LED light to project structured patterns of stripes onto the object being scanned. These stripes allow the system to determine the depth and shape of the object.
The platform could enable applications where real-time delivery of high-resolution, high accuracy of 3-D video data is especially critical, such as collaborative design and online “facial behavior analysis,” which could reveal a person’s mental state and medical conditions such as depression and post-traumatic stress disorder.
The Latest on: 3-D video communication
[google_news title=”” keyword=”3-D video communication” num_posts=”10″ blurb_length=”0″ show_thumb=”left”]
- NCAA committee endorses ‘coach-to-player’ electronic communication in football gameson March 1, 2024 at 3:58 pm
Those and other new rules for 2024 still have to be approved by the NCAA’s playing-rules oversight panel at its April 18 meeting. That’s considered a formality.
- Q4 2023 Cogent Communications Holdings Inc Earnings Callon February 29, 2024 at 8:46 pm
Now I'd like to turn ... impact of $16.3 million. For the full year, the positive USF impact was $34.8 million. Some comments on the net-centric business. Our net-centric business continues to benefit ...
- Communications Services Up as Netflix, Zoom Video Gain -- Communications Services Roundupon February 27, 2024 at 1:07 pm
Communications services companies rose as traders chased gains in some of the fastest-rising stocks of 2024. Netflix shares rose almost 3% to top $600 ...
- Era of 3D video chat inches closer with demo at Barcelona fairon February 27, 2024 at 3:27 am
and the fast 5G mobile communications standard with its low latency is an important building block for this. At a time where conversations on video chat platforms like Zoom still struggle to match the ...
- Deutsche Telekom Unveils ‘Concept T’: Redefining Future Communication with Human-Centered Designon February 27, 2024 at 12:11 am
Deutsche Telekom unveils its visionary "Concept T" at the Mobile World Congress 2024, offering a glimpse into the future of personal communicatio ...
- Universities Use Video Walls as Storytelling Toolson February 24, 2024 at 1:13 pm
The video wall gives the university’s communications school a dynamic way to depict students’ experiences. Five MicroLED video panels separated by a 3-inch gap are used to ... to see themselves on the ...
- 3 Hyper-Growth Stocks to Add Rocket Fuel to Your Portfolioon February 22, 2024 at 3:00 am
While hyper-growth stocks don’t typically include attractive dividends, they compensate by providing higher-than-average returns. However, growth investing requires a lot of strategic planning. It ...
- SpaceX launches Indonesian satellite on 300th successful Falcon 9 mission (video)on February 20, 2024 at 6:00 am
Today's launch will be the 16th for SpaceX already in 2024. Three of this year's launches came in a 23-hour span over Feb. 14 and Feb. 15, when the company launched the classified USSF-124 mission for ...
- What went wrong between Meghan Markle and her Suits co-stars? They were all invited to her fairytale wedding to Prince Harry in 2018 but now have 'zero communication' and admit ...on February 17, 2024 at 3:51 am
Yet lately, when the actors have been asked about the Duchess, they've all replied with similar statements suggesting there's no communication between the ... Life is short. 3. There has to got to be ...
- Mobile Wireless Communicationson December 18, 2023 at 4:35 am
Sacchi, Claudio D'Orazio, Leandro Donelli, Massimo Fedrizzi, Riccardo and De Natale, Francesco 2006. A Genetic Algorithm-Assisted Semi-Adaptive MMSE Multi-User Detection for MC-CDMA Mobile ...
via Google News and Bing News