A new platform enables high-quality 3-D video communication on mobile devices such as smartphones and tablets using existing standard wireless networks.
“To our knowledge, this system is the first of its kind that can deliver dense and accurate 3-D video content in real time across standard wireless networks to remote mobile devices such as smartphones and tablets,” said Song Zhang, an associate professor in Purdue University’s School of Mechanical Engineering.
The platform, called Holostream, drastically reduces the data size of 3-D video without substantially sacrificing data quality, allowing transmission within the bandwidths provided by existing wireless networks, he said.
It improves the quality and expands the capabilities of popular applications already harnessing real-time 3-D data delivery, such as teleconferencing and “telepresence,” which uses virtual reality and other interactive technologies, allowing people to feel or appear as if they were present in a remote location.
“This technology also could enable emerging applications that may require high-resolution, high-accuracy 3-D video data delivery, such as remote robotic surgery and telemedicine,” said Zhang, director of Purdue’s XYZT Lab.
Findings are detailed in a research paper to be presented during the Electronic Imaging 2018 conference, Jan. 28-Feb. 2 in Burlingame, Calif. The paper was authored by doctoral student Tyler Bell; Jan P. Allebach, Purdue’s Hewlett-Packard Distinguished Professor of Electrical and Computer Engineering; and Zhang. (A YouTube video is available at https://www.youtube.com/watch?v=NhSbWqEcmQg)
Existing 3-D video communication technologies have limited applications, in part because of they require specialized and often expensive hardware, complex system setup, and highly demanding computational resources for operation in real-time, or without delay.Before 3-D video can be transmitted it must be compressed. However, it has been difficult to compress 3-D video for transmission in real time using conventional methods. The new platform solves the problem by first converting 3-D video to 2-D format.
“Standard 2-D image and video compression techniques are quite mature and enable today’s modern 2-D video communications over standard wireless networks,” Zhang said. “If 3-D geometry can be efficiently and precisely converted into standard 2-D images, existing 2-D video communication platforms can be immediately leveraged for low bandwidth 3-D video communications.”
The 3-D objects are represented by a mesh of intersecting lines that form triangles. On top of this geometry is a “texture” of features that make the objects look realistic.
“This paper presents a novel method for the efficient and precise encoding of 3-D video data and color texture into a regular 2-D video format,” Zhang said. “We developed a novel 3-D video compression method that can drastically reduce 3-D video data size without substantially sacrificing data quality.”
The framework was tested using standard medium-bandwidth networks to simultaneously deliver high-quality 3-D videos to multiple mobile devices.
Holostream is made possible through a new pipeline for 3-D video recording, compression, transmission, decompression and visualization.
The team developed both the hardware and software for the pipeline including a 3-D video capture system. A 3-D camera captures the images, using an LED light to project structured patterns of stripes onto the object being scanned. These stripes allow the system to determine the depth and shape of the object.
The platform could enable applications where real-time delivery of high-resolution, high accuracy of 3-D video data is especially critical, such as collaborative design and online “facial behavior analysis,” which could reveal a person’s mental state and medical conditions such as depression and post-traumatic stress disorder.
The Latest on: 3-D video communication
[google_news title=”” keyword=”3-D video communication” num_posts=”10″ blurb_length=”0″ show_thumb=”left”]
- Zoom Video Communications, Inc.: Zoom Video Communications Reports Financial Results for the Third Quarter of Fiscal Year 2023on November 22, 2022 at 12:00 am
Zoom Video Communications, Inc. (NASDAQ: ZM), today announced financial results for the third fiscal quarter ended October 31, 2022. "At Zoomtopia, we announced a number of innovations including Zoom ...
- Zoom Video Communications, Inc. (ZM) Q3 2023 Earnings Call Transcripton November 21, 2022 at 10:13 pm
And welcome to Zoom’s Earnings Video Webinar for the Third Quarter of Fiscal ... benefits of a cloud-based PBX solution integrated into a full communications platform. Also, I’d like to add that G-P ...
- Zoom Video Communications (ZM) Q3 2023 Earnings Call Transcripton November 21, 2022 at 8:00 pm
Q3 2023 Earnings CallNov 21, 2022, 5:00 p.m. ETContents: Prepared Remarks Questions and Answers Call Participants Prepared Remarks: Kelcey McKinley Well, hello, everyone, and welcome to Zoom's Q3 ...
- Zoom Video Communications Inc.on November 21, 2022 at 4:00 pm
1 Day ZM -3.92% DJIA 0.90% S&P 500 0.93% Technology -0.87% The Price to Earnings (P/E) ratio, a key valuation measure, is calculated by dividing the stock's most recent closing price by the sum of ...
- Zoom Video Communications Reports Financial Results for the Third Quarter of Fiscal Year 2023on November 21, 2022 at 1:17 pm
Zoom Video Communications, Inc. (NASDAQ: ZM), today announced financial results for the third fiscal quarter ended October 31, 2022. “At Zoomtopia, we announced a number of innovations including Zoom ...
- 3 ways communications teams can simplify Web3 UX for mass adoptionon November 19, 2022 at 10:34 am
This user experience (UX) challenge goes all the way to communications ... They can spend them how they’d like or even turn them into cash. Remind users that while centralized rewards go ...
- Zoom Video Communications (ZM) Dips More Than Broader Markets: What You Should Knowon November 17, 2022 at 5:02 pm
Zoom Video Communications is holding a Zacks Rank of #3 (Hold) right now. Digging into valuation, Zoom Video Communications currently has a Forward P/E ratio of 22.43. This valuation marks a ...
- 3 Communication Stocks Likely to Ride on Solid Demand Trendson November 11, 2022 at 4:04 am
The Zacks Communication - Components industry appears well poised to gain from healthy demand trends amid fading supply chain adversities with the gradual revival in post-pandemic market conditions ...
- 3 Stocks to Watch From the Satellite and Communication Industryon November 1, 2022 at 12:01 pm
Continued momentum in the commercial IoT business (particularly personal satellite communications) and broadband business (especially L-band services) augurs well. Iridium carries a Zacks Rank #3 ...
via Google News and Bing News