A new platform enables high-quality 3-D video communication on mobile devices such as smartphones and tablets using existing standard wireless networks.
“To our knowledge, this system is the first of its kind that can deliver dense and accurate 3-D video content in real time across standard wireless networks to remote mobile devices such as smartphones and tablets,” said Song Zhang, an associate professor in Purdue University’s School of Mechanical Engineering.
The platform, called Holostream, drastically reduces the data size of 3-D video without substantially sacrificing data quality, allowing transmission within the bandwidths provided by existing wireless networks, he said.
It improves the quality and expands the capabilities of popular applications already harnessing real-time 3-D data delivery, such as teleconferencing and “telepresence,” which uses virtual reality and other interactive technologies, allowing people to feel or appear as if they were present in a remote location.
“This technology also could enable emerging applications that may require high-resolution, high-accuracy 3-D video data delivery, such as remote robotic surgery and telemedicine,” said Zhang, director of Purdue’s XYZT Lab.
Findings are detailed in a research paper to be presented during the Electronic Imaging 2018 conference, Jan. 28-Feb. 2 in Burlingame, Calif. The paper was authored by doctoral student Tyler Bell; Jan P. Allebach, Purdue’s Hewlett-Packard Distinguished Professor of Electrical and Computer Engineering; and Zhang. (A YouTube video is available at https://www.youtube.com/watch?v=NhSbWqEcmQg)
Existing 3-D video communication technologies have limited applications, in part because of they require specialized and often expensive hardware, complex system setup, and highly demanding computational resources for operation in real-time, or without delay.Before 3-D video can be transmitted it must be compressed. However, it has been difficult to compress 3-D video for transmission in real time using conventional methods. The new platform solves the problem by first converting 3-D video to 2-D format.
“Standard 2-D image and video compression techniques are quite mature and enable today’s modern 2-D video communications over standard wireless networks,” Zhang said. “If 3-D geometry can be efficiently and precisely converted into standard 2-D images, existing 2-D video communication platforms can be immediately leveraged for low bandwidth 3-D video communications.”
The 3-D objects are represented by a mesh of intersecting lines that form triangles. On top of this geometry is a “texture” of features that make the objects look realistic.
“This paper presents a novel method for the efficient and precise encoding of 3-D video data and color texture into a regular 2-D video format,” Zhang said. “We developed a novel 3-D video compression method that can drastically reduce 3-D video data size without substantially sacrificing data quality.”
The framework was tested using standard medium-bandwidth networks to simultaneously deliver high-quality 3-D videos to multiple mobile devices.
Holostream is made possible through a new pipeline for 3-D video recording, compression, transmission, decompression and visualization.
The team developed both the hardware and software for the pipeline including a 3-D video capture system. A 3-D camera captures the images, using an LED light to project structured patterns of stripes onto the object being scanned. These stripes allow the system to determine the depth and shape of the object.
The platform could enable applications where real-time delivery of high-resolution, high accuracy of 3-D video data is especially critical, such as collaborative design and online “facial behavior analysis,” which could reveal a person’s mental state and medical conditions such as depression and post-traumatic stress disorder.
Learn more: ‘Holostream’ allows high-quality wireless 3-D video communications
The Latest on: 3-D video communication
[google_news title=”” keyword=”3-D video communication” num_posts=”10″ blurb_length=”0″ show_thumb=”left”]- AI Chatbots in Travel: Bridging Communication Gapson May 7, 2024 at 5:00 pm
These intelligent systems facilitate clear and efficient communication, allowing travelers to convey their concerns promptly. Notably, these chatbots are not standalone solutions; they work in tandem ...
- United Way of Lancaster County hosts annual Trike Race [video]on May 7, 2024 at 3:32 pm
Thirty-four teams from local businesses participated in United Way of Lancaster County’s Trike Race 2024 on Tuesday in the parking lot of Clipper Magazine Stadium in Lancaster city.
- Charter Communications, Inc. (NASDAQ:CHTR) Q1 2024 Earnings Call Transcripton May 1, 2024 at 9:10 am
Q1 2024 Earnings Call Transcript April 26, 2024 Charter Communications, Inc. misses on earnings expectations. Reported EPS is $7.55 EPS, expectations were $7.59. Charter Communications, Inc. isn’t one ...
- The Power Of Effective Communication To Advance Workplace Safetyon May 1, 2024 at 4:00 am
Here are five innovative communication approaches to boost performance and help your team get serious about safety.
- ‘From’ Season 3 Celebrates Halfway to Halloween With Haunting First Teaser Traileron April 29, 2024 at 9:00 am
To celebrate Halfway to Halloween, MGM+ released the first teaser for From Season 3 showing Harold Perrineau in grave danger. Watch it now!
- ‘We’re Aware of the Location’: Aid Groups in Gaza Coordinated With I.D.F. but Still Came Under Fireon April 26, 2024 at 7:43 am
Visual evidence and internal communications obtained by The Times show six aid groups based in Western countries, including Israel’s strongest allies, had humanitarian sites hit by Israeli strikes, ...
- The 3 Keys to a Great Relationship—Starting Nowon April 25, 2024 at 9:45 am
If you are like Janine and Ed, you are strong in some areas of the triangle and weak in others. But if you want sustainable passion and connection, you need all three sides to be strong. Now, let’s ...
- C-SPAN 3 TV Scheduleon April 25, 2024 at 9:34 am
American History TV talked about America's first diplomat, Benjamin Franklin, and the Apple+ TV series about his life and career, with author Stacy Schiff. This U.S. Forest Service film tells the ...
- Nearly 3 million Californians at risk of losing home internet service as subsidy expireson April 22, 2024 at 7:25 am
But while opening mail at her home in South Gate two months ago, Aleman came across a letter from the Federal Communications Commission announcing ... 1 in 6 U.S. households — including nearly 3 ...
- CEO Reveals the 3 Things You Should Never Do on Your Work Laptopon April 19, 2024 at 8:08 am
"I just saw a video of a woman talking about how your company is spying ... If the IT team really wanted to inspect who wrote what—they could. And number 3: I probably wouldn't take my work laptop and ...
via Google News and Bing News