Computer vision and sound experts at the University of Surrey have demonstrated ‘Media Device Orchestration’ – an innovative home audio concept which enables users to enjoy immersive audio experiences by using all available devices in a typical living room.
The Media Device Orchestration (MDO) concept has been developed at Surrey in collaboration with the Universities of Salford and Southampton, and BBC Research & Development. It is being presented at the Audio Mostly conference in London on 24 August 2017.
Using the MDO concept, researchers have demonstrated that a 3D or ‘spatial audio’ experience can be achieved by employing everyday home devices in the living room such as a laptop, smartphone or wireless mini-speaker. The technology works by isolating different ‘objects’ within audio content (such as a particular voice), and connecting them to separate speakers available around the room.
The concept could enable consumers to enjoy films, games, programmes and music in a far more immersive, multi-layered and exciting way.
While it is possible to create 3D listening experiences using current spatial audio technology, this requires a complex set-up involving a multitude of speakers located at exact points in relation to the listener. Because of these limitations, the technology cannot easily be replicated in a domestic situation and is generally limited to specialist environments such as cinemas and theme park experiences.
The MDO research is part of the £5.4m five-year S3A project, funded by EPSRC (Engineering and Physical Sciences Research Council), which is aimed at delivering a step-change in the quality of audio consumed by the general public.
The development of immersive spatial audio systems has become a major focus for the audio research community and home audio industry in recent years for a number of reasons. With the advent of advanced home video technology such as 3D TV, there is a need for audio technology to ‘catch up’ in order to match the visual experience. At the same time, the growth of Virtual Reality for video games and other applications is creating demand for a sense of sound which is all around the user.
In addition to ‘channel-based’ sound production (in which the reproduction system is fixed before the content is broadcast), ‘object-based’ audio has recently emerged on the commercial market with the launch of technologies such as Dolby Atmos. The object-based audio technology has enabled the S3A researchers to access each separate part of an audio scene, intelligently routing them to improve the listener experience.
Leading the S3A project, the University of Surrey combines expertise in both computer vision and machine listening (within its Centre for Vision, Speech and Signal Processing) and sound perception (within its Institute of Sound Recording), which has enabled a user-focused solution rather than a purely lab-based approach.
Dr Philip Jackson, Senior Lecturer in Machine Audition at Surrey, said: “Most consumer audio transmitted into our homes is in the form of two-channel stereo which uses basic principles that have been around for over 130 years. To date, sophisticated multi-channel audio techniques have not helped to improve the listening experience for the general public. Our aim is to take spatial audio out of the lab and into people’s homes, and give users the impression of being at the heart of the action while in their living room.”
Dr Jon Francombe, Research Fellow in spatial audio in Surrey’s Institute of Sound Recording, commented: “New spatial audio methods have often required consumers to buy and install specific systems. We’re trying to make immersive listening experiences available to anyone by intelligently re-purposing content for whatever devices they already have available. The feedback we’ve had on our demonstrations to date has been great: MDO produces a listening experience that’s different to normal surround sound but can be equally (if not even more) immersive.”
The MDO concept is now being further developed by the S3A team in order to automate the process of ‘labelling’ sounds and connecting them with available speakers.
Learn more: Revolutionary approach brings 3D sound into the living room
The Latest on: Media Device Orchestration
[google_news title=”” keyword=”Media Device Orchestration” num_posts=”10″ blurb_length=”0″ show_thumb=”left”]- Rigetti Computing Launches the Novera™ QPU Partner Programon April 26, 2024 at 5:39 am
Rigetti intends on growing the Novera QPU Partner Program with additional partners on an ongoing basis.
- Nvidia to buy AI orchestration software provider Run:aion April 24, 2024 at 1:34 pm
Reported $700 million acquisition is aimed at helping AI users with workload management and resource allocation.
- Fiserv, Inc. (NYSE:FI) Q1 2024 Earnings Call Transcripton April 24, 2024 at 5:55 am
April 23, 2024 Fiserv, Inc. isn't one of the 30 most popular stocks among hedge funds at the end of the third quarter (see the details here). Operator: Welcome to the Fiserv First Quarter 2024 ...
- Tiny but mighty: The Phi-3 small language models with big potentialon April 23, 2024 at 3:25 pm
A series of SLMs offer many of the same capabilities found in LLMs but are smaller in size and are trained on smaller amounts of data.
- The dawn of intelligent and automated data orchestrationon April 23, 2024 at 2:03 am
Enterprise workflows desperately need what iPhone and Android users have enjoyed for years—ready access to files wherever and whenever they’re needed, regardless of where the files are physically ...
- Meta opens Quest operating system to third-party device makerson April 22, 2024 at 4:29 pm
Meta Platforms is sharing its Quest headset's operating system with rival device makers, including Microsoft , for the first time, it said on Monday, as it works to extend its influence over the ...
- Braze Blazes Aheadon April 22, 2024 at 10:59 am
B ill Magnuson is the chairman, CEO, and co-founder of Braze, a customer engagement platform that works with some of business's biggest names. In this podcast, Motley Fool analyst Tim Beyers caught up ...
- Manac launches SmartHorizon platform with ZFon April 16, 2024 at 10:45 am
Manac has launched SmartHorizon, offering customers greater connectivity in partnership with ZF. The company says the platform is not just a smart ...
- The Cloud: Where ‘Cooperation and Collaboration Are Built-In’on April 14, 2024 at 12:34 pm
The cloud is the first technology platform where cooperation and collaboration are built-in and expected,” said Jeromy Young, CEO of Atomos. “So-called ‘Camera to Cloud w ...
- NAB Show 2024 News: Planar, Disguise Go Virtual (Production, That Is) and Moreon April 13, 2024 at 5:02 am
NAB Show 2024 opens its doors at the Las Vegas Convention Center tomorrow, so be sure to add Planar, swXtch.io, Visilink, JVC, and Disguise to your must-see list. Planar and its affiliate company ...
via Google News and Bing News