A new computer software programme has the potential to lip-read more accurately than people and to help those with hearing loss, Oxford University researchers have found.
Watch, Attend and Spell (WAS), is a new artificial intelligence (AI) software system that has been developed by Oxford, in collaboration with the company DeepMind.
The AI system uses computer vision and machine learning methods to learn how to lip-read from a dataset made up of more than 5,000 hours of TV footage, gathered from six different programmes including Newsnight, BBC Breakfast and Question Time. The videos contained more than 118,000 sentences in total, and a vocabulary of 17,500 words.
The research team compared the ability of the machine and a human expert to work out what was being said in the silent video by focusing solely on each speaker’s lip movements. They found that the software system was more accurate compared to the professional. The human lip-reader correctly read 12 per cent of words, while the WAS software recognised 50 per cent of the words in the dataset, without error. The machine’s mistakes were small, including things like missing an “s” at the end of a word, or single letter misspellings.
The software could support a number of developments, including helping the hard of hearing to navigate the world around them. Speaking on the tech’s core value, Jesal Vishnuram, Action on Hearing Loss Technology Research Manager, said: ‘Action on Hearing Loss welcomes the development of new technology that helps people who are deaf or have a hearing loss to have better access to television through superior real-time subtitling.
‘It is great to see research being conducted in this area, with new breakthroughs welcomed by Action on Hearing Loss by improving accessibility for people with a hearing loss. AI lip-reading technology would be able to enhance the accuracy and speed of speech-to-text especially in noisy environments and we encourage further research in this area and look forward to seeing new advances being made.’
Commenting on the potential uses for WAS Joon Son Chung, lead-author of the study and a graduate student at Oxford’s Department of Engineering, said: ‘Lip-reading is an impressive and challenging skill, so WAS can hopefully offer support to this task – for example, suggesting hypotheses for professional lip readers to verify using their expertise. There are also a host of other applications, such as dictating instructions to a phone in a noisy environment, dubbing archival silent films, resolving multi-talker simultaneous speech and improving the performance of automated speech recognition in general.’
Receive an email update when we add a new ARTIFICIAL INTELLIGENCE article.
The Latest on: Artificial intelligence
via Google News
The Latest on: Artificial intelligence
- Geospatial Analytics Artificial Intelligence Market Estimated to Reach $160 Million by 2025on April 16, 2021 at 7:01 am
The Global Geospatial Analytics Artificial Intelligence Market is estimated to reach 160 million by 2025 growing at a CAGR of 32 5 from 2020 to 2025 Geospatial Analytics Artificial Intelligence ...
- Artificial Intelligence (Ai) in Medical Diagnostics Market Industry Analysis, Market Size, Trends, Share and Forecast 2027on April 16, 2021 at 6:37 am
The Global Artificial Intelligence (Ai) in Medical Diagnostics Market is estimated to value over USD 5.2 million ...
- Sonoma County tests new artificial intelligence to fight wildfireson April 16, 2021 at 6:18 am
Fire officials in Sonoma County are using new artificial intelligence to help stop wildfires before they grow out of control; The county teamed up with Sout ...
- Artificial Intelligence in Transportation Market Study Report Based on Size, Shares, Opportunities, Industry Trends and Forecast to 2028on April 16, 2021 at 6:08 am
The global Artificial Intelligence in transportation market size is expected to reach USD 7,065.1 Million in 2028 and register a robust CAGR over the forecast period, according to latest analysis by ...
- How State’s Disinformation-Fighting Arm Uses Artificial Intelligenceon April 16, 2021 at 6:00 am
Emerging technologies—and partnerships promoting their use—have proven instrumental for the State Department’s Global Engagement Center, a hub that steers federal efforts to counter state-sponsored ...
- Five ways artificial intelligence can help space explorationon April 16, 2021 at 3:59 am
From designing missions to clearing Earth's orbit of junk, here are a few ways artificial intelligence can help us venture further in space. Do you remember Tars and Case, the assistant robots from ...
- Artificial Intelligence And Whisky Making: The Perfect Blend?on April 15, 2021 at 9:44 pm
Find out how Mackmyra, a Swedish whisky distillery, used AI to analyze 70 million possible combinations and create an innovative new whiskey recipe that customers love.
- Cruise's head of artificial intelligence wants the autonomous-car startup to be defined by its AI innovationon April 15, 2021 at 6:57 am
Hussein Mehanna thinks machine learning is going to set Cruise apart, and he told Insider how companies could become "AI natives" in the future.
- C3.ai May Be In an Artificial Intelligence Bubbleon April 15, 2021 at 6:21 am
AI stock appeals on the surface thanks to its seemingly compelling business but this is also where the looks of C3.ai may be deceiving.More From InvestorPlace Why Everyone Is Investing in 5G All WRONG ...
via Bing News