A new computer software programme has the potential to lip-read more accurately than people and to help those with hearing loss, Oxford University researchers have found.
Watch, Attend and Spell (WAS), is a new artificial intelligence (AI) software system that has been developed by Oxford, in collaboration with the company DeepMind.
The AI system uses computer vision and machine learning methods to learn how to lip-read from a dataset made up of more than 5,000 hours of TV footage, gathered from six different programmes including Newsnight, BBC Breakfast and Question Time. The videos contained more than 118,000 sentences in total, and a vocabulary of 17,500 words.
The research team compared the ability of the machine and a human expert to work out what was being said in the silent video by focusing solely on each speaker’s lip movements. They found that the software system was more accurate compared to the professional. The human lip-reader correctly read 12 per cent of words, while the WAS software recognised 50 per cent of the words in the dataset, without error. The machine’s mistakes were small, including things like missing an “s” at the end of a word, or single letter misspellings.
The software could support a number of developments, including helping the hard of hearing to navigate the world around them. Speaking on the tech’s core value, Jesal Vishnuram, Action on Hearing Loss Technology Research Manager, said: ‘Action on Hearing Loss welcomes the development of new technology that helps people who are deaf or have a hearing loss to have better access to television through superior real-time subtitling.
‘It is great to see research being conducted in this area, with new breakthroughs welcomed by Action on Hearing Loss by improving accessibility for people with a hearing loss. AI lip-reading technology would be able to enhance the accuracy and speed of speech-to-text especially in noisy environments and we encourage further research in this area and look forward to seeing new advances being made.’
Commenting on the potential uses for WAS Joon Son Chung, lead-author of the study and a graduate student at Oxford’s Department of Engineering, said: ‘Lip-reading is an impressive and challenging skill, so WAS can hopefully offer support to this task – for example, suggesting hypotheses for professional lip readers to verify using their expertise. There are also a host of other applications, such as dictating instructions to a phone in a noisy environment, dubbing archival silent films, resolving multi-talker simultaneous speech and improving the performance of automated speech recognition in general.’
Receive an email update when we add a new ARTIFICIAL INTELLIGENCE article.
The Latest on: Artificial intelligence
via Google News
The Latest on: Artificial intelligence
- Rackmount rugged computer servers for EW, C4ISR, and artificial intelligence (AI) introduced by Mercuryon February 25, 2021 at 10:31 pm
The secure server features trusted computing performance, built-in data integrity protection, and features the latest Intel server-class processors.
- War Mongering for Artificial Intelligenceon February 25, 2021 at 10:20 pm
The ghost of Edward Teller must have been doing the rounds between members of the National Commission on Artificial Intelligence. The father of the hydrogen bomb was never one too bothered by the ...
- Virtus AllianzGI Artificial Intelligence & Technology Opportunities Fund (NYSE: AIO) Announces Results of Special Meeting of Shareholderson February 25, 2021 at 4:34 pm
Virtus AllianzGI Artificial Intelligence & Technology Opportunities Fund (NYSE: AIO) announced today that its shareholders have voted to approve a new investment advisory agreement with Virtus ...
- Artificial Intelligence Market worth $190.61 billion by 2025, at a CAGR of 36.62%on February 25, 2021 at 2:20 pm
Artificial Intelligence Market” [222 Pages] Artificial Intelligence Market report categorizes the Global market by Offering (Hardware, Software), Technology ...
- Artificial Intelligence in the Education Sector Market Emerging Trends, Demand, Revenue and Forecasts Research 2027on February 25, 2021 at 12:48 pm
USD 1.08 Billion in 2019, Market Growth – at a CAGR of 43.8%, Market Trends – Rise in venture capital funding in EdTech companies ...
- Spy agency: Artificial intelligence is already a vital part of our missionson February 25, 2021 at 8:51 am
The UK's top intelligence and security body, GCHQ, is betting big on artificial intelligence: the organization has revealed how it wants to use AI In a new paper titled "Pioneering a New National ...
- Artificial Intelligence: Leveling The Business Playing Fieldon February 25, 2021 at 5:20 am
Covid-19 has catalyzed the accelerated adoption of AI-based business analytics, workflow and process automation.
- Artificial Intelligence (AI) in Retail Market |Global Opportunities, Size, Share, Emerging Trends, Technological Innovation and Forecastson February 25, 2021 at 5:13 am
Global Size, Share Report,Market Trends, Industry Forecast, Growth, Trends Analysis, Keyplayers & Regional Analysis (Latin America, North America, Asia Pacific, Europe, Middle East) "Global Artificial ...
- Global artificial intelligence in retail market valuation to reach USD 24 billion by 2027on February 25, 2021 at 3:06 am
The research study on ‘global artificial intelligence (AI) in retail market’ offers crucial insights pertaining to the growth drivers, limitations & challenges faced by industry participants, and ...
via Bing News