A new computer software programme has the potential to lip-read more accurately than people and to help those with hearing loss, Oxford University researchers have found.
Watch, Attend and Spell (WAS), is a new artificial intelligence (AI) software system that has been developed by Oxford, in collaboration with the company DeepMind.
The AI system uses computer vision and machine learning methods to learn how to lip-read from a dataset made up of more than 5,000 hours of TV footage, gathered from six different programmes including Newsnight, BBC Breakfast and Question Time. The videos contained more than 118,000 sentences in total, and a vocabulary of 17,500 words.
The research team compared the ability of the machine and a human expert to work out what was being said in the silent video by focusing solely on each speaker’s lip movements. They found that the software system was more accurate compared to the professional. The human lip-reader correctly read 12 per cent of words, while the WAS software recognised 50 per cent of the words in the dataset, without error. The machine’s mistakes were small, including things like missing an “s” at the end of a word, or single letter misspellings.
The software could support a number of developments, including helping the hard of hearing to navigate the world around them. Speaking on the tech’s core value, Jesal Vishnuram, Action on Hearing Loss Technology Research Manager, said: ‘Action on Hearing Loss welcomes the development of new technology that helps people who are deaf or have a hearing loss to have better access to television through superior real-time subtitling.
‘It is great to see research being conducted in this area, with new breakthroughs welcomed by Action on Hearing Loss by improving accessibility for people with a hearing loss. AI lip-reading technology would be able to enhance the accuracy and speed of speech-to-text especially in noisy environments and we encourage further research in this area and look forward to seeing new advances being made.’
Commenting on the potential uses for WAS Joon Son Chung, lead-author of the study and a graduate student at Oxford’s Department of Engineering, said: ‘Lip-reading is an impressive and challenging skill, so WAS can hopefully offer support to this task – for example, suggesting hypotheses for professional lip readers to verify using their expertise. There are also a host of other applications, such as dictating instructions to a phone in a noisy environment, dubbing archival silent films, resolving multi-talker simultaneous speech and improving the performance of automated speech recognition in general.’
Receive an email update when we add a new ARTIFICIAL INTELLIGENCE article.
The Latest on: Artificial intelligence
via Google News
The Latest on: Artificial intelligence
- A Nude Portrait Hidden in a Picasso Painting Was Just Was Just Revealed by Artificial Intelligenceon October 11, 2021 at 3:30 pm
A nude figure has been found hiding beneath the oil paint of the Spanish artist’s (1903). And we don’t have to wonder what the original work would have looked like thanks to the magic of AI ...
- How artificial intelligence can predict, detect and deter financial crimeon October 11, 2021 at 3:24 pm
By Martin Rehak, CEO of Resistant AI For each dollar of fraud lost, the cost to the merchant is three times as great. Banks need to be agile to compete with the fintechs, but how can they do this ...
- IBM, Raytheon Intend To Develop Artificial Intelligence, Cryptographic, Quantum Solutionson October 11, 2021 at 11:08 am
International Business Machines Corp (NYSE: IBM) and Raytheon Technologies Corp (NYSE: RTX) have agreed to strategic collaboration to develop advanced artificial intelligence, cryptographic and ...
- The AI-Enabled Telco Takes Shape: Why Telcos Are Using Artificial Intelligence To Rollout Their 5G Serviceson October 11, 2021 at 10:06 am
Over the next five years, Bain & Company expects 5G to enter the mainstream, gaining popularity through accelerated deployment by telcos, affordable handsets and other major uses for the technology.
- Former Pentagon official says China has won artificial intelligence battleon October 11, 2021 at 10:04 am
The Pentagon's former software chief resigned and said that China is headed toward global dominance in artificial intelligence (AI) due to the relatively slow pace of innovation in the United States.
- Hidden Picasso nude revealed and brought to life with artificial intelligenceon October 11, 2021 at 9:02 am
A nude portrait of a crouching woman, hidden beneath the surface of a Pablo Picasso painting, has been revealed using artificial intelligence, advanced imaging technology and 3D printing.
- Artificial Intelligence Chip Market size worth $ 109.83 Billion, Globally, by 2028 at 40.17% CAGR: Verified Market Research®on October 11, 2021 at 8:17 am
Despite many headwinds and realignment of interest and priorities that can breed uncertainty, the market did not suffer any fatigue. Enterprises are increasingly warming up to the AI value. Not only ...
- 2 Artificial Intelligence Stocks to Buy, 2 to Avoidon October 11, 2021 at 8:03 am
As artificial intelligence (AI) gains importance with the ongoing digital transformation, tech giants Apple (AAPL) and Alphabet (GOOGL) are well-positioned to gain owing to their consistent product ...
- IBM and Raytheon Technologies to Collaborate on Artificial Intelligence, Cryptography and Quantum Technologieson October 11, 2021 at 7:20 am
IBM (NYSE: IBM) and Raytheon Technologies (NYSE: RTX) will jointly develop advanced artificial intelligence, cryptographic and quantum solutions for the aerospace, defense and intelligence industries, ...
via Bing News