New lip-reading technology developed at the University of East Anglia could help in solving crimes and provide communication assistance for people with hearing and speech impairments.
The visual speech recognition technology, created by Dr Helen L. Bear and Prof Richard Harvey of UEA’s School of Computing Sciences, can be applied “any place where the audio isn’t good enough to determine what people are saying,” Dr Bear said.
Dr Bear, whose findings will be presented at the International Conference on Acoustics, Speech and Signal Processing (ICASSP) in Shanghai on March 25, said unique problems with determining speech arise when sound isn’t available – such as on CCTV footage – or if the audio is inadequate and there aren’t clues to give the context of a conversation. The sounds ‘/p/,’ ‘/b/,’ and ‘/m/’ all look similar on the lips, but now the machine lip-reading classification technology can differentiate between the sounds for a more accurate translation.
Dr Bear said: “We are still learning the science of visual speech and what it is people need to know to create a fool-proof recognition model for lip-reading, but this classification system improves upon previous lip-reading methods by using a novel training method for the classifiers.
“Potentially, a robust lip-reading system could be applied in a number of situations, from criminal investigations to entertainment. Lip-reading has been used to pinpoint words footballers have shouted in heated moments on the pitch, but is likely to be of most practical use in situations where are there are high levels of noise, such as in cars or aircraft cockpits.
“Crucially, whilst there are still improvements to be made, such a system could be adapted for use for a range of purposes – for example, for people with hearing or speech impairments. Alternatively, a good lip-reading machine could be part of an audio-visual recognition system.”
Prof Harvey said: “Lip-reading is one of the most challenging problems in artificial intelligence so it’s great to make progress on one of the trickier aspects, which is how to train machines to recognise the appearance and shape of human lips.”
Learn more: Read my lips: New technology spells out what’s said when audio fails
The Latest on: Lip-reading technology
via Google News
The Latest on: Lip-reading technology
- New glasses for the deaf and hard of hearing display subtitles while people speakon August 1, 2022 at 5:56 am
Having been born hard of hearing, Feldman has gotten used to lip reading while socializing. But it can be a struggle to keep up in a world that often doesn’t accommodate those who are deaf or hard of ...
- Will Clark, Greg Maddux and the lip-reading that (allegedly) changed baseballon July 29, 2022 at 4:00 am
Why do mound conversations in baseball look like spy games? It just might date back to one fateful at-bat in the 1989 NLCS.
- Disability Pride Month – meet the siblings working in healthcare with impaired hearingon July 25, 2022 at 6:31 am
Walid and Nada Hassoon share their experience working in healthcare with impaired hearing and how we can make it more accessible.
- Hitomi MatchBox – now with added Latencyon July 20, 2022 at 2:47 am
Lots of things can add tiny amounts of delay to a signal path, making getting everything in sync tricky. Now, Hitomi's new MatchBox Latency feature can analyse delay without delay, and with ...
- Lip Powders Industry 2022 Share, Size, Company Profiles, Trends, Growth, Segments, Landscape and Demand by Forecast to 2027on July 20, 2022 at 12:10 am
Jul 20, 2022 (The Expresswire) -- "Final Report will add the analysis of the impact of Pre and Post COVID-19 on this Lip Powders industry/market." ...
- Abuse in Care: Deaf children smacked for failing to lip read, denied sign languageon July 18, 2022 at 4:57 pm
He was denied sign language and forced – unsuccessfully – to learn lip-reading, which he hated. Teachers would tell the students “watch me, watch my lips,” and slap the students’ mouths ...
- Did you know the LANEIGE Lip Sleeping Mask is 30% off for Prime Day right now? Because I sure didn’t!on July 12, 2022 at 12:36 pm
Hello, smooth base! Using hero ingredients like shea butter, glycerin, hyaluronic acid and dimethicone, the lip mask features “moisture wrap technology” to lock in moisture. TikTok loves it ...
- Venomous Lumpsucker by Ned Beauman, review: A bit like reading flat-pack instructionson July 7, 2022 at 7:45 am
But, as scientist Karin Resaint has just realised, the venomous lumpsucker is in fact “one of the most intelligent creatures on the planet”. Venomous Lumpsucker falls roughly into the genre of climate ...
- Best lip balm with SPFon July 7, 2022 at 1:08 am
Using products with SPF technology helps protect us from harmful UV rays that the sun produces. These items can work to prevent skin cancers and damage caused by the sun. Lip balms that contain ...
- Lip Wolfon July 4, 2022 at 5:00 pm
In her first collection available to English-language readers, rising Mexican poet Laura Solórzano explores the risks and obstacles of communication through startling juxtapositions of images ...
via Bing News