New lip-reading technology developed at the University of East Anglia could help in solving crimes and provide communication assistance for people with hearing and speech impairments.
The visual speech recognition technology, created by Dr Helen L. Bear and Prof Richard Harvey of UEA’s School of Computing Sciences, can be applied “any place where the audio isn’t good enough to determine what people are saying,” Dr Bear said.
Dr Bear, whose findings will be presented at the International Conference on Acoustics, Speech and Signal Processing (ICASSP) in Shanghai on March 25, said unique problems with determining speech arise when sound isn’t available – such as on CCTV footage – or if the audio is inadequate and there aren’t clues to give the context of a conversation. The sounds ‘/p/,’ ‘/b/,’ and ‘/m/’ all look similar on the lips, but now the machine lip-reading classification technology can differentiate between the sounds for a more accurate translation.
Dr Bear said: “We are still learning the science of visual speech and what it is people need to know to create a fool-proof recognition model for lip-reading, but this classification system improves upon previous lip-reading methods by using a novel training method for the classifiers.
“Potentially, a robust lip-reading system could be applied in a number of situations, from criminal investigations to entertainment. Lip-reading has been used to pinpoint words footballers have shouted in heated moments on the pitch, but is likely to be of most practical use in situations where are there are high levels of noise, such as in cars or aircraft cockpits.
“Crucially, whilst there are still improvements to be made, such a system could be adapted for use for a range of purposes – for example, for people with hearing or speech impairments. Alternatively, a good lip-reading machine could be part of an audio-visual recognition system.”
Prof Harvey said: “Lip-reading is one of the most challenging problems in artificial intelligence so it’s great to make progress on one of the trickier aspects, which is how to train machines to recognise the appearance and shape of human lips.”
Learn more: Read my lips: New technology spells out what’s said when audio fails
The Latest on: Lip-reading technology
[google_news title=”” keyword=”lip-reading technology” num_posts=”10″ blurb_length=”0″ show_thumb=”left”]
via Google News
The Latest on: Lip-reading technology
- Lip Readers Uncover Prince William and Kate Middleton’s Secret Comments to Each Other on Their Wedding Dayon April 28, 2024 at 5:00 pm
The lip-reading expert told CBS (per Marie Claire) that William made a remark as if he was in disbelief about how many people packed the streets for their big day saying: “I hope I remember ...
- This bad lip-reading of Mark Zuckerberg’s Senate testimony is so much better than the real thingon April 24, 2024 at 5:00 pm
The Bad Lip Reading YouTube channel did just that, and the five-minute long video is everything you’d hope it would be. The makers stayed impressively true to its origins. Zuckerberg is given a ...
- This Lip Reading of What Taylor Swift Said to Travis Kelce at Coachella Is So Funnyon April 17, 2024 at 2:36 am
Celebrities pretty much can't step out in public ~these days~ without either an amateur or professional lip reader analyzing their conversation. Like, remember when everyone incorrectly thought John ...
- This Lip Reading of What Taylor Swift Said to Travis Kelce at Coachella Is So Funnyon April 16, 2024 at 5:01 pm
Celebrities pretty much can't step out in public ~these days~ without either an amateur or professional lip reader analyzing their conversation. Like, remember when everyone incorrectly thought ...
- Taylor Swift apologized to Travis Kelce for being drunk at Coachella: lip readeron April 16, 2024 at 11:04 am
“Disclaimer: Lip reading is not a reliable form of communication, all statements are alleged,” she wrote on both her TikTok and Instagram. In another clip, Swift is seen facing the stage with ...
- John Krasinskion October 19, 2023 at 5:00 pm
Emily Blunt and Selena Gomez are not here for the lip readers. The actresses pose for a photo seemingly poking fun at their recent lip reading scandals.
- Viral Video Of Ron DeSantis Saying ‘Mmm Hungwy’ Is Completely Fakeon July 15, 2023 at 3:56 pm
FOIA reporter and founder of Paleofuture.com, writing news and opinion on every aspect of technology ... is actually from a series called Bad Lip Reading, where videos are edited to make the ...
- Communication Strategies for Nurses Interacting With Patients Who Are Deafon May 3, 2022 at 12:36 pm
Health care providers may assume that lip reading is an effective form of communication. However, reliance on lip reading only should be considered an option when an ASL interpreter is not ...
- Lost for words? Automated lip reading technology deciphers speech in silent CCTV imageson May 17, 2016 at 3:26 am
images, but the University of East Anglia is pushing the next stage of this technology Scientists at the University of East Anglia in Norwich, England, are working on the next stage of automated lip ...
- New University of East Anglia lip reading technology could help solve crimeson March 25, 2016 at 1:02 am
New lip reading technology developed in Norfolk could help solve crimes by deciphering what people caught on CCTV are saying. The visual speech recognition technology developed by the University ...
via Bing News