New lip-reading technology developed at the University of East Anglia could help in solving crimes and provide communication assistance for people with hearing and speech impairments.
The visual speech recognition technology, created by Dr Helen L. Bear and Prof Richard Harvey of UEA’s School of Computing Sciences, can be applied “any place where the audio isn’t good enough to determine what people are saying,” Dr Bear said.
Dr Bear, whose findings will be presented at the International Conference on Acoustics, Speech and Signal Processing (ICASSP) in Shanghai on March 25, said unique problems with determining speech arise when sound isn’t available – such as on CCTV footage – or if the audio is inadequate and there aren’t clues to give the context of a conversation. The sounds ‘/p/,’ ‘/b/,’ and ‘/m/’ all look similar on the lips, but now the machine lip-reading classification technology can differentiate between the sounds for a more accurate translation.
Dr Bear said: “We are still learning the science of visual speech and what it is people need to know to create a fool-proof recognition model for lip-reading, but this classification system improves upon previous lip-reading methods by using a novel training method for the classifiers.
“Potentially, a robust lip-reading system could be applied in a number of situations, from criminal investigations to entertainment. Lip-reading has been used to pinpoint words footballers have shouted in heated moments on the pitch, but is likely to be of most practical use in situations where are there are high levels of noise, such as in cars or aircraft cockpits.
“Crucially, whilst there are still improvements to be made, such a system could be adapted for use for a range of purposes – for example, for people with hearing or speech impairments. Alternatively, a good lip-reading machine could be part of an audio-visual recognition system.”
Prof Harvey said: “Lip-reading is one of the most challenging problems in artificial intelligence so it’s great to make progress on one of the trickier aspects, which is how to train machines to recognise the appearance and shape of human lips.”
Learn more: Read my lips: New technology spells out what’s said when audio fails
The Latest on: Lip-reading technology
[google_news title=”” keyword=”lip-reading technology” num_posts=”10″ blurb_length=”0″ show_thumb=”left”]
via Google News
The Latest on: Lip-reading technology
- Study says playing with dogs may help you focus and relaxon April 26, 2024 at 12:39 pm
The lip also serves as a pillow. It comes in 11 colors and in six sizes. This pillow-like dog bed is a great addition to the corners of rooms so your furry friend has their own seat wherever you go.
- An AI startup made a hyperrealistic deepfake of me that’s so good it’s scaryon April 24, 2024 at 9:59 pm
Synthesia's new technology is impressive but raises big questions about a world where we increasingly can’t tell what’s real.
- This Plumping Lip Treatment Instantly Doubles Your Lip Volume & Reviewers Say the Results Last For Hourson April 24, 2024 at 11:01 am
The brand recommends using the plumper in conjunction with the GloPRO Lip Attachment for further benefits, like reducing the look of fine lines and feathering. To reach maximum plumpness, roll the ...
- Mercedes explores electric frontier with G-Wagen off-roaderon April 24, 2024 at 10:09 am
The G 580 retains the iconic boxy ladder frame design but ditches a combustion engine for a quartet of electric motors and a hefty 116-kilowatt-hour battery.
- Ditch Your Lip Liner Pencil and Try This Viral, Peel-Off Tattoo Insteadon April 24, 2024 at 3:19 am
The "Lip Liner Stay-N" can be purchased on the brand's website for $30 USD. For more on makeup trends, check out our coverage of the viral "sunset blush" technique.
- Why Rachel Khong says novel ‘Real Americans’ explores issues society still faceson April 23, 2024 at 6:49 pm
The book, which involves questions arising from gene therapy, address questions of power, identity, privilege and immigration, says Khong ...
- The growing power of Chinese organized crime in Mexicoon April 23, 2024 at 10:28 am
The Sinaloa drug cartel in Mexico has had “more than two decades of relations with Chinese organized crime,” according to Brookings Institution Senior Fellow Vanda Felbab-Brown, who asserts that the ...
- What’s the Difference Between Solawave and NuFace?on April 19, 2024 at 1:33 pm
In the world of skin-care devices, the Solawave and NuFace are among the most popular. It’s rare that I go a few days without seeing someone talk about the way one of them changed their skin for the ...
- ‘Big Ocean,’ South Korea’s first idol group with hearing impairments is set to debuton April 18, 2024 at 7:22 pm
Big Ocean’, South Korea’s first idol group with hearing impairments, will debut on Apr. 20, coinciding with the Day of Persons with Disabilities in Korea. The group consists of rapper Lee Chan-yeon ...
- Beauty Boom & Social Media Drive US$ 3.5 Billion Lip Gloss Tube Market | FMIon April 15, 2024 at 8:56 pm
The global lip gloss tube market is positioned for significant expansion, with sales expected to almost treble to an estimated US$ 3.5 billion by 2032. Throughout the projected period (2022–2032), the ...
via Bing News