New lip-reading technology developed at the University of East Anglia could help in solving crimes and provide communication assistance for people with hearing and speech impairments.
The visual speech recognition technology, created by Dr Helen L. Bear and Prof Richard Harvey of UEA’s School of Computing Sciences, can be applied “any place where the audio isn’t good enough to determine what people are saying,” Dr Bear said.
Dr Bear, whose findings will be presented at the International Conference on Acoustics, Speech and Signal Processing (ICASSP) in Shanghai on March 25, said unique problems with determining speech arise when sound isn’t available – such as on CCTV footage – or if the audio is inadequate and there aren’t clues to give the context of a conversation. The sounds ‘/p/,’ ‘/b/,’ and ‘/m/’ all look similar on the lips, but now the machine lip-reading classification technology can differentiate between the sounds for a more accurate translation.
Dr Bear said: “We are still learning the science of visual speech and what it is people need to know to create a fool-proof recognition model for lip-reading, but this classification system improves upon previous lip-reading methods by using a novel training method for the classifiers.
“Potentially, a robust lip-reading system could be applied in a number of situations, from criminal investigations to entertainment. Lip-reading has been used to pinpoint words footballers have shouted in heated moments on the pitch, but is likely to be of most practical use in situations where are there are high levels of noise, such as in cars or aircraft cockpits.
“Crucially, whilst there are still improvements to be made, such a system could be adapted for use for a range of purposes – for example, for people with hearing or speech impairments. Alternatively, a good lip-reading machine could be part of an audio-visual recognition system.”
Prof Harvey said: “Lip-reading is one of the most challenging problems in artificial intelligence so it’s great to make progress on one of the trickier aspects, which is how to train machines to recognise the appearance and shape of human lips.”
The Latest on: Lip-reading technology
via Google News
The Latest on: Lip-reading technology
- Liopa wins healthcare contract with new AI lip-reading technologyon October 18, 2021 at 6:00 pm
BELFAST-based technology specialist Liopa, which last year launched the world's first automated lip reader, has secured its first commercial contract with a UK based hospital for its artificial ...
- Belfast start-up Liopa gets licence to read lips in English hospitalon October 18, 2021 at 5:54 am
Belfast-based medtech Liopa has secured a contract for its lip-reading app to be used across inpatient units at the Royal Preston Hospital in England. The Invest NI-backed start-up has developed ...
- Liopa gets a yes for its speech-recognition softwareon October 17, 2021 at 9:45 pm
Invest Northern Ireland-backed software developer Liopa has won a contract to provide technology designed to aid speech recognition to Royal Preston Hospital in Britain. Spun out from the Queen’s ...
- Belfast company seals deal with Preston Hospital for lip reading technology which gives voice to the voicelesson October 17, 2021 at 4:01 pm
A Belfast company has signed its first commercial contract with a hospital in England for its lip-reading software. Liopa’s app helps patients who have lost the ability to speak – generally in ...
- Lip reading: Contract success for software firm Liopaon October 17, 2021 at 3:29 pm
A software business in Belfast has won its first contract with a UK hospital for its artificial intelligence lip-reading app.
- Our Editors Tested Shiseido's New Synchro Skin Tint, and We All Agree: It's Incredibleon October 15, 2021 at 10:17 am
The most obvious case for this is nude lipstick, as "nude" means different things to different people depending on your skin tone, natural lip color, and personal preference. But it really applies ...
- Big Launch Challenge Pitch Competition heldon October 15, 2021 at 9:02 am
The Launch Place received 64 applications for its Ninth Annual Big Launch Challenge Pitch Competition from various start-up companies located in the U.S. and abroad.
- AI startup with UNC roots takes home top prize at Big Launch Challengeon October 15, 2021 at 8:04 am
LiRA took home first place at the 9th Annual Big Launch Challenge Pitch Competition, held Thursday at the North Carolina Biotechnology Center.
- Developer of voice restoration software takes top prize in Big Launch Challengeon October 15, 2021 at 7:51 am
LiRA is developing next-generation voice restoration software through an AI-based lip-reading platform designed to empower voiceless individuals and advance the quality of care they receive. On Thursd ...
via Bing News