Computers Learning To Read Lips

Visual speech recognition - computer assisted lip reading - developed at the University of East Anglia - could help in a variety of areas.

The visual speech recognition technology, created by Helen L. Bear, PhD, and Prof Richard Harvey of UEA’s School of Computing Sciences, can be applied “any place where the audio isn’t good enough to determine what people are saying,” Bear said. Those include criminal investigations, entertainment, and especially where are there are high levels of noise, such as in cars or aircraft cockpits, she said.

Bear said unique problems with determining speech arise when sound isn’t available — such as on video footage — or if the audio is inadequate and there aren’t clues to give the context of a conversation. Or on those ubiquitous annoying videos with music that masks speech. The sounds ‘/p/,’ ‘/b/,’ and ‘/m/’ all look similar on the lips, but now the machine lip-reading classification technology can differentiate between the sounds for a more accurate translation.

“We are still learning the science of visual speech and what it is people need to know to create a fool-proof recognition model for lip-reading, but this classification system improves upon previous lip-reading methods by using a novel training method for the classifiers,” said Bear.

Science fiction fans have seen this future before. In the film 2001:A Space Odyssey, the HAL 9000 computer was able to read lips.


(HAL 9000 [background] eavesdrops on astronauts Poole and Bowman)

In the film, HAL's increasingly erratic behavior becomes a matter of concern for the astronauts. Since HAL can effectively monitor every part of the ship, the astronauts retire to a small pod to discuss the matter. Unfortunately, it turns out that somebody did research on computer lip-reading, and so HAL was on to them, with very unfortunate results for Poole.

Via KurzweilAI.

Scroll down for more stories in the same category. (Story submitted 3/17/2016)

Follow this kind of news @Technovelgy.

| Email | RSS | Blog It | Stumble | del.icio.us | Digg | Reddit |

Would you like to contribute a story tip? It's easy:
Get the URL of the story, and the related sf author, and add it here.

Comment/Join discussion ( 0 )

Related News Stories - (" Artificial Intelligence ")

DeepMind AI Baffled By Homer Simpson, Needs Human Help
'Whenever a robot finds something it can't identify straight off...' - Harry Harrison, 1956.

Deep Learning Creates New Faces
'a million and a half physiognomic fraction-representations of various people...' - Philip K. Dick, 1977.

Xiaoice AI Now A Poet
'How can you compete with an IBM heavy-duty logomatic analogue?'- JG Ballard, 1971.

Artificial Intelligence Software Predicts Lifespan
'The doctor... went behind his apparatus... exposed dials came to life and a low humming came from the machine...' - Robert Heinlein, 1939.

 

Google
  Web TechNovelgy.com   

Technovelgy (that's tech-novel-gee!) is devoted to the creative science inventions and ideas of sf authors. Look for the Invention Category that interests you, the Glossary, the Invention Timeline, or see what's New.

 

 

 

 

 

Current News

TALOS Exoskeleton Development Proceeding
'Suited up, you look like a big steel gorilla...'

Autonomous Robots Navigate Like Rats
'Out of warrens in the wall, tiny robot mice darted.'

SINTEF Robot Cleans Solar Panels
'The window cleaners, with large padded feet...'

Pangorin Restaurant Service Robots
What'll you have? Jawa juice?

Drug Creates Real Melanin Tan
I've used them all my life...

Medical Drones Hover Like Angels Near You
'The death-reversal equipment is on its way...'

SkEye Amazing Israeli Gigapixel Drone
'An eye that could not only see, but fly...'

How Rude! DARPA Wants Robots To Behave More Like Threepio
'Do I know protocol? Why, it's my primary function.'

'Liquid Light' Flows Around Corners
Light as a superfluid.

Unrolling The Filmy Materials Of Space Tech
'When unfolded and unrolled... it became a tough, gleaming film.'

Buddy Companion Robot Your Bulbous Friend
'Nanny was built in the shape of a sphere, a large metal sphere, flattened on the bottom...'

Poli-X1 Prototype Bee Pollinator
Is there anything drones can't do?

Bake in Space Bake-Off... In Space!
'A joyous condition commenced for the cook in the electric kitchen...'

DeepMind AI Baffled By Homer Simpson, Needs Human Help
'Whenever a robot finds something it can't identify straight off...'

Does Earth's Middle Mantle Hold Oceans Of Water?
Al Gore, you have no idea.

Vaccine Blocks Heroin High
'You're biochemically incapable of getting off...'

More SF in the News Stories

More Beyond Technovelgy science news stories

Home | Glossary | Invention Timeline | Category | New | Contact Us | FAQ | Advertise |
Technovelgy.com - where science meets fiction™

Copyright© Technovelgy LLC; all rights reserved.