Computers Learning To Read Lips

Visual speech recognition - computer assisted lip reading - developed at the University of East Anglia - could help in a variety of areas.

The visual speech recognition technology, created by Helen L. Bear, PhD, and Prof Richard Harvey of UEA’s School of Computing Sciences, can be applied “any place where the audio isn’t good enough to determine what people are saying,” Bear said. Those include criminal investigations, entertainment, and especially where are there are high levels of noise, such as in cars or aircraft cockpits, she said.

Bear said unique problems with determining speech arise when sound isn’t available — such as on video footage — or if the audio is inadequate and there aren’t clues to give the context of a conversation. Or on those ubiquitous annoying videos with music that masks speech. The sounds ‘/p/,’ ‘/b/,’ and ‘/m/’ all look similar on the lips, but now the machine lip-reading classification technology can differentiate between the sounds for a more accurate translation.

“We are still learning the science of visual speech and what it is people need to know to create a fool-proof recognition model for lip-reading, but this classification system improves upon previous lip-reading methods by using a novel training method for the classifiers,” said Bear.

Science fiction fans have seen this future before. In the film 2001:A Space Odyssey, the HAL 9000 computer was able to read lips.


(HAL 9000 [background] eavesdrops on astronauts Poole and Bowman)

In the film, HAL's increasingly erratic behavior becomes a matter of concern for the astronauts. Since HAL can effectively monitor every part of the ship, the astronauts retire to a small pod to discuss the matter. Unfortunately, it turns out that somebody did research on computer lip-reading, and so HAL was on to them, with very unfortunate results for Poole.

Via KurzweilAI.

Scroll down for more stories in the same category. (Story submitted 3/17/2016)

Follow this kind of news @Technovelgy.

| Email | RSS | Blog It | Stumble | del.icio.us | Digg | Reddit |

Would you like to contribute a story tip? It's easy:
Get the URL of the story, and the related sf author, and add it here.

Comment/Join discussion ( 0 )

Related News Stories - (" Artificial Intelligence ")

LipNet Reads Lips - Until Disconnected, That Is
'We'd have to cut his higher brain functions... I'm not sure what [HAL} would think about that.' - Arthur C. Clarke, 1968.

Pokerbot Libratus Learns To Lie (Bluff)
'Lying's a vital part of your psychological defense system - you're naked without it!' - Red Dwarf

Software Learns To Design Software
'... The rational use of computers to design more advanced computers.' - Isaac Asimov, 1958.

China Now Has Robot Journalists
'A vast complex electronic organism buried deep in the ground, responsible to no one...' - Philip K. Dick, 1963.

 

Google
  Web TechNovelgy.com   

Technovelgy (that's tech-novel-gee!) is devoted to the creative science inventions and ideas of sf authors. Look for the Invention Category that interests you, the Glossary, the Invention Timeline, or see what's New.

 

 

 

 

 

Current News

PassivDom 3D Printed House - What If You Could Live Anywhere?
'The houses are prefabricated units...'

Breakthrough In Manufacture Of Red Blood Cells
This blood's for you!

Caihong Solar-Powered Drone 'Atmospheric Satellite'
'... placed in the wings of a plane to generate power from the light falling on that surface.'

NASA Wants Low Earth Orbit Wifi
'This was the center of Interplanetary Communications.'

Is Genetic Testing At Businesses A Bad Idea?
It's not a topic that fares well in science fiction movies-

Wearable Smart Jacket
He pressed the button in his sleeve communicator and snapped: 'Action stations!'

Store One Bit On One Atom
'...each individual molecule has a meaning.'

Fluorescent Bacteria Fashion
'The racks of gowns itched and quivered, their colors running into blurred pools.'

Keith Laumer's Bolo Autonomous Tanks Right On Schedule
'I cannot lie idle under attack.'

When Computers Develop Their Own Language, Will They Talk To Us?
'The curious absent look of a robot talking on the TBR circuits - the Talk Between Robots radio...'

LipNet Reads Lips - Until Disconnected, That Is
'We'd have to cut his higher brain functions... I'm not sure what [HAL} would think about that.'

Eterni.me - To Skype With The Dead
'Nothing... left of Jeserac but a galaxy of electrons frozen in the heart of a crystal.'

Wearable MRI Is Former Occulus/Facebook Exec's New Project
'Your cephalochromoscope... that you always turn on and play when you get home...'

Ford Stratasys Infinte Build 3D Printer
'He proudly indicated his Buick... Almost as good as the original it was printed from...'

The Space Suit As Personal Spaceship
'Darn clever, these suits...'

Dune Fans! Your God Emperor Is Ready
'If one held a sandtrout in the hand, smoothing it over your skin, it formed a living glove.'

More SF in the News Stories

More Beyond Technovelgy science news stories

Home | Glossary | Invention Timeline | Category | New | Contact Us | FAQ | Advertise |
Technovelgy.com - where science meets fiction™

Copyright© Technovelgy LLC; all rights reserved.