Computers Learning To Read Lips

Visual speech recognition - computer assisted lip reading - developed at the University of East Anglia - could help in a variety of areas.

The visual speech recognition technology, created by Helen L. Bear, PhD, and Prof Richard Harvey of UEA’s School of Computing Sciences, can be applied “any place where the audio isn’t good enough to determine what people are saying,” Bear said. Those include criminal investigations, entertainment, and especially where are there are high levels of noise, such as in cars or aircraft cockpits, she said.

Bear said unique problems with determining speech arise when sound isn’t available — such as on video footage — or if the audio is inadequate and there aren’t clues to give the context of a conversation. Or on those ubiquitous annoying videos with music that masks speech. The sounds ‘/p/,’ ‘/b/,’ and ‘/m/’ all look similar on the lips, but now the machine lip-reading classification technology can differentiate between the sounds for a more accurate translation.

“We are still learning the science of visual speech and what it is people need to know to create a fool-proof recognition model for lip-reading, but this classification system improves upon previous lip-reading methods by using a novel training method for the classifiers,” said Bear.

Science fiction fans have seen this future before. In the film 2001:A Space Odyssey, the HAL 9000 computer was able to read lips.


(HAL 9000 [background] eavesdrops on astronauts Poole and Bowman)

In the film, HAL's increasingly erratic behavior becomes a matter of concern for the astronauts. Since HAL can effectively monitor every part of the ship, the astronauts retire to a small pod to discuss the matter. Unfortunately, it turns out that somebody did research on computer lip-reading, and so HAL was on to them, with very unfortunate results for Poole.

Via KurzweilAI.

Scroll down for more stories in the same category. (Story submitted 3/17/2016)

Follow this kind of news @Technovelgy.

| Email | RSS | Blog It | Stumble | del.icio.us | Digg | Reddit |

Would you like to contribute a story tip? It's easy:
Get the URL of the story, and the related sf author, and add it here.

Comment/Join discussion ( 0 )

Related News Stories - (" Artificial Intelligence ")

Datagrid Model Generation Perfect For Eternal Cities Of Science Fiction
'... there was enough flexibility to allow for wide variation. - Arthur C. Clarke, 1956.

Amazon Echo And Google Home Should Have Morality Software
'The Dwoskin Morality Rating-Computer could 'spot the slightest tendency to deviation' from the social norm...' - Kendall Foster Crossen, 1953.

Deepfakes From OpenAI GPT-2 Algorithm
'How can you compete with an IBM heavy-duty logomatic analogue?' - JG Ballard, 1971.

Fishy Facial Recognition Now Possible
'Palenkis can identify random line patterns better than any other species in the universe.' - Frank Herbert, 1969.

 

Google
  Web TechNovelgy.com   

Technovelgy (that's tech-novel-gee!) is devoted to the creative science inventions and ideas of sf authors. Look for the Invention Category that interests you, the Glossary, the Invention Timeline, or see what's New.

 

 

 

 

 

Current News

Skin Electronics Can Show Electrocardiogram
'... the young men in the streets who applied polyimde OLED body film to their bared shoulders.'

Chinese Fern Helps Remediate Arsenic Soil
'Bioengeering had put out a spec report on the long crawly things five months back.'

Skai Air Taxi Costs The Same As Uber
'The air-taxi found its way past and around other ground-cars...'

Neurodevices For Consumers? Neuroethicists (And Philip K Dick) Say 'Caveat Emptor'
'They tried to use it today and it wouldn't work. No colors and no ceph patterns, neither one...'

NASA 3D Printed Habitat Challenge Won By AI SpaceFactory
3D printing - on Mars!

The Future Of Elon Musk's Neuralink
'Cerebral Electromagnetic Emmission Amplification and Relay System — call it artificial telepathy, if you like.'

Researchers Make You Say Anything in Videos
'[It] caused his televised image... to mouth the vowels and consonants beautifully.'

Jeff Bezos Tries Waldoes (Robotic Hands)
'Waldo put his arms into the primary pair before him...'

Asimov and Musk - Boring Company Tunnel vs. Street Race
'There was almost no sound, just a steady velvety whirr as the taxi sped along.'

Project Dylan - Amazon's Voice-Activated Wearable That Recognizes Human Emotions
Life imitates anime art.

Tesla Diagnoses Itself, Sends Part Request
'Tentacles emerged from the side of the machine and felt puzzledly at the damaged area.'

Lilium Electric Air Taxi Prototype
'The air-taxi found its way past and around other ground-cars...'

Swedes Premiere T-Pod Driverless Electric Truck
'the trucks gulped packages and scurried like beetles...'

HEL TVD Laser System To Be Built By Dynetics Lockheed Martin
'Forthwith flashes of actual flame, a bright glare leaping from one to another, sprang from the scattered group of men.'

Alcarelle Synthetic Alcohol Like Star Trek Synthehol
Bottoms up!

Datagrid Model Generation Perfect For Eternal Cities Of Science Fiction
'... there was enough flexibility to allow for wide variation.

More SF in the News Stories

More Beyond Technovelgy science news stories

Home | Glossary | Invention Timeline | Category | New | Contact Us | FAQ | Advertise |
Technovelgy.com - where science meets fiction™

Copyright© Technovelgy LLC; all rights reserved.