Computers Learning To Read Lips

Visual speech recognition - computer assisted lip reading - developed at the University of East Anglia - could help in a variety of areas.

The visual speech recognition technology, created by Helen L. Bear, PhD, and Prof Richard Harvey of UEA’s School of Computing Sciences, can be applied “any place where the audio isn’t good enough to determine what people are saying,” Bear said. Those include criminal investigations, entertainment, and especially where are there are high levels of noise, such as in cars or aircraft cockpits, she said.

Bear said unique problems with determining speech arise when sound isn’t available — such as on video footage — or if the audio is inadequate and there aren’t clues to give the context of a conversation. Or on those ubiquitous annoying videos with music that masks speech. The sounds ‘/p/,’ ‘/b/,’ and ‘/m/’ all look similar on the lips, but now the machine lip-reading classification technology can differentiate between the sounds for a more accurate translation.

“We are still learning the science of visual speech and what it is people need to know to create a fool-proof recognition model for lip-reading, but this classification system improves upon previous lip-reading methods by using a novel training method for the classifiers,” said Bear.

Science fiction fans have seen this future before. In the film 2001:A Space Odyssey, the HAL 9000 computer was able to read lips.


(HAL 9000 [background] eavesdrops on astronauts Poole and Bowman)

In the film, HAL's increasingly erratic behavior becomes a matter of concern for the astronauts. Since HAL can effectively monitor every part of the ship, the astronauts retire to a small pod to discuss the matter. Unfortunately, it turns out that somebody did research on computer lip-reading, and so HAL was on to them, with very unfortunate results for Poole.

Via KurzweilAI.

Scroll down for more stories in the same category. (Story submitted 3/17/2016)

Follow this kind of news @Technovelgy.

| Email | RSS | Blog It | Stumble | del.icio.us | Digg | Reddit |

Would you like to contribute a story tip? It's easy:
Get the URL of the story, and the related sf author, and add it here.

Comment/Join discussion ( 0 )

Related News Stories - (" Artificial Intelligence ")

Orwell's Memory Hole Looms Larger Thanks To Nvidia
'All history was a palimpsest, scraped clean and reinscribed exactly as often as was necessary.' - George Orwell, 1948.

SciFiQ Science Fiction Writing Aid
'Books were just a commodity that had to be produced, like jam or bootlaces.' - George Orwell, 1948.

Elon Musk Fears A 'Fleet-Wide Hack' Of Autonomous Vehicles
'Khan grinned. 'It's alive! Bu-wahhahahah!''

Shelley.ai AI Terrifies Thanks To Reddit's Nosleep
'How can you compete with IBM?' - JG Ballard, 1971.

 

Google
  Web TechNovelgy.com   

Technovelgy (that's tech-novel-gee!) is devoted to the creative science inventions and ideas of sf authors. Look for the Invention Category that interests you, the Glossary, the Invention Timeline, or see what's New.

 

 

 

 

 

Current News

Fungi-Infused Concrete Repairs Itself
'I noticed that curious mottled knots were forming, indicating where the room had been strained and healed faultily.'

Shiftwear Display Shoes
'He unlaced her shoe and glanced at its readout.'

NASA SEXTANT First With X-Ray Nav In Space
'You need at least four beacons for an accurate fix.'

GM Introduces Cruise AV With No Steering Wheel
'How about the steering wheel?' ... 'I do not need one.'

Subsurface Martian Ice Slabs Piece Of Cake For Miners
'One shy little fellow with bloodshot eyes of old-time drillman stood up. 'I'm an ice miner,' he said.'

LG Rollable Version Of Niven's Poster TV
'A television that unrolled like a poster.'

Multi-Robot Farming On Highly Sloped Land
High Plains, indeed.

Aeolus Robot Brings Jetson's Rosie Closer
Domestic duties, robotically performed.

Sony's New, Cuter Aibo Robot Puppy
Engineered to be adorable.

Earth-1 Transformer Gundam Car
Is it a Gundam? Or maybe a Transformer.

Self-Driving Domino's Pizza Car
Yes, but can it negotiate entry at your Burbclave?

I Want Massive Space Freighters!
Ah, the space freighters of old.

When Will The Feds Ban Human Drivers?
'The first laws came out forcing the old machines off the highways...'

Our World Formed In A Bubble?
'The Worldcraft bubble glittered, catching the light...'

Will You Live To See EM Pulse Scattering By Ships Nearing Light Speed?
'...half a million kilometers away, the Stardrive went on.'

Jabil Integrated Textile Heart Monitoring
'Della's first present was an imipolex sweatshirt called a heartshirt…'

More SF in the News Stories

More Beyond Technovelgy science news stories

Home | Glossary | Invention Timeline | Category | New | Contact Us | FAQ | Advertise |
Technovelgy.com - where science meets fiction™

Copyright© Technovelgy LLC; all rights reserved.