Robots Learn To Understand Outdoor Scenes

Computer vision systems used by robots can now do a better job in understanding outdoor scenes, thanks to researchers at Carnegie Mellon University.


(Computers see outdoors)

“When people look at a photo, they understand that the scene is geometrically constrained,” said Abhinav Gupta, a post-doctoral fellow in CMU’s Robotics Institute. “We know that buildings aren’t infinitely thin, that most towers do not lean, and that heavy objects require support. It might not be possible to know the three-dimensional size and shape of all the objects in the photo, but we can narrow the possibilities. In the same way, if a computer can replicate an image, block by block, it can better understand the scene.”

This novel approach to automated scene analysis could eventually be used to understand not only the objects in a scene, but the spaces in between them and what might lie behind areas obscured by objects in the foreground, said Alexei A. Efros, associate professor of robotics and computer science at CMU. That level of detail would be important, for instance, if a robot needed to plan a route where it might walk, he noted.

In the new method devised by Gupta, Efros and Hebert, the image is first broken into various segments corresponding to objects in the image. Once the ground and sky are identified, other segments are assigned potential geometric shapes. The shapes also are categorized as light or heavy, depending on appearance; a surface that appears to be a brick wall, for instance, would be classified as heavy.

The computer then attempts to reconstruct the image using the virtual blocks. If a heavy block appears unsupported, the computer must substitute an appropriately shaped block, or make assumptions that the original block was obscured in the original image.

This capability is assumed by science fiction writers like Philip K. Dick, whose "leadies" from his 1964 novel The Penultimate Truth were robots that roamed the surface of the earth while most of humanity was kept underground.

From CMU.

Scroll down for more stories in the same category. (Story submitted 9/13/2010)

Follow this kind of news @Technovelgy.

| Email | RSS | Blog It | Stumble | del.icio.us | Digg | Reddit |

Would you like to contribute a story tip? It's easy:
Get the URL of the story, and the related sf author, and add it here.

Comment/Join discussion ( 0 )

Related News Stories - (" Robotics ")

DIY Autonomous Robot Detects Trash
'The search-bug detached itself and rolled forward.' - Philip K. Dick

When Robots Beg For Their Lives
"Just what do you think you're doing... Dave.'

SRI MicroFactory Of Microrobots Recalls Dick's Autofac
'Microscopic machinery, smaller than ants... constructing something...' - Philip K. Dick, 1955.

Rolls Royce 'Cockroach-Sized' Repair Robots To Crawl Inside Engines
'As if swarms of tiny animals were busily scurrying...' - Stanislaw Lem, 1954.

 

Google
  Web TechNovelgy.com   

Technovelgy (that's tech-novel-gee!) is devoted to the creative science inventions and ideas of sf authors. Look for the Invention Category that interests you, the Glossary, the Invention Timeline, or see what's New.

 

 

 

 

 

Current News

PAL-V Liberty Flying Helicopter Car
'...lifted themselves to skimming flight upon whirling helicopters."

Space Drones - UK's Effective Space To Launch Rocket Tugs
'Twenty rocket tugs towed it from its Earth hangar out into space.'

DIY Autonomous Robot Detects Trash
'The search-bug detached itself and rolled forward.'

Ancient Russian Walking Excavator Would Be Perfect RV
I don't need it to go fast, it just needs to amble along.

ELROI Satellite 'License Plate'
Robert Heinlein was thinking about this in 1941.

When Robots Beg For Their Lives
"Just what do you think you're doing... Dave.'

Do You Still Want A Folding Screen Phone?
'A paper thin polycarbon screen unfurled...'

'Snapchat Dysmorphia' Now A Thing, Say Plastic Surgeons
'The program raced up the screen one scan line at a time, subtly smoothing, deleting and coloring.'

Quiet Electric Cars Law Finalized By US Transportation Department
'... a sound tape to supply the noise'

Drone Assassin Fails To Kill Venezuelan President
'The spotter descends, and we think it searches the vicinity, looking for the victim's face...'

Stick-On Tape Speakers, As Predicted By Bruce Sterling
Flexible tape speakers, someday.

Bezos Invites You To New Life In Off-World Colonies
'A new life awaits you!'

Amazon's Rekognition System Sees Criminals In Congress
'... the imprint of her image on the telephoto cell.'

Build Your Own Space Suit For Cheap
'I'm going to pump the air from this room... so that the interior will be like airless and pressure-less space.'

CIMON Space Sidekick For Weary Astronauts
I welcome our floating robotic assistants.

SRI MicroFactory Of Microrobots Recalls Dick's Autofac
'Microscopic machinery, smaller than ants... constructing something...'

More SF in the News Stories

More Beyond Technovelgy science news stories

Home | Glossary | Invention Timeline | Category | New | Contact Us | FAQ | Advertise |
Technovelgy.com - where science meets fiction™

Copyright© Technovelgy LLC; all rights reserved.