Robots Learn To Understand Outdoor Scenes

Computer vision systems used by robots can now do a better job in understanding outdoor scenes, thanks to researchers at Carnegie Mellon University.


(Computers see outdoors)

“When people look at a photo, they understand that the scene is geometrically constrained,” said Abhinav Gupta, a post-doctoral fellow in CMU’s Robotics Institute. “We know that buildings aren’t infinitely thin, that most towers do not lean, and that heavy objects require support. It might not be possible to know the three-dimensional size and shape of all the objects in the photo, but we can narrow the possibilities. In the same way, if a computer can replicate an image, block by block, it can better understand the scene.”

This novel approach to automated scene analysis could eventually be used to understand not only the objects in a scene, but the spaces in between them and what might lie behind areas obscured by objects in the foreground, said Alexei A. Efros, associate professor of robotics and computer science at CMU. That level of detail would be important, for instance, if a robot needed to plan a route where it might walk, he noted.

In the new method devised by Gupta, Efros and Hebert, the image is first broken into various segments corresponding to objects in the image. Once the ground and sky are identified, other segments are assigned potential geometric shapes. The shapes also are categorized as light or heavy, depending on appearance; a surface that appears to be a brick wall, for instance, would be classified as heavy.

The computer then attempts to reconstruct the image using the virtual blocks. If a heavy block appears unsupported, the computer must substitute an appropriately shaped block, or make assumptions that the original block was obscured in the original image.

This capability is assumed by science fiction writers like Philip K. Dick, whose "leadies" from his 1964 novel The Penultimate Truth were robots that roamed the surface of the earth while most of humanity was kept underground.

From CMU.

Scroll down for more stories in the same category. (Story submitted 9/13/2010)

Follow this kind of news @Technovelgy.

| Email | RSS | Blog It | Stumble | del.icio.us | Digg | Reddit |

Would you like to contribute a story tip? It's easy:
Get the URL of the story, and the related sf author, and add it here.

Comment/Join discussion ( 0 )

Related News Stories - (" Robotics ")

Unusual Twist On Woman Dates Robot
'My hearing, vision and awareness went along with that excellent imitation of a young Adonis...' - Manly Wade Wellman, 1938.

Blood Battery Robotic Fish
'With one fluid motion, it surged forward, plunged, and was gone.'- Michael Swanwick, 2002.

Bee+ Robobee Now With Four Wings
'It was a tiny thing, scarcely more than an inch and a half in length...' - Raymond Z. Gallun, 1936.

Jeff Bezos Tries Waldoes (Robotic Hands)
'Waldo put his arms into the primary pair before him...' - Robert Heinlein, 1942.

 

Google
  Web TechNovelgy.com   

Technovelgy (that's tech-novel-gee!) is devoted to the creative science inventions and ideas of sf authors. Look for the Invention Category that interests you, the Glossary, the Invention Timeline, or see what's New.

 

 

 

 

 

Current News

Michelin Self-Sealing Tires On Ford's Explorer
'...a seal of compressed plastifoam to save the air.'

Mushroom Eats Plastic, Saves Planet
Fungus Amongus, SaveUs!

Juggalo Face Paint Disrupts Facial Recognition
'... designed to foil facial recognition systems.'

Mojipic Smart Voice Vehicle Emojis
KITT, what's your response?

Unusual Twist On Woman Dates Robot
'My hearing, vision and awareness went along with that excellent imitation of a young Adonis...'

BrainNet Triple Telepathic Gaming Threat
'In the gloomy half-darkness the three idiots sat babbling.'

AVAS Noisemakers Required For EVs By EU
'...a sound tape to supply the noise of a soi-disant "[internal combustion]" engine...'

Pun Generation Via Neural Nets
'You said you wanted him to be able to distinguish between laugh-power in different gags...'

Blood Battery Robotic Fish
'With one fluid motion, it surged forward, plunged, and was gone.'

Lightyear One Solar-Powered Electric Car (Design By Heinlein)
'It drew its power from six square yards of sunpower screens on its low curved roof.'

'Agression Detectors' Don't Work When Spying On Students
'The professional agitators had also learned how to modulate their voices below the danger level...'

Mining Of Golden Asteroid Foretold In 1898 Science Fiction
'This must be a golden planet—this little asteroid.'

Miners! NASA Wants To License RASSOR Excavator
'The borers had been dismantled and packed away.'

Bee+ Robobee Now With Four Wings
'It was a tiny thing, scarcely more than an inch and a half in length...'

CNSILK Robotic Spider Builder
'We could certainly spin a web right through the Solar System, if we can think of a good use for one.'

Starshade Will Help Space Telescope To Search For Exoplanets
'When it found planetary systems in its field, automatically shifted upon them a higher powered telespectroscope ...'

More SF in the News Stories

More Beyond Technovelgy science news stories

Home | Glossary | Invention Timeline | Category | New | Contact Us | FAQ | Advertise |
Technovelgy.com - where science meets fiction™

Copyright© Technovelgy LLC; all rights reserved.