Robots Learn To Understand Outdoor Scenes

Computer vision systems used by robots can now do a better job in understanding outdoor scenes, thanks to researchers at Carnegie Mellon University.


(Computers see outdoors)

“When people look at a photo, they understand that the scene is geometrically constrained,” said Abhinav Gupta, a post-doctoral fellow in CMU’s Robotics Institute. “We know that buildings aren’t infinitely thin, that most towers do not lean, and that heavy objects require support. It might not be possible to know the three-dimensional size and shape of all the objects in the photo, but we can narrow the possibilities. In the same way, if a computer can replicate an image, block by block, it can better understand the scene.”

This novel approach to automated scene analysis could eventually be used to understand not only the objects in a scene, but the spaces in between them and what might lie behind areas obscured by objects in the foreground, said Alexei A. Efros, associate professor of robotics and computer science at CMU. That level of detail would be important, for instance, if a robot needed to plan a route where it might walk, he noted.

In the new method devised by Gupta, Efros and Hebert, the image is first broken into various segments corresponding to objects in the image. Once the ground and sky are identified, other segments are assigned potential geometric shapes. The shapes also are categorized as light or heavy, depending on appearance; a surface that appears to be a brick wall, for instance, would be classified as heavy.

The computer then attempts to reconstruct the image using the virtual blocks. If a heavy block appears unsupported, the computer must substitute an appropriately shaped block, or make assumptions that the original block was obscured in the original image.

This capability is assumed by science fiction writers like Philip K. Dick, whose "leadies" from his 1964 novel The Penultimate Truth were robots that roamed the surface of the earth while most of humanity was kept underground.

From CMU.

Scroll down for more stories in the same category. (Story submitted 9/13/2010)

Follow this kind of news @Technovelgy.

| Email | RSS | Blog It | Stumble | del.icio.us | Digg | Reddit |

Would you like to contribute a story tip? It's easy:
Get the URL of the story, and the related sf author, and add it here.

Comment/Join discussion ( 0 )

Related News Stories - (" Robotics ")

Autonomous Robots Navigate Like Rats
'Out of warrens in the wall, tiny robot mice darted.' - Ray Bradbury, 1950.

SINTEF Robot Cleans Solar Panels
'The window cleaners, with large padded feet...' - Arthur C. Clarke, 1972.

How Rude! DARPA Wants Robots To Behave More Like Threepio
'Do I know protocol? Why, it's my primary function.' - George Lucas, 1976.

Buddy Companion Robot Your Bulbous Friend
'Nanny was built in the shape of a sphere, a large metal sphere, flattened on the bottom...' - Philip K. Dick, 1955.

 

Google
  Web TechNovelgy.com   

Technovelgy (that's tech-novel-gee!) is devoted to the creative science inventions and ideas of sf authors. Look for the Invention Category that interests you, the Glossary, the Invention Timeline, or see what's New.

 

 

 

 

 

Current News

TALOS Exoskeleton Development Proceeding
'Suited up, you look like a big steel gorilla...'

Autonomous Robots Navigate Like Rats
'Out of warrens in the wall, tiny robot mice darted.'

SINTEF Robot Cleans Solar Panels
'The window cleaners, with large padded feet...'

Pangorin Restaurant Service Robots
What'll you have? Jawa juice?

Drug Creates Real Melanin Tan
I've used them all my life...

Medical Drones Hover Like Angels Near You
'The death-reversal equipment is on its way...'

SkEye Amazing Israeli Gigapixel Drone
'An eye that could not only see, but fly...'

How Rude! DARPA Wants Robots To Behave More Like Threepio
'Do I know protocol? Why, it's my primary function.'

'Liquid Light' Flows Around Corners
Light as a superfluid.

Unrolling The Filmy Materials Of Space Tech
'When unfolded and unrolled... it became a tough, gleaming film.'

Buddy Companion Robot Your Bulbous Friend
'Nanny was built in the shape of a sphere, a large metal sphere, flattened on the bottom...'

Poli-X1 Prototype Bee Pollinator
Is there anything drones can't do?

Bake in Space Bake-Off... In Space!
'A joyous condition commenced for the cook in the electric kitchen...'

DeepMind AI Baffled By Homer Simpson, Needs Human Help
'Whenever a robot finds something it can't identify straight off...'

Does Earth's Middle Mantle Hold Oceans Of Water?
Al Gore, you have no idea.

Vaccine Blocks Heroin High
'You're biochemically incapable of getting off...'

More SF in the News Stories

More Beyond Technovelgy science news stories

Home | Glossary | Invention Timeline | Category | New | Contact Us | FAQ | Advertise |
Technovelgy.com - where science meets fiction™

Copyright© Technovelgy LLC; all rights reserved.