Robots Learn To Understand Outdoor Scenes

Computer vision systems used by robots can now do a better job in understanding outdoor scenes, thanks to researchers at Carnegie Mellon University.


(Computers see outdoors)

“When people look at a photo, they understand that the scene is geometrically constrained,” said Abhinav Gupta, a post-doctoral fellow in CMU’s Robotics Institute. “We know that buildings aren’t infinitely thin, that most towers do not lean, and that heavy objects require support. It might not be possible to know the three-dimensional size and shape of all the objects in the photo, but we can narrow the possibilities. In the same way, if a computer can replicate an image, block by block, it can better understand the scene.”

This novel approach to automated scene analysis could eventually be used to understand not only the objects in a scene, but the spaces in between them and what might lie behind areas obscured by objects in the foreground, said Alexei A. Efros, associate professor of robotics and computer science at CMU. That level of detail would be important, for instance, if a robot needed to plan a route where it might walk, he noted.

In the new method devised by Gupta, Efros and Hebert, the image is first broken into various segments corresponding to objects in the image. Once the ground and sky are identified, other segments are assigned potential geometric shapes. The shapes also are categorized as light or heavy, depending on appearance; a surface that appears to be a brick wall, for instance, would be classified as heavy.

The computer then attempts to reconstruct the image using the virtual blocks. If a heavy block appears unsupported, the computer must substitute an appropriately shaped block, or make assumptions that the original block was obscured in the original image.

This capability is assumed by science fiction writers like Philip K. Dick, whose "leadies" from his 1964 novel The Penultimate Truth were robots that roamed the surface of the earth while most of humanity was kept underground.

From CMU.

Scroll down for more stories in the same category. (Story submitted 9/13/2010)

Follow this kind of news @Technovelgy.

| Email | RSS | Blog It | Stumble | del.icio.us | Digg | Reddit |

Would you like to contribute a story tip? It's easy:
Get the URL of the story, and the related sf author, and add it here.

Comment/Join discussion ( 0 )

Related News Stories - (" Robotics ")

Flying Dragon Robot Transforms In Mid-Air
Terrific prototype video.

MXene Hydrogel Skin For Robots Flexes And Senses
'The plastex swam and whirled like boiling toothpaste...' - JG Ballard, 1962.

Drywall Robot Looking For Sheetrock
Sheetrockers have sure changed since my day. Speaking as someone who as done this, I welcome robots.

Robots Help People Get Dressed, As Predicted In 1931
Yes, people of the future, robots will dress you.

 

Google
  Web TechNovelgy.com   

Technovelgy (that's tech-novel-gee!) is devoted to the creative science inventions and ideas of sf authors. Look for the Invention Category that interests you, the Glossary, the Invention Timeline, or see what's New.

 

 

 

 

 

Current News

Wound Healing With Wearable Nanogenerators
'... forcing the energy transfer which allowed him to ... erase the other internal-external damage.'

Flying Dragon Robot Transforms In Mid-Air
Terrific prototype video.

Negative Matter Fluid Theorized In New Paper
'Of course, being negative matter, when you push it, it comes toward you..'

Grow Structures Upon Planetfall - Myco-Architecture
'They'll also start pulling in gases and liquids from the local atmosphere...'

MXene Hydrogel Skin For Robots Flexes And Senses
'The plastex swam and whirled like boiling toothpaste...'

EXPLORER, The First Total-Body Scanner
'The object is built up of an infinite series of plane layers, at the focus of the ray...'

UK Police AI To Stop Criminals Before They Strike
'... the computing mechanisms that studied and restructured the incoming material.'

Sonitus Audio Interface Positioned Beyond The Noise
'... an instrument having relatively small bit pieces adapted to be gripped between the teeth.'

Volvo's Self-Driving Mining Trucks
'A procession of automatic ore carts was racing over the bleak slag'

Audi Pop.Up Autonomous Electric Flying Car
'The cab was an egg-shaped bubble of light metals and plastics...'

Music Not Impossible (MNI) Vibrotactile Wearable Experience
Don't you want to experience the 'feely' effects?

Chinese Face Recognition Mistakes Bus Ad For Jaywalker
'... the imprint of her image on the telephoto cell.'

A Look Back At Apollo's Emergency Escape Vehicle
'A simple mechanism... it drove the iron ball through space like a ship.'

InMotion Glide 3 Electric Unicycle For The Last Mile
'...gyro-stabilized on a single wheel.'

China's Social Credit System - A Facebook-1984 Mashup
'Prestige, face, mana, repute, glory: the Sirenese word is strakh.'

Musk Declares Tesla Supercharger Capacity Will Double By Next Year
'Recharge the batteries... in almost every town and village...'

More SF in the News Stories

More Beyond Technovelgy science news stories

Home | Glossary | Invention Timeline | Category | New | Contact Us | FAQ | Advertise |
Technovelgy.com - where science meets fiction™

Copyright© Technovelgy LLC; all rights reserved.