Robots Learn To Understand Outdoor Scenes

Computer vision systems used by robots can now do a better job in understanding outdoor scenes, thanks to researchers at Carnegie Mellon University.


(Computers see outdoors)

“When people look at a photo, they understand that the scene is geometrically constrained,” said Abhinav Gupta, a post-doctoral fellow in CMU’s Robotics Institute. “We know that buildings aren’t infinitely thin, that most towers do not lean, and that heavy objects require support. It might not be possible to know the three-dimensional size and shape of all the objects in the photo, but we can narrow the possibilities. In the same way, if a computer can replicate an image, block by block, it can better understand the scene.”

This novel approach to automated scene analysis could eventually be used to understand not only the objects in a scene, but the spaces in between them and what might lie behind areas obscured by objects in the foreground, said Alexei A. Efros, associate professor of robotics and computer science at CMU. That level of detail would be important, for instance, if a robot needed to plan a route where it might walk, he noted.

In the new method devised by Gupta, Efros and Hebert, the image is first broken into various segments corresponding to objects in the image. Once the ground and sky are identified, other segments are assigned potential geometric shapes. The shapes also are categorized as light or heavy, depending on appearance; a surface that appears to be a brick wall, for instance, would be classified as heavy.

The computer then attempts to reconstruct the image using the virtual blocks. If a heavy block appears unsupported, the computer must substitute an appropriately shaped block, or make assumptions that the original block was obscured in the original image.

This capability is assumed by science fiction writers like Philip K. Dick, whose "leadies" from his 1964 novel The Penultimate Truth were robots that roamed the surface of the earth while most of humanity was kept underground.

From CMU.

Scroll down for more stories in the same category. (Story submitted 9/13/2010)

Follow this kind of news @Technovelgy.

| Email | RSS | Blog It | Stumble | del.icio.us | Digg | Reddit |

Would you like to contribute a story tip? It's easy:
Get the URL of the story, and the related sf author, and add it here.

Comment/Join discussion ( 0 )

Related News Stories - (" Robotics ")

Robot Buddhist Priest Chants, Drums
'He crossed the waiting room to the Padre booth...' - Philip K. Dick, 1969.

X2-VelociRoACH Cooperates To Launch Tiny Drones
Little robots cooperating can do big tasks. Eventually.

An 'Ethical Black Box' For Robots?
Explored by science fiction authors.

Kino Project Roaming Personal Fashion Robots
'Most of the crew have the tiny imp ride on their shoulder...' - Robert Forward, 1985.

 

Google
  Web TechNovelgy.com   

Technovelgy (that's tech-novel-gee!) is devoted to the creative science inventions and ideas of sf authors. Look for the Invention Category that interests you, the Glossary, the Invention Timeline, or see what's New.

 

 

 

 

 

Current News

Eden-ISS, Greenhouse In Antarctica
'With this kind of light we could get the gardens going again."

Make Space Tools On The Spot (Like Moties)
'A moment ago it was squeezing silver toothpaste in a ribbon...'

Will Robots Be Moral If We Raise Them Like Our Children?
'The birth of Machine, my robot child...'

Foldable Galaxy Phones, I Swear They're Coming (Maybe)
How hard can it be?

Bacteria Behave Differently In Space
'The Republic struggled to control its Sours...'

Brain Connected To Internet - ‘Brainternet'
Fascinating!

Artificial Spider Silk
You can also use it to make a roof - on an asteroid.

MIT Tunes Ions For Frictionless Surface - Superlubricity!
'My telelubricator here neutralizes the interatomic bonds the surface of any solid...'

Seiko Astron Always Knows Your Time Zone
'Harrington glanced at his wrist watch - a bulky affair - and whistled.'

Robot Buddhist Priest Chants, Drums
'He crossed the waiting room to the Padre booth...'

Koniku Kore, Mouse Brain-Based Chip, Detects Explosives
'As a matter of fact, this mouse is going to keep on thinking forever.'

CNH Industrial Autonomous Tractor Concept Video
'...the tiny red glints of self-guided tractors.'

The Neuroon Open Sleep Tracker For Lucid Dreaming
'Leads trail away from insertion points on her face and wrist... to a lucid dreamer on the bedside shelf.'

Siri Now Smoother, Perkier (Thanks, Deep Learning!)
'Good morning, Dr. Chandra. This is Hal.'

China's Drone Fleet Flies In Formation
'Programmed to hang... in a hexagonal grid pattern.'

Neuralink, The Latest Elon Musk Passion
'I used my implant to tell MILLIE [a mainframe computer] what we wanted...'

More SF in the News Stories

More Beyond Technovelgy science news stories

Home | Glossary | Invention Timeline | Category | New | Contact Us | FAQ | Advertise |
Technovelgy.com - where science meets fiction™

Copyright© Technovelgy LLC; all rights reserved.