Science Fiction Dictionary
A  B  C  D  E  F  G  H  I  J  K  L  M  N  O  P  Q  R  S  T  U  V  W  X  Y  Z

 

Robots Learn Cooking By Watching Videos - Foreseen In 1943

DARPA’s Mathematics of Sensing, Exploitation and Execution (MSEE) program recently developed a system that enabled robots to process visual data from a series of “how to” cooking videos on YouTube.


(Robot Learning Manipulation Action Plans by “Watching” Unconstrained Videos)

In order to advance action generation and creation in robots beyond simple learned schemas we need computational tools that allow us to automatically interpret and represent human actions. This paper presents a system that learns manipulation action plans by processing unconstrained videos from the World Wide Web. Its goal is to robustly generate the sequence of atomic actions of seen longer actions in video in order to acquire knowledge for robots.

The lower level of the system consists of two convolutional neural network (CNN) based recognition modules, one for classifying the hand grasp type and the other for object recognition. The higher level is a probabilistic manipulation action grammar based parsing module that aims at generating visual sentences for robot manipulation.

Experiments conducted on a publicly available unconstrained video dataset show that the system is able to learn manipulation actions by “watching” unconstrained videos with high accuracy.

This very process was foreseen in Anthony Boucher's 1943 short story Q.U.R.. Can a robot bartender make a perfect Three Planets drink? Only by watching detailed videos with high accuracy:

Quniby said, "Three Planets," and he [the robot] went into action. He had tentacles, and the motions were exactly like Guzub's...

...I got one of those new electronic cameras - you know, one thousand exposures per second... So we took pictures of Guzub making a Three Planets, and I could construct this one to do it exactly right down to the thousandth of a second. The proper proportion of vuzd, in case you're interested, works out to three-point-six-five-four-seven eight-two-three drops. It's done with a flip of the third joint of the tentacle on the down beat.
(Read more about Boucher's robot bartender)

From Robot Learning Manipulation Action Plans by “Watching” Unconstrained Videos from the World Wide Web and DARPA MSEE via IEE Spectrum

Scroll down for more stories in the same category. (Story submitted 2/3/2015)

Follow this kind of news @Technovelgy.

| Email | RSS | Blog It | Stumble | del.icio.us | Digg | Reddit |

Would you like to contribute a story tip? It's easy:
Get the URL of the story, and the related sf author, and add it here.

Comment/Join discussion ( 0 )

Related News Stories - (" Robotics ")

NAVER Labs Haptic Device 2.0 Robot vs. IKEA
'... the two pairs of waldoes in the screen followed in exact, simultaneous parallelism.' - Robert Heinlein, 1942.

Dyson's Secret Household Robots
'...work a human being does around a house.' - Robert Heinlein, 1956.

Festo BionicSwift Bird Robots Described In 1930
'Bird-like robots now descended from the ceiling of the theatre...' - Clarence Edward Heller, 1930.

Robotics Jobs In The Food Industry
'The efficient robot waiter of the Sky Club had cleared away the remnants of an epicurean meal.' Nat Schachter and Al Zagat, 1931.

 

Google
  Web TechNovelgy.com   

Technovelgy (that's tech-novel-gee!) is devoted to the creative science inventions and ideas of sf authors. Look for the Invention Category that interests you, the Glossary, the Invention Timeline, or see what's New.

 

 

 

 

Science Fiction Timeline
1600-1899
1900-1939
1940's   1950's
1960's   1970's
1980's   1990's
2000's   2010's

Current News

NAVER Labs Haptic Device 2.0 Robot vs. IKEA
'... the two pairs of waldoes in the screen followed in exact, simultaneous parallelism.'

Spaceships Should Last So Long
'THE SPACE VESSEL was traveling swiftly… For over five thousand years they had Voyaged on and on.’

Shine On, Portable Wind Turbine
'Sometimes a man has a windmill on his roof...'

Amazing Indoor Robotic Drones Mimic Dolphins and Whales
'They circled the vast audiences, dancing, twittering, chirping...'

Space Station Shutters
'The sun-quilt was a patchwork of colors and materials on the inward side, but silvered on the outward side...'

Tiny Mining - Extract Precious Industrial Minerals From Your Own Body
'Jim, I saw them reduce four of my doctors and nurses into those little cubes!'

MIT Proposes Space Bubbles To Combat Climate Change, Misses The Point Of Space Bubbles
'Fats Jordan was hanging in the center of the Big Glass Balloon, hugging his guitar to his massive black belly above his purple shorts..'

Tianjin Solar Vehicle From Hanergy (2022) Looking Like Heinlein's (1940)
'When confronted by hills, or rough terrain, it did not stop, but simply slowed until the task demanded equaled its steady power output.'

Study Reveals Effect Of Space Travel On The Brain
'... the brain is no longer subjected to the accustomed pull, and it expands slightly in all directions.'

Sky Cruise Nuclear Powered Flying Hotel Concept
'... the huge air-freighter Jupiter.'

The Mojo Smart Contact Lens Experience
'... the lens displays would be useless without a wearable computer to do the graphics.'

Small Town Wants 60 License Plate Readers
'the registration number which the traffic control automatically photographed as she left the controlway...'

Lightyear 0 World's First Production-Ready Solar Car
'It could maintain a steady six miles per hour...'

AI Robots Excel At Trash Sorting And Recycling
'Then they press one of these here thirteen buttons...'

Could Increased Space Rocketry Damage The Ozone Layer?
'...without burning a single hydrocarbon molecule to injure the diseased atmosphere any further.'

Dyson's Secret Household Robots
'...work a human being does around a house.'

More SF in the News Stories

More Beyond Technovelgy science news stories

Home | Glossary | Invention Timeline | Category | New | Contact Us | FAQ | Advertise |
Technovelgy.com - where science meets fiction™

Copyright© Technovelgy LLC; all rights reserved.