 |
VirtualHome: Teaching Robots To Do Chores Around The House
Before we can have Robert Heinlein's wonderful home robot Flexible Frank (from his 1956 classic The Door into Summer...
...We need to train them. Hence, VirtualHome, the activity simulator for teaching household tasks to robots.
Just what did I want Flexible Frank to do? Answer: any work a human being does around a house. He didn't have to play cards, make love, eat or sleep, but he did have to clean up after the card game, cook, make beds, and tend babies - at least he had to keep track of a baby's breathing and call someone if it changes.
(VirtualHome video: Teaching Robots To Do Chores)
In this paper, we are interested in modeling complex activities that occur in a typical household. We propose to use programs, i.e., sequences of atomic actions and interactions, as a high level representation of complex tasks. Programs are interesting because they provide a non-ambiguous representation of a task, and allow agents to execute them. However, nowadays, there is no database providing this type of information. Towards this goal, we first crowd-source programs for a variety of activities that happen in people’s homes, via a game-like interface used for teaching kids how to code. Using the collected dataset, we show how we can learn to extract programs directly from natural language descriptions or from videos. We then implement the most common atomic (inter)actions in the Unity3D game engine, and use our programs to “drive” an artificial agent to execute tasks in a simulated household environment. Our VirtualHome simulator allows us to create a large activity video dataset with rich ground-truth, enabling training and testing of video understanding models. We further showcase examples of our agent performing tasks in our VirtualHome based on language descriptions.(From VirtualHome: Simulating Household Activities via Programs [pdf])
I just love the idea of a household robot, maybe one of the following will be perfected in my lifetime:
- Twendy-One Robot Is Your Humanoid Helper
- REEM-B Robot Autonomous Helper Video
- Care-O-Bot Robot Does Chores One-Handed
- Basil Reification Robot
- Toyota Delivery Robot Home Helper
- ATLAS Robot Now Does Housework!
- Elon Musk et. al. OpenAI Household Robot
- Housekeeping Robots Easy To Imagine, Tough To Make
Scroll down for more stories in the same category. (Story submitted 6/7/2018)
Follow this kind of news @Technovelgy.| Email | RSS | Blog It | Stumble | del.icio.us | Digg | Reddit |
Would
you like to contribute a story tip?
It's easy:
Get the URL of the story, and the related sf author, and add
it here.
Comment/Join discussion ( 0 )
Related News Stories - (" Robotics ")
Las Vegas Humans Ready To Strike Over Robots
'A worker replaced by a nubot... had to be compensated.' - John Twelve Hawks, 2014.
Somnox Sleep Robot - Your Sleepytime Cuddlebot
Science fiction authors are serious about sleep, too.
VirtualHome: Teaching Robots To Do Chores Around The House
'Just what did I want Flexible Frank to do? - any work a human being does around a house.' Robert Heinlein, 1956.
Artificial Sensory Neurons For Prosthetics, Robots
Great for humans and robots!
Technovelgy (that's tech-novel-gee!) is devoted to the creative science inventions and ideas of sf authors. Look for the Invention Category that interests you, the Glossary, the Invention Timeline, or see what's New.
Current News
Las Vegas Humans Ready To Strike Over Robots
'A worker replaced by a nubot... had to be compensated.'
You'll Regrow That Limb, One Day
'... forcing the energy transfer which allowed him to regrow his lost fingers.'
Elon Musk Seeks To Create 1941 Heinlein Speedster
'The car surged and lifted, clearing its top by a negligible margin.'
Somnox Sleep Robot - Your Sleepytime Cuddlebot
Science fiction authors are serious about sleep, too.
Real-Life Macau or Ghost In The Shell
Art imitates life imitates art.
Has Climate Change Already Been Solved By Aliens?
'I had explained," said Nessus, "that our civilisation was dying in its own waste heat.'
First 3D Printed Human Corneas From Stem Cells
Just what we need! Lots of spare parts.
VirtualHome: Teaching Robots To Do Chores Around The House
'Just what did I want Flexible Frank to do? - any work a human being does around a house.'
Messaging Extraterrestrial Intelligence (METI) Workshop
SF writers have thought about this since the 19th century.
Nanorobots Roam Your Bloodstream, Cleaning It
Too bad they won't have lasers, though...
Galini 3D Printed Sleeping Pod Tiny Houses
'The houses are prefabricated units...'
MIT Boffins Create Psychopath AI On Purpose
There's a lesson in this for neural net AI engineers everywhere.
Skin Electronics 3D Printed
'June's body is a tracery of lambent lines, like some arcane capillary circuitry...'
Artificial Sensory Neurons For Prosthetics, Robots
Great for humans and robots!
China Uses Artificial Intelligence To Grade Student Papers
Looks like the City Fathers are starting to take over China's education system.
Electronic Tongues Will Rule The Kitchen
'Install taste buds in the end of one tentacle...'
