Science Fiction
Dictionary
A B C D E F G H I J K L M N O P Q R S T U V W X Y Z
 |
SayCan with PaLM - Google's Robot Helper
Google's everyday robots are getting better and better at what robots need to do - help people!
Think I saw this in Iron Man 1 (2003) Dum-E https://t.co/5NvGPKGZhs
— Bill Christensen (@Technovelgy) April 29, 2023
Large language models can encode a wealth of semantic knowledge about the world. Such knowledge could in principle be extremely useful to robots aiming to act upon high-level, temporally extended instructions expressed in natural language. However, a significant weakness of language models is that they lack contextual grounding, which makes it difficult to leverage them for decision making within a given real-world context. For example, asking a language model to describe how to clean a spill might result in a reasonable narrative, but it may not be applicable to a particular agent, such as a robot, that needs to perform this task in a particular environment.We propose to provide this grounding by means of pretrained behaviors, which are used to condition the model to propose natural language actions that are both feasible and contextually appropriate. The robot can act as the language model’s “hands and eyes,” while the language model supplies high-level semantic knowledge about the task.
(say-can robot helper)We show how low-level tasks can be combined with large language models so that the language model provides high-level knowledge about the procedures for performing complex and temporally extended instructions, while value functions associated with these tasks provide the grounding necessary to connect this knowledge to a particular physical environment.
We evaluate our method on a number of real-world robotic tasks, where we show that this approach is capable of completing long-horizon, abstract, natural language instructions on a mobile manipulator.
(Via say-can)
Science fiction of course features many helpful robots, like TARS and CASE from the movie Interstellar.
Scroll down for more stories in the same category. (Story submitted 4/27/2023)
Follow this kind of news @Technovelgy.| Email | RSS | Blog It | Stumble | del.icio.us | Digg | Reddit |
Would
you like to contribute a story tip?
It's easy:
Get the URL of the story, and the related sf author, and add
it here.
Comment/Join discussion ( 0 )
Related News Stories - (" Robotics ")
It's A Giant Robot! You Reporters Have Been Warned!
'... completely forgetting the ship at sight of the awesome figure and great head of the giant Gaut...'
Tactile Skin Supplier Map
'What strange sensitivity! What an amazing development of science was manifested in every move and act and word of this Robot!' - Ray Cummings, 1931.
Robot Bees 3D Printed By Festo
'At first I was struck by the large size of these bees..' - Ernst Junger, 1957.
DIY Robot Scorpion Crushes It
'...it raised its front end off the ground and waved its antennae at them, then raised one armoured claw as if to snip them out of the sky.' - Neal Asher, 2008.
Technovelgy (that's tech-novel-gee!) is devoted to the creative science inventions and ideas of sf authors. Look for the Invention Category that interests you, the Glossary, the Invention Timeline, or see what's New.
Science Fiction
Timeline
1600-1899
1900-1939
1940's 1950's
1960's 1970's
1980's 1990's
2000's 2010's
Current News
You Will Eat The Cookies Made From Plastic...
'Our planes are going to start bringing in bales of discarded plastics...'
It's A Giant Robot! You Reporters Have Been Warned!
'... completely forgetting the ship at sight of the awesome figure and great head of the giant Gaut...'
Birds Learn To Sing Pictures ala Frank Herbert's Distrans
'We will fight in the time of fighting.'
ElectionSim: China's 'Ender's Game' Battle Sim, Or Lem's 'Kingdom In A Box'?
'So, Ender, we will now begin your education.'
Tactile Skin Supplier Map
'What strange sensitivity! What an amazing development of science was manifested in every move and act and word of this Robot!'
Flock Stymied By 'Adversarial Fashion'
'Forget the head atop it, the legs below, feet, arms, hands. It compels erasure.'
Orb Nomad Zero-Emission Electric Aircraft
'That explains how it was so easy for me to remain motionless in midair or to perch on a flagpole in imitation of a giant bird, even in the windy city of Chicago.'
ICE Buys Shock Gloves Like Batman's
What else is the Caped Crusader using?
Factories In The Sky Will Surpass Those Of Earth
'The thirty-odd miles of The Factory’s circumference...'
Sleeper Drones Lie in Wait
'Wandering mines, you took them out on the edge of the desert, set them down and activated them.'
Warfare Goes Underground In Ukraine
'Once in the very first weeks of the war, before everyone had been evacuated from the surface...'
Robot Bees 3D Printed By Festo
'At first I was struck by the large size of these bees..'
3D Printed Organs From Space
'For a while your colonists will have to come up to the [orbital] Hospital...'
DIY Robot Scorpion Crushes It
'...it raised its front end off the ground and waved its antennae at them, then raised one armoured claw as if to snip them out of the sky.'
How To Settle An Argument Between Two Robots
'Henry... assumed the curious absent look of a robot talking on the TBR circuits.'
The Wind Phone Calls Those Who Have Passed On
'Only I heard that!'
