Science Fiction
Dictionary
A B C D E F G H I J K L M N O P Q R S T U V W X Y Z
 |
A Bayesian Approach to Safe Imitation Learning For AIs and Robots
In his wonderful 1943 short story Q.U.R., science fiction writer Anthony Boucher writes about robots that are able to learn by viewing hundreds of images:
Now, doughty researchers are working to improve imitation learning:
Modern-day roboticists might be interested in Boucher's distinction between manlike robots and usuform robots.
"I got one of those new electronic cameras - you know, one thousand exposures per second... So we took pictures of Guzub making a Three Planets, and I could construct this one to do it exactly right down to the thousandth of a second. The proper proportion of vuzd, in case you're interested, works out to three-point-six-five-four-seven eight-two-three drops. It's done with a flip of the third joint of the tentacle on the down beat. It didn't seem right to use Guzub to make a robot that would compete with him and probably drive him out of business, so we've promised him a generous pension from the royalties on usuform barkeeps."
(Read more about Anthony Boucher's usuform robot bartender)
DropoutDAgger: A Bayesian Approach to Safe Imitation Learning
While imitation learning is becoming common practice in robotics, this approach often suffers from data mismatch and compounding errors. DAgger is an iterative algorithm that addresses these issues by continually aggregating training data from both the expert and novice policies, but does not consider the impact of safety. We present a probabilistic extension to DAgger, which uses the distribution over actions provided by the novice policy, for a given observation. Our method, which we call DropoutDAgger, uses dropout to train the novice as a Bayesian neural network that provides insight to its confidence. Using the distribution over the novice's actions, we estimate a probabilistic measure of safety with respect to the expert action, tuned to balance exploration and exploitation. The utility of this approach is evaluated on the MuJoCo HalfCheetah and in a simple driving experiment, demonstrating improved performance and safety compared to other DAgger variants and classic imitation learning.
Scroll down for more stories in the same category. (Story submitted 10/6/2017)
Follow this kind of news @Technovelgy.| Email | RSS | Blog It | Stumble | del.icio.us | Digg | Reddit |
Would
you like to contribute a story tip?
It's easy:
Get the URL of the story, and the related sf author, and add
it here.
Comment/Join discussion ( 0 )
Related News Stories - (" Artificial Intelligence ")
Nuclear Plant Restarted To Power AI To Feed Us Dreams
'...Anything was possible in my imaginary environment.' - Raymond Z. Gallun, 1940.
Dino From Magical Toys An AI Companion To Children
'...the imaginary companions discovered by needful children.' - Anne McCaffrey, 1990.
AI Computer Chip Designs Passeth Human Understanding
'It seems that at one time computers were designed directly by human beings.' - Isaac Asimov, 1958.
Fine-Tune Your Infinite Book The Way You Want It
'I squatted down beside the roller and tried to make some sense out of the knobs. There were thirty-nine of them...' - Clifford Simak, 1957.
Technovelgy (that's tech-novel-gee!) is devoted to the creative science inventions and ideas of sf authors. Look for the Invention Category that interests you, the Glossary, the Invention Timeline, or see what's New.
Science Fiction
Timeline
1600-1899
1900-1939
1940's 1950's
1960's 1970's
1980's 1990's
2000's 2010's
Current News
Nuclear Plant Restarted To Power AI To Feed Us Dreams
'...Anything was possible in my imaginary environment.'
SpaceX's Starman Tesla Roadster In Space
'Somewhere in space, a chrome and blue automobile raced the green light of Earth.'
Pivotal Blackfly Electric Aircraft Lifts And Hovers
'That explains how it was so easy for me to remain motionless in midair...'
CORLEO Robotic Horse Concept Looks Ready To Ride
Imagine digging your heels in to a steam horse!
Who First Thought Of A Tin Foil Hat?
'We had discovered that metal was relatively impervious to the telepathic effect.'
Warp Drive Tech Back On The Menu
'Detailed plans for the construction of the Gundstetter-Halone warp drive were flowing.'
Huawei Pura X Folding Phattie Phone
Why can't we get more innovative phone configurations?
Sleep Pods At Daxing International Airport
'Do not waste your priceless company on the unappreciative folds of a sleep pod...'
Robot Baristas Learn Their Trade Without Paying Royalties
'...so we've promised him a generous pension from the royalties.'
JAXA Int Ball 2 Coming Right Along As Star Wars Remote
'Hocus-pocus religions and archaic weapons are no substitute for a good blaster at your side.'
Robot Bricklayer Or Passer-By Bricklayer?
'Oscar picked up a trowel. 'I'm the tool for the mortar,' the little trowel squeaked cheerfully.'
Robot Gas Station Attendant Pumps Gas For You
'... he waited for the robotrix attendant to finish fueling up his ship.'
Engineer Creates Crazy Motorized Track Hospital Bed
The Roujin Z system provides care to fully bedridden patients - and then some!
Tiny Flying Robot Weighs Just One Gram
'Aerostat meant anything that hung in the air. This was an easy trick to pull off nowadays.'
Some Ringworld Configurations Are Stable
'The Ringworld had no horizon. There was no line where the land curved away from the sky.'
TRANSFORM Dynamic Furniture Concept Becomes What You Need
'An adjustment panel outside the door would cause it to extrude various appurtenances in memory plastic...'
