Science Fiction Dictionary
A  B  C  D  E  F  G  H  I  J  K  L  M  N  O  P  Q  R  S  T  U  V  W  X  Y  Z

 

A Bayesian Approach to Safe Imitation Learning For AIs and Robots

In his wonderful 1943 short story Q.U.R., science fiction writer Anthony Boucher writes about robots that are able to learn by viewing hundreds of images:

"I got one of those new electronic cameras - you know, one thousand exposures per second... So we took pictures of Guzub making a Three Planets, and I could construct this one to do it exactly right down to the thousandth of a second. The proper proportion of vuzd, in case you're interested, works out to three-point-six-five-four-seven eight-two-three drops. It's done with a flip of the third joint of the tentacle on the down beat. It didn't seem right to use Guzub to make a robot that would compete with him and probably drive him out of business, so we've promised him a generous pension from the royalties on usuform barkeeps."
(Read more about Anthony Boucher's usuform robot bartender)

Now, doughty researchers are working to improve imitation learning:

DropoutDAgger: A Bayesian Approach to Safe Imitation Learning

While imitation learning is becoming common practice in robotics, this approach often suffers from data mismatch and compounding errors. DAgger is an iterative algorithm that addresses these issues by continually aggregating training data from both the expert and novice policies, but does not consider the impact of safety. We present a probabilistic extension to DAgger, which uses the distribution over actions provided by the novice policy, for a given observation. Our method, which we call DropoutDAgger, uses dropout to train the novice as a Bayesian neural network that provides insight to its confidence. Using the distribution over the novice's actions, we estimate a probabilistic measure of safety with respect to the expert action, tuned to balance exploration and exploitation. The utility of this approach is evaluated on the MuJoCo HalfCheetah and in a simple driving experiment, demonstrating improved performance and safety compared to other DAgger variants and classic imitation learning.

Modern-day roboticists might be interested in Boucher's distinction between manlike robots and usuform robots.

Scroll down for more stories in the same category. (Story submitted 10/6/2017)

Follow this kind of news @Technovelgy.

| Email | RSS | Blog It | Stumble | del.icio.us | Digg | Reddit |

Would you like to contribute a story tip? It's easy:
Get the URL of the story, and the related sf author, and add it here.

Comment/Join discussion ( 0 )

Related News Stories - (" Artificial Intelligence ")

Microsoft VASA-1 Creates Personal Video From A Photo
'...to build up a video picture would require, say, ten million decisions every second. Mike, you're so fast I can't even think about it. But you aren't that fast.' - Robert Heinlein, 1966.

Bespoke Environment Music From AIs
'Call 'em Winter Mute," said the other, making it two words.' - William Gibson, 1984.

Steve Jobs: 'Capture The Next Aristotle - With AI'
'It was disturbing to think of the Flatline as a construct...'

BMind Smart Mirror from Baracoda
Mirror, mirror, on the wall, who has the greatest wellness of all?

 

Google
  Web TechNovelgy.com   

Technovelgy (that's tech-novel-gee!) is devoted to the creative science inventions and ideas of sf authors. Look for the Invention Category that interests you, the Glossary, the Invention Timeline, or see what's New.

 

 

 

 

Science Fiction Timeline
1600-1899
1900-1939
1940's   1950's
1960's   1970's
1980's   1990's
2000's   2010's

Current News

'Whisper Mode' ala Blue Thunder Researched At Bristol
'Forest Lawn.'

Gaia - Why Stop With Just The Earth?
'But the stars are only atoms in larger space, and in that larger space the star-atoms could combine to form living matter, thinking matter, couldn't they?'

Microsoft VASA-1 Creates Personal Video From A Photo
'...to build up a video picture would require, say, ten million decisions every second. Mike, you're so fast I can't even think about it. But you aren't that fast.'

Splendid View Of Eclipse From Orbit Visualized And Repurposed By Arthur C. Clarke
'The area affected was five hundred kilometres across, and perfectly circular.'

Bespoke Environment Music From AIs
'Call 'em Winter Mute," said the other, making it two words.'

Goldene - A Two-Dimensional Sheet Of Gold One Atom Thick
'Hasan always pitched a Gauzy - a one-molecule-layer tent, opaque, feather-light, and very tough.'

SpaceX Wants A Moonbase Alpha
'And he had been sent with troops, supplies and bombs to command Russia's most trusted post, the Moonbase.'

Vast Apartment Living Will Get Even More Vast
'What is your population', I asked. 'About eighty millions.'

NASA Wants Self-Driving Or Remote-Controlled Vehicles For Lunar Astronauts
'THE autobus turned silently down the wide street of Hydropole. Robot-guided, insulated from noise and cold...'

Elon Musk Says Robotaxis Will Be Ready This August, 2024
'The car had no steering wheel, and no one drove!'

Moonwalkers AI-Controlled Electric Shoes
Now that's power walking that Hugo Gernsback would have approved.

Steve Jobs: 'Capture The Next Aristotle - With AI'
'It was disturbing to think of the Flatline as a construct...'

No Tips! Robotic Food Delivery In Phoenix
'...he rewired the delivery robot so that it would serve him midnight snacks.'

Electric Catamaran 'Explorer Eco 40m' Has 'Solar Skin'
'On went the electric-yacht faster and still faster.'

Orbital Mechanics, The Liftoff, The Turnover, The Retrograde Burn
'...the huge vessel had spun, with a sickening lurch, through a complete half-circle, the instant the power was reversed.'

Harvest Power From Tears And Blinking With Smart Contact Lens
'...he realized that it was not quite a clear lens. Speckles of colored brightness swirled and gathered in it.'

More SF in the News Stories

More Beyond Technovelgy science news stories

Home | Glossary | Invention Timeline | Category | New | Contact Us | FAQ | Advertise |
Technovelgy.com - where science meets fiction™

Copyright© Technovelgy LLC; all rights reserved.