Can We Comprehend Deep Learning Systems?

Science fiction readers have long enjoyed the humorous works of Lewis Padgett (who was really a married couple). In the 1943 short story The Proud Robot, they describe a robot with ways of thinking and sensing that, well, don't make sense to humans:

"How’d you know where to reach me?"
"I vastened you," the robot said.
"What?"
"I vastened you were at the Vox-View studios with Patsy Brock."
"What’s vastened?" Gallegher wanted to know.
"It’s a sense I’ve got. You’ve nothing remotely like it, so I can’t describe it to you. It’s rather like a combination of sagrazi and prescience."
"Sagrazi?"
"Oh, you don’t have sagrazi, either, do you? Well, don’t waste my time..."

In an intriguing article in Technology Review, Will Knight talks about how nobody really knows how the most advanced algorithms behind self-driving cars (and other technology) are able to do the things they do.

...deep learning, has proved very powerful at solving problems in recent years, and it has been widely deployed for tasks like image captioning, voice recognition, and language translation. There is now hope that the same techniques will be able to diagnose deadly diseases, make million-dollar trading decisions, and do countless other things to transform whole industries.

But this won’t happen—or shouldn’t happen—unless we find ways of making techniques like deep learning more understandable to their creators and accountable to their users. Otherwise it will be hard to predict when failures might occur—and it’s inevitable they will.

There’s already an argument that being able to interrogate an AI system about how it reached its conclusions is a fundamental legal right. Starting in the summer of 2018, the European Union may require that companies be able to give users an explanation for decisions that automated systems reach. This might be impossible... Even the engineers who build these apps cannot fully explain their behavior.

(Via The Dark Secret at the Heart of AI.)

Scroll down for more stories in the same category. (Story submitted 6/1/2019)

Follow this kind of news @Technovelgy.

| Email | RSS | Blog It | Stumble | del.icio.us | Digg | Reddit |

Would you like to contribute a story tip? It's easy:
Get the URL of the story, and the related sf author, and add it here.

Comment/Join discussion ( 0 )

Related News Stories - (" Artificial Intelligence ")

Pun Generation Via Neural Nets
'You said you wanted him to be able to distinguish between laugh-power in different gags...' - William Tenn, 1951.

Can We Comprehend Deep Learning Systems?
'You’ve nothing remotely like it, so I can’t describe it to you.' - Lewis Padgett, 1943.

Datagrid Model Generation Perfect For Eternal Cities Of Science Fiction
'... there was enough flexibility to allow for wide variation. - Arthur C. Clarke, 1956.

Amazon Echo And Google Home Should Have Morality Software
'The Dwoskin Morality Rating-Computer could 'spot the slightest tendency to deviation' from the social norm...' - Kendall Foster Crossen, 1953.

 

Google
  Web TechNovelgy.com   

Technovelgy (that's tech-novel-gee!) is devoted to the creative science inventions and ideas of sf authors. Look for the Invention Category that interests you, the Glossary, the Invention Timeline, or see what's New.

 

 

 

 

 

Current News

Nobe 3-Wheel Electric Vehicle Parking Like I, Robot
Spidercar, Spidercar, does whatever a spidercar does.

Michelin Self-Sealing Tires On Ford's Explorer
'...a seal of compressed plastifoam to save the air.'

Mushroom Eats Plastic, Saves Planet
Fungus Amongus, SaveUs!

Juggalo Face Paint Disrupts Facial Recognition
'... designed to foil facial recognition systems.'

Mojipic Smart Voice Vehicle Emojis
KITT, what's your response?

Unusual Twist On Woman Dates Robot
'My hearing, vision and awareness went along with that excellent imitation of a young Adonis...'

BrainNet Triple Telepathic Gaming Threat
'In the gloomy half-darkness the three idiots sat babbling.'

AVAS Noisemakers Required For EVs By EU
'...a sound tape to supply the noise of a soi-disant "[internal combustion]" engine...'

Pun Generation Via Neural Nets
'You said you wanted him to be able to distinguish between laugh-power in different gags...'

Blood Battery Robotic Fish
'With one fluid motion, it surged forward, plunged, and was gone.'

Lightyear One Solar-Powered Electric Car (Design By Heinlein)
'It drew its power from six square yards of sunpower screens on its low curved roof.'

'Agression Detectors' Don't Work When Spying On Students
'The professional agitators had also learned how to modulate their voices below the danger level...'

Mining Of Golden Asteroid Foretold In 1898 Science Fiction
'This must be a golden planet—this little asteroid.'

Miners! NASA Wants To License RASSOR Excavator
'The borers had been dismantled and packed away.'

Bee+ Robobee Now With Four Wings
'It was a tiny thing, scarcely more than an inch and a half in length...'

CNSILK Robotic Spider Builder
'We could certainly spin a web right through the Solar System, if we can think of a good use for one.'

More SF in the News Stories

More Beyond Technovelgy science news stories

Home | Glossary | Invention Timeline | Category | New | Contact Us | FAQ | Advertise |
Technovelgy.com - where science meets fiction™

Copyright© Technovelgy LLC; all rights reserved.