Can We Comprehend Deep Learning Systems?

Science fiction readers have long enjoyed the humorous works of Lewis Padgett (who was really a married couple). In the 1943 short story The Proud Robot, they describe a robot with ways of thinking and sensing that, well, don't make sense to humans:

"How’d you know where to reach me?"
"I vastened you," the robot said.
"What?"
"I vastened you were at the Vox-View studios with Patsy Brock."
"What’s vastened?" Gallegher wanted to know.
"It’s a sense I’ve got. You’ve nothing remotely like it, so I can’t describe it to you. It’s rather like a combination of sagrazi and prescience."
"Sagrazi?"
"Oh, you don’t have sagrazi, either, do you? Well, don’t waste my time..."

In an intriguing article in Technology Review, Will Knight talks about how nobody really knows how the most advanced algorithms behind self-driving cars (and other technology) are able to do the things they do.

...deep learning, has proved very powerful at solving problems in recent years, and it has been widely deployed for tasks like image captioning, voice recognition, and language translation. There is now hope that the same techniques will be able to diagnose deadly diseases, make million-dollar trading decisions, and do countless other things to transform whole industries.

But this won’t happen—or shouldn’t happen—unless we find ways of making techniques like deep learning more understandable to their creators and accountable to their users. Otherwise it will be hard to predict when failures might occur—and it’s inevitable they will.

There’s already an argument that being able to interrogate an AI system about how it reached its conclusions is a fundamental legal right. Starting in the summer of 2018, the European Union may require that companies be able to give users an explanation for decisions that automated systems reach. This might be impossible... Even the engineers who build these apps cannot fully explain their behavior.

(Via The Dark Secret at the Heart of AI.)

Scroll down for more stories in the same category. (Story submitted 6/1/2019)

Follow this kind of news @Technovelgy.

| Email | RSS | Blog It | Stumble | del.icio.us | Digg | Reddit |

Would you like to contribute a story tip? It's easy:
Get the URL of the story, and the related sf author, and add it here.

Comment/Join discussion ( 0 )

Related News Stories - (" Artificial Intelligence ")

Legal Profession Now Fairly Bristling With AI
'The virtual counsel appeared to be about forty-five years old and prosperous.' - Greg Bear, 2007

Venezuelans Teaching Your Self-Driving Car
‘She wouldn't stop until Antar had told her everything he knew...’ Amitav Ghosh, 1995.

Pun Generation Via Neural Nets
'You said you wanted him to be able to distinguish between laugh-power in different gags...' - William Tenn, 1951.

Can We Comprehend Deep Learning Systems?
'You’ve nothing remotely like it, so I can’t describe it to you.' - Lewis Padgett, 1943.

 

Google
  Web TechNovelgy.com   

Technovelgy (that's tech-novel-gee!) is devoted to the creative science inventions and ideas of sf authors. Look for the Invention Category that interests you, the Glossary, the Invention Timeline, or see what's New.

 

 

 

 

 

Current News

Orbital Display's Low Earth Orbit Advertisements
'A vast circle of scarlet stars came up into the greenish desert dusk.'

Neuromorphic Computing Hardare
'He had constructed an organ, a brain, of metal, entirely inorganic and lifeless...'

Vascularized Human Skin 3D Printed
Hey Fishboy!

Trillionaires Still Earth-Bound
'I shall never forget the sight... when the yellow gleam of the precious metal appeared under the star dust.'

Digit V2 Bipedal Robot From Agility Robotics
Oh, and now I suppose someone will develop the robotic porch pirate.

3D Printed Dubai Building Is World's Largest
'This thing will start at one end of ...a house and build it complete to the other end, following drawings only.'

Grow Plants On Moon Or Mars!
'In contrast to the airless desolation outside, the interior of this five-acre greenhouse was the one most desirable place to be.'

California Gets Shockwave Rider-Style Avoidance Zones
'It was cheaper to pay the refugees to go without up-to-the-minute equipment.'

Microbot Interstellar von Neumann Explorers
'Evidently they have never had a planet of their own...'

Hail SmartCan! Your Trash Bin Takes Itself Out
'...a waste can twenty feet away stirred into life.'

Finally! Microsoft Surface Neo And Surface Duo Implement Excellent Courier Idea
'Runcible, whose pages were thicker and more densely packed with computational machinery...'

Tap Strap 2 Now With Air Mouse
'He waved his hand and the circuit switched abruptly.'

Legal Profession Now Fairly Bristling With AI
'The virtual counsel appeared to be about forty-five years old and prosperous.'

Entire Planet Modeled In New MS Flight Sim
'CIC uses [it] to keep track of every bit of spatial information that it owns...'

FlyZoo Robot Hotel By Alibaba
'... hotels that specialized in non-human service.'

Implanted Memories Provide Songs To Birds
Finches can't tell the difference.

More SF in the News Stories

More Beyond Technovelgy science news stories

Home | Glossary | Invention Timeline | Category | New | Contact Us | FAQ | Advertise |
Technovelgy.com - where science meets fiction™

Copyright© Technovelgy LLC; all rights reserved.