Can We Comprehend Deep Learning Systems?

Science fiction readers have long enjoyed the humorous works of Lewis Padgett (who was really a married couple). In the 1943 short story The Proud Robot, they describe a robot with ways of thinking and sensing that, well, don't make sense to humans:

"How’d you know where to reach me?"
"I vastened you," the robot said.
"What?"
"I vastened you were at the Vox-View studios with Patsy Brock."
"What’s vastened?" Gallegher wanted to know.
"It’s a sense I’ve got. You’ve nothing remotely like it, so I can’t describe it to you. It’s rather like a combination of sagrazi and prescience."
"Sagrazi?"
"Oh, you don’t have sagrazi, either, do you? Well, don’t waste my time..."

In an intriguing article in Technology Review, Will Knight talks about how nobody really knows how the most advanced algorithms behind self-driving cars (and other technology) are able to do the things they do.

...deep learning, has proved very powerful at solving problems in recent years, and it has been widely deployed for tasks like image captioning, voice recognition, and language translation. There is now hope that the same techniques will be able to diagnose deadly diseases, make million-dollar trading decisions, and do countless other things to transform whole industries.

But this won’t happen—or shouldn’t happen—unless we find ways of making techniques like deep learning more understandable to their creators and accountable to their users. Otherwise it will be hard to predict when failures might occur—and it’s inevitable they will.

There’s already an argument that being able to interrogate an AI system about how it reached its conclusions is a fundamental legal right. Starting in the summer of 2018, the European Union may require that companies be able to give users an explanation for decisions that automated systems reach. This might be impossible... Even the engineers who build these apps cannot fully explain their behavior.

(Via The Dark Secret at the Heart of AI.)

Scroll down for more stories in the same category. (Story submitted 6/1/2019)

Follow this kind of news @Technovelgy.

| Email | RSS | Blog It | Stumble | del.icio.us | Digg | Reddit |

Would you like to contribute a story tip? It's easy:
Get the URL of the story, and the related sf author, and add it here.

Comment/Join discussion ( 0 )

Related News Stories - (" Artificial Intelligence ")

Airbnb Has AI Psychiatrist Looking At Your Facebook
'It's illegal to hold back information during a psyche test.'

Viisights AI Hones Video Surveillance
''The math boys worked it out...' Pournelle and Niven, 1981.

Legal Profession Now Fairly Bristling With AI
'The virtual counsel appeared to be about forty-five years old and prosperous.' - Greg Bear, 2007

Venezuelans Teaching Your Self-Driving Car
‘She wouldn't stop until Antar had told her everything he knew...’ Amitav Ghosh, 1995.

 

Google
  Web TechNovelgy.com   

Technovelgy (that's tech-novel-gee!) is devoted to the creative science inventions and ideas of sf authors. Look for the Invention Category that interests you, the Glossary, the Invention Timeline, or see what's New.

 

 

 

 

 

Current News

Cruise Autonomous Car Drives Aimlessly For An Hour
Convincing video shows progress (and limitations).

Fast Charging A Bus In 20 Seconds
'... in almost every town and village.'

Realistic Translation With The Waverly Labs Ambassador
'The speech patterns you actually hear decode the brainwave matrix which has been fed into your mind by your Babel fish.'

Biotech Firms Raised $Millions For Anti-Agathics (Longevity Drugs)
'Against Death doth no simple grow.'

Out-Of-Work Blue Collar Robots Need Your Help
'His legs relaxed with a rattle as he cut off all power below his waist... and ran his eye down the Help Wanted - Robot column...'

The Dawn Of Orbiting Manufacturing In 2020?
'It can be mass-produced only in the orbiting factories.'

Smart Contact Lenses Charges With 3D Printed Antenna
'He realized that it was not quite a clear lens.'

Segway S-Pod Fulfills Dire 1928 SciFi Prophecy
'Noiselessly, on rubber-tired wheels, they journeyed down the long aisles...'

Physicist Inspired By SciFi And Seeing Back In Time
'Here is the chronoscope... Scansion depends upon a special curved field...'

Airbnb Has AI Psychiatrist Looking At Your Facebook
'It's illegal to hold back information during a psyche test.'

NASA's Electric Motor Scooter
'...all the [lunar] prospectors took bicycles along as a matter of course'

Moving Suns To Different Galactic Neighborhoods
'...to swerve their star from its course, the globemen made use of a simple physical principle.'

Students Surveilled By School Phone Apps
Cheer up, students. '...cracking my SchoolBook had been easy.'

Massage Robot Has Soft Hands, Er, Pads
'The automatic massager began to fumble gently over my naked form.'

Medical Tattoos Are STILL Being Researched
'Following the current craze, she has had a subdermal pattern of micro-channels implanted.'

Elon Musk's Traffic Tunnel Challenge Is Boring
'The car vibrated... threading the maze of local tubes.'

More SF in the News Stories

More Beyond Technovelgy science news stories

Home | Glossary | Invention Timeline | Category | New | Contact Us | FAQ | Advertise |
Technovelgy.com - where science meets fiction™

Copyright© Technovelgy LLC; all rights reserved.