Science Fiction Dictionary
A  B  C  D  E  F  G  H  I  J  K  L  M  N  O  P  Q  R  S  T  U  V  W  X  Y  Z

Latest By
Category:


Armor
Artificial Intelligence
Biology
Clothing
Communication
Computers
Culture
Data Storage
Displays
Engineering
Entertainment
Food
Input Devices
Lifestyle
Living Space
Manufacturing
Material
Media
Medical
Miscellaneous
Robotics
Security
Space Tech
Spacecraft
Surveillance
Transportation
Travel
Vehicle
Virtual Person
Warfare
Weapon
Work

"The whole problem of energy sources is going to be solved by little solutions, not by some big new piece of technology that does everything. We got into this crisis by believing that we had one big piece of technology that would do everything (oil)."
- Gregory Benford

Robot AI Driven Mad  
  Placing an artificial intelligence or autonomous robot in a situation in which its brain is unable to make a decision and is destroyed or driven mad.  

I don't know of an earlier instance of this in science fiction.

Calvin resumed, “But you understand, Herbie, that despite that, Drs. Lanning and Bogert want that solution.”

“By their own efforts!” insisted Herbie.

“But they want it, and the fact that you have it and won’t give it hurts them. You see that, don’t you?”

“Yes! Yes!”

“And if you tell them, that will hurt them, too.”

“Yes! Yes!” Herbie was retreating slowly, and step by step Susan Calvin advanced. The two men watched in frozen bewilderment.

“You can’t tell them,” droned the psychologist slowly, “because that would hurt and you mustn’t hurt. But if you don’t tell them, you hurt, so you must tell them. And if you do, you will hurt and you mustn’t, so you can’t tell them; but if you don’t, you hurt, so you must; but if you do, you hurt, so you mustn’t; but if you don’t, you hurt, so you must; but if you do, you — ”

Herbie was up against the wall, and here he dropped to his knees. “Stop!” he shrieked. “Close your mind! It is full of pain and frustration and hate! I didn’t mean it, I tell you! I tried to help! I told you what you wanted to hear. I had to!”

The psychologist paid no attention, “You must tell them, but if you do, you hurt, so you musn’t; but if you don’t, you hurt, so you must; but — ”

And Herbie screamed!

It was like the whistling of a piccolo many times magnified — shrill and shriller till it keened with the terror of a lost soul and filled the room with the piercingness of itself.

And when it died into nothingness, Herbie collapsed into a huddled heap of motionless metal.

Bogert’s face was bloodless, “He’s dead!”

“No!” Susan Calvin burst into body-racking gusts of wild^ laughter, “not dead — merely insane. I confronted him with the insoluble dilemma, and he broke down. You can scrap him now — because he’ll never speak again.”

Lanning was on his knees beside the thing that had been Herbie. His fingers touched the cold, unresponsive metal face and he shuddered. “You did that on purpose.” He rose and faced her, face contorted.

“What if I did? You can’t help it now.” And in a sudden access of bitterness, “He deserved it.”

Technovelgy from Liar, by Isaac Asimov.
Published by Astounding Science Fiction in 1941
Additional resources -

Other well-known instances of this condition occur in 2001: A Space Odyssey (1969), in which the HAL 9000 computer is driven mad, and in Home is the Hangman (1976) by Roger Zelazny (see the entry for the Hangman robot).

Here's another example from The Mountain in the Sea (2022) by Ray Naylor:

A [autonomous fishing factory] ship had docked at the factory ship with nobody aboard, its hold full. Not a trace of the crew or of the mercenaries who were supposed to have been watching them, until the crew of the factory ship had opened the hold and found them all there, neatly stacked and frozen, crew and guards alike. The ship had failed to catch any fish, and gone mad, decided protein was protein. The ship’s AI mind had to be decommissioned.

Comment/Join this discussion ( 0 ) | RSS/XML | Blog This |

Additional resources:
  More Ideas and Technology from Liar
  More Ideas and Technology by Isaac Asimov
  Tech news articles related to Liar
  Tech news articles related to works by Isaac Asimov

Robot AI Driven Mad-related news articles:
  - Do You Hold Robots Morally Accountable?

Articles related to Artificial Intelligence
Light Society: Simulates Earth-Scale Society With A Billion AI Agents
Collective Superintelligence Is At Hand!
AI Operates An Excavator
Grok And The City Fathers From 'Cities In Flight' By James Blish

Want to Contribute an Item? It's easy:
Get the name of the item, a quote, the book's name and the author's name, and Add it here.

<Previous
Next>

Google
  Web TechNovelgy.com   

 

 

Technovelgy (that's tech-novel-gee!) is devoted to the creative science inventions and ideas of sf authors. Look for the Invention Category that interests you, the Glossary, the Science Fiction Invention Timeline, or see what's New.

 

 

 

 

Science Fiction Timeline
1600-1899
1900-1939
1940's   1950's
1960's   1970's
1980's   1990's
2000's   2010's

Science Fiction in the News

Prairie Madness - And Space Sickness
'Space-sickness is one of the most unpleasant sensations that a human being can experience. Not all are subject to it...'

Can Stratospheric Aerosol Injection Control The Weather?
'...I saw a nice black heavy-looking cloud sailing by just now, and I can get the electrical machine out in five minutes to draw it down.'

SETI Suggests Prospecting The Solar System Without Landing
'From a distance it could resolve the cosmic rays reflected from various substances.'

Wolfram Alpha Mathematica Predicted by Science Fiction in 1948!
'The answer to the dumb student's prayer.'

Cislunar Space And The Space Lanes of Golden Age Science Fiction
'He had travelled the space-lanes of the solar system for the greater part of his life...'

NASA Moonbase Update
'The dinner was excellent. It was completely vegetarian — grown in specially prepared gardens in this Moon base...'

Neuralink Will Allow Humans To Communicate With ... Animals?
'Telepaths had their sensitiveness enlarged to an immense range by the pin-sets, which were telepathic amplifiers adapted to the mammal mind.'

Special Lights For Driverless Cars!
'That light is actually the Anamorphic Equalizer...'

'Old People Began to Cross The Continent In Their Own Cars'
'It was a relief to enter one of the comfortable autos, whisper a direction down the tube, and just know that you would be taken to your destination in the quickest, safest, and cheapest manner.'

Harrison Bergeron, Illustrated And Practiced
'But he didn't get very far with it before another noise in his ear radio scattered his thoughts. George winced...'

More SF in the News

More Beyond Technovelgy

Home | Glossary | Science Fiction Timeline | Category | New | Contact Us | FAQ | Advertise |
Technovelgy.com - where science meets fiction™

Copyright© Technovelgy LLC; all rights reserved.