Anti-Shredder Computer Versus Stasi Secret Police

A German research team has developed a computer system to attempt to put together East German secret police files ripped into 600 million pieces. The shredded and torn documents date from 1989, when the fall of the Berlin wall caused Stasi members to try to liquidate the past.


(Shredded Stasi documents in a small plastic sack)

Bertram Nickolay, head of security technology at the Fraunhofer Institute for Production Systems and Design Technology (IPK) in Berlin, says that the heart of the reconstruction software that his team has spent years developing is powered by algorithms designed to recognize and process digital patterns and images.

The pieces of torn documents are scanned on both sides, and the digital images are then analysed by a cluster of 16 computers for 25 features, including colour, shape, texture, handwriting and typeface, Nickolay says. Just like a person doing a jigsaw, the computer then groups the images into clusters with similar features, and finally fits pieces in each cluster together. The software should get better with time, Nickolay notes. "It learns as it processes."

According to Nickolay, the project will start with ten bags of torn documents this coming June. Initial scanning will be done by hand by 20 team members, but the team is "looking for solutions to mechanize this process."

It turns out that science fiction writers are once again ahead of the curve. In his excellent (and Hugo-nominated) 2006 book Rainbows End, sf author and computer scientist Vernor Vinge attacks the problem of digitizing entire libraries with characteristic gusto. Meet the Navicloud Custom Debinder:

Ahead of him, everything was empty bookcases, skeletons. Robert went to the end of the aisle and walked toward the noise. The air was a fog of floating paper dust. In the fourth aisle, the space between the bookcases was filled with a pulsing fabric tube. The monster worm was brightly lit from within. At the other end, almost twenty feet away, was the worm's maw - the source of the noise... The raging maw was a "Navicloud custom debinder." The fabric tunnel that stretched out behind it was a "camera tunnel..." The shredded fragments of books and magazines flew down the tunnel like leaves in a tornado, twisting and tumbling. The inside of the fabric was stiched with thousands of tiny cameras. The shreds were being photographed again and again, from every angle and orientation...
(Read more about the Navicloud Custom Debinder)

If you are interested in the logistics of scanning millions of pages, read Encyclopedia Googleactica - Google To Put All Human Knowledge Online.

Update 11-May-2007: Thanks to reader RandomAction who wrote in with the same idea (I independently came up with it). RandomAction cited an article in spiegel.de:

Rights activists interrupted the project [by the East German Staatssicherheitsdienst to destroy the material] and rescued a total of 16,250 garbage bags full of scraps. But rescuing the history on those sheets of paper amounted to an absurdly difficult jigsaw puzzle. By 2000, no more than 323 sacks were legible again -- reconstructed by a team of 15 people working in Nuremburg -- leaving 15,927 to go. So the German government promised money to any group that could plausibly deal with the remaining tons of paper.
(From New Computer Program to Reassemble Shredded Stasi Files)

(End Update.)

Story via Nature.

Scroll down for more stories in the same category. (Story submitted 5/11/2007)

Follow this kind of news @Technovelgy.

| Email | RSS | Blog It | Stumble | del.icio.us | Digg | Reddit |

Would you like to contribute a story tip? It's easy:
Get the URL of the story, and the related sf author, and add it here.

Comment/Join discussion ( 1 )

Related News Stories - (" Culture ")

We Could Downgrade Puerto Rico - And Thereby Save It
'It was cheaper to pay the refugees to go without up-to-the-minute equipment.' - John Brunner, 1976.

The Neuroon Open Sleep Tracker For Lucid Dreaming
'Leads trail away from insertion points on her face and wrist... to a lucid dreamer on the bedside shelf.' - Peter Watts, 1999.

'Do Not Pay' Chatbots To Replace Law Firm Associates?
'I want my lawyer program.' - David Brin, 1990.

Translate One2One From IBM's Watson Your Communication Solution
'It then excretes into the mind of its carrier a telepathic matrix...' - Douglas Adams, 1979.

 

Google
  Web TechNovelgy.com   

Technovelgy (that's tech-novel-gee!) is devoted to the creative science inventions and ideas of sf authors. Look for the Invention Category that interests you, the Glossary, the Invention Timeline, or see what's New.

 

 

 

 

 

Current News

A 'Genuine Nanorobotic Production Factory'
'Microscopic machinery, smaller than ants, smaller than pins, working energetically, purposefully - constructing something...'

Neuromorphic Computer Offers Non-von Neumann Architecture
Fires faster than brain at 1/10K energy.

Evorus Your Crowd-Powered Conversational Assistant
'...the DS [Daily Schedule] was suddenly transformed into a valued confidante.'

Mealworms Food Of The Future
Get your grubs on.

Alibaba's AI May Read Better Than You
'Mike ... could accept other languages and was doing technical translating - and reading endlessly.'

Musk's Boring Flamethrower
'Skeletons in tatters. Burned by a flesh gun'

Humanity Star LEO Advertisement?
'Everyone has noticed those enormous advertisements...'

Nissan ProPILOT Slippers Are Self-Parking, Autonomous
Beyond science and fiction.

Atomristors - Atomic Memristors - Using Thin Nanomaterials
'I could almost feel those little tunnel junction neuristors working, forming their own interconnections as I operated it.'

Bigelow Prepares Inflatable Lunar Hotel
'Suddenly, hitherto unheard-of sums of money became available for investment in civilian orbital stations.'

Drunk Driver Of Tesla Claims Autopilot Was In Charge
'Mr. Garden, you are in no condition to drive.'

Medical Exoskeleton From Cyberdyne Gets FDA Approval
It's been a long road for HAL-5; I started writing about it in 2005.

Fungi-Infused Concrete Repairs Itself
'I noticed that curious mottled knots were forming, indicating where the room had been strained and healed faultily.'

Shiftwear Display Shoes
'He unlaced her shoe and glanced at its readout.'

NASA SEXTANT First With X-Ray Nav In Space
'You need at least four beacons for an accurate fix.'

GM Introduces Cruise AV With No Steering Wheel
'How about the steering wheel?' ... 'I do not need one.'

More SF in the News Stories

More Beyond Technovelgy science news stories

Home | Glossary | Invention Timeline | Category | New | Contact Us | FAQ | Advertise |
Technovelgy.com - where science meets fiction™

Copyright© Technovelgy LLC; all rights reserved.