Adversarial Pattern Shirts Confound Object Detection Systems

Computers are getting way too good at identifying us (systems in China are taking masks into account).


(Bright adversarial pattern shirt)

It turns out, confounding software into not realizing what it's looking at is a matter of fooling several different smaller systems at once.

Think about a person, for example. Now think of a person who looks nothing like that. And now do it again. Humanity, after all, contains multitudes, and a person can have many different appearances. A machine learning system needs to understand the diverse array of different inputs that, put together, mean "person." A nose by itself won't do it; an eye alone will not suffice; anything could have a mouth. But put dozens or hundreds of those priors together, and you've got enough for an object detector.

Code does not "think" in terms of facial features, the way a human does, but it does look for and classify features in its own way. To foil it, the "cloaks" need to interfere with most or all of those priors. Simply obscuring some of them is not enough. Facial recognition systems used in China, for example, have been trained to identify people who are wearing medical masks while trying to prevent the spread of COVID-19 or other illnesses.

And of course, to make the task even more challenging, different object detection frameworks all use different mechanisms to detect people, Goldstein explained. "We have different cloaks that are designed for different kinds of detectors, and they transfer across detectors, and so a cloak designed for one detector might also work on another detector," he said.

Science fiction writer Philip K. Dick, in his 1977 novel A Scanner Darkly, described a scramble suit, a device that enables the wearer to defy description, both in person and in surveillance videos:


(Explanatory Scramble suit video from the movie version)

The scramble suit was an invention of the Bell laboratories, conjured up by accident by an employee named S. A. Powers... Basically, his design consisted of a multifaceted quartz lens hooked up to a million and a half physiognomic fraction-representations of various people: men and women, children, with every variant encoded and then projected outward in all directions equally onto a superthin shroudlike membrane large enough to fit around an average human.
(Read more about Philip K. Dick's scramble suit)

I love this story, take a look at similar instances:

  - Let's Hear It For The Vague Blur!
  - Face Recognition Now Sees Through Disguises
  - HyperFace Aims To Foil Facial Recognition
  - Camouflage To Confound Face Recognition
  - RealFace Glamoflage T-Shirt Like PKD's Scramble Suit
  - CV Dazzle Anti-Surveillance Make-Up
  - Project KOVR Fashion Protection From Infosphere
  - Deep Learning Creates New Faces

Scroll down for more stories in the same category. (Story submitted 3/29/2020)

Follow this kind of news @Technovelgy.

| Email | RSS | Blog It | Stumble | del.icio.us | Digg | Reddit |

Would you like to contribute a story tip? It's easy:
Get the URL of the story, and the related sf author, and add it here.

Comment/Join discussion ( 0 )

Related News Stories - (" Surveillance ")

Adversarial Pattern Shirts Confound Object Detection Systems
Ah, to be a vague blur!

A Passing Drone Has Covid-19 Advice
'Gold dots against blue, basketball-sized, twelve feet up.' Larry Niven, 1972.

Drones Used To Smuggle Contraband Into Prison
'And some mega chip inside so it never runs into anything and no cop ever sees it.' - Bruce Sterling, 1994.

DARPA's Subterranean Challenge
Let the machines explore the underground city!

 

Google
  Web TechNovelgy.com   

Technovelgy (that's tech-novel-gee!) is devoted to the creative science inventions and ideas of sf authors. Look for the Invention Category that interests you, the Glossary, the Invention Timeline, or see what's New.

 

 

 

 

 

Current News

I Want My 1928 Telestereo Hologram Now
'Instantly there appeared standing upon the disk, the image of a man...'

Memes Now Come From Neural Nets
'Your order said for him to be able to be able to work out twists on the gags in the file...'

Robot Dog Learns To Be Doggy From Real Dogs
'So we took pictures of Guzub making a Three Planets, and I could construct this one to do it exactly right down to the thousandth of a second.'

Unwanted Cruise Ships Huddle Together Out At Sea
'On the screen they passed in an endless, boundaryless flood of green specks...'

Sono Sion Electric Car Charges As You Drive
'It drew its power from six square yards of sunpower screens on its low curved roof.'

News Mood Filter Web Extension
'He adjusted the n, the r and b knobs, and hopefully anticipated a turn for the better...'

Fetal Lamb Rests In Artificial Womb
'... stewing warm on their cushion of peritoneum and gorged with blood-surrogate and hormones, the foetuses grew and grew...'

MIT Wants To Catch Interstellar Visitors
'INVESTIGATE MYSTERIOUS OBJECT ENTERING NEW CALEDONIA SYSTEM FROM NORMAL SPACE'

AutoX Sets Up Asia's Largest Robotaxi Center
'The robot cab seemed to know where it was going and, no doubt, the master machine from which it received its signals knew.'

E - Ink's Automatic Self Styling Color-Changing Dress
'The racks of gowns itched and quivered, their colors running into blurred pools.'

Soft Robots Use Kirigami Piezoelectric Sensor Skin
'A worthy opponent was the golem.'

Bosch Smartglasses Laser Paints AR Image On Your Retina
'Soon we'll be testing a system that projects directly on the retina of the eye.'

Maybe We Could Hibernate Until The Covid-19 Pandemic's End
'Cold-rest was a common last resort therapy for functional psychoses.'

Workplace Monitoring Hell, I Mean, Tool For Safe Distancing
'And here is the weirdest part -- I never see another employee the entire day.'

Patent Office Says AIs Cannot Be Inventors
'The real smart ones are as smart as the Turing heat is willing to let 'em get.'

Starlink Orbital Network Like Coruscant Traffic Jam
Vermin of the Sky? Or Internet access for all?

More SF in the News Stories

More Beyond Technovelgy science news stories

Home | Glossary | Invention Timeline | Category | New | Contact Us | FAQ | Advertise |
Technovelgy.com - where science meets fiction™

Copyright© Technovelgy LLC; all rights reserved.