Control Robot Planes With Hand Gestures!

Aircraft-carrier crew have long used hand gestures to guide planes on the carrier deck. MIT researchers are working on a gesture recognition system for drone aircraft.


(MIT video shows gesture control)

Yale Song, a PhD student in MIT’s Department of Electrical Engineering and Computer Science, his advisor, computer science professor Randall Davis, and David Demirdjian, a research scientist at MIT’s Computer Science and Artificial Intelligence Laboratory (CSAIL), recorded a series of videos in which several different people performed a set of 24 gestures commonly used by aircraft-carrier deck personnel. In order to test their gesture-identification system, they first had to determine the body pose of each subject in each frame of video...

The main challenge in classifying the signals, Song explains, is that the input — the sequence of body positions — is continuous: Crewmembers on the aircraft carrier’s deck are in constant motion. The algorithm that classifies their gestures, however, can’t wait until they stop moving to begin its analysis. “We cannot just give it thousands of [video] frames, because it will take forever,” Song says.

Gesure-recognition by machines is a familiar idea to anyone who has read Douglas Adams' Hitchhiker's Guide to the Galaxy:

The machine was rather difficult to operate. For years radios had been operated by means of pressing buttons and turning dials; then as the technology became more sophisticated the controls were made touch-sensitive--you merely had to brush the panels with your fingers; now all you had to do was wave your hand in the general direction of the components and hope.
(Read more about Adam's gesture control)

Update: Here's a science-fictional example of a gesture-controlled aircraft from the series Earth: Final Conflict (starts about thirty seconds into the clip):

After arriving on Earth, the Taelons (also known as the Companions) entered into a partnership with the Human race and one of the many recruited into their service due to her extensive experience as a Marine pilot was Captain Lili Marquette (Played by Lisa Howard). Lili was an ergonomic prodigy that not only redesigned elements from the internal shuttle structure, she most importantly created a holographic gesture control shield interface which allowed humans to fly Taelon Shuttles. Consequently, Lili leveraged her position, knowledge and experience to create the Official Taelon Shuttle pilot certification program for humans. The Taelon shuttles can travel in both normal and inter-dimensional space.
(Earth: Final Conflict)

Thanks as always to Moira, for contributing the tip! End update.

I'm looking forward to seeing the video from a drone strafing run showing someone on the ground attempting to hack into the plane's operating system with gestures...

From MIT.

Scroll down for more stories in the same category. (Story submitted 3/15/2012)

Follow this kind of news @Technovelgy.

| Email | RSS | Blog It | Stumble | del.icio.us | Digg | Reddit |

Would you like to contribute a story tip? It's easy:
Get the URL of the story, and the related sf author, and add it here.

Comment/Join discussion ( 0 )

Related News Stories - (" Engineering ")

Tiny LEDs Developed For Dust-Sized Computers
'They use sparkles to talk to each other...' - Neal Stephenson, 1995.

Seabreacher, H.G. Winter's 1939 Torpoon
'Ken lay full-length in the padded body compartment, his feet resting on the controlling bars of the directional planes, hands on the torpoon's engine levers.' - HG Winters, 1939.

Project Soli Radar Gesture Chip Now FCC Approved
'He waved his hand and the circuit switched abruptly.' - Philip K. Dick, 1955.

Implosion Fabrication Shrinks 3D Objects To Nanoscale
'Carter had watched miniaturization a hundred times...' - Isaac Asimov, 1965.

 

Google
  Web TechNovelgy.com   

Technovelgy (that's tech-novel-gee!) is devoted to the creative science inventions and ideas of sf authors. Look for the Invention Category that interests you, the Glossary, the Invention Timeline, or see what's New.

 

 

 

 

 

Current News

Nobe 3-Wheel Electric Vehicle Parking Like I, Robot
Spidercar, Spidercar, does whatever a spidercar does.

Michelin Self-Sealing Tires On Ford's Explorer
'...a seal of compressed plastifoam to save the air.'

Mushroom Eats Plastic, Saves Planet
Fungus Amongus, SaveUs!

Juggalo Face Paint Disrupts Facial Recognition
'... designed to foil facial recognition systems.'

Mojipic Smart Voice Vehicle Emojis
KITT, what's your response?

Unusual Twist On Woman Dates Robot
'My hearing, vision and awareness went along with that excellent imitation of a young Adonis...'

BrainNet Triple Telepathic Gaming Threat
'In the gloomy half-darkness the three idiots sat babbling.'

AVAS Noisemakers Required For EVs By EU
'...a sound tape to supply the noise of a soi-disant "[internal combustion]" engine...'

Pun Generation Via Neural Nets
'You said you wanted him to be able to distinguish between laugh-power in different gags...'

Blood Battery Robotic Fish
'With one fluid motion, it surged forward, plunged, and was gone.'

Lightyear One Solar-Powered Electric Car (Design By Heinlein)
'It drew its power from six square yards of sunpower screens on its low curved roof.'

'Agression Detectors' Don't Work When Spying On Students
'The professional agitators had also learned how to modulate their voices below the danger level...'

Mining Of Golden Asteroid Foretold In 1898 Science Fiction
'This must be a golden planet—this little asteroid.'

Miners! NASA Wants To License RASSOR Excavator
'The borers had been dismantled and packed away.'

Bee+ Robobee Now With Four Wings
'It was a tiny thing, scarcely more than an inch and a half in length...'

CNSILK Robotic Spider Builder
'We could certainly spin a web right through the Solar System, if we can think of a good use for one.'

More SF in the News Stories

More Beyond Technovelgy science news stories

Home | Glossary | Invention Timeline | Category | New | Contact Us | FAQ | Advertise |
Technovelgy.com - where science meets fiction™

Copyright© Technovelgy LLC; all rights reserved.