Mask-bot Robot Human Face

Mask-bot is a prototype robot face created at Institute for Cognitive Systems (ICS) at Germany's TU München by Dr. Takaaki Kuratate.


(Dr. Takaaki Kuratate and his robot communication interface Mask-Bot)

Many comparable systems project faces onto the front of a mask – following the same concept as cinema projection. "Walt Disney was a pioneer in this field back in the 1960s," explains Kuratate. "He made the installations in his Haunted Mansion by projecting the faces of grimacing actors onto busts." Whereas Walt Disney projected images from the front, the makers of Mask-bot use on-board rear projection to ensure a seamless face-to-face interaction.

This means that there is only a twelve centimeter gap between the high-compression, x0.25 fish-eye lens with a macro adapter and the face mask. The CoTeSys team therefore had to ensure that an entire face could actually be beamed onto the mask at this short distance. Mask-bot is also bright enough to function in daylight thanks to a particularly strong and small projector and a coating of luminous paint sprayed on the inside of the plastic mask. "You don't have to keep Mask-bot behind closed curtains," laughs Kuratate.

This part of the new system could soon be deployed in video conferences. "Usually, participants are shown on screen. With Mask-bot, however, you can create a realistic replica of a person that actually sits and speaks with you at the conference table. You can use a generic mask for male and female, or you can provide a custom-made mask for each person," explains Takaaki Kuratate.

In order to be used as a robot face, Mask-bot must be able to function without requiring a video image of the person speaking. A new program already enables the system to convert a normal two-dimensional photograph into a correctly proportioned projection for a three-dimensional mask. Further algorithms provide the facial expressions and voice.

To replicate facial expressions, Takaaki Kuratate developed a talking head animation engine – a system in which a computer filters an extensive series of face motion data from people collected by a motion capture system and selects the facial expressions that best match a specific sound, called a phoneme, when it is being spoken. The computer extracts a set of facial coordinates from each of these expressions, which it can then assign to any new face, thus bringing it to life. Emotion synthesis software delivers the visible emotional nuances that indicate, for example, when someone is happy, sad or angry.

SF movie fans are reminded of the robots depicted in the 2004 film I, Robot directed by Alex Proyas, based on Isaac Asimov's eponymous short-story collection. Take a look at this short excerpt showing Sonny, the most expressive of robots.

From Eurekalert.

Scroll down for more stories in the same category. (Story submitted 11/29/2011)

Follow this kind of news @Technovelgy.

| Email | RSS | Blog It | Stumble | del.icio.us | Digg | Reddit |

Would you like to contribute a story tip? It's easy:
Get the URL of the story, and the related sf author, and add it here.

Comment/Join discussion ( 1 )

Related News Stories - (" Robotics ")

China Building Robot Wives
'Want a life-companion, a pleasant one?' - Alice W. Fuller, 1895.

Stan, Robot Valet, Will Drag Your Car Away
'He activated the grapple tracks. ' - Frank Herbert, 1977.

Jibo Home Robot Says Goodbye, Is Killswitched
'It resembles an oyster....' Philip K. Dick, 1968.

I Can't Resist Worm Robots
'Seen close it was not completely flexible...' - Harry Harrison, 1962.

 

Google
  Web TechNovelgy.com   

Technovelgy (that's tech-novel-gee!) is devoted to the creative science inventions and ideas of sf authors. Look for the Invention Category that interests you, the Glossary, the Invention Timeline, or see what's New.

 

 

 

 

 

Current News

Unfurl The Future! Huawei Mate X versus Galaxy Fold
'A paper thin polycarbon screen unfurled silently from the top of the unit and immediately grew rigid.'

Amazon Echo And Google Home Should Have Morality Software
'The Dwoskin Morality Rating-Computer could 'spot the slightest tendency to deviation' from the social norm...'

China Building Robot Wives
'Want a life-companion, a pleasant one?'

China Social Credit System Like State-Run Whuffie
'At least there was no mandatory Whuffie check on the monorail platform...'

Project Soli Radar Gesture Chip Now FCC Approved
'He waved his hand and the circuit switched abruptly.'

Stan, Robot Valet, Will Drag Your Car Away
'He activated the grapple tracks. '

Jibo Home Robot Says Goodbye, Is Killswitched
'It resembles an oyster....'

Johns Hopkins Says Asteroid Deflection Will Be Difficult
'This obelisk is one huge deflector mechanism...'

Fabric Automatically Cools Or Insulates Based On Environment
'...a high-efficiency filter and heat-exchange system.'

Deepfakes From OpenAI GPT-2 Algorithm
'How can you compete with an IBM heavy-duty logomatic analogue?'

John Deere Self-Driving Tractor
'The huge plow... seemed to shake itself - and began to move back southward.'

North Focals Smart Glasses Provide Augmented Reality In Style
'The world ... is drenched in unfamiliar information all the way to the horizon.'

Tesla Driver Caught Napping Behind The Wheel
'Mary Risling settled back for a little nap...'

Hayabusa 2 To Begin Asteroid Mining
'We must dig down, and then doubtless we shall find the metal.'

Ionocraft Drone Powered By Electrohydrodynamic Thrust
'He saw one hiss by him as he rounded the corner, trailing a short whip antenna...'

Purdue Pharma Ready To Profit From OxyContin Use Or Addiction Recovery
'It may be organic damage. It may be permanent. Time'll tell, and only after you are off Substance D for a long while.'

More SF in the News Stories

More Beyond Technovelgy science news stories

Home | Glossary | Invention Timeline | Category | New | Contact Us | FAQ | Advertise |
Technovelgy.com - where science meets fiction™

Copyright© Technovelgy LLC; all rights reserved.