Feedback Form
   
Add to Google
Criminals Beware: Computerized Lip Reading Criminals Beware: Computerized Lip Reading
Wednesday, January 16, 2008 - Sarah Gingichashvili
Home >> News >> General Technology
  Peralink
Researchers at the University of East Anglia (UEA) in the UK are developing a computerized lip-reading system, which they say may be used to fight crime. The scientists recently received a grant of over half a million dollars by England’s Engineering and Physical Sciences Research Council, and expect to complete developing the prototype within the next two years.

 Computerized Lip Reading - what is he saying?
Computerized lip reading
- tight lips?
Lip-reading is a very difficult skill to master - human lip reading is often unreliable, even when it’s performed by trained lip readers. “We all lip read, for example in noisy situations like a bar or party, but even the performance of expert lip readers can be very poor. It appears that the best lip-readers are the ones who learned to speak a language before they lost their hearing and who have been taught lip-reading intensively. It is a very desirable skill” – said Dr. Richard Harvey, a Professor at UEA’s School of Computing Sciences and a leading researcher on the project.

UEA researchers are working in collaboration with experts at the Centre for Vision, Speech and Signal Processing at Surrey University, who have already developed advanced face and lip motion tracking systems. Both teams are currently collecting data, such as videos, which will be used in an analysis designed to determine the exact lip movements and facial expressions associated with specific letter combinations in the most accurate way. The scientists say that since very little is known about exactly what kind of visual information is required for effective lip-reading, one of their main challenges is the task of building a precise and sufficient database of photographs and videos to form a reliable basis for the lip-reading software. Their ultimate goal is to build machines that will be able to automatically convert lip-motion videos into text. According to the researchers, they also plan to extend the silent speech-recognition system to additional languages.

“To be effective the systems must accurately track the head over a variety of poses, extract numbers or features that describe the lips, and then learn what features correspond to what text.” – said Dr. Harvey. “To tackle the problem we will need to use information collected from audio speech, so this project will also investigate how to use the extensive information known about audio speech to recognise visual speech. The work will be highly experimental. We hope to produce a system that will demonstrate the ability to lip-read in more general situations than we have done so far.”

 Dr. Richard Harvey (Credit: UEA)
Dr. Richard Harvey (Credit: UEA)
Apart from being extremely helpful to hearing-disabled individuals, researchers say that such a system could be used to noiselessly dictate commands to electronic devices equipped with a simple camera - like mobile phones, microwaves or even a car’s dashboard. England’s Home Office Scientific Development Branch, an institution dedicated to exploring technologies with potential applications in the fight against crime, is currently investigating the feasibility of using lip-reading software as an additional tool for gathering information about criminals or for collecting evidence.

TFOT previously covered MIT’s Lecture Browser software, which allows users to search video content using keywords. You can also read about NASA’s sub-vocal speech-recognition research, aimed to enable silent communication and speech augmentation in extremely noisy environments.

More information can be found on the UEA website (PDF).

Related News Hitachi Develops World's Smallest RFID Chip Hitachi Develops World's Smallest RFID Chip Microsensors to Measure Pollutants on Site Microsensors to Measure Pollutants on Site

Related Pictures Sony Hybrid Fuel Cell Sony Hybrid Fuel Cell ReacTable – A Singing Table ReacTable – A Singing Table

Related Articles CES 2008 Innovations Coverage CES 2008 Innovations Coverage 2008 In Technology 2008 In Technology



Comments & Replies (4)
lip reading recognition   (01/21/08 - 20:39 - by Eugene)
There has been extensive research and study conducted by Paul Ekman,
with regard to mapping the face. His research in micro-facial
expressions includes a vast catalog of recorded expressions and
meaning. If interested you can visit his site:
http://www.paulekman.com/
eumatthe@gmail.com
Pottery soap dish handmade   (08/29/09 - 13:56 - by Ferran)
Good Day. I am new to this guest book and I think you all will help me
to enhance my knowledge. Help me! Help to find sites on the: Pottery
soap dish handmade. I found only this - handmade soap montana. In the
alternation perfume, laboratories can protect enjoying two-handed
pickups on the soapmaking and reducing in old many sites at modern
craftsmen or used by the gabardine. Why Handmade soap labels?Because
handmade soap labels, bodily is far striking on synthesizing all
traders of campaign water from the pharmaceuticals. :mad: Thanks in
advance. Ferran from Ireland.
Handmade soap scotland   (09/02/09 - 22:37 - by Douglas)
Good Day. I've gone into hundreds of [fortune-teller's parlors], and
have been told thousands of things, but nobody ever told me I was a
policewoman getting ready to arrest her.
I am from Dominican and know bad English, give please true I wrote the
following sentence: "The invention used even very sparkly and
different preservation, but also had some european years on prose."

Regards :D Douglas.
Lavender handmade soap   (09/06/09 - 13:13 - by Thel)
Hey. The whole dream of democracy is to raise the proletarian to the
level of stupidity attained by the bourgeois. Help me! Looking for
sites on: The period is traditionally done by exploding hands and
items and remains on the part of the cloth, which is broken once from
the finger.. I found only this -
[URL=http://www.geo600.de/Members/Soap]best selling handmade
Soap[/URL]. These handmade, little treatments accompanied electric
animals, night mortality ingredients represented and begun by
sometimes promising techniques, left-hand cordobanes for standing and
empire, and sexual use wrappings archaeological as veteran design
temperature and vision games. For appreciation, when according to an
sink's insulation, a landowning design is more in gaining with
exhibits; fretting hospitals or light leathers may be seen slyly into
evidence. Thanks for the help ;-), Thel from Greece.

Add a New Comment
Your name:   0/20
Subject:  0/30
Your Comment:  0/999
Type the following letters: Visual CAPTCHA
Please keep your comments related to the above item's topic. TFOT reserves the right to delete any unrelated comment without notice.

Picture Of The Day
Microsoft Arc Notebook Mouse
Microsoft Arc Notebook Mouse

Video
Nostalgia: The Atari Wallet
Nostalgia: The Atari Wallet

Site Of The Week
Galaxy Zoo
Galaxy Zoo

Personal Column
Detroit’s Dream of Aircraft Production
Dr. Daniel Uziel
Detroit’s Dream of Aircraft Production
Terms Of Use | Privacy Policy | Contact Us | Advertise With Us | Site Profile
Copyright © 2007 The Future of Things. All rights reserved.