Feedback Form
   
Add to Google
Speaking Without Saying a Word Speaking Without Saying a Word
Thursday, October 12, 2006 - Iddo Genuth
Home >> Articles >> General Technology
  Peralink
In two years time a technology that will enable users to speak without uttering a sound might become commercially available. The ability to communicate silently could assist us in every day situations such as a phone conversation on a crowded subway or simply anytime we'd prefer that others wouldn't hear us. It could aid security and special operations forces, people with vocal cord problems, and might even find a place in gaming.
 
Tester with subvocal system
electrodes (Credit: NASA)
Seven years ago a modest NASA research program aimed at developing the ability to capture, analyze, and recreate subvocal speech was initiated as part of NASA's Extension of the Human Senses program. The subvocal speech-recognition research, headed by Dr. Charles Jorgensen, was initially aimed at developing silent communication and speech augmentation in extremely noisy environments such as the space station. It soon became clear that the technology could have many other applications as well; it could enable bodyguards, security personal, or Special Forces during highly covert operations to communicate without detection, and tank commanders to give orders even during noisy fighting conditions. The technology also has many civilian applications, enabling users to talk with privacy even in the company of others or in very noisy environments. Firefighters and other help and rescue personal could use the technology in their daily routines (as this NASA video shows), as could people with vocal cord disorders. Finally, the technology could find its way into the gaming market as a way to send specific commands to team members in multiplayer games.

 
NASA's Chief Scientist for
Neuroengineering - Chuck-Jorgensen
(Credit: NASA)
Subvocal speech is silent, or sub-auditory, speech, such as when a person silently reads or talks to himself. Even when reading or speaking to oneself with or without actual lip or facial movement, biological signals arise. While using the NASA subvocal system, a person thinks of a phrase and talks to himself so quietly that it can't be heard; despite that, the tongue and vocal cords receive speech signals from the brain that are detected and analyzed using a small electrode placed on the throat. Jorgensen created a neural net to analyze electrical patterns recorded by the electrodes and by 2004 he reached a 99% recognition rate with a small number of words in addition to vowels and consonants. Jorgensen's goal is to be able to reach a stage in which it would be possible to interface his subvocal technology with existing speech recognition systems, thus allowing full subvocal recognition. In addition, Jorgensen and his team are striving to improve exiting electrodes, transforming them into more advanced and conferrable sensors. Jorgensen foresees such advanced sensors embedded in either clothing or some sort of adorned simple appliance, allowing the electrical signals to be picked up in a non-invasive, convenient, and comfortable way.

To learn more about subvocal speech technology, its current state and future potential, TFOT interviewed Dr. Chuck Jorgensen, Chief Scientist for Neuroengineering at NASA Ames Research Center.


Q: When did the subvocal speech project begin and what was the initial motivation for it?
A: The Subvocal program at NASA started in 1999. It was part of a larger program called the Extension of the Human Senses. It was motivated by communication problems under pressurized breathing equipment and alternate gas mixtures occurring in space operations and high noise environments such as extra-vehicular missions and space station operations.


Q: What is subvocal speech and how did you detect and translate it into normal speech?
A: Subvocal speech is the direct non-auditory interpretation of the nervous system signals sent to muscles of the vocal tract (e.g., electromyographic or EMG signals). It is measured by surface contact sensors and the electrical signals are transformed into patterns recognized by classifiers as word or word components.

Q: Is there a difference between "thinking in words" and subvocal speech?  In other words, would you describe your device as a mind reading machine (even if a crude one at that)?
A:
Yes, there is a difference. Subvocal speech requires some activation of the speech muscles. It is not in any way a mind reading machine. Subvocal speech requires active cooperation and intentional stimulation of the speech muscles. Hence it is voluntary and private.


Q: In 2004 your device was only able to recognize about ten or so words. What advancements have you made since then?
A: We are up to about 25 words and 38 vowels and consonants. We are communicating in real time in pressurized suits to live cell phones.

Q: What do you think could be the main application of such technology and how much computing power will be necessary to make it work effectively?
A:
A silent cell phone, military operations, bioelectric device control, and handicapped communication. As for your second question, a small wearable PDA or PC will suffice. With custom chips it could be much smaller yet. Specialized sensors are also factors that will increase usability.


Q: How many sensors do you currently use in your test and how do you predict commercial applications of the technology implement the sensors?

A: We currently use two sensors although, if needed, that number can easily be increased to detect specific speech articulator movements. It is just a cost question. We are also in late stage development of a non-contact capacitive sensor that would not require wires or the messy medical style Ag/AgCl sensors used in the lab.


Q: Does the software you developed need to learn the EMG signals of every user (like voice recognition software), and how long does it take to teach the software each word?
A:
Right now it is user-specific; we are not at the level of speaker-independent recognition, much like the early stages of acoustic voice recognition. We can learn six to ten words in a morning, taking about one hour plus to acquire the signals and a half hour to train the recognition system.


Q: Are you working on composition of full sentences, and what are the current obstacles in your way of achieving this goal?
A: At this stage, only simple two or three word phrases. Our effort is small and resource-constrained more than technically constrained. If we recognize more vowels and consonants and be able to connect to existing speech recognition systems quickly, making the full sentence issue a largely solved problem.


Q: Have DARPA and the U.S. military been actively interested in the technology?
A: Yes, DARPA (The Defense Advanced Research Projects Agency) has begun a recent program using the technology after consulting with us. We are working on a couple of other military applications of interest to us through small company subcontracts, but NASA is a civilian agency and that is not our main focus.

Q: Could you give some sort of time estimate for a commercial application of the technology?
 
Two sensors on a
tester's neck (Credit: NASA)
A:
It depends on private user communities and their interest. Gaming would probably go first, then more sophisticated users, as the technology is refined in the field. Two to four years is achievable. Much faster progress would be possible if major resources were devoted to technology applications, since we now have a pretty good handle on the scientific research questions and more of the hold up is in engineering implementations.
Related Articles 2008 In Technology 2008 In Technology 2007 In Technology 2007 In Technology

Related News New Technique Braces Buildings against Earthquakes New Technique Braces Buildings against Earthquakes New Technology can Identify Distorted Fingerprints New Technology can Identify Distorted Fingerprints

Related Pictures BMX Wheelchair BMX Wheelchair XWave is The First Brainwave Interface XWave is The First Brainwave Interface



Comments & Replies (15)
that will still have a long way to go   (07/03/09 - 2:42 - by jane)
well, a project like that is fantastic. what about now? already 3
years past lol
I would rather go to http://www.lucky-eyewear.com/ for a reading
glass if i am near-sighted. That is more efficient. the same if i
can't say or hear any words, i have many other alternations, like body
language, writing,...that will be more direct and money saving lol
adf   (07/14/09 - 20:19 - by adfd)
sem, 搜索引擎营销,
study Chinese in China means you can make a good progress in learning
chinese because you can
learn Chinese in China, and you need to find a good Mandarin School in
China that you can Study Mandarin in China. so mandarincapital.cn is
you good choice just learn chinese study mandarin hangzhou to see the
good west lake and learn chinese
living for the future   (11/24/09 - 15:25 - by brokenportal)
Things like this are exactly the kind of things that the movement for
indefinite life extension is working to create indefinite healthy life
extension for. The future is going to be amazing, and to be dead while
its going on would suck.

This reminds me of another thing Ive seen lately, where you were a
helmet that picks up brainwaves that allow you to do simple things,
not speak yet, but it can get there in time.
Communicating with the Chips   (02/07/10 - 11:57 - by Uncle B)
This appears to be one more way to communicate with computers, silent
or not, the signals can be fed to the chips in computers as
intelligence! Typing, and voice devices are limiting factors for
computing, imagine dictating letters, instructions, messages without
making a sound! The future is here.better than am electrical
connection to the brain itself.
application of sub vocal   (04/19/10 - 9:20 - by Barbara Dahm)
I have used your technological application of sub vocal speech to show
my clients who stutter how speech is developed. Most people who
stutter try to get words out. I refer them to your research to show
them that it is enough to talk in their head. The signal for executing
the speech will happen without thought or effort. Actually having such
a device would be a great therapy tool The person could actually
experience how this happens.
Subvocal Communication   (05/11/10 - 10:58 - by Unknown)
Iv recently figured out how to do this exact thing 4 days ago. My
roommates have been thinking that they have been going insane.
Subvocal communication   (05/11/10 - 11:06 - by Unknown)
oh wait you ment with a machine
subvocal   (06/22/10 - 1:06 - by very very interested)
Another application for this is for hearing and hearing impaired to
communicate, maybe through bluetooth link to a pda or smartphone,
maybe even some kind of digital visor that holographs the words
   (07/01/10 - 5:26 - by )
ssss]]d]d]


not schizophrenia   (03/02/11 - 2:34 - by chris)
I've searched the internet on information about implants. The first
brain implant is said to have been in ohio in 1974 but there is
nothing about who or how many or what happened to them. I've also seen
where electrodes were being implanted in babies heads as early as 1946
without parental consent/knowledge. Also there was an implant called
the "rambo chip" used on soldiers during the vietnam war. That was
before 1975. So how does Ohio fit in? Did it ever really stop after
1946? Or after Vietnam? The NSA has poison kits to run
pharmapsychology drugs into homes. Drugs used to aid in mind control.
I've found powder in my ears in several places in ohio. I've also been
harassed by police in indiana and ohio. I was born in 1976. This is
2011. How far has it come without anyone knowing? Why doesn't anyone
believe the technology is there except the people that are harassed
and the people who design and use it? Is it possible that most people
have implants from birth or the unlucky visit to a doctor who sold
out? Implants can control all of your brain functions and can induce
and control dreams. Is that how some people who are born deaf dream in
spoken english? A survey in Great Britain showed that 7-10 percent of
the people hear voices. A psychiatrist suggested to one woman she
should talk to the voices. He said they were all part of her
subconscious. I believe we all have an inner voice but don't think we
talk to it. I don't think she's crazy. I think she has an implant. How
many people in this country have an actual "inner voice"? Maybe you
have an implant. And if you don't hear voices or an inner voice that
doesn't mean they're not watching you.
bose ear headphone   (03/14/11 - 6:28 - by bosemm)

bose on ear headphones
cool   (05/04/11 - 12:09 - by The Pretty One)
cool dat jullie dreuzels gedachten kunnen lezen zonder te toveren.
wjxbqcHWFv   (09/13/11 - 1:01 - by Sondi)
I relaly couldn't ask for more from this article.
FXrAPBkXdV   (09/14/11 - 2:27 - by esrgzvw)
TVHjDG jmyfqegdqhlb
xBAdTGNuPkNFx   (09/16/11 - 3:21 - by ezmrrkucci)
DRYdlS swzwijufwvdy


Picture Of The Day
Robotic Space Travel with Spidernaut
Robotic Space Travel with Spidernaut

Video
Pix4D-Turns 2D Photos into 3D Images
Pix4D-Turns 2D Photos into 3D Images

Site Of The Week
Galaxy Zoo
Galaxy Zoo

Personal Column
Detroit’s Dream of Aircraft Production
Dr. Daniel Uziel
Detroit’s Dream of Aircraft Production
Terms Of Use | Privacy Policy | Contact Us | Advertise With Us | Site Profile
Copyright © 2011 The Future of Things. All rights reserved.