Seminar
Seminar
Seminar
On
Submitted in partial fulfillment of the Requirements for the award of the degree
BACHELOR OF TECHNOLOGY
IN
Submitted By
D PRATHYUSHA (19H61A0411)
1
ANURAG GROUP OF INSTITUTIONS
CERTIFICATE
This is to Certify that the seminar reported entitled “SILENT SOUND TECHNOLOGY”,
being submitted by D PRATHYUSHA (19H61A0411) in partial fulfillment for the award of
Degree of Bachelor of Technology in ELECTRONICS AND COMMUNICATION
ENGINEERING, during the academic year 2019-2023. Certified further, to the best of our
knowledge, the work reported here is not a part of any other project on the basis of which a
degree or an award has been given on an earlier occasion to any other candidate. The results
have been verified and found to be satisfactory
2
ACKNOWLEDGEMENT
I would like to express my sincere thanks to Prof.N.Mangala Gouri, Head of the Department of
ELECTRONICS AND COMMUNICATION ENGINEERING, Anurag Group of Institutions,
Ghatkesar, her motivation in the field has made me to overcome all hardships during the course of
study and successful completion of seminar. I extend my sincere thanks to Dr. G. Vishnu Murthy,
Dean, School of Engineering, Anurag Group of Institutions, Venkatapur(V), Ghatkesar(M),
Medchal District, for his encouragement and constant help. Finally, I would like to express my
heartfelt thanks to my parents who were very supportive both financially and mentally and for their
encouragement to achieve my set goals.
D.PRATHYUSHA (19H61A0411)
3
DECLARATION
This is to certify that the technical seminar report work entitled “SILENT SOUND
TECHNOLOGY” submitted to Anurag Group of Institutions in partial fulfillment of the
requirement for the award of the Degree of Bachelor of Technology (B-Tech), is an original work
carried out by D PRATHYUSHA (19H61A0411). This matter embodied in this technical
seminar is a genuine work, done by the student and has not been submitted whether the university
or to any other university/Institute for the fulfillment of the requirement of any course of study.
D.PRATHYUSHA (19H61A0411)
4
ABSTRACT
Everybody has the experience of talking aloud in the cell
phone in the midst of the
disturbance while travelling in trains or buses. There is no need of
shouting anymore for this
purpose. ‘Silent sound technology’ is the answer for this problem.
The Silent sound technology is an amazing solution for those who had
lost their voice but
wish to speak over phone. It is developed at the Karlsruhe Institute of
Technology and you
can expect to see it in the near future. When demonstrated, it seems
to detect every lip
movement and internally converts the electrical pulses into sounds
signals and sends them
neglecting all other surrounding noise. It is definitely going to be a
good solution for those
feeling annoyed when other speak loud over phone.
‘Silent Sound’ technology aims to notice every movements of the lips
and transform them
into sounds, which could help people who lose voices to speak, and
allow people to make
silent calls without bothering others. Rather than making any sounds,
your handset would
decipher the movements your mouth makes by measuring muscle
activity, then convert this
into speech that the person on the other end of the call can hear. So,
basically, it reads your
lips. This new technology will be very helpful whenever a person looses
his voice while
speaking or allow people to make silent calls without listurbing others,
even we can tell our
PIN number to a trusted friend or relative without eavesdropping . At
the other end, the
5
listener can hear a clear voice. the awesome feature added to this
technology is that "it is an
instant polyglot" I.E, movements can be immediately transformed into
the language of the
user's choice. This translation works for languages like English,
French & German. But, for
the languages like Chinese, different tones can hold many different
meanings. This poses
Problem said Wand. he also said that in five or may be in ten years this
will Be used in
everyday's technology.
ABSTRACT
Everybody has the experience of talking aloud in the cell
phone in the midst of the
disturbance while travelling in trains or buses. There is no need of
shouting anymore for this
purpose. ‘Silent sound technology’ is the answer for this problem.
The Silent sound technology is an amazing solution for those who had
lost their voice but
wish to speak over phone. It is developed at the Karlsruhe Institute of
Technology and you
can expect to see it in the near future. When demonstrated, it seems
to detect every lip
movement and internally converts the electrical pulses into sounds
signals and sends them
neglecting all other surrounding noise. It is definitely going to be a
good solution for those
feeling annoyed when other speak loud over phone.
‘Silent Sound’ technology aims to notice every movements of the lips
and transform them
into sounds, which could help people who lose voices to speak, and
allow people to make
silent calls without bothering others. Rather than making any sounds,
your handset would
decipher the movements your mouth makes by measuring muscle
activity, then convert this
into speech that the person on the other end of the call can hear. So,
basically, it reads your
lips. This new technology will be very helpful whenever a person looses
his voice while
6
speaking or allow people to make silent calls without listurbing others,
even we can tell our
PIN number to a trusted friend or relative without eavesdropping . At
the other end, the
listener can hear a clear voice. the awesome feature added to this
technology is that "it is an
instant polyglot" I.E, movements can be immediately transformed into
the language of the
user's choice. This translation works for languages like English,
French & German. But, for
the languages like Chinese, different tones can hold many different
meanings. This poses
Problem said Wand. he also said that in five or may be in ten years this
will Be used in
everyday's technology.
ABSTRACT
Everybody has the experience of talking aloud in the cell phone in the midst
of the disturbance while travelling in trains or buses. There is no need of shouting anymore for
this purpose. ‘Silent sound technology’ is the answer for this problem.
The Silent sound technology is an amazing solution for those who had lost their voice but wish
to speak over phone. It is developed at the Karlsruhe Institute of Technology and you can expect
to see it in the near future. When demonstrated, it seems to detect every lip movement and
internally converts the electrical pulses into sounds signals and sends them neglecting all other
surrounding noise. It is definitely going to be a good solution for those feeling annoyed when
other speak loud over phone.
‘Silent Sound’ technology aims to notice every movements of the lips and transform them
into sounds, which could help people who lose voices to speak, and allow people to make silent
calls without bothering others. Rather than making any sounds, your handset would decipher the
movements your mouth makes by measuring muscle activity, then convert this into speech that
the person on the other end of the call can hear. So, basically, it reads your lips. This new
technology will be very helpful whenever a person looses his voice while speaking or allow
people to make silent calls without disturbing others, even we can tell our PIN number to a trusted
friend or relative without eaves dropping . At the other end, the listener can hear a clear voice. the
7
awesome feature added to this technology is that "it is an instant polyglot" I.E, movements can be
immediately transformed into the language of the user's choice. This translation works for
languages like English, French & German. But, for the languages like Chinese, different tones can
hold many different meanings. This poses Problem said Wand. he also said that in five or may be
in ten years this will Be used in everyday's technology.
8
TABLE OF CONTENT
9
CHAPTER: 1
INTRODUCTION
1.1 INTRODUCTION
Silence is the best answer for all the situations …even your mobile understands !
The word Cell Phone has become greatest buzz word in Cellular Communication
industry.
There are lots and lots of technology that tries to reduce the Noise pollution and make the
environment a better place to live in.
I will tell about a new technology known as Silent Sound Technology that will put an end
to Noise pollution.
2 2022
3 CHAPTER: 1
10
4 INTRODUCTIO
N
5Silence is the best answer
for all the situations …even
your mobile understands !
6 The word Cell
Phone has become greatest
buzz word in Cellular
Communication
7industry.
8 There are lots and
lots of technology that tries
to reduce the Noise
pollution and make
11
9the environment a better
place to live in.
1 0 I will tell about
a new technology known as
Silent Sound Technology
that will put an
11 end to Noise pollution.
12 Silence is the best
answer for all the situations
…even your mobile
understands !
1 3 The word Cell
Phone has become greatest
buzz word in Cellular
Communication
14 industry.
12
1 5 There are lots
13
transform them into sounds, which could help people who lose voices to speak, and allow
uttered
The device, developed by the Karlsruhe Institute of Technology (KIT), uses
electromyography, monitoring tiny muscular movements that occur when we speak
and converting them into electrical pulses that can then be turned into speech, without a sound
uttered.
‘Silent Sound’ technology aims to notice every movements of the lips and transform them
into sounds, which could help people who lose voices to speak, and allow people to make
silent calls without bothering others. Rather than making any sounds, your handset would
decipher the movements your mouth makes by measuring muscle activity, then convert this
into speech that the person on the other end of the call can hear. So, basically, it reads your
lips. “We currently use electrodes which are glued to the skin. In the future, such electrodes
might for example by incorporated into cellphones,” said Michael Wand, from the KIT.
14
Figure1.1-common people talking at same place without disturbance.
2022
The technology opens up a
host of applications, from
helping people who have lost
their
voice due to illness or
accident to telling a trusted
15
friend your PIN number over
the phone
without anyone
eavesdropping — assuming
no lip-readers are around.
The technology can also turn
you into an instant polyglot.
Because the electrical pulses
are
universal, they can be
immediately transformed
into the language of the
user’s choice.
The technology opens up a host of applications, from helping people who have lost their voice
due to illness or accident to telling a trusted friend your PIN number over the phone without
anyone eavesdropping — assuming no lip-readers are around. The technology can also turn
16
you into an instant polyglot. Because the electrical pulses are universal, they can be
immediately transformed into the language of the user’s choice.
2022
The technology opens up a host of applications, from helping people who have lost their
voice due to illness or accident to telling a trusted friend your PIN number over the
phone
without anyone eavesdropping — assuming no lip-readers are around.
The technology can also turn you into an instant polyglot. Because the electrical pulses
are
universal, they can be immediately transformed into the language of the user’s choice.
“Native speakers can silently utter a sentence in their language, and the receivers hear
the
translated sentence in their language. It appears as if the native speaker produced speech
in a
foreign language,” said Wand.
The translation technology works for languages like English, French and Gernan, but
for
languages like Chinese, where different tones can hold many different meanings, poses
a
problem, he added.
Noisy people in your office? Not anymore. “We are also working on technology to be
used in
an office environment,” the KIT scientist told AFP.
The engineers have got the device working to 99 percent efficiency, so the mechanical
voice
at the other end of the phone gets one word in 100 wrong, explained Wand.
“But we’re working to overcome the remaining technical difficulties. In five, maybe
ten
years, this will be useable, everyday technology,” he said.
Native speakers can silently utter a sentence in their language, and the receivers hear the
translated sentence in their language. It appears as if the native speaker produced speech in a
foreign language,” said Wand. The translation technology works for languages like English,
French and German, but for languages like Chinese, where different tones can hold many
different meanings, poses a problem, he added. Noisy people in your office? Not
anymore.
“We are also working on technology to be used in an office environment,” the KIT scientist
told AFP. The engineers have got the device working to 99 percent efficiency, so the
mechanical voice at the other end of the phone gets one word in 100 wrong, explained Wand.
17
“But we’re working to overcome the remaining technical difficulties. In five, maybe ten
years, this will be useable, everyday technology,” he said.
CHAPTER: 2
NEED FOR SILENT
SOUND
18
Silent Sound Technology
will put an end to
embarrassed situation such
as-
An person answering
his silent, but vibrating
cell phone in a meeting,
lecture or
performance, and whispering
loudly, ‘ I can’t talk to you
right now’ .
In the case of an urgent
call, apologetically rushing
out of the room in order to
answer
or call the person back.
19
CHAPTER 2
Silent Sound Technology will put an end to embarrassed situation such as- An person
answering his silent, but vibrating cell phone in a meeting, lecture or performance, and
whispering loudly, ‘ I can’t talk to you right now’ . In the case of an urgent call, apologetically
rushing out of the room in order to answer or call the person back.
ORIGINATION:
Humans are capable of
producing and
understanding whispere
speech in quiet
environments at remarkably
low signal levels. Most
people can also understand a
few
unspoken words by lip-
reading The idea of
20
interpreting silent speech
electronically or
with a computer has been
around for a long time,
and was popularized in the
1968
Stanley Kubrick science-
fiction film ‘‘2001 – A Space
Odyssey ” A major focal
point was
the DARPA Advanced
Speech Encoding Program
(ASE ) of the early
2000’s, which
funded research on low bit
rate speech synthesis ‘‘with
21
acceptable intelligibility,
quality ,
and aural speaker
recognizability in
acoustically harsh
environments”,
ORIGINATION
22
transport trucks, and horns
and buzzers of all types and
descriptions you have a wall
of
constant noise and irritation.
Even when watching a
television program at a
reasonable
volume level you are blown
out of your chair when a
commercial comes on at the
decibel
level of a jet.
The technology opens up a
host of applications, from
23
helping people who have lost
their
voice due to illness or
accident to telling a trusted
friend your PIN number over
the phone
without anyone
eavesdropping — assuming
no lip-readers are
around.Native speakers can
silently utter a sentence in
their language, and the
receivers hear the translated
sentence in
their language. It appears as
if the native speaker
24
produced speech in a foreign
language.
When you add lawnmowers, snow blowers, leaf blowers, jack hammers, jet engines,
transport trucks, and horns and buzzers of all types and descriptions you have a wall of
constant noise and irritation. Even when watching a television program at a reasonable
volume level you are blown out of your chair when a commercial comes on at the decibel
level of a jet.
The technology opens up a host of applications, from helping people who have lost their
voice due to illness or accident to telling a trusted friend your PIN number over the phone
without anyone eavesdropping — assuming no lip-readers are around. Native speakers can
silently utter a sentence in their language, and the receivers hear the translated sentence in
their language. It appears as if the native speaker produced speech in a foreign language.
2022
CHAPTER: 3
METHODS
Silent Sound Technology is
processed through some
ways or methods. They are
25
Electromyography
(EMG)
Image Processing
CHAPTER 3
METHODS
Silent Sound Technology is processed through some ways or methods. They are
Electromyography (EMG)
Image Processing
Electromyography:
The Silent Sound
Technology uses
electromyography,
monitoring tiny muscular
movements that occur when
we speak.
26
Monitored signals are
converted into electrical
pulses that can then be
turned into
speech, without a sound
uttered.
Electromyography
(EMG) is a technique for
evaluating and recording the
electrical
activity produced by skeletal
muscles.
An electromyography
detects the electrical
potential generated by
muscle cells, when
27
these cells are electrically or
neurologically activated.
Electromyographic
sensors attached to the face
records the electric signals
produced
by the facial muscles,
compare them with pre
recorded signal pattern of
spoken words
When there is a match
that sound is transmitted on
to the other end of the line
and
person at the other end listen
to the spoken words
28
Electromyography
Monitored signals are converted into electrical pulses that can then be turned into
Electromyographic sensors attached to the face records the electric signals produced
by the facial muscles, compare them with pre recorded signal pattern of spoken words
When there is a match that sound is transmitted on to the other end of the line and
Image Processing:
The simplest form of
digital image processing
29
converts the digital data tape
into a film
image with minimal
corrections and calibrations.
Then large mainframe
computers are employed
for sophisticated
interactive
manipulation of the data.
In the present context,
overhead prospective are
employed to analyze the
picture.
In electrical engineering
and computer science,
30
image processing is any
form of
signal processing for which
the input is an image, such as
a photograph or video
frame; the output of
image processing may be
either an image or, a
set of
characteristics or parameters
related to the image. Most
image-processing techniques
involve treating the image as
a two-dimensional signal and
applying standard signal-
processing techniques to it.
31
Image Processing
The simplest form of digital image processing converts the digital data tape into a film
In the present context, overhead prospective are employed to analyze the picture.
In electrical engineering and computer science, image processing is any form of
signal processing for which the input is an image, such as a photograph or video
frame; the output of image processing may be either an image or, a set of
involve treating the image as a two-dimensional signal and applying standard signal-
32
CHAPTER: 4
ELECTROMYOGR
APHY
Electromyography (EMG) is
a technique for evaluating
and recording the electrical
activity
produced by skeletal
muscles. EMG is
performed using an
instrument called an
electromyograph, to produce
a record called an
33
electromyogram. An
electromyograph detects
the electrical potential
generated by muscle cells
when these cells are
electrically or
neurologically activated.
The signals can be
analyzed to detect
medical abnormalities,
activation level,
recruitment order or to
analyze the biomechanics
of human or animal
movement.
34
The Silent Sound
Technology uses
electromyography,
monitoring tiny muscular
movements that occur when
we speak.
Monitored signals are
converted into electrical
pulses that can then be
turned into
speech, without a sound
uttered.
Electromyography
(EMG) is a technique for
evaluating and recording the
electrical
35
activity produced by skeletal
muscles.
An
electromyography detects
the electrical potential
generated by
muscle cells, when these
cells are electrically or
neurologically activated
CHAPTER 3.1
ELECTROMYOGRAPHY
Electromyography (EMG) is a technique for evaluating and recording the electrical activity
produced by skeletal muscles. EMG is performed using an instrument called an
electromyograph, to produce a record called an electromyogram. An electromyograph detects
the electrical potential generated by muscle cells when these cells are electrically
or
neurologically activated. The signals can be analyzed to detect medical
abnormalities,
activation level, recruitment order or to analyze the biomechanics of human or
animal
36
movement.
Monitored signals are converted into electrical pulses that can then be turned into
Figure-4.1
Electromorphography signal
generation
37
Figure-4.1 Electromorphography signal generation
ELECTRICAL
CHARSTICSRACTE
The electrical source is the
muscle membrane potential
of about -90 mV. Measured
EMG
potentials range between less
than 50 μV and up to 20 to
30 mV, depending on the
muscle
under observation.
Typical repetition rate of
muscle motor unit firing is
38
about 7–20 Hz, depending on
the size of
the muscle (eye muscles
versus seat (gluteal)
muscles), previous axonal
damage and other
factors. Damage to motor
units can be expected at
ranges between 450 and 780
mV
ELECTRICAL CHARSTICSRACTE
The electrical source is the muscle membrane potential of about -90 mV. Measured EMG
potentials range between less than 50 μV and up to 20 to 30 mV, depending on the muscle under
observation. Typical repetition rate of muscle motor unit firing is about 7–20 Hz, depending on
the size of the muscle (eye muscles versus seat (gluteal) muscles), previous axonal damage and
other factors. Damage to motor units can be expected at ranges between 450 and 780 mV.
39
PROCEDURE
There are two kinds of EMG in widespread use: surface EMG and intramuscular (needle and
fine-wire) EMG. To perform intramuscular EMG, a needle electrode or a needle containing
two fine-wire electrodes is inserted through the skin into the muscle tissue.
2022
amplifiers. At present, a
number of suitable amplifiers
40
are commercially available.
In the
early 1980s, cables that
produced signals in the
desired microvolt range
became available.
Recent research has resulted
in a better understanding of
the properties of surface
EMG
recording. Surface
electromyography is
increasingly used for
recording from superficial
muscles in clinical or
kinesiological protocols,
41
where intramuscular
electrodes are used for
investigating deep muscles
or localized muscle activity.
There are many applications
for the use of EMG. EMG is
used clinically for the
diagnosis of
neurological and
neuromuscular problems. It
is used diagnostically by gait
laboratories and
by clinicians trained in the
use of biofeedback or
ergonomic assessment. EMG
is also used in
42
many types of research
laboratories, including those
involved in biomechanics,
motor control,
neuromuscular physiology,
movement disorders,
postural control, and
physical therapy.
PROCEDURE:
There are two kinds of EMG
in widespread use: surface
EMG and intramuscular
(needle and
fine-wire) EMG. To perform
intramuscular EMG, a needle
43
electrode or a needle
containing
two fine-wire electrodes
is inserted through the
skin into the muscle
tissue. A trained
professional (such as a
neurologist, physiatrist, or
physical therapist) observes
the electrical
activity while inserting the
electrode. The insertional
activity provides valuable
information
about the state of the muscle
and its innervating nerve.
44
Normal muscles at rest make
certain,
normal electrical signals
when the needle is inserted
into them. Then the electrical
activity
when the muscle is at rest is
studied. Abnormal
spontaneous activity might
indicate some
nerve and/or muscle damage.
Then the patient is asked to
contract the muscle
smoothly. The
shape, size, and
frequency of the resulting
45
motor unit potentials are
judged. Then the
electrode is retracted a few
millimeters, and again the
activity is analyzed until at
least 10–20
units have been collected.
Each electrode track gives
only a very local picture of
the activity
of the whole muscle.
Because skeletal muscles
differ in the inner structure,
the electrode has
46
to be placed at various
locations to obtain an
accurate study
2022
Figure4.2-:Electromyograph
y istruments
Figure4.2-:Electromyography instruments
47
unnecessary in some cases.
Instead, a
surface electrode may be
used to monitor the general
picture of muscle activation,
as opposed
to the activity of only a few
fibres as observed using an
intramuscular EMG. This
technique
is used in a number of
settings; for example, in the
physiotherapy clinic, muscle
activation is
monitored using surface
EMG and patients have an
48
auditory or visual stimulus to
help them
know when they are
activating the muscle
(biofeedback)
Intramuscular EMG may be considered too invasive or unnecessary in some cases. Instead, a
surface electrode may be used to monitor the general picture of muscle activation, as opposed to
the activity of only a few fibres as observed using an intramuscular EMG. This techniqueis used
in a number of settings; for example, in the physiotherapy clinic, muscle activation is monitored
using surface EMG and patients have an auditory or visual stimulus to help them know when
they are activating the muscle.
49
A motor unit is defined as
one motor neuron and all of
the muscle fibers it
innervates. When a
motor unit fires, the impulse
(called an action potential) is
carried down the motor
neuron to
the muscle. The area
where the nerve contacts
the muscle is called the
neuromuscular
junction, or the motor
end plate. After the
action potential is
transmitted across the
50
neuromuscular junction, an
action potential is elicited in
all of the innervated muscle
fibers of
that particular motor unit.
The sum of all this electrical
activity is known as a motor
unit
action potential (MUAP).
This electrophysiologic
activity from multiple motor
units is the
signal typically evaluated
during an EMG. The
composition of the motor
unit, the number of
51
muscle fibres per motor unit,
the metabolic type of muscle
fibres and many other factors
affect the shape of the motor
unit potentials in the
myogram
A motor unit is defined as one motor neuron and all of the muscle fibers it innervates. When a
motor unit fires, the impulse (called an action potential) is carried down the motor neuron to the
muscle. The area where the nerve contacts the muscle is called the neuromuscular
junction, or the motor end plate. After the action potential is transmitted across
the neuromuscular junction, an action potential is elicited in all of the innervated muscle fibers of
that particular motor unit. The sum of all this electrical activity is known as a motor unit action
potential (MUAP). This electrophysiologic activity from multiple motor units is the signal
typically evaluated during an EMG. The composition of the motor unit, the number of muscle
fibres per motor unit, the metabolic type of muscle fibres and many other factors affect the shape
of the motor unit potentials in the myogram.
Normal results:
Muscle tissue at rest is
normally electrically
inactive. After the electrical
activity caused by
53
the irritation of needle
insertion subsides, the
electromyograph should
detect no abnormal
spontaneous activity (i.e., a
muscle at rest should be
electrically silent, with the
exception of
the area of the
neuromuscular junction,
which is, under normal
circumstances, very
spontaneously active). When
the muscle is voluntarily
contracted, action potentials
begin to
54
appear. As the strength of the
muscle contraction is
increased, more and more
muscle fibers
produce action potentials.
When the muscle is
fully contracted, there
should appear a
disorderly group of action
potentials of varying rates
and amplitudes (a complete
recruitment
and interference pattern
Normal results
Muscle tissue at rest is normally electrically inactive. After the electrical activity caused by
the irritation of needle insertion subsides, the electromyograph should detect no abnormal
spontaneous activity (i.e., a muscle at rest should be electrically silent, with the exception of
the area of the neuromuscular junction, which is, under normal circumstances, very
55
spontaneously active). When the muscle is voluntarily contracted, action potentials begin to
appear. As the strength of the muscle contraction is increased, more and more muscle fibers
produce action potentials. When the muscle is fully contracted, there should appear
a disorderly group of action potentials of varying rates and amplitudes (a complete recruitment
and interference pattern.
Abnormal results
EMG is used to diagnose diseases that generally may be classified into one of the following
categories: neuropathies, neuromuscular junction diseases and myopathies. Neuropathic disease
has the following defining EMG characteristics. An action potential amplitude that is twice
normal due to the increased number of fibres per motor unit because of reinnervation of
denervated fibres An increase in duration of the action potential. A decrease in the number of
motor units in the muscle (as found using motor unit number estimation techniques).
56
A decrease in the number
of motor units in the muscle
(in extremely severe cases
only)
Because of the individuality
of each patient and disease,
some of these characteristics
may
not appear in every case
Myopathic disease has these defining EMG characteristics
Because of the individuality of each patient and disease, some of these characteristics may
not appear in every case
Abnormal results:
57
EMG is used to diagnose
diseases that generally may
be classified into one of the
following
categories: neuropathies,
neuromuscular junction
diseases and myopathies.
Neuropathic disease has the
following defining EMG
characteristics:
An action potential
amplitude that is twice
normal due to the increased
number of
58
fibres per motor unit because
of reinnervation of
denervated fibres
An increase in duration
of the action potential
A decrease in the number
of motor units in the muscle
(as found using motor unit
number estimation
techniques)
Applications of EMG:
EMG signals are used in
many clinical and
biomedical applications.
EMG is used as a
59
diagnostics tool for
identifying neuromuscular
diseases, assessing low-
back pain,
kinesiology, and disorders of
motor control. EMG signals
are also used as a control
signal for
prosthetic devices such as
prosthetic hands, arms, and
lower limbs.
EMG can be used to sense
isometric muscular activity
where no movement is
produced. This
60
enables definition of a class
of subtle motionless gestures
to control interfaces without
being
noticed and without
disrupting the surrounding
environment. These signals
can be used to
control a prosthesis or as a
control signal for an
electronic device such as a
mobile phone or
PDA.
EMG signals have been
targeted as control for flight
61
systems. The Human Senses
Group at
the NASA Ames Research
Center at Moffett Field,
CA seeks to advance
man-machine
interfaces by directly
connecting a person to a
computer. In this project, an
EMG signal is
used to substitute for
mechanical joysticks and
keyboards. EMG has also
been used in
research towards a "wearable
cockpit," which employs
62
EMG-based gestures to
manipulate
switches and control sticks
necessary for flight in
conjunction with a goggle-
based display.
Unvoiced speech recognition
recognizes speech by
observing the EMG activity
of muscles
associated with speech. It is
targeted for use in noisy
environments, and may be
helpful for
people without vocal cords
and people with aphasia.
63
21
3.2 BLOCK DIAGRAM OF EMG
The Block diagram clearly explains the implementation of silent sound technology
through electromyography. From the block diagram it is clear that the silent lip
movements are captured through sensor probes or it may be through image
processing technique and these movements are converted to speech through a
silent vocoder. These speech signals are transmitted through a mobile and received
voice signals at the other end.
The process of course begins in the brain. Triggering muscle movements begins in the motor
cortex, where neural activity (a series of action potentials) signals to the spinal cord, and the
64
information about the movement is conveyed to the relevant muscle via motor neurons. This
begins with upper motor neurons, that carry the signal to lower motor neurons.
As EMG activity is even measurable when we do not display obvious actions or even inhibit
certain behaviours, EMG recordings represent an additional source of information into cognitive-
behavioural processing which would be hidden based on pure observation.
65
3.4 Applications of EMG
EMG signals are used in many clinical and biomedical applications. EMG is used as a
diagnostics tool for identifying neuromuscular diseases, assessing low-back pain,
kinesiology, and disorders of motor control. EMG signals are also used as a control signal for
prosthetic devices such as prosthetic hands, arms, and lower limbs.
EMG can be used to sense isometric muscular activity where no movement is produced. This
enables definition of a class of subtle motionless gestures to control interfaces without being
noticed and without disrupting the surrounding environment. These signals can be used to
control a prosthesis or as a control signal for an electronic device such as a mobile phone or
PDA.
EMG signals have been targeted as control for flight systems. The Human Senses Group at the
NASA Ames Research Center at Moffett Field, CA seeks to advance man-machine
interfaces by directly connecting a person to a computer. In this project, an EMG signal issued
to substitute for mechanical joysticks and keyboards. EMG has also been used in
research towards a "wearable cockpit," which employs EMG-based gestures to manipulate
switches and control sticks necessary for flight in conjunction with a goggle-based display.
Unvoiced speech recognition recognizes speech by observing the EMG activity of muscles
associated with speech. It is targeted for use in noisy environments, and may be helpful for
people without vocal cords and people with aphasia.
66
CHAPTER 3.5
IMAGE PROCESSING
There are two types of methods used for image processing namely, analogue and digital image
processing. Analogue image processing can be used for the hard copies like printouts and
photographs. Image analysts use various fundamentals of interpretation while using these visual
techniques. Digital image processing techniques help in manipulation of the digital images by
using computers. The three general phases that all types of data have to undergo while using
digital technique are pre-processing, enhancement, and display, information extraction.
In this lecture we will talk about a few fundamental definitions such as image, digital image,
and digital image processing. Different sources of digital images will be discussed and
examples for each source will be provided. The continuum from image processing to computer
vision will be covered in this lecture. Finally we will talk about image acquisition and different
types of image sensors.
67
Figure :picture of image processing
Digital Image Processing means processing digital image by means of a digital computer. We
can also say that it is a use of computer algorithms, in order to get enhanced image either to
extract some useful information.
Digital image processing is the use of algorithms and mathematical models to process and
analyze digital images. The goal of digital image processing is to enhance the quality of
images, extract meaningful information from images, and automate image-based tasks.
1. Image acquisition: This involves capturing an image using a digital camera or scanner, or
importing an existing image into a computer.
2. Image enhancement: This involves improving the visual quality of an image, such as
increasing contrast, reducing noise, and removing artifacts.
3. Image restoration: This involves removing degradation from an image, such as blurring,
noise, and distortion.
4. Image segmentation: This involves dividing an image into regions or segments, each of
which corresponds to a specific object or feature in the image.
5. Image representation and description: This involves representing an image in a way that
can be analyzed and manipulated by a computer, and describing the features of an image
in a compact and meaningful way.
6. Image analysis: This involves using algorithms and mathematical models to extract
information from an image, such as recognizing objects, detecting patterns, and
quantifying features.
7. Image synthesis and compression: This involves generating new images or
compressing existing images to reduce storage and transmission requirements.
68
3.6ARCHITECTURE AND WORKING OF SILENT SOUND TECHNOLOGY
To proceed with this research work, the Process Model assumed is Iterative Process Model
since it is more adaptable for this work. Once the face detection and mouth region detection is
achieved, speech analysis can be performed with the use of lip motion features strategies and
emotional expression with the use of other facial parts. If efficiency with identification
technique is not proper, then the threshold value falls out of the defined unique index value and
retrial has to be made. Those are one of the main reasons to choose the Iterative Process Fig
shows the overall architecture of the process model and its working methodology As the live
video is captured by a high-resolution camera, the video can be processed as normal or
grayscale color mode /or saved as Mpeg, Avi Flv etc. for customization. Region of Interest
(ROI) video is segmented from which Facial features like Mouth, nose & Eyes are detected.
69
4.LITERATURE SURVEY
74
sEMG. In the early 1980s, Cram and Steger introduced a clinical method for
scanning a variety of muscles using an EMG sensing device amplifiers.
amplifiers. At present, a
number of suitable amplifiers
are commercially available.
In the
75
early 1980s, cables that
produced signals in the
desired microvolt range
became available
2022
amplifiers. At present, a
number of suitable amplifiers
are commercially available.
In the
early 1980s, cables that
produced signals in the
desired microvolt range
became available.
76
Recent research has resulted
in a better understanding of
the properties of surface
EMG
recording. Surface
electromyography is
increasingly used for
recording from superficial
muscles in clinical or
kinesiological protocols,
where intramuscular
electrodes are used for
investigating deep muscles
or localized muscle activity.
There are many applications
for the use of EMG. EMG is
77
used clinically for the
diagnosis of
neurological and
neuromuscular problems. It
is used diagnostically by gait
laboratories and
by clinicians trained in the
use of biofeedback or
ergonomic assessment. EMG
is also used in
many types of research
laboratories, including those
involved in biomechanics,
motor control,
neuromuscular physiology,
movement disorders,
78
postural control, and
physical therapy
At present, a number of suitable amplifiers are commercially available. In the early
1980s, cables that produced signals in the desired microvolt range became available. Recent
research has resulted in a better understanding of the properties of surface EMG recording.
Surface electromyography is increasingly used for recording from superficial muscles
in clinical or kinesiological protocols, where intramuscular electrodes are used forinvestigating
deep muscles or localized muscle activity. There are many applications for the use of EMG.
EMG is used clinically for the diagnosis of neurological and neuromuscular problems. It is
used diagnostically by gait laboratories and by clinicians trained in the use of biofeedback or
ergonomic assessment. EMG is also used in many types of research laboratories, including
those involved in biomechanics, motor control, neuromuscular physiology, movement
disorders, postural control, and physical therapy
CHAPTER :5
79
FEATURES OF
SILENT SOUND
TECHNOLOGY
Some of the features of silent
sound technology are
Native speakers can
silently utter a sentence in
their language, and the
receivers can
hear the translated sentence
in their language. It
appears as if the native
speaker
produced speech in a
foreign language. The
80
translation technology
works for
languages like English,
French and German, except
Chinese, where different
tones
can hold many different
meanings.
Allow people to make
silent calls without bothering
others.
The Technology opens
up a host of application such
as mentioned below
81
Helping people who have
lost their voice due to illness
or accident.
Telling a trusted
friend your PIN number
over the phone without
anyone
eavesdropping — assuming
no lip-readers are around.
Silent Sound Techniques
is applied in Military for
communicating
secret/confidential
matters to others.
82
CHAPTER 5
Native speakers can silently utter a sentence in their language, and the receivers can
hear the translated sentence in their language. It appears as if the native speaker
languages like English, French and German, except Chinese, where different tones
Helping people who have lost their voice due to illness or accident.
Telling a trusted friend your PIN number over the phone without anyone
83
matters to others.
CHAPTER: 7
APPLICATIONS:
The Technology opens up
a host of application such as
mentioned below :
Helping people who have
lost their voice due to illness
or accident.
Telling a trusted
friend your PIN number
84
over the phone without
anyone
eavesdropping — assuming
no lip-readers are around.
Silent Sound Techniques
is applied in Military for
communicating
secret/confidential
matters to others.
Native speakers can
silently utter a sentence in
their language, and the
receivers can
hear the translated sentence
in their language. It
85
appears as if the native
speaker
produced speech in a
foreign language. The
translation technology
works for
languages like English,
French and German, except
Chinese, where different
tones
can hold many different
meanings.
Allow people to make
silent calls without bothering
others
CHAPTER 6
86
APPLICATIONS
Helping people who have lost their voice due to illness or accident.
Telling a trusted friend your PIN number over the phone without anyone
matters to others.
Native speakers can silently utter a sentence in their language, and the receivers can
hear the translated sentence in their language. It appears as if the native speaker
languages like English, French and German, except Chinese, where different tones
this
87
technology will be use in our
day to day life.
‘Silent Sound’ technology
aims to notice every
movements of the lips and
transform
them into sounds, which
could help people who lose
voices to speak, and allow
people to make silent calls
without bothering others.
Rather than making any
sounds,
your handset would decipher
the movements your mouth
makes by measuring muscle
88
activity, then convert this
into speech that the person
on the other end of the call
can
hear. So, basically, it reads
your lips.
CHAPTER 7
CONCLUSION
Thus Silent Sound Technology, one of the recent trends in the field of information
It will be one of the innovation and useful technology and in mere future
this technology will be use in our day to day life.
‘Silent Sound’ technology aims to notice every movements of the lips and transform
them into sounds, which could help people who lose voices to speak, and allow
people to make silent calls without bothering others. Rather than making any sounds,
your handset would decipher the movements your mouth makes by measuring muscle
activity, then convert this into speech that the person on the other end of the call can
89
REFERENCES
[2] International journal in multidisciplinary and Academic Research (SSIJMAR) Vol .2,
No.2, March – April (ISSN 2278 - 5973)
[4] http://www.techpark.net/2010/03/04/silent-soundtechnology-an-end-to-noisy-
communications/
[6] http://www.dellchallenge.org/projects/silent-soundtechnology
[7] http://en.wikipedia.orrg/wiki/Digital_signal_processin g
90
[8] http://en.m.wikibooks.org/wiki/speechlanguage_pathology/stuttering/print_version [9]
http://www.techpark.net/2010/03/04/silent-soundtechnology-an-end-to-noisy-
communications/
91