Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                

Seminar

Download as docx, pdf, or txt
Download as docx, pdf, or txt
You are on page 1of 91

A Technical Seminar Report

On

SILENT SOUND TECHNOLOGY

Submitted in partial fulfillment of the Requirements for the award of the degree

BACHELOR OF TECHNOLOGY

IN

ELECTRONICS AND COMMUNICATION ENGINEERING

Submitted By

D PRATHYUSHA (19H61A0411)

Department of Electronics and Communication Engineering

ANURAG GROUP OF INSTITUTIONS

(Formerly CVSR College of Engineering)(Formerly CVSR College of Engineering)


(Formerly CVSR College of Engineering)

(Affiliated to Jawaharlal Nehru Technological University, Hyderabad) Venkatapur(V),

Ghatkesar(M), Medchal-Malkajgiri Dist-500088 2022-2023

1
ANURAG GROUP OF INSTITUTIONS

(An Autonomous Institution)


(Affiliated to JNTU-HYD, Approved by AICTE and NBA Accredited)
Venkatapur (V), Ghatkesar (M), Medchal District, Telangana 500088
2022-2023

Department of Electronics and Communication Engineering

CERTIFICATE

This is to Certify that the seminar reported entitled “SILENT SOUND TECHNOLOGY”,
being submitted by D PRATHYUSHA (19H61A0411) in partial fulfillment for the award of
Degree of Bachelor of Technology in ELECTRONICS AND COMMUNICATION
ENGINEERING, during the academic year 2019-2023. Certified further, to the best of our
knowledge, the work reported here is not a part of any other project on the basis of which a
degree or an award has been given on an earlier occasion to any other candidate. The results
have been verified and found to be satisfactory

Prof. N. Mangala Gouri


Head of the Department

2
ACKNOWLEDGEMENT

I would like to express my sincere thanks to Prof.N.Mangala Gouri, Head of the Department of
ELECTRONICS AND COMMUNICATION ENGINEERING, Anurag Group of Institutions,
Ghatkesar, her motivation in the field has made me to overcome all hardships during the course of
study and successful completion of seminar. I extend my sincere thanks to Dr. G. Vishnu Murthy,
Dean, School of Engineering, Anurag Group of Institutions, Venkatapur(V), Ghatkesar(M),
Medchal District, for his encouragement and constant help. Finally, I would like to express my
heartfelt thanks to my parents who were very supportive both financially and mentally and for their
encouragement to achieve my set goals.

D.PRATHYUSHA (19H61A0411)

3
DECLARATION

This is to certify that the technical seminar report work entitled “SILENT SOUND
TECHNOLOGY” submitted to Anurag Group of Institutions in partial fulfillment of the
requirement for the award of the Degree of Bachelor of Technology (B-Tech), is an original work
carried out by D PRATHYUSHA (19H61A0411). This matter embodied in this technical
seminar is a genuine work, done by the student and has not been submitted whether the university
or to any other university/Institute for the fulfillment of the requirement of any course of study.

D.PRATHYUSHA (19H61A0411)

4
ABSTRACT
Everybody has the experience of talking aloud in the cell
phone in the midst of the
disturbance while travelling in trains or buses. There is no need of
shouting anymore for this
purpose. ‘Silent sound technology’ is the answer for this problem.
The Silent sound technology is an amazing solution for those who had
lost their voice but
wish to speak over phone. It is developed at the Karlsruhe Institute of
Technology and you
can expect to see it in the near future. When demonstrated, it seems
to detect every lip
movement and internally converts the electrical pulses into sounds
signals and sends them
neglecting all other surrounding noise. It is definitely going to be a
good solution for those
feeling annoyed when other speak loud over phone.
‘Silent Sound’ technology aims to notice every movements of the lips
and transform them
into sounds, which could help people who lose voices to speak, and
allow people to make
silent calls without bothering others. Rather than making any sounds,
your handset would
decipher the movements your mouth makes by measuring muscle
activity, then convert this
into speech that the person on the other end of the call can hear. So,
basically, it reads your
lips. This new technology will be very helpful whenever a person looses
his voice while
speaking or allow people to make silent calls without listurbing others,
even we can tell our
PIN number to a trusted friend or relative without eavesdropping . At
the other end, the

5
listener can hear a clear voice. the awesome feature added to this
technology is that "it is an
instant polyglot" I.E, movements can be immediately transformed into
the language of the
user's choice. This translation works for languages like English,
French & German. But, for
the languages like Chinese, different tones can hold many different
meanings. This poses
Problem said Wand. he also said that in five or may be in ten years this
will Be used in
everyday's technology.
ABSTRACT
Everybody has the experience of talking aloud in the cell
phone in the midst of the
disturbance while travelling in trains or buses. There is no need of
shouting anymore for this
purpose. ‘Silent sound technology’ is the answer for this problem.
The Silent sound technology is an amazing solution for those who had
lost their voice but
wish to speak over phone. It is developed at the Karlsruhe Institute of
Technology and you
can expect to see it in the near future. When demonstrated, it seems
to detect every lip
movement and internally converts the electrical pulses into sounds
signals and sends them
neglecting all other surrounding noise. It is definitely going to be a
good solution for those
feeling annoyed when other speak loud over phone.
‘Silent Sound’ technology aims to notice every movements of the lips
and transform them
into sounds, which could help people who lose voices to speak, and
allow people to make
silent calls without bothering others. Rather than making any sounds,
your handset would
decipher the movements your mouth makes by measuring muscle
activity, then convert this
into speech that the person on the other end of the call can hear. So,
basically, it reads your
lips. This new technology will be very helpful whenever a person looses
his voice while

6
speaking or allow people to make silent calls without listurbing others,
even we can tell our
PIN number to a trusted friend or relative without eavesdropping . At
the other end, the
listener can hear a clear voice. the awesome feature added to this
technology is that "it is an
instant polyglot" I.E, movements can be immediately transformed into
the language of the
user's choice. This translation works for languages like English,
French & German. But, for
the languages like Chinese, different tones can hold many different
meanings. This poses
Problem said Wand. he also said that in five or may be in ten years this
will Be used in
everyday's technology.
ABSTRACT

Everybody has the experience of talking aloud in the cell phone in the midst
of the disturbance while travelling in trains or buses. There is no need of shouting anymore for
this purpose. ‘Silent sound technology’ is the answer for this problem.

The Silent sound technology is an amazing solution for those who had lost their voice but wish
to speak over phone. It is developed at the Karlsruhe Institute of Technology and you can expect
to see it in the near future. When demonstrated, it seems to detect every lip movement and
internally converts the electrical pulses into sounds signals and sends them neglecting all other
surrounding noise. It is definitely going to be a good solution for those feeling annoyed when
other speak loud over phone.

‘Silent Sound’ technology aims to notice every movements of the lips and transform them
into sounds, which could help people who lose voices to speak, and allow people to make silent
calls without bothering others. Rather than making any sounds, your handset would decipher the
movements your mouth makes by measuring muscle activity, then convert this into speech that
the person on the other end of the call can hear. So, basically, it reads your lips. This new
technology will be very helpful whenever a person looses his voice while speaking or allow
people to make silent calls without disturbing others, even we can tell our PIN number to a trusted
friend or relative without eaves dropping . At the other end, the listener can hear a clear voice. the

7
awesome feature added to this technology is that "it is an instant polyglot" I.E, movements can be
immediately transformed into the language of the user's choice. This translation works for
languages like English, French & German. But, for the languages like Chinese, different tones can
hold many different meanings. This poses Problem said Wand. he also said that in five or may be
in ten years this will Be used in everyday's technology.

8
TABLE OF CONTENT

9
CHAPTER: 1

INTRODUCTION

1.1 INTRODUCTION
Silence is the best answer for all the situations …even your mobile understands !

 The word Cell Phone has become greatest buzz word in Cellular Communication
industry.
 There are lots and lots of technology that tries to reduce the Noise pollution and make the
environment a better place to live in.
 I will tell about a new technology known as Silent Sound Technology that will put an end
to Noise pollution.

2 2022
3 CHAPTER: 1
10
4 INTRODUCTIO
N
5Silence is the best answer
for all the situations …even
your mobile understands !
6  The word Cell
Phone has become greatest
buzz word in Cellular
Communication
7industry.
8  There are lots and
lots of technology that tries
to reduce the Noise
pollution and make

11
9the environment a better
place to live in.
1 0  I will tell about
a new technology known as
Silent Sound Technology
that will put an
11 end to Noise pollution.
12 Silence is the best
answer for all the situations
…even your mobile
understands !
1 3  The word Cell
Phone has become greatest
buzz word in Cellular
Communication
14 industry.
12
1 5 There are lots 

and lots of technology that


tries to reduce the Noise
pollution and make
16 the environment a better
place to live in.
1 7 I will tell about

a new technology known as


Silent Sound Technology
that will put an
18 end to Noise pollution.
You are in a movie theater or noisy restaurant or a bus etc. where there is lot of noise
around is big issue while talking on a mobile phone. But in the future this problem is
eliminated with ”silent sounds”, a new technology unveiled at the CeBIT fair on Tuesday that
transforms lip movements into a computer-generated voice for the listener at the other end of
the phone. It is a technology that helps you to transmit information without using your vocal
cords. This technology aims to notice lip movements & transform them into a computer-
generated sound that can be transmitted over a phone. Hence person on other end of
phone receives the information in audio. In the 2010 CeBIT's "future park", a concept "Silent
Sound" Technology demonstrated which aims to notice every movement of the lips and

13
transform them into sounds, which could help people who lose voices to speak, and allow

people to make silent calls without bothering others.

uttered
The device, developed by the Karlsruhe Institute of Technology (KIT), uses
electromyography, monitoring tiny muscular movements that occur when we speak
and converting them into electrical pulses that can then be turned into speech, without a sound

uttered.

‘Silent Sound’ technology aims to notice every movements of the lips and transform them
into sounds, which could help people who lose voices to speak, and allow people to make
silent calls without bothering others. Rather than making any sounds, your handset would
decipher the movements your mouth makes by measuring muscle activity, then convert this
into speech that the person on the other end of the call can hear. So, basically, it reads your
lips. “We currently use electrodes which are glued to the skin. In the future, such electrodes
might for example by incorporated into cellphones,” said Michael Wand, from the KIT.

14
Figure1.1-common people talking at same place without disturbance.

2022
The technology opens up a
host of applications, from
helping people who have lost
their
voice due to illness or
accident to telling a trusted

15
friend your PIN number over
the phone
without anyone
eavesdropping — assuming
no lip-readers are around.
The technology can also turn
you into an instant polyglot.
Because the electrical pulses
are
universal, they can be
immediately transformed
into the language of the
user’s choice.
The technology opens up a host of applications, from helping people who have lost their voice
due to illness or accident to telling a trusted friend your PIN number over the phone without
anyone eavesdropping — assuming no lip-readers are around. The technology can also turn

16
you into an instant polyglot. Because the electrical pulses are universal, they can be
immediately transformed into the language of the user’s choice.

2022
The technology opens up a host of applications, from helping people who have lost their
voice due to illness or accident to telling a trusted friend your PIN number over the
phone
without anyone eavesdropping — assuming no lip-readers are around.
The technology can also turn you into an instant polyglot. Because the electrical pulses
are
universal, they can be immediately transformed into the language of the user’s choice.
“Native speakers can silently utter a sentence in their language, and the receivers hear
the
translated sentence in their language. It appears as if the native speaker produced speech
in a
foreign language,” said Wand.
The translation technology works for languages like English, French and Gernan, but
for
languages like Chinese, where different tones can hold many different meanings, poses
a
problem, he added.
Noisy people in your office? Not anymore. “We are also working on technology to be
used in
an office environment,” the KIT scientist told AFP.
The engineers have got the device working to 99 percent efficiency, so the mechanical
voice
at the other end of the phone gets one word in 100 wrong, explained Wand.
“But we’re working to overcome the remaining technical difficulties. In five, maybe
ten
years, this will be useable, everyday technology,” he said.

Native speakers can silently utter a sentence in their language, and the receivers hear the
translated sentence in their language. It appears as if the native speaker produced speech in a
foreign language,” said Wand. The translation technology works for languages like English,
French and German, but for languages like Chinese, where different tones can hold many

different meanings, poses a problem, he added. Noisy people in your office? Not
anymore.

“We are also working on technology to be used in an office environment,” the KIT scientist
told AFP. The engineers have got the device working to 99 percent efficiency, so the
mechanical voice at the other end of the phone gets one word in 100 wrong, explained Wand.

17
“But we’re working to overcome the remaining technical difficulties. In five, maybe ten
years, this will be useable, everyday technology,” he said.

CHAPTER: 2
NEED FOR SILENT
SOUND
18
Silent Sound Technology
will put an end to
embarrassed situation such
as-
 An person answering
his silent, but vibrating
cell phone in a meeting,
lecture or
performance, and whispering
loudly, ‘ I can’t talk to you
right now’ .
 In the case of an urgent
call, apologetically rushing
out of the room in order to
answer
or call the person back.
19
CHAPTER 2

NEED FOR SILENT SOUND

Silent Sound Technology will put an end to embarrassed situation such as- An person
answering his silent, but vibrating cell phone in a meeting, lecture or performance, and
whispering loudly, ‘ I can’t talk to you right now’ . In the case of an urgent call, apologetically
rushing out of the room in order to answer or call the person back.

ORIGINATION:
Humans are capable of
producing and
understanding whispere
speech in quiet
environments at remarkably
low signal levels. Most
people can also understand a
few
unspoken words by lip-
reading The idea of
20
interpreting silent speech
electronically or
with a computer has been
around for a long time,
and was popularized in the
1968
Stanley Kubrick science-
fiction film ‘‘2001 – A Space
Odyssey ” A major focal
point was
the DARPA Advanced
Speech Encoding Program
(ASE ) of the early
2000’s, which
funded research on low bit
rate speech synthesis ‘‘with
21
acceptable intelligibility,
quality ,
and aural speaker
recognizability in
acoustically harsh
environments”,
ORIGINATION

Humans are capable of producing and understanding whisper speech in quiet


environments at remarkably low signal levels. Most people can also understand a few
unspoken words by lip-reading The idea of interpreting silent speech electronically or
with a computer has been around for a long time, and was popularized in the 1968
Stanley Kubrick science-fiction film ‘‘2001 – A Space Odyssey ” A major focal point was
the DARPA Advanced Speech Encoding Program (ASE ) of the early 2000’s, which
funded research on low bit rate speech synthesis ‘‘with acceptable intelligibility, quality ,
and aural speaker recognizability in acoustically harsh environments”.

When you add lawnmowers,


snow blowers, leaf blowers,
jack hammers, jet engines,

22
transport trucks, and horns
and buzzers of all types and
descriptions you have a wall
of
constant noise and irritation.
Even when watching a
television program at a
reasonable
volume level you are blown
out of your chair when a
commercial comes on at the
decibel
level of a jet.
The technology opens up a
host of applications, from

23
helping people who have lost
their
voice due to illness or
accident to telling a trusted
friend your PIN number over
the phone
without anyone
eavesdropping — assuming
no lip-readers are
around.Native speakers can
silently utter a sentence in
their language, and the
receivers hear the translated
sentence in
their language. It appears as
if the native speaker
24
produced speech in a foreign
language.
When you add lawnmowers, snow blowers, leaf blowers, jack hammers, jet engines,
transport trucks, and horns and buzzers of all types and descriptions you have a wall of
constant noise and irritation. Even when watching a television program at a reasonable
volume level you are blown out of your chair when a commercial comes on at the decibel
level of a jet.

The technology opens up a host of applications, from helping people who have lost their
voice due to illness or accident to telling a trusted friend your PIN number over the phone
without anyone eavesdropping — assuming no lip-readers are around. Native speakers can
silently utter a sentence in their language, and the receivers hear the translated sentence in
their language. It appears as if the native speaker produced speech in a foreign language.

2022

CHAPTER: 3
METHODS
Silent Sound Technology is
processed through some
ways or methods. They are

25
 Electromyography
(EMG)
 Image Processing
CHAPTER 3
METHODS

Silent Sound Technology is processed through some ways or methods. They are

 Electromyography (EMG)

 Image Processing

Electromyography:
 The Silent Sound
Technology uses
electromyography,
monitoring tiny muscular
movements that occur when
we speak.

26
 Monitored signals are
converted into electrical
pulses that can then be
turned into
speech, without a sound
uttered.
 Electromyography
(EMG) is a technique for
evaluating and recording the
electrical
activity produced by skeletal
muscles.
 An electromyography
detects the electrical
potential generated by
muscle cells, when
27
these cells are electrically or
neurologically activated.
 Electromyographic
sensors attached to the face
records the electric signals
produced
by the facial muscles,
compare them with pre
recorded signal pattern of
spoken words
 When there is a match
that sound is transmitted on
to the other end of the line
and
person at the other end listen
to the spoken words
28
Electromyography

 The Silent Sound Technology uses electromyography, monitoring tiny muscular

movements that occur when we speak.

 Monitored signals are converted into electrical pulses that can then be turned into

speech, without a sound uttered.

 Electromyography (EMG) is a technique for evaluating and recording the electrical

activity produced by skeletal muscles.

 An electromyography detects the electrical potential generated by muscle cells, when

these cells are electrically or neurologically activated.

 Electromyographic sensors attached to the face records the electric signals produced

by the facial muscles, compare them with pre recorded signal pattern of spoken words

 When there is a match that sound is transmitted on to the other end of the line and

person at the other end listen to the spoken words

Image Processing:
 The simplest form of
digital image processing

29
converts the digital data tape
into a film
image with minimal
corrections and calibrations.
 Then large mainframe
computers are employed
for sophisticated
interactive
manipulation of the data.
 In the present context,
overhead prospective are
employed to analyze the
picture.
 In electrical engineering
and computer science,

30
image processing is any
form of
signal processing for which
the input is an image, such as
a photograph or video
frame; the output of
image processing may be
either an image or, a
set of
characteristics or parameters
related to the image. Most
image-processing techniques
involve treating the image as
a two-dimensional signal and
applying standard signal-
processing techniques to it.
31
Image Processing

The simplest form of digital image processing converts the digital data tape into a film

image with minimal corrections and calibrations.

Then large mainframe computers are employed for sophisticated interactive

manipulation of the data.

In the present context, overhead prospective are employed to analyze the picture.

In electrical engineering and computer science, image processing is any form of

signal processing for which the input is an image, such as a photograph or video

frame; the output of image processing may be either an image or, a set of

characteristics or parameters related to the image. Most image-processing techniques

involve treating the image as a two-dimensional signal and applying standard signal-

processing techniques to it.

32
CHAPTER: 4
ELECTROMYOGR
APHY
Electromyography (EMG) is
a technique for evaluating
and recording the electrical
activity
produced by skeletal
muscles. EMG is
performed using an
instrument called an
electromyograph, to produce
a record called an

33
electromyogram. An
electromyograph detects
the electrical potential
generated by muscle cells
when these cells are
electrically or
neurologically activated.
The signals can be
analyzed to detect
medical abnormalities,
activation level,
recruitment order or to
analyze the biomechanics
of human or animal
movement.

34
 The Silent Sound
Technology uses
electromyography,
monitoring tiny muscular
movements that occur when
we speak.
 Monitored signals are
converted into electrical
pulses that can then be
turned into
speech, without a sound
uttered.
 Electromyography
(EMG) is a technique for
evaluating and recording the
electrical
35
activity produced by skeletal
muscles.
 An
electromyography detects
the electrical potential
generated by
muscle cells, when these
cells are electrically or
neurologically activated
CHAPTER 3.1

ELECTROMYOGRAPHY

Electromyography (EMG) is a technique for evaluating and recording the electrical activity
produced by skeletal muscles. EMG is performed using an instrument called an
electromyograph, to produce a record called an electromyogram. An electromyograph detects
the electrical potential generated by muscle cells when these cells are electrically
or
neurologically activated. The signals can be analyzed to detect medical
abnormalities,
activation level, recruitment order or to analyze the biomechanics of human or
animal

36
movement.

The Silent Sound Technology uses electromyography, monitoring tiny muscular

movements that occur when we speak.

Monitored signals are converted into electrical pulses that can then be turned into

speech, without a sound uttered.

Electromyography (EMG) is a technique for evaluating and recording the electrical

activity produced by skeletal muscles.

An electromyography detects the electrical potential generated by

muscle cells, when these cells are electrically or neurologically activated

Figure-4.1
Electromorphography signal
generation
37
Figure-4.1 Electromorphography signal generation

ELECTRICAL
CHARSTICSRACTE
The electrical source is the
muscle membrane potential
of about -90 mV. Measured
EMG
potentials range between less
than 50 μV and up to 20 to
30 mV, depending on the
muscle
under observation.
Typical repetition rate of
muscle motor unit firing is

38
about 7–20 Hz, depending on
the size of
the muscle (eye muscles
versus seat (gluteal)
muscles), previous axonal
damage and other
factors. Damage to motor
units can be expected at
ranges between 450 and 780
mV
ELECTRICAL CHARSTICSRACTE

The electrical source is the muscle membrane potential of about -90 mV. Measured EMG
potentials range between less than 50 μV and up to 20 to 30 mV, depending on the muscle under
observation. Typical repetition rate of muscle motor unit firing is about 7–20 Hz, depending on
the size of the muscle (eye muscles versus seat (gluteal) muscles), previous axonal damage and
other factors. Damage to motor units can be expected at ranges between 450 and 780 mV.

39
PROCEDURE

There are two kinds of EMG in widespread use: surface EMG and intramuscular (needle and
fine-wire) EMG. To perform intramuscular EMG, a needle electrode or a needle containing
two fine-wire electrodes is inserted through the skin into the muscle tissue.

A trained professional (such as a neurologist, physiatrist, or physical therapist) observes the


electrical activity while inserting the electrode. The insertional activity provides valuable
information about the state of the muscle and its innervating nerve. Normal muscles at rest make
certain, normal electrical signals when the needle is inserted into them. Then the electrical
activity
when the muscle is at rest is studied. Abnormal spontaneous activity might indicate some
nerve and/or muscle damage. Then the patient is asked to contract the muscle smoothly. The
shape, size, and frequency of the resulting motor unit potentials are judged.
Then the electrode is retracted a few millimeters, and again the activity is analyzed until at
least 10–20 units have been collected. Each electrode track gives only a very local picture of the
activity of the whole muscle. Because skeletal muscles differ in the inner structure, the electrode
has to be placed at various locations to obtain an accurate study

2022
amplifiers. At present, a
number of suitable amplifiers

40
are commercially available.
In the
early 1980s, cables that
produced signals in the
desired microvolt range
became available.
Recent research has resulted
in a better understanding of
the properties of surface
EMG
recording. Surface
electromyography is
increasingly used for
recording from superficial
muscles in clinical or
kinesiological protocols,
41
where intramuscular
electrodes are used for
investigating deep muscles
or localized muscle activity.
There are many applications
for the use of EMG. EMG is
used clinically for the
diagnosis of
neurological and
neuromuscular problems. It
is used diagnostically by gait
laboratories and
by clinicians trained in the
use of biofeedback or
ergonomic assessment. EMG
is also used in
42
many types of research
laboratories, including those
involved in biomechanics,
motor control,
neuromuscular physiology,
movement disorders,
postural control, and
physical therapy.
PROCEDURE:
There are two kinds of EMG
in widespread use: surface
EMG and intramuscular
(needle and
fine-wire) EMG. To perform
intramuscular EMG, a needle

43
electrode or a needle
containing
two fine-wire electrodes
is inserted through the
skin into the muscle
tissue. A trained
professional (such as a
neurologist, physiatrist, or
physical therapist) observes
the electrical
activity while inserting the
electrode. The insertional
activity provides valuable
information
about the state of the muscle
and its innervating nerve.
44
Normal muscles at rest make
certain,
normal electrical signals
when the needle is inserted
into them. Then the electrical
activity
when the muscle is at rest is
studied. Abnormal
spontaneous activity might
indicate some
nerve and/or muscle damage.
Then the patient is asked to
contract the muscle
smoothly. The
shape, size, and
frequency of the resulting
45
motor unit potentials are
judged. Then the
electrode is retracted a few
millimeters, and again the
activity is analyzed until at
least 10–20
units have been collected.
Each electrode track gives
only a very local picture of
the activity
of the whole muscle.
Because skeletal muscles
differ in the inner structure,
the electrode has

46
to be placed at various
locations to obtain an
accurate study

2022
Figure4.2-:Electromyograph
y istruments
Figure4.2-:Electromyography instruments

Intramuscular EMG may be


considered too invasive or

47
unnecessary in some cases.
Instead, a
surface electrode may be
used to monitor the general
picture of muscle activation,
as opposed
to the activity of only a few
fibres as observed using an
intramuscular EMG. This
technique
is used in a number of
settings; for example, in the
physiotherapy clinic, muscle
activation is
monitored using surface
EMG and patients have an
48
auditory or visual stimulus to
help them
know when they are
activating the muscle
(biofeedback)
Intramuscular EMG may be considered too invasive or unnecessary in some cases. Instead, a
surface electrode may be used to monitor the general picture of muscle activation, as opposed to
the activity of only a few fibres as observed using an intramuscular EMG. This techniqueis used
in a number of settings; for example, in the physiotherapy clinic, muscle activation is monitored
using surface EMG and patients have an auditory or visual stimulus to help them know when
they are activating the muscle.

Figure4.3 Interfacing with electromyographer and body

49
A motor unit is defined as
one motor neuron and all of
the muscle fibers it
innervates. When a
motor unit fires, the impulse
(called an action potential) is
carried down the motor
neuron to
the muscle. The area
where the nerve contacts
the muscle is called the
neuromuscular
junction, or the motor
end plate. After the
action potential is
transmitted across the
50
neuromuscular junction, an
action potential is elicited in
all of the innervated muscle
fibers of
that particular motor unit.
The sum of all this electrical
activity is known as a motor
unit
action potential (MUAP).
This electrophysiologic
activity from multiple motor
units is the
signal typically evaluated
during an EMG. The
composition of the motor
unit, the number of
51
muscle fibres per motor unit,
the metabolic type of muscle
fibres and many other factors
affect the shape of the motor
unit potentials in the
myogram
A motor unit is defined as one motor neuron and all of the muscle fibers it innervates. When a
motor unit fires, the impulse (called an action potential) is carried down the motor neuron to the
muscle. The area where the nerve contacts the muscle is called the neuromuscular
junction, or the motor end plate. After the action potential is transmitted across
the neuromuscular junction, an action potential is elicited in all of the innervated muscle fibers of
that particular motor unit. The sum of all this electrical activity is known as a motor unit action
potential (MUAP). This electrophysiologic activity from multiple motor units is the signal
typically evaluated during an EMG. The composition of the motor unit, the number of muscle
fibres per motor unit, the metabolic type of muscle fibres and many other factors affect the shape
of the motor unit potentials in the myogram.

Some patients can find the


procedure somewhat painful,
whereas others experience
only a
52
small amount of discomfort
when the needle is inserted.
The muscle or muscles being
tested
may be slightly sore for a
day or two after the
procedure.
19
Some patients can find the procedure somewhat painful, whereas others experience only a small
amount of discomfort when the needle is inserted. The muscle or muscles being tested may be
slightly sore for a day or two after the procedure.

Normal results:
Muscle tissue at rest is
normally electrically
inactive. After the electrical
activity caused by
53
the irritation of needle
insertion subsides, the
electromyograph should
detect no abnormal
spontaneous activity (i.e., a
muscle at rest should be
electrically silent, with the
exception of
the area of the
neuromuscular junction,
which is, under normal
circumstances, very
spontaneously active). When
the muscle is voluntarily
contracted, action potentials
begin to
54
appear. As the strength of the
muscle contraction is
increased, more and more
muscle fibers
produce action potentials.
When the muscle is
fully contracted, there
should appear a
disorderly group of action
potentials of varying rates
and amplitudes (a complete
recruitment
and interference pattern
Normal results

Muscle tissue at rest is normally electrically inactive. After the electrical activity caused by
the irritation of needle insertion subsides, the electromyograph should detect no abnormal
spontaneous activity (i.e., a muscle at rest should be electrically silent, with the exception of
the area of the neuromuscular junction, which is, under normal circumstances, very

55
spontaneously active). When the muscle is voluntarily contracted, action potentials begin to
appear. As the strength of the muscle contraction is increased, more and more muscle fibers
produce action potentials. When the muscle is fully contracted, there should appear
a disorderly group of action potentials of varying rates and amplitudes (a complete recruitment
and interference pattern.
Abnormal results

EMG is used to diagnose diseases that generally may be classified into one of the following
categories: neuropathies, neuromuscular junction diseases and myopathies. Neuropathic disease
has the following defining EMG characteristics. An action potential amplitude that is twice
normal due to the increased number of fibres per motor unit because of reinnervation of
denervated fibres An increase in duration of the action potential. A decrease in the number of
motor units in the muscle (as found using motor unit number estimation techniques).

Myopathic disease has these


defining EMG
characteristics:
 A decrease in duration of
the action potential
 A reduction in the area to
amplitude ratio of the action
potential

56
 A decrease in the number
of motor units in the muscle
(in extremely severe cases
only)
Because of the individuality
of each patient and disease,
some of these characteristics
may
not appear in every case
Myopathic disease has these defining EMG characteristics

A decrease in duration of the action potential


A reduction in the area to amplitude ratio of the action potential
A decrease in the number of motor units in the muscle (in extremely severe cases
only)

Because of the individuality of each patient and disease, some of these characteristics may
not appear in every case

Abnormal results:
57
EMG is used to diagnose
diseases that generally may
be classified into one of the
following
categories: neuropathies,
neuromuscular junction
diseases and myopathies.
Neuropathic disease has the
following defining EMG
characteristics:
 An action potential
amplitude that is twice
normal due to the increased
number of

58
fibres per motor unit because
of reinnervation of
denervated fibres
 An increase in duration
of the action potential
 A decrease in the number
of motor units in the muscle
(as found using motor unit
number estimation
techniques)
Applications of EMG:
EMG signals are used in
many clinical and
biomedical applications.
EMG is used as a
59
diagnostics tool for
identifying neuromuscular
diseases, assessing low-
back pain,
kinesiology, and disorders of
motor control. EMG signals
are also used as a control
signal for
prosthetic devices such as
prosthetic hands, arms, and
lower limbs.
EMG can be used to sense
isometric muscular activity
where no movement is
produced. This

60
enables definition of a class
of subtle motionless gestures
to control interfaces without
being
noticed and without
disrupting the surrounding
environment. These signals
can be used to
control a prosthesis or as a
control signal for an
electronic device such as a
mobile phone or
PDA.
EMG signals have been
targeted as control for flight

61
systems. The Human Senses
Group at
the NASA Ames Research
Center at Moffett Field,
CA seeks to advance
man-machine
interfaces by directly
connecting a person to a
computer. In this project, an
EMG signal is
used to substitute for
mechanical joysticks and
keyboards. EMG has also
been used in
research towards a "wearable
cockpit," which employs
62
EMG-based gestures to
manipulate
switches and control sticks
necessary for flight in
conjunction with a goggle-
based display.
Unvoiced speech recognition
recognizes speech by
observing the EMG activity
of muscles
associated with speech. It is
targeted for use in noisy
environments, and may be
helpful for
people without vocal cords
and people with aphasia.
63
21
3.2 BLOCK DIAGRAM OF EMG

The Block diagram clearly explains the implementation of silent sound technology
through electromyography. From the block diagram it is clear that the silent lip
movements are captured through sensor probes or it may be through image
processing technique and these movements are converted to speech through a
silent vocoder. These speech signals are transmitted through a mobile and received
voice signals at the other end.

EMG (electromyography) records the movement of our muscles. It is based on


the simple fact that whenever a muscle contracts, a burst of electric activity is
generated which propagates through adjacent tissue and bone and can be
recorded from neighboring skin areas.
How do muscles move

The process of course begins in the brain. Triggering muscle movements begins in the motor
cortex, where neural activity (a series of action potentials) signals to the spinal cord, and the

64
information about the movement is conveyed to the relevant muscle via motor neurons. This
begins with upper motor neurons, that carry the signal to lower motor neurons.

How does EMG work?

As EMG activity (measured in microvolts) is linearly related to the amount of muscle


contraction as well as the number of contracted muscles – or in other words, the stronger the
muscle contraction and the higher the number of activated muscles, the higher the recorded
voltage amplitude will be.

As EMG activity is even measurable when we do not display obvious actions or even inhibit
certain behaviours, EMG recordings represent an additional source of information into cognitive-
behavioural processing which would be hidden based on pure observation.

65
3.4 Applications of EMG
 EMG signals are used in many clinical and biomedical applications. EMG is used as a
diagnostics tool for identifying neuromuscular diseases, assessing low-back pain,
kinesiology, and disorders of motor control. EMG signals are also used as a control signal for
prosthetic devices such as prosthetic hands, arms, and lower limbs.

 EMG can be used to sense isometric muscular activity where no movement is produced. This
enables definition of a class of subtle motionless gestures to control interfaces without being
noticed and without disrupting the surrounding environment. These signals can be used to
control a prosthesis or as a control signal for an electronic device such as a mobile phone or
PDA.

 EMG signals have been targeted as control for flight systems. The Human Senses Group at the
NASA Ames Research Center at Moffett Field, CA seeks to advance man-machine
interfaces by directly connecting a person to a computer. In this project, an EMG signal issued
to substitute for mechanical joysticks and keyboards. EMG has also been used in
research towards a "wearable cockpit," which employs EMG-based gestures to manipulate
switches and control sticks necessary for flight in conjunction with a goggle-based display.
Unvoiced speech recognition recognizes speech by observing the EMG activity of muscles
associated with speech. It is targeted for use in noisy environments, and may be helpful for
people without vocal cords and people with aphasia.

66
CHAPTER 3.5

IMAGE PROCESSING

Image processing is a method to perform some operations on an image, in order to get an


enhanced image or to extract some useful information from it. It is a type of signal processing
in which input is an image and output may be image or characteristics/features associated with
that image. Nowadays, image processing is among rapidly growing technologies. It forms core
research area within engineering and computer science disciplines too.

Image processing basically includes the following three steps:

 Importing the image via image acquisition tools;


 Analysing and manipulating the image;
 Output in which result can be altered image or report that is based on image analysis.

There are two types of methods used for image processing namely, analogue and digital image
processing. Analogue image processing can be used for the hard copies like printouts and
photographs. Image analysts use various fundamentals of interpretation while using these visual
techniques. Digital image processing techniques help in manipulation of the digital images by
using computers. The three general phases that all types of data have to undergo while using
digital technique are pre-processing, enhancement, and display, information extraction.

In this lecture we will talk about a few fundamental definitions such as image, digital image,
and digital image processing. Different sources of digital images will be discussed and
examples for each source will be provided. The continuum from image processing to computer
vision will be covered in this lecture. Finally we will talk about image acquisition and different
types of image sensors.

67
Figure :picture of image processing

Digital Image Processing means processing digital image by means of a digital computer. We
can also say that it is a use of computer algorithms, in order to get enhanced image either to
extract some useful information. 
 Digital image processing is the use of algorithms and mathematical models to process and
analyze digital images. The goal of digital image processing is to enhance the quality of
images, extract meaningful information from images, and automate image-based tasks.

The basic steps involved in digital image processing are:

1. Image acquisition: This involves capturing an image using a digital camera or scanner, or
importing an existing image into a computer.
2. Image enhancement: This involves improving the visual quality of an image, such as
increasing contrast, reducing noise, and removing artifacts.
3. Image restoration: This involves removing degradation from an image, such as blurring,
noise, and distortion.
4. Image segmentation: This involves dividing an image into regions or segments, each of
which corresponds to a specific object or feature in the image.
5. Image representation and description: This involves representing an image in a way that
can be analyzed and manipulated by a computer, and describing the features of an image
in a compact and meaningful way.
6. Image analysis: This involves using algorithms and mathematical models to extract
information from an image, such as recognizing objects, detecting patterns, and
quantifying features.
7. Image synthesis and compression: This involves generating new images or
compressing existing images to reduce storage and transmission requirements.

68
3.6ARCHITECTURE AND WORKING OF SILENT SOUND TECHNOLOGY

To proceed with this research work, the Process Model assumed is Iterative Process Model
since it is more adaptable for this work. Once the face detection and mouth region detection is
achieved, speech analysis can be performed with the use of lip motion features strategies and
emotional expression with the use of other facial parts. If efficiency with identification
technique is not proper, then the threshold value falls out of the defined unique index value and
retrial has to be made. Those are one of the main reasons to choose the Iterative Process Fig
shows the overall architecture of the process model and its working methodology As the live
video is captured by a high-resolution camera, the video can be processed as normal or
grayscale color mode /or saved as Mpeg, Avi Flv etc. for customization. Region of Interest
(ROI) video is segmented from which Facial features like Mouth, nose & Eyes are detected.

Figure : Working of Silent Sound Technology

69
4.LITERATURE SURVEY

The first documented


experiments dealing with
EMG started with Francesco
Redi’s works in
1666. Redi discovered a
highly specialized muscle
of the electric ray fish
(Electric Eel)
generated electricity. By
1773, Walsh had been able
to demonstrate that the Eel
fish’s muscle
tissue could generate a
spark of electricity. In
70
1792, a publication
entitled De Viribus
Electricitatis in Motu
Musculari Commentarius
appeared, written by Luigi
Galvani, in which
the author demonstrated that
electricity could initiate
muscle contractions. Six
decades later,
in 1849, Dubois-Raymond
discovered that it was also
possible to record electrical
activity
during a voluntary muscle
contraction. The first actual
71
recording of this activity was
made by
Marey in 1890, who also
introduced the term
electromyography. In
1922, Gasser and
Erlanger used an
oscilloscope to show the
electrical signals from
muscles. Because of the
stochastic nature of the
myoelectric signal, only
rough information could be
obtained from its
observation. The capability
of detecting
72
electromyographic signals
improved steadily from
the 1930s through the 1950s,
and researchers began to use
improved electrodes more
widely
for the study of muscles.
Clinical use of surface EMG
(sEMG) for the treatment of
more
specific disorders began in
the 1960s. Hardyck and his
researchers were the first
(1966)
practitioners to use sEMG. In
the early 1980s, Cram and
73
Steger introduced a clinical
method
for scanning a variety of
muscles using an EMG
sensing device
The first documented experiments dealing with EMG started with Francesco
Redi’s works in1666. Redi discovered a highly specialized muscle of the
electric ray fish (Electric Eel)generated electricity. By 1773, Walsh had been
able to demonstrate that the Eel fish’s muscle tissue could generate a spark
of electricity. In 1792, a publication entitled De Viribus Electricitatis in
Motu Musculari Commentarius appeared, written by Luigi Galvani, in which the
author demonstrated that electricity could initiate muscle contractions. Six
decades later,in 1849, Dubois-Raymond discovered that it was also possible to
record electrical activity during a voluntary muscle contraction. The first actual
recording of this activity was made by Marey in 1890, who also introduced
the term electromyography. In 1922, Gasser and Erlanger used an
oscilloscope to show the electrical signals from muscles. Because of the
stochastic nature of the myoelectric signal, only rough information could be
obtained from its observation. The capability of detecting electromyographic
signals improved steadily from the 1930s through the 1950s, and researchers
began to use improved electrodes more widely for the study of muscles. Clinical
use of surface EMG (sEMG) for the treatment of more specific disorders began in
the 1960s. Hardyck and his researchers were the first (1966)practitioners to use

74
sEMG. In the early 1980s, Cram and Steger introduced a clinical method for
scanning a variety of muscles using an EMG sensing device amplifiers.

It is not until the middle of


the 1980s that integration
techniques in electrodes had
sufficiently
advanced to allow batch
production of the required
small and lightweight
instrumentation and
It is not until the middle of the 1980s that integration techniques in
electrodes had sufficiently advanced to allow batch production of the
required small and lightweight instrumentation and

amplifiers. At present, a
number of suitable amplifiers
are commercially available.
In the

75
early 1980s, cables that
produced signals in the
desired microvolt range
became available

2022
amplifiers. At present, a
number of suitable amplifiers
are commercially available.
In the
early 1980s, cables that
produced signals in the
desired microvolt range
became available.

76
Recent research has resulted
in a better understanding of
the properties of surface
EMG
recording. Surface
electromyography is
increasingly used for
recording from superficial
muscles in clinical or
kinesiological protocols,
where intramuscular
electrodes are used for
investigating deep muscles
or localized muscle activity.
There are many applications
for the use of EMG. EMG is
77
used clinically for the
diagnosis of
neurological and
neuromuscular problems. It
is used diagnostically by gait
laboratories and
by clinicians trained in the
use of biofeedback or
ergonomic assessment. EMG
is also used in
many types of research
laboratories, including those
involved in biomechanics,
motor control,
neuromuscular physiology,
movement disorders,
78
postural control, and
physical therapy
At present, a number of suitable amplifiers are commercially available. In the early
1980s, cables that produced signals in the desired microvolt range became available. Recent
research has resulted in a better understanding of the properties of surface EMG recording.
Surface electromyography is increasingly used for recording from superficial muscles
in clinical or kinesiological protocols, where intramuscular electrodes are used forinvestigating
deep muscles or localized muscle activity. There are many applications for the use of EMG.
EMG is used clinically for the diagnosis of neurological and neuromuscular problems. It is
used diagnostically by gait laboratories and by clinicians trained in the use of biofeedback or
ergonomic assessment. EMG is also used in many types of research laboratories, including
those involved in biomechanics, motor control, neuromuscular physiology, movement
disorders, postural control, and physical therapy

CHAPTER :5

79
FEATURES OF
SILENT SOUND
TECHNOLOGY
Some of the features of silent
sound technology are
 Native speakers can
silently utter a sentence in
their language, and the
receivers can
hear the translated sentence
in their language. It
appears as if the native
speaker
produced speech in a
foreign language. The
80
translation technology
works for
languages like English,
French and German, except
Chinese, where different
tones
can hold many different
meanings.
 Allow people to make
silent calls without bothering
others.
 The Technology opens
up a host of application such
as mentioned below

81
 Helping people who have
lost their voice due to illness
or accident.
 Telling a trusted
friend your PIN number
over the phone without
anyone
eavesdropping — assuming
no lip-readers are around.
 Silent Sound Techniques
is applied in Military for
communicating
secret/confidential
matters to others.

82
CHAPTER 5

FEATURES OF SILENT SOUND TECHNOLOGY

Some of the features of silent sound technology are

Native speakers can silently utter a sentence in their language, and the receivers can

hear the translated sentence in their language. It appears as if the native speaker

produced speech in a foreign language. The translation technology works for

languages like English, French and German, except Chinese, where different tones

can hold many different meanings.

 Allow people to make silent calls without bothering others.

The Technology opens up a host of application such as mentioned below

Helping people who have lost their voice due to illness or accident.

Telling a trusted friend your PIN number over the phone without anyone

eavesdropping — assuming no lip-readers are around.

Silent Sound Techniques is applied in Military for communicating secret/confidential

83
matters to others.

CHAPTER: 7
APPLICATIONS:
The Technology opens up
a host of application such as
mentioned below :
 Helping people who have
lost their voice due to illness
or accident.
 Telling a trusted
friend your PIN number
84
over the phone without
anyone
eavesdropping — assuming
no lip-readers are around.
 Silent Sound Techniques
is applied in Military for
communicating
secret/confidential
matters to others.
 Native speakers can
silently utter a sentence in
their language, and the
receivers can
hear the translated sentence
in their language. It

85
appears as if the native
speaker
produced speech in a
foreign language. The
translation technology
works for
languages like English,
French and German, except
Chinese, where different
tones
can hold many different
meanings.
 Allow people to make
silent calls without bothering
others
CHAPTER 6

86
APPLICATIONS

The Technology opens up a host of application such as mentioned below

Helping people who have lost their voice due to illness or accident.

Telling a trusted friend your PIN number over the phone without anyone

eavesdropping — assuming no lip-readers are around.

Silent Sound Techniques is applied in Military for communicating secret/confidential

matters to others.

Native speakers can silently utter a sentence in their language, and the receivers can

hear the translated sentence in their language. It appears as if the native speaker

produced speech in a foreign language. The translation technology works for

languages like English, French and German, except Chinese, where different tones

can hold many different meanings.

 Allow people to make silent calls without bothering others

this

87
technology will be use in our
day to day life.
‘Silent Sound’ technology
aims to notice every
movements of the lips and
transform
them into sounds, which
could help people who lose
voices to speak, and allow
people to make silent calls
without bothering others.
Rather than making any
sounds,
your handset would decipher
the movements your mouth
makes by measuring muscle
88
activity, then convert this
into speech that the person
on the other end of the call
can
hear. So, basically, it reads
your lips.
CHAPTER 7

CONCLUSION

 Thus Silent Sound Technology, one of the recent trends in the field of information

technology implements ”Talking Without Talking”.

 It will be one of the innovation and useful technology and in mere future
this technology will be use in our day to day life.

‘Silent Sound’ technology aims to notice every movements of the lips and transform

them into sounds, which could help people who lose voices to speak, and allow

people to make silent calls without bothering others. Rather than making any sounds,

your handset would decipher the movements your mouth makes by measuring muscle

activity, then convert this into speech that the person on the other end of the call can

hear. So, basically, it reads your lips.

89
REFERENCES

[1] Denby B, Schut T. HondakHueber T, Gilbert J.M, BrumbergJS(2010) slient speech


interface surface electromyography signal processing and application by A.N Norali, M.H.
Mat Som, Journal of electromyography and kinestology 10 (2000) 351 -360

[2] International journal in multidisciplinary and Academic Research (SSIJMAR) Vol .2,
No.2, March – April (ISSN 2278 - 5973)

[3] http://www.infoplease.com/dk/science/encyclopedia/r espiratory-system.html

[4] http://www.techpark.net/2010/03/04/silent-soundtechnology-an-end-to-noisy-
communications/

[5] http://www.scribd.com/doc/114337130/silent -sound - technology-report/

[6] http://www.dellchallenge.org/projects/silent-soundtechnology

[7] http://en.wikipedia.orrg/wiki/Digital_signal_processin g

90
[8] http://en.m.wikibooks.org/wiki/speechlanguage_pathology/stuttering/print_version [9]
http://www.techpark.net/2010/03/04/silent-soundtechnology-an-end-to-noisy-
communications/

91

You might also like