Adaptive Noise Canceling Applied To Sinusoidal Interferences
Adaptive Noise Canceling Applied To Sinusoidal Interferences
Adaptive Noise Canceling Applied To Sinusoidal Interferences
SPEECH,
ANDSIGNAL
PROCESSING, VOL. ASSP-25, NO. 6, DECEMBER 1977
. , . ,
l l
RELATED
NOISE €k = d k - Y k
jb I 1
I
D
REFERENCE
I
REFERENCE
NOISE
F FILTER
Y
ERROR
wk+l = wk t (YfkXk.
LMSis an iterative gradient-descent algorithm that usesan
estimate of the gradient on the mean-square error surface to
(1)
INPUT
seek the optimum weight vector at the minimum mean-square
Fig. 1. Adaptive noise canceling (ANC) system.
errorpoint. The term f k x k represents the estimate ofthe
beused when a reference forthe interference is available, negative gradient, and the adaptation constant 01 determines
thereby making explicit measurement of its frequency un- the step size taken at each iteration along that estimated nega-
necessary. This reference is adaptively filtered to match the tive-gradient direction. The true negative gradient is given by
interfering sinusoids as closelyas possible, allowing them to the expected value of ekxk. If cr is chosen properly, such that
then be subtracted out. This application of adaptive filtering small steps are taken, adaptation noise due to error in the gra-
is called adaptive noise canceling (ANC) and is fully described dient estimate isaveraged out. Widrow has shown [3] that
for broad-band interferences in [ 11 and [2] . when adapting with LMS on stationary stochastic processes,
In the broad-band case the solution for the adaptive filter is the expected value of the weight vector converges to an op-
a constant set of filter weights. Any motion in the weights timal solution w*.
after convergence to this solution is considered to be simply With sinusoidal inputs, however, this solution is not relevant,
noise in the adaptive process. The results presented herein and a new approach to the analysis is needed. The suggested
show that when the reference is sinusoidal, significant time- approach is to select a different set of inputs and outputs as
varying components in the weights give rise to a tunable notch shown in Fig. 2. Our goal is to show that when xk is a cosine
filter centered atthe frequency of each reference sinusoid. xk = C COS (w,kT t 6)
This adaptive notch filter can be a very useful methodfor
the dashed box can be approximated, if certain conditions are
automatically tracking and eliminating sinusoidal interferences.
met, by a linear, time-invariant (LTI) filter G(z) from input f k
11. THE ADAPTIVE
NOTCH FILTER to output Y k . With this model, the sinusoidal input xk, the N
weights of the filter, and the weight-update equation of the
A. Adaptive Noise Canceling
LMS algorithm are all lumped together in the transfer func-
An adaptive filter is used in ANCas shown in Fig. 1. The tion G(z).
primary consists of the signal plus noise, s t no. The reference With this goal in mind let us compute the ztransform of the
input is the related noise n l . The reference n is filtered to output Y(z).Fig. 3 is a block diagram representation of (1).
match no and thensubtracted from the primary. The error For generality, consider theith element ofa general input
signal to the adaptation algorithm is therefore the output of x-vector, Xik, with arbitrary phase angle 0
the ANC system. For more background on adaptive filtering
and the use of ANC applied to broad-band interferences, the Xik = c COS (w,kT f 6i)
reader is referred to [ 11 .
I---------- 1 .
I
I x, - ADAPTIVE
I .
I (SINUSOID)
F ILTER
I
I
I 'I
I
I
I
I I
I _ _ - _ - -I
(b) I
Fig. 2. Newmodel for the
adaptivesystem.
(a)
Block diagram. Fig. 3. Block diagram of the LMS adaptive algorithm.
(b) Transfer-function diagram.
The ith contribution to the output at Y ( z )is Equation (5) can now be simplified as
yi(z) = 2 {wjk Xik 1
- --
1-
N = 8 WEIGHTS
3 /1
- 1-
1- N.18 WEIGHTS
# _ _ -
A / - .
v - - - - - - " -P
.5
-1-
1
N=32 WEIGHTS
-1
N.64 WEIGHTS
1 c
NaC2
1~ filter at the frequency 0,. The zeros of H(z) are at the poles
of G(z), z = e t i W r Tprecisely
, on the unit circle. For slow
adaptation rates (narrow-bandwidth notch, aswill be seen
(Z COS wrT - 1)
- 2 shortly) such that NaC2/4 << 1, the pole locations are ap-
(9) proximated by
Z' - 22 COS w,T t 1 *
D. Notch-Filter Response
Now that we have justified the model in Fig. 2, the transfer The 3-dB bandwidth.(BW) is then obtained by finding the two
function of interest in ANC is that from d k to e k , which will points on the unit circle which are 4 times as far from the
be denoted H(z). (See the Appendix for a discussion ofJ(z), pole as they are from the zero. The result is found geomet-
the corresponding transfer function from d k to yk.) H(z) is rically as approximately
now easily found to be
BW= -
NQ!c2rad/s.
2T
Under the assumption of approximate linearity, anex-
perimental sweep frequency response of the actual H(z)
was obtained for a reference frequency of f r T = 0.2, and the
result is shown inFig.S(a). Note that the value o f f = 0 is
greater thanunity.Infact, using the final-value theorem
- Z' - 22 COS w r T + 1 for z transforms on (lo), the value at f = 0 is found to be
z 2 - 2 (1 -
NaC2
q ) z c o s w r T t (1 - y) * (10)
1/ [ 1 - (NaC2/4)] . A similar response, but with much smaller
adaptation rate Q! and thus much smaller BW, is shown in Fig.
488 IEEE TRANSACTIONS ON ACOUSTICS,
SPEECH, AND SIGNAL PROCESSING, VOL. ASSP-25, NO. 6, DECEMBER 1917
E. Conclusion
Iv.
EXTENSIONTO A SUM OF SINUSOIDS AS
THE REFERENCE
Thus far we haveseen that when the reference is a pure
The analysis for a single-reference sinusoid is easily extended
sinusoid, and /3/N X 0, a linear, time-invariant notch-filter re-
to a sum of reference sinusoids, resulting in a multiple-notch
sponse is obtained from the primary input D(z) to the ANC
filter. Suppose the reference is a sum of M sinusoids
output E@). Three important characteristics of this adaptive
notch filter are as follows. M
1) It is tunable, since the null point of the notch is deter- xk = cmCOS (amkT + 6,)
m=1
mined by, and thus will move with, the reference frequency.
2) The notch can be made very sharp at precisely the fre- then
quency of reference-input sinusoid. An example of the im-
M
portanceof this will be seen in an adaptive noise-canceling Xik = c, COS (am[k - i t 11 T + 6,)
experiment described later. m= 1
3) The effects of the notch are clearly not due to the usual
M
constant-weight converged solution. If the weights were con-
= Cm COS (a,k T + Sim) (12)
stant, they could only pass the input reference frequency to
m=1
the y output, and could not cause any cancellation of nearby
frequencies. where
111. SOLUTIONOF THE WEIGHTS OF THE FILTER eim.=em - am[i- 11 T.
Now that wehaveseen the input-output behavior of the Proceeding as in (3)-(8), we obtain for the multiple-sinusoid
adaptive system, let us lookatthe time-varying solution of case
weights which brings about this behavior. We have actually NOr M
-
already derived the z transform for the weights in (4). In
order to study the implications of this solution, still under the
assumption that p/N 0, consider that dk , and therefore E k ,
is sinusoidal at frequency a d . The pole-zero plotfor E(z)
~ ( z=)-~ ( z )
4
M
m=1 n=1
[U(ze-’”m T > t U(zei”m T>l
M
m=1
2 T , N ) [TV]
would indicate poles at z = e ‘iw T . Since E(ze-iwr T , repre-
n#m
sents a counterclockwise rotation of E(z) through anangle
a , T , and E(zeiwrT) a clockwise rotation, the pole-zero plot
of lE(ze-iarT) ei9i + E(zei”,T) would show poles at
. -
+(a, t ad)T and at &(a, - ad) T . This rotated spectrum is
then filtered through (aC/2) U(z) to give Wi(z). Each weight where TV again
~ ” renresents undesired time-varying
. . -components.
GLOVER: NOISE CANCELING 489
1-
ah/,=
2T
IHk)I /
c,=.707
\
C*=l.O
6 4= 9 6 4=
T
4 fT
0 .l S6 .20 .3 .4 .5
FG. 7. Experimentalsweepfrequencyplot of sum oftwo sinusoids
as reference. Q! = 0.05/16,N = 32.
C I-------- - 1
\ I MOTORtt2 AT C
64 W t s
- I (BANDPASS OUTPUT)
I
L - - - - - - l
MULTIPLE NOTCH AND
BANDPASS F I L T E R S
Fig. 8. Separating vibrations from two variable-speed motors.
Herewehave both sum and difference frequencies of the generalcase of sinusoids into the adaptive filter of an ANC
reference sinusoids to contend with in order to make the p/N system. The previous single-frequency results can be viewed
ratios small. Large sum frequencies may be handled as before, as a special'case of the multiple-frequency TDL results.
by decreasing T or increasing N so that p [ ( o m t wJ2) T,
N] / N = 0. However, the difference frequencies may already v. APPLICATIONS
OF THE ADAPTIVE
NOTCH FILTER
be so small that they are far to the left on the PIN curve. De-
In actual practice, some special configurations of the adap-
creasing T would push them' even further to the left,increasing
tive notch filter are sometimes used. An example of a 2-weight
p [ ( w m - w,/2) T, N ] IN. Therefore, when the reference sinus-
notch filter was introduced in [l] . If there are only two com-
oids are close together, often the only way to eliminate all of
ponents to the x k vector, and the delay between them :is
the unwanted TV termsjs to increase N , the number of weights
equivalent to a 90" phase shift atthe reference frequency,
in the adaptive filter. That is, a long filter is required to give
then they represent a sine and cosine pair, and p/N is easily
good resolution between adjacent frequencies.
shown to be exactly zero. Further, if instead of a TDL there
If we again assume that each of the 6's in (13) is such that
aie N = 2~ components of x k consisting of M sine-cosine
PIN = 0, the transfer function from E(z) to Y(z) is
pairs at different frequencies, then again all p/N ratios are ex-
actly zero. This configuration is preferred when separate
references can be obtained for each of several interfering
-r m=1 sinusoids.
The H(z) transfer function from D(z) to E(z) is, therefore, An example of the use of a single long adaptive filter to ob-
1
tain multiple-notch filters is shown in Fig. 8. At pointsA and
B two variable-speed motors operating at different but .very
close frequencies generate odd harmonics (for purposes of this
-t m=1
simulation) through the chassis on which they are mounted.
Due .to multipath and other reasons;,each harmonic received
H(z) represents a series of notches, one notch at each reference at point C on. the chassis has an unknown and unpredictable
frequency am.The 3-dB BW at each wm is amplitude and phase. The goalis to separate the harmonics
NaC& coming from each motor so that the vibrations at point C due
BWm = -rad/s. to each motor can be determined. Fig. 8 is the ANC config-
2T
uration for eliminating motor 2 so that motor 1 can be ob-
An experimental sweep frequency response for a 32-weight served. As shown in the Appendix motor 2 can be observed
TDL is shown in Fig. 7. As indicated on the plot, one band- at the same time at thebandpass filter output at Y k .
width is twice the other because the amplitude ratio of the A simple method of generating the odd reference harmonics
two reference sinusoids is fito 1. is used. The fundamental frequency of motor 2 is measured
In summary, these results comprise a solution for the most directly off the motor and is clipped to give a square wave at
490 IEEE TRANSACTIONS
ONACOUSTICS,
SPEECH,
ANDSIGNAL
PROCESSING,
VOL.
ASSP-25, NO. 6 , DECEMBER 1977
(b) (dl
Fig. 9. (a) Spectrum of square-wave reference. (b) Spectrum of primary: both motors and their harmonics. (c) Spectrum
of notch-filter output: motor 1 and its harmonics. (d) Spectrum of bandpass-filter output: motor 2 and its harmonics.
the same frequency. A more efficient method of obtaining Although this exampleissomewhat contrived, it isgiven to
higher harmonics with equal amplitudes could be used in ac- demonstrate the type of situation in which the adaptive filter
tual practice. can be used to eliminate multiple-sinusoid interference. There
The fundamental frequency of motor 2 is 0.078. A digital art: many similar practical applications in which the adaptive
amplitude spectrum of the square-wave reference derived from notch filter has proved to be an extremely useful tool.
it is shown in Fig. 9(a). ,Note the aliasing of the higher har-
monics. The sumof thevibration hakmonicsfrom both VI. CONCLUSIONS
motors is received at point C and is used as the primary irlput The results presented here have provided a new approach to
to the noise canceler. The amplitude of this primary is shown the analysis of the adaptive filter and theadaptation algo-
in Fig. 9(b). rithm. When theinputtothe adaptive filter is sinusoidal,
A 64-weight adaptive filter was used for this simulation. The there are significant time-varying components in the filter
operation of the noise canceler was to place a notch filter at weights that havepreviouslybeenignored as noise in the
each of the frequencies seeri in the spectrum of the reference adaptation process. In ANC applications the effect is that of
in Fig. 9(a). By adapting very slowly, the flotches were made a tunable adaptive notch filter exactly at the frequency of the
very narrow so that tlie nearby harmonics from motor 1 were sinusoidal interference. As long as a reference is available that
undisturbed. The amplitude spectrum of the resulting noise- includesevery sinusoidal interference,the ANC systemwill
canceller output at ek is showninFig. s ( ~ ) . Only thehar- automatically create a notch over each sinusoid and follow it
monics from motor 1 remain, and they have the same relative if it drifts in frequency. This adaptive notch filter provides a
amplitude as they do in Fig. 9(b). Since for each notch filter simple and effective alternative to other methods of tracking
there is a correspondingbandpass fiter, the harmonicsof and eliminating sinusoidal interference.
motor 2 are simultaneouslyavailable at the Y k output. The One further point should be made about the relationship of
result is shown in Fig. 9(d), the results obtained here to previous ANC results. In an ANC
Thus we have seen that this combination of multiple-notch application, when the noise reference is sinusoidal, the noise to
fdters and bandpassfilters obtained by using multiple-reference be canceled is generally at exactly the same frequency as the
sinusoids into a long TDL allows us to separate the vibration reference. The solution desired is therefore probably the con-
harmonics caused by the two motors. Each of the notch and stant-weight solution previously assumed. This constant solu-
bandpass filters is precisely atthe, required harmonicfre- tion corresponds to an infinitely narrow notch fiter, the limit-
quency, even if one or both of the motors change frequency. ing case as a: + 0. However, in practice a: is not set to zero in
GLOVER: NOISE CANCELING 49 1
L
N;C2)
(Z COS - 1)
( N;C2) * (17)
signal components falling within the finite notch will be dis- z2-2 1-- z COS w,T+ 1- -
torted. Therefore, it is important to keep a as small as pos-
siblewhenlarge sinusoidal components are present in the This is a tunable digital bandpass filter centered at frequency
reference. f,.. Its poles are the same as those of H(z). Since the points of
It should also be pointed out that in many practical cases the unit gain are exactly at ff,., where the zeros of H(z) were,
reference interference is a mixture of both sinusoidal and non- then the 3-dB BW is found to be the sameas (1 1) for the
periodic components. For slow adaptation rates one canap- notch filter.
proximate that the resulting ANC solution is a combination of Multiple bandpass filters, corresponding to themultiple-
steady-state solution described in [I] and the notch-filter solu- notch filters, are obtained when a long TDL has more than one
tion described here. However, the exact nature of this inter- sinusoidal reference. Using (14) we obtain the following series
action is still being studied. of bandpass filters.
APPENDIX
BANDPASSFILTER
THE ADAPTIVE
In each instance where a notch filter is obtained as the trans-
fer function from dk to Ek, there is a corresponding bandpass
filter from d k to Y k , which will be denoted J(z). Ifwe con- The 3-dB BW at each reference frequency is the same as (16).
sider first the case of single-reference frequency into an REFERENCES
N-weight TDL, the results are easily found using the expres-
[ l ] B. Widrow et al., “Adaptive noise cancelling: Principles and appli-
sion for G(z) found earlier in (9). Substituting to find J(z) cations,” Proc. IEEE, vol. 63, pp. 1692-1716, Dec. 1975.
[ 2 ] J. Kaunitz, “Adaptive filtering of broadband signalsas applied to
J(z) = -
Y(Z> noise cancelling,” Stanford Electron. Labs., Stanford Univ., Rep.
SEL-72-038, Aug. 1972.
Hz) [3] B. Widrow,“Adaptivefilters I: Fundamentals,”StanfordElec-
tron. Labs., Stanford Univ., Rep. SEL-66-126, Dec. 1966.
-- G(z) [ 4 ] J. M. Wozencraft
and I. M. Jacobs, Principles of Communications
1+ G ( z ) Engineering.
Wiley, York: New 1965, p. 496.