CoConstructive Perspectives On Inductive Logic Holm
CoConstructive Perspectives On Inductive Logic Holm
CoConstructive Perspectives On Inductive Logic Holm
)?=@A
E? @EIIAHJ=JE ? ?
EIIE JD
JDA
15* 15* 0A IE 0A IE
'
$!#
! F=FAH>=?
#&!# $ 2,.
E 7 ELAHIEJO 2HE J
)>IJH=?J
EIJ
=? E C
=@AGK=JA ?
B JHKJD E
?AH E C B=?JK= E A
IJHK?JELA IA
J F IIE> A J
IA I HO ANFA LAH JDAIA E JDA IJHK? A J MEJD IJHK?JELA 6DA IJK@O +=H =FI JDA IJHK?JELA
HA LAH = ?
AI = F=HJE?K =H =E I
B =FFH =?D J
JDA ?
?AFJ
B JHKJD E = ?
CE? 6DA
JHKJD E
B E @ELE@K= I 6DEI ?
FEHE?= IJ=JA
B JHKJD ME J
E? FH >=>E EJO ME
6DA =E
AJD @ E
JE KK B
AJD @ EJIA B E
? KHIA
>J=E E C ALE@A ?A ME IE E
E JAHFHAJ=JE
JA JI
)?
M A@CA
A JI
'
" % '
EJA F IIE> A M H @I += J H IF=?A CE?= F IIE>E EJO ! " # + . H # # #! #" ## + 4A E JAHFHAJ=> A ,A K IJHK?JELA >IAHL=JE AH=> A = AI
! ! # $ %
CE?= IF=?A
% & ! !
=M E A IAGKA ?AI E @ E @AFA @A J E H@E =JA = CK=CAI EJA >IAHL=JE IAGKA ?AI 2 IIE> O E EJO
+ ! !
E? FH >=>E EJO E? FH >=>E EJO EJO =I LAHE =>E EJO B >A EAB
2H >=>E EJO E
"
. H "
E >AH
"" "" "% "& "& "' @ @I = @ K E I B # B #! ## #% #' #' $ $ $ B F IIE> A = JE?I EJA @ FAH=JE >IAH $" JDA IA B > $# ? IA?KJELA CE?= =E I I $% $' % % %! %" %# %$ %% %& & & EJI B? IJHK?JELA ANJA @E> A FH > & A JI &! EJI B ? =IIE?= ANJA @E> A FH > "' AECD> KHD @I B @I
=E I =?? H@E C J
-NJA @E> A FH >=>E EJO # # #! 1 JH @K?JE 5=JEI =>E EJO E 1 #! #!! #!" #" #" #" #"! #"" #"# #"$ #"% #"& + )IO + #! CHA=JAH ?=H@E = EJEAI EJA IJHK?JKHAI =E I IAGKA ?AI = @ IAGKA ?AI EJO HAFHAIA JA@ >O AIJA@ @ >IAHL=JE L=JE I IJHK?JELA JHKJD = @ FH >=>E EJO E IAGKA ?AI EJI = @ JHKJD E FJ JE? E KJ=JE
-NJA @E> A JHKJD = @ JHKJD E 6DA FH >=>E EJO #"" 6DA E M ) HA E 6DA ANEIJA ?A
B FH >=>E EJO
+= ?K =JE C ANJA @E> A FH >=>E EJO #"& #"& #"&! =>E EJO =>E EJO 2H @K?E C JDA E EJE= IAC
5A? $ $ $!
H@AH FH >=>E EJEAI @ @ K K H@AH FH >=>E EJEAI H@AH FH >=>E EJEAI AJD @ = @ E AJD @ MEJD AJD @I H@AH ? @EJE = FH >=>E EJEAI @ EJA IJ=JA @AI?HEFJE EJA IJ=JA @AI?HEFJE I I
&& &' ' ' '! '" '$ '% ! #
1 JAHFHAJE C IA? 5K> A?JELA IA? 6DA $! $! FJE K 6DA 6DA FJE FJE
AJD @
$"
= EJO
B E @K?JELA
+= ?K =JE C IA?
7F@=JE C JDA E @K?JELA % % %! %" %# 1 @K?JELA I AFJE?EI 1 @AIJO A=IKHA HK A +=H =FI 2AHB H %# %# %#!
AJD @
B IK??AII
6DA ? HHA?JE = ?A + + %# +
LAHCA ?A F=HE C JM
B ?
A=
IJ= J
AJD @I
IJ= J HK A = @
F=HE C JDA 1 +
AJD @I #
%#! %#! %#!! %#!" %#!# %#!$ %#!% %#" & 6DA ? HHA?JE & 6E A= @ & 6DA ?K
AJD @
& ! " #
6DA E LAHIA E BAHA ?A LAHCA ?A H=JA A= F A JDA FH >=>E EJO IGK=HA AHH H
HK A = @ JE
>J=E E C ALE@A ?A )?JK= EIJ JHKJD =?JK= EIJ JHKJD 6DA H@AH B? K ?JI
4ABAHA ?AI
)?
IJ LAHIEJO = OM H /H E CA B ?
M A@CA
B JDEI IJK@O D=I >AA B 0A IE E MDAHA ?
A JI
@K?JA@ =J JDA ,AF=HJ A J B 2DE I FDO B JDA 7 E A CHA=J O @A ?A E B
EE E K J
D=I =IIEIJA@
JDA M=O JDH KCD JDA FH ?AII 9EJD KJ DEI ANFAHJEIA IKFF HJ = @ ? EJ M K @ ALAH D=LA >AA B 2DE A = F EIDA@ HAIA=H?D ? CE? AJDAH = @I /H E CA 6DA .=?K JEAI A @I
I FDO =J 7JHA?DJ 7 ELAHIEJO = @ =J JDA 7 ELAHIEJO E JAH =JE E? EBA E C JDA = JE?I = @ E @K?JELA ) >AHJ 8EIIAH E =H 6DA L= 7JHA?DJ E
FH LE@A@ A J
IJHK?JELA IA O =
JH @K?A@ , KLA
MAHA ?AHJ=E
IJ E IFEHE C H B OM H
,KHE C
O IJ=O E
L=HE KI =IFA?JI
) HA=@O >AB HA 1 IJ=HJA@ CE? AIFA?E= O E JOFA JDA HO =J JDA ,AF=HJ J F ? =II =?=@A O FDE B JDA I= I FDE?= JDE A J
O 2D, HAIA=H?D 1 D=@ >A? EJI JOFA JDA HAJE?= L=HE= J B 2DE I FDO E B 0A IE O = L A J KA ?A E M=I 2 =J
A HAIA=H?D CH KF D=LA = I = = C
> JD FDOIE?= HAIA=H?D B=?E EJEAI = @ E JA A?JK= JH=E E C /=>HEA 5= @K D=I >AA = @ = BHEA @ JD= ANFAHEA ?A@ I?D 6DA AN= KD= JDAEH E 1 ) E B 2DE =EJ=H E =@@EJE ADJE A 2AJJAH B FDE A J B JDA DEI ? L=HE KI H = =HI E O F IJCH=@K=JA IJK@EAI 0EI ME E C AII J A=CKA AHA O = FH BAII H JDAEH =?=@A O JDAIEI = B H A JI =JDA = @ =H DA F = @ =@LEIA AII = I= @
E? ABB HJI EI HA
=H => O CA AH KI KEFAHI 2AH -HE I J >A AN=CCAH=JA@ B O JANJ @EI?KIIE EJ?DA KD= 0E = I MEJD A J = 6E = HAC D=LA E JDA JANJ JD=J
E AHI
=H I = @ IKCCAIJE
F HJ= ?A J
B JDA ,AF=HJ
K 4 E E = JDA K ?D >K ?D D=I >AA =EF=E A A J B 2DE = @ 6AHDE I FDO E EEI E A 0A IE
K =H I KH?A
'
O JD= =JJE A E
I= I K A
*AHCIJH= EH = 0=HJE = AH A A K
= 8
A 0EEF= = 9E A A
= = @
2= K 4==JE =E A
6DA M H
= @ 4ACE = 9=E IJAE . K @=JE I FDO = @ JDA JJ B 0A IE JDA HAIA=H?D A?J =JDA ) CE? =JE?I =
= @ JDA -
JDA HAIA=H?D FH
` 6DA HO = @ )FF E?=JE B JDA 7 ELAHIEJO . K @=JE 7 ELAHIEJO F OA@ 1 F=JD B 0A IE JDA ,AF=HJ
B 2DE
K @ . K @=JE
E = @ JDA A O J J
E CH= J B H B JDA M H
JDA IFEHEJ
IKCCAIJ = @EHA?JE
EE =I F=JEA ?A = @ K @AHIJ= @E C @KHE C JDA =IJ DA?JE? IJ=CA >AA E @EIFA I=> A 6DEI JDAIEI EI @A@E?=JA@ J O @=KCDJAH 5==C=
0A IE 4KKHE
E 0
?J >AH
'
+D=FJAH 1 JH @K?JE
+ ?
/A AH= H=JE
= A = @ >=? CH K @
= JE?I D=I JDKI B=H =? A@ = A FEHE?= ? @A =JDA A = LAHE ?=JE =JE?= @ =E I @EJE >IAHL=JE =@AGK=JA =JE?= B H IA I E A
=JDA
IA JA ?AI
JA ?AI JD=J ?= A? I E E C E A JI E ? = E
AEJDAH >A
H LAHE A@ >O
EI JDA @EB ?K JO J A E
IJHK?JELA IA
FH >=>E EJO
+=H =FI E @K?JELA IKB ?EA J ANF E?=JE EI @A = ? A@ =I JDA E =E A= I JD=J JDA ? EJA @ IA?KJELA E
HABAHA ?A EI +=H =F '$ D=I =? A@ = E @K?JELA ? IA?KJELA EJE A?JE E JDA @A ?AFJ CE? FH >=>E EJO E EJO EJA ?=H@E = EJEAI MDE?D B FH >=>E EJO EI JHKJD E >AJMAA EJO EI ?AFJ = ? FH >=>E EJO E EIIE C BH B JHKJD E ? IJHK?JELA A J MEJD IJHK?JELA
B JHKJD E
JDA IOIJA 6DEI IJK@O @A E IA?KJELA E JAHFHAJ=JE HAIFA?J J EJA @ JDEI ? AI = F=HJE?K =H =E I ?AFJ B =FFH =?D J ?AFJ ME A JDA ? >A CELA EJO B H +=H =FI E @K?JELA = @ MD=J ?= CE? 6DEI AM =FFH =?D EI >=IA@ JHKJD E
B E @ELE@K= I B JHKJD ME
6DEI ?
FEHE?= IJ=JA
JE
B AFEIJA
E? FH >=>E EJO ME =I AM H @A
>A E JH @K?A@ MDO +=H =FI E @K?JELA E C ? E? FH >=>E EJO 1J EI CE? ID K @ >A ? 9DO CE? J A J A KCD J IJ=JA IJHK?JELA FH >=>E EJEAI B +=H =FI E @K?JELA JHKJD = @ FH >=>E EJO = JE?I EI JDA >AIJ CE?= IA @A I B JDA IA M
M JDA HA=@AH EI A JEJ A@ J IE@AHA@ =I JDA >=IE? BH= I A KIJ ) = JDAH =FFH =?D J BBAH I E = CK=CA @A JD=J JDA IJK@O ME
B H @A
E C AFEIJA
>A => KJ = ?
A KIJE ?=JE
B JHOE C J I?HEFJE IJ + I E
= JE?I
B F IIE>E EJEAI
F IIE> A M H @I IJHK?JELA O F IIE> A M H @I ?= I A ?= KFFAH E >J=E A@ =I IAGKA ?AI @E C J = @=J= IJHA= HAFHAIA J IK?D = @=J= IJHA= EJ A=?D @ECEJ ? HHAIF I A =BJAH = EJE JDAH MEJD >E =HO IAGKA ?AI MDE?D 6DEI IJHK?JELA O A?JA@ J IAGKA ?AI
F IIE> O D=LA B =J @A IOIJA 5JE GKA ?AI B H @A JDKI E ? A?JE = AI B H >A M EJE E? B=?JI B = ? I
0A ?A JDA FDE
@AI?HEFJE = H
6DA ?
=>E EJO EI @A
IAGKA ?AI = @ ?
E@ B K @=JE
JDA FH > A
7IE C +=H =FI E @K?JELA EJE C JDA I? FA =FI E @K?JELA I=HE O = @H=M>=? B? JDA MD A A @ B JDA IJK@O O CE? @ALA =@E? = CK=CAI = O
CE? =I = >=? CH K @ BH= +=H =FI IOIJA B JDA I E '$ JDA J JE ALA @E CI =FF O
=HA @A
FA@ E
JDEI IJK@O
IE ?A JDA B HAIA=H?D ?
FH LE@A I
IJHK?JELA AFEIJA E C =
E IECDJ E J >AJMAA
=>E EJO = @ ?
JDAIA JM = JE?I
= O F=HJE?K =H =O >A ?
=JE?= IOIJA
JD=J
BI ?
0 MALAH B A FEHE
A E JAHAIJE C A
IJHK?JELA JHKJD = @ FH >=>E EJO = @ J +=H =FI IJ=JA @AI?HEFJE ?AFJI D=@ J =JE?= IOIJA = JE?I =JDA
?AFJI ? K @ >A KIJEBO JDA KIA =?JK= O I B JDEI A@ E F I ?AFJI JHKJD M=> A FKJ=> A ` EJ
M H A@ E J
I FDE?= >=? CH K @
>A @EI?KIIA@ E 1J EI =
JDA >=IEI
IJK@O ?AFJ IJHK?JELEI H KIE C JDA MDE?D EI KIA@ E A= E C ANF = =JE > A?JELA B? JDEI IJK@O EI JDKI I FAHJ=E E C J @A J @A = OB H IE> A J >AO @ = IOIJA ?AFJ IK?D = IOIJA
) FHA?EIA ?
IJHK?JELA A
FEHE?= JHKJD = @ FH >=>E EJO M K @ >A E B JDA IJK@O EI J A IK?D ? IJHK?JELA JHKJD EI HAIFA?JA@ JDAHA EI O >A JHKA EB EJ EI >A ABBA?JELA O ? =H L ? E JAHFHAJ=JE AII IJ=JA@ IJHK?JELA A A@ J
0 MALAH JDA CA AH= FHE ?EF A LAHE => A EI FH LE@A@ E IJHK?JELA BK ?JE
HA HA =NA@ ? IJ= JI ME
IJHK?JELA E
.E = O JDA IJ= @=H@ *0 >A KIA@ K B ? JDA FH >=>E EJO IA LAI E A CE?= HA =JE
CE?= ?
6DA FHALE KI EJAH=JKHA FH >=>E EJO IJ=JA =IIEC A@ = @ D ' E A JDA A= E C A JI JDA @I JD=J
'&" @EI?KIIAI =
= JE HA= EIJ ?
IJHK?JELA E JAHFHAJ=JE
J IA JA ?AI J B H=
MDE?D FH >=>E EJEAI =HA AO AI B H = JE HA= EIJ ANF = =JE F A BHAGKA JEIJ O FH >=> A A= E C B E C M
E @K?JELA
B FH >=>E EJEAI EI J= J= FH FA IEJO ?B *A A I A@CA = @ JDKI MA =HA E A JDAO # HA =JE JDA I= = I #! FEHE?= $"
D MALAH
)I /H LA 0= FAH
CA AH= K @A?E@=> A >KJ EJ EI JHKA JD=J JDA ?AFJ @ABA @ JDA LEAM JD=J JDA CE?= HA =JE
> A?JELA =I ?
= JE HA= EIJ E JAHFHAJ=JE IJHK?JELA A AJJ B H A '&" FF #% #& HA EAI FEHE?= IJ=JA A JI B H JDA = JE HA= EIJ EJELA O ,K AJJ KIA@ JD=J => KJ JDA =IIAHJE>E EJO ? FEHE?= IJ=JA I B H A
A JI JDAHA ME
LEHJKA
!
MA @ ,K A
$
AA@A@ B H
AO B H ,K
AJJ EI KIJE A@ =IIAHJE>E EJO = IA JA ?A >J=E A@ 6DEI ALE@A ?A JDEI LEAM ? KIELA O MDE?D A J=E I JD=J = KIJE => O J >A KIJE => O =IIAHJE> A @EJE JE B EJI KIJE => A =IIAHJE>E EJO B FH >=>E EJO -LE@A ?A
=O >A KIJE => O =IIAHJA@ EB ALE@A ?A IKFF HJE C EJ EI @ AI JDA LAHEBO JDA IA JA ?A ? =O E JDA BKJKHA =IIAHJE> A IA JA ?A J LAHE =>E EJO KIJE A@ =IIAHJE>E EJO EI ? E ?HA=IAI JDA FH >=>E EJO FH >=>E EJO ?= >A ? JDKI -LE@A ?A ?= B = IA JA ?A E E A?JA@ MEJD JDA A J ) IJ=JA B = IJ=JA
B = IA JA ?A EI @A
A@ >O JDA ?
IE@AHA@ =I KIJE => O =IIAHJE> A = A = IA JA ?A A= I KIJ IJE HA FH >=> A = @ JDKI KIJE => O =IIAHJ >A ANF =E A@ EJA JDA + A=H O JDA FH >=>E EJO EI JHKA 1B JDA @ JHKJD DAHA ?AFJ B ? =E A= I JHKJD IJHK?JELA '&" @I E A
EJO 0A ?A EJ IAA A= I E ?
EJO >O HAF =?E C LAHE =>E EJO MEJD KIJE A@ =IIAHJE>E EJO 9D=J FH > IJHK?JELA JAH B JDEI AA@I J A@ >KJ *A A I =?? K J
=> O JHKA
J FH LE@A =
6DA =E
1 @K?JELA E BAHA ?A
B JDEI IJK@O EI = I = FH > A => KJ ? ? J E FH LA +=H =FI E @K?JELA B +=H =FI E @K?JELA AA@I I CE? CE? I LE C I AM H B JDA B A A
I 6DA KIA
B E @K?JELA B=L KH
EJ D=I B=?A@ @KHE C JDA F=IJ @A?=@AI I >A FH LE@A@ E H I FDO >IAHL=JE >O ? A= I H =IIEC =JE = O B H
5?EA JE ? DOF JDAIAI =HA ? IA JA ?AI K ELAHI= CA AH= E =JE ?E= GKAIJE CA AH= E =JE MDA I EI = E >A
= E A@ =I K ELAHI= O GK= JE A@ >O ALE@A ?A EI = ?HK H MI IE = EJA JE A EJ EI = E J EJA JDA B ALE@A ?A E =JE B K ELAHI=
@A= E C MEJD I?EA JE ? DOF JDAIAI ? F HJ= J EIIKA E JDEI ?= EJA K O= K =JA@ =I B
B I?EA ?A
=HEIE C BH
5E ?A JDAHA ?=
B E @ELE@K= I 0A ?A =J >AIJ
e ?=
hE
"
JDA IA IA
JDA HK A
B?
@EJE
= FH >=>E EJEAI
P (h|e) =
EI =FF EA@ 0 MALAH JE?I IOIJA B A ID K @ @A
P (h&e) P (e)
>O MDE?D JDEI ? ?AFJ M H
=JE =
=?JK= O J= AI F =?A MDE?D D=I JKH A@ CE?= FH >=>E EJO EI = = = CK=CA =I E =I MA KIE C JDA B H B FHA@E?=JA AH
CE? >KJ EJ EI MA
+=H =F '# K ELAHI= O GK= JE A@ A= I JD=J JDAO AH B M AI FH >=>E EJO K @AH @A@K?JELA CE?= O BH B E @K?JE . H AN= H
HK A => LA >A =IIEC A@ = HA CA AH= BH= ? KIE >IAHL=JE @ AI I J AM H J B BKJKHA > =? IEIJE C > =?
5?EA JE ? E BAHA ?A >A E @K?JELA E BAHA ?A E FHA EIAI 6DEI JOFA >IAHLA@ ?
n > =?
@A EAI JD=J
A M K @ >A JAH B
KIJE A@ E
n + 1JD ?H
M EI = I
-NFHAIIA@ E B
FH >=>E EIJE? E @K?JE ?H MI >AE C > =? + > =? B 1 IE@AH ?H MI J E @ MI JD=J = B=?J EJ B
E @K?JELA I AFJE?EI
n + 1JD
n > =?
?H MI >IAHLA@ n 1J
EII JD=J
A D=I
n + 1JD ?H
JD=J JDEI
AH=JELA E @K?JE
n+1
> =?
n + 2JD ?H
M EI = I
MI JD=J =
0A ?A = L= E@ E @K?JELA E BAHA ?A BH
(x)P (x)
EI JHKA EBB
P (c)
>AH JDAIA
ANJ
B JDA E BAHA ?A BH
= CA AH=
=> KJ = IE C A E IJ= ?A EI =J A=IJ F IIE> A J MDA JE A F=IIAI 1 = IA = JE?I >=IA@ ? KIE B = I=O JD=J = IE C A E IJ= ?A ? >A @EHA?J O >IAHL=> A
>IAHL=JE
EJ EI F IIE> A J
E @EHA?J O LAHE A@ >O E @K?JE JD=J JDA E IJ= ?A ME EI @EHA?J O E BAHA ?A A E JE E EJA @ IJHK?JELA O JHKA
F A A K
I M K @ D=LA =
I M K @ D=LA = ?
A= E C ANF = =JE #
B A K
A E
JDA FH > A
0 MALAH FH >=>E EIJE? E @K?JE J FH LE@A = LAHE ?=JE =I => LA 6DA =IIK J I FJE
JDA
EI = L= E@ B H
B E BAHA ?A @ AI 6DA ?=H@E = EJO JE?I J EJA EJA ?= E K JDA FH > A K >AH >AH E B
LA JDA FH > A =E 1
B JDA @ B E @K?JE
IJHK?JELA IA
B E @K?JELA E BAHA ?A IE ?A = KIJEBO = K ELAHI= J KIJEBO JDA ? 1 B H =E B=?J JDEI ? = E A JDA @ J B ? >A AEJDAH =M = JD=J =E EJA = B = JE?I B H ? KIE ? KIE
JDAHA EI =
B LEAM
IJHK?JELA IA
JE?I = @ E @K?JELA E BAHA ?A 6DEI EI JDEI IJK@O K )I M=I IJ=JA@ => LA JE ?=JE AH JDA = E C =
A JE C JDA IA
EJA IJHK?JKHAI E @K?JELA E BAHA ?A ? EB >IAHLA@ > =? ?AH E C = JDKI B=H ?H MI E ?HA=IA JDA I =O IJE D=LA = B =IIEC E C K ELAHI= GK=
>IAHLA@ IE C A E @ELE@K= EI = @EBBAHA J EIIKA BH I = F IEJELA FHE H FH >=>E EJO -LA ANJ ?H M EI > =? >IAHLA@ > =?
FHE H FH >=>E EJO JDAH D= @ EB AH J E ?HA=IA JDA FH >=>E EJO EJA IAHEAI I AFJE?EI B > =? ANJ ?H MI >AE C > =? JDA FH >=>E EJO ?H MI EI
A E @K?JELA
EI = FHAHAGKEIEJA I EI >
B H F IEJELA FH >=>E EJEAI 6DA M=O J J=E A@ JDH KCD = AJD @ E E @ AI =IIK J= E CE =JJA
JE KK
JDA FH > A
AM H
6DAHA EI = F=HJE?K =H
M=O I EA
E C IK?D =
B E JH @K?E C IA?
C JDA E @K?JELA
>A AIJ=> EIDA@ JD=J JDA FH >=>E EJO @I J = = F=HJE?K =H AH JE =IO B JHKJD JE HA?AELA
B = IA JA ?A E E
B JHKJD E
EJO K ELAH
!
KJ E A
B JDA IJK@O
JDA B ME C ?D=FJAHI E @I JDA B A JEJEAI ? JA@ IJHK?JELA A FEHE?= = I I E? >A E CKEIJE?= O @A IJHK?JELA B H EI @AL JA@ J K =JE I B ? IJHK?JELA B=?JK= JHKJD E I >O E JH @K?E C JDA ? 8=HE KI FH F 5A?JE #! E 6DA =JJAH GKAIJE ?AFJ
M H @I =HA = @ D M JDAO ?= JDA FH > A +D=FJAH ! @EI?KIIAI JDA ? FH >=>E EJO 5FA?E= =JJA JE = @ JHKJD E JDA ?=IA BE
JDA FH > A I
= E E C FH >=>E EJO
+D=FJAH # A => H=JAI BKHJDAH JDA FH > A EJO = @ FH >=>E EJO ) ?AFJI AHJEAI
LA JDA FH > A
B ANJA @E> A JHKJD = @ ANJA @E> A FH >=>E EJO EI FHAIA JA@ JDAH DEJDAHJ = I >A I LAH A@ FH > A B JDA FJI J HA =JA@ J =IO
B ANJA @E> A JHKJD = @ FH >=>E EJO =HA @EIF =OA@ = @ FH LA@ LA@ >O ANJA @E> A JHKJD AO FH > A CO )JJA CE?= E JAHFHAJ=JE
A O JDAEH @AFA @A ?A
JDA ?D E?A
@A= MEJD JDA EIIKA >O E JH @K?E C B JDA ?D=FJAH KIJEBOE C FH >= *=OAIE= @AIJO B H AJD @ =I 1 A= IA?JE IGK=HA HK A B JDA
E C ALE@A ?A ?D %
AL= K=JA@ >O EJIA B 1J IAA % ! +=H =FI E @K?JELA HK A FAHB H AHH H EI A => H=JA@ EI AL= K=JA@ E IE IA?JE
@AIJO ?HEJAHE B =
AJD @ JDA
% " FHAIA JI =
*=OAIE= = ?A
% # 1J EI =HCKA@ JD=J =
HA CA AH= B H FJE
JE KK 6DA ?D=FJAH ? B JD=J = F=HJE?K =H K EB H EJ FH >=>E EJO MDA = @ A @ AII JDA ? HHA?JE B ALE@A ?A IA JA ?AI D=I = F IEJELA E
IJHA=
%
B JDA FH > A
=JE? EIIKAI E
E @K?JELA B = ? H
.E = O ?D=FJAH & @EI?KIIAI JDA ? HA?JE >E EJO HK A D=I E ? IJHK?JELA IA @E C IJHA= FH >=>E EJO
= JE?I
1J EI =HCKA@ JD=J E JAH = E= JDA FHE H A =I JDA FH >= JDAH M H@I F IEJELA
B JDA ? HHAIF
&
>A I
LA@ EI JDA ?
= HAFHAIA J=JE ?
K @AH JDA BK J?
EI
FEHE?= M H @ E A IE@AHA@ J @ @A
= O =J AH= E =JE
E? B=?JI J I
E ? K@E C I?EA JE ? CA LAHE =>E EJO JDAIA = JE?I B H IJ=JA B JDA A FEHE?=
IJHK?JELA IA
FH LE@A = = OIEI
FEHE?= M H @ ` IKHA O JDAHA =HA IALAH= FDE =IIK H@AH I FDO JDAHA EI = IFA?E= @EI?E E @I B A JEJO F I IEIJ KH @EIF I= E CKEIJE? I A JD=J F IIE> A M H @I ? JDA = CK=CA =J
ECDJ >A E
IE> A M H @I =HA . H JDEI IJK@O EJ EI A @AI?HE>A IJ=JAI ME >A JD=J 6DA = CK=CA E HAFHAIA J=JE IAA IA?JE )I A JE
FEHE?= M H @ = @ JDKI =
'
JDA A
FEHE?= M H @
ECDJ >A EI E =
EJA
A?AII=HE O E
JDA IA IA
B >AE C B= J B
IF=JE= O E
EJA O ANJA IELA >KJ E AND=KIJE> A )IIK E FHE ?EF A EI ? A >O =FFA= J EJO K IJHK?JELA O FH > A F JA JE= O E
E C JD=J JDAHA =HA F=HJI MDE?D =HA =JDA E A JDA IAJ B = >AHI =JE? 1
IAGKA ?A
? C E => A HK A *O = M=OI CA AH=JA = JDA IAJ AJ KI ? EJA @ IJ A A ) JDA B =JKH= 6DA FH FAHJEAI JD=J ANFHAIIE I E
ME C JDA IJHK?JKHA
=JDA
<w EI =
>A ID M
M JDA IE
= CK=CA E A
I =HA
A J=HO ?=IAI 1
B F IIE> A M H @I J >A HAFHAIA JA@ E KIJ >A EJA IE A= EJ=HO = CK=CA = JE?I A IJHK?JELA O KIJ B IJHK?JELA IA
=JE? EB =@ FJE C ?
J=E A@ JD=J JDA F IIE> A A E@A JE ?=JE KIJE A@ ANEIJA ?A >A HAFHAIA J=> A E JDE I 1 E E C => KJ JDA AJDE C ANEIJI ?
= JE?I EI = M=O
B E CKEIJE? ANFHAIIE J ANEIJ A A KJIE@A = CK=CA KIJ >A => A J JDAH M=O J
I >KJ EJ @ AI
IJHK?JELA IA
B H JDA ? =E
FEHE?= M H @ 1B
w EI E
KI
J >A CH=IFA@
B CK=H= JAAE C JD=J EJ EI = F IIE> A I B H = F IIE> A M H @I JDA IJ=JA F IIE> A M H @I JA@ >O = >A @EJE 0A ?A E CKEIJE? AN
*A?=KIA JDAHA =HA E IKB ?EA J ANFHAIIE FEHE?= M H @ EI >A F IIE> A M H @I MDE?D ?= JDAH D= @ EB EJ EI ? =E ? A JEJO ANEIJI MDE?D ?= KIJ D=LA = LAHE ?=JE @EJE
B =
J >A @A H@AH J ?
AJDE C ANEIJI JDA =IIAHJE A= E CBK IJHK?JELA O = I ANEIJ B B H EJ 2 IIE> A >A ?= A@ => KJ EI = ?
FH LE@A@ JD=J JDAHA EI = LAHE ?=JE EB JDAHA =HA >A ? A A A JI E JA KCD = E AI B H JDA 6DEI ME
JDA IA IA
IJHK?JELA O ALA = AI B H =
F IIE> A M H @I ?=
JDA J J= EJO
+= J H IF=?A
E C JD=J JDA CE?= O F IIE> A @ =E I D=LA @A K AH=> A
B F IIE> A M H @I
5J=JA @AI?HEFJE B =J
|N | = 0
E? IA JA ?AI = @ JDAEH
F A EB JDA = CK=CA ?
P (x) =
Q(x) =
C JDA @ >A ?
B E @ELE@K= I HAFHAIA J = E
EA
JD=J E
N
LA EA J J B
I E
JDEI IJK@O EJ ME
>O = A B = JAH
0I=
1IE
@E C JAH
. H AN= JDA =J
F A EB JDA =
A(x)
A(1), A(2) =
@ B
A(3)
1B JDA L= KA
JDA =J I =I
>E =HO IAGKA ?A IAA F # >A 6DA ? =IIE?= IAJ ? IJHK?JELA LAHIE JDA
6DA M
B JDA += J H IF=?A ME
>A E JH @K?A@ E
0 MALAH = JD KCD JDA += J H IF=?A EI I=E@ J HAFHAIA JE C = JDA ?=IA IE ?A JDAHA =HA += J H IF=?A =I ID M 6DA IAJ E JDAHA =HA JM >A J A M @A K JE KK
I JDEI ?=
. H A=?D JAH
B JDA IAGKA ?A
0=
MDE?D
20
(|N | = 0 )
MA DAE 5 =E
6DEI =IIK
FJE
?=
= @A K
=J JE KK
= ? K J=> O E I
EJA
B E @ELE@K= ? IE@AH =
1 MDE?D @A
JAI =
EJA IAGKA ?A O @A K
0I =
1I
= O A JI >A
I EI @A K
AH=> O
JDA EJAH= IA IA
B JDA A A
JDA += J H IF=?A ?=
JDA EJAH= IA IA E
B JDA M H@
6DEI H=EIAI JDA GKAIJE ?= A@ JDA IF=?A 5J=JAI ANFHAIIE = CK=CA E JDA GKAIJE IJ=JA @AI?HEFJE GKAIJE I ?= IJ=JA @AI?HEFJE I EI = E CKEIJE? ANFHAIIE B =BB=EHI ?= I 6DA JAH GKAIJE
B IJ=JA @AI?HEFJE
=BB=EHI MD IA =J
E? F=HJI ?=
>A @AI?HE>A@ >O E @ELE@K= I = @ FHA@E?=JAI FHE ?EF A J EJA BH = K E? IA JA ?A EI JHKA H B= IA E K >AH
B MDAJDAH =
B = IMAHI J B
IK?D JDAH
K ? K J=> A
E E C JDA =
M H @I >O E CKEIJE? ANFHAIIE 5D K @ JDEI >A JDA ?=IA ? J A JE KK >A E AA@I J B IJ=JA @AI?HEFJE JDA =? @A A JHKJD F IIE> A CELA
A M K @ I MDE?D E O B H @A K B @A E A?JE
IJHK?JELA JHKJD IJ
= O IJ=JA @AI?HEFJE
CE?= F IIE>E EJO F =OI = >A => A J HAFHAIA J = JDA JHKA 6DAHA EI ME >LE KI ?
?D=FJAH !
FH > A J EI FH LE@A@ >O *HE? AH '&% KJE F !"! >O IJHK?
EJ=HO IA JA JE= ?
I =HA ?
JELA O FH > A
6DA
4A E JAHFHAJ=> A
HIJ =JJA FJ J @
AI
JE KK AI B H = E @A E C CE?= F IIE>E EJO ECDJ >A IE@AH HA N JDA
MI JD KCD JDAHA =HA = F IIE> A M H @I JDAHA B 1 B = AI + A B H A=?D M H @ JDH KCD JDA HA E JAHFHAJ=JE
wa
=I HABAHHE C J
= ?AHJ=E =
F IIE> A M H @ E
H@AH J
A M K @ D=LA J B JDA
I=O JD=J
wa HABAHI J w AI w = @ w
I MDA
E IJA=@
0 MALAH B H
HECE = FH > A BK ?JE I BK ?JE JDAO =HA E JAHFHAJA@ =I A JEJEAI A = A J HABAH J JM A JE >AH IALAH= @EBBAHA J A B F JA B=?J JD=J A CA AH=JAI IAL 7IE C KIJ A= I E
=FF EAI J
HAFHAIA J=> A >O E CKEIJE? ANFHAIIE M H @I >O ?D= CE C JDA L= K=JE AH= = AI . H AN= M H @I >KJ JDAO =HA JDA JE= HABAHA JI BH F A JDA L= K=JE IA LAI JM = =? JE KK
I v1 (w ) = @ AI A ?=
v2 (w) ?=
HABAH J K
@EBBAHA J ANFHAIIE
I =J JDA I=
J E ?HA=IA JDA
0 J
,A K
) J
AH=> A
CE?= IF=?A
ME C HA=I E C B ANFHAIIE I HABAHHE C
JDAH F IIE>E EJO EI IKCCAIJA@ >O JDA B 5KFF IA JDAHA EI = IJ=JA @AI?HEFJE MDE?D O @A K AJ= ALA = CK=CA I MDE?D B H =
LM
IEIJE C
I?HEFJE =HA B
F IIE> A IA JA ?AI ? J=E I = IE C A IJ=JA @A M = AI JDA IA JA ?A JHKA L KIJ >A @A K AH=> A >A?=KIA JDAHA = O IA JA ?AI AM K @ J D=LA J HABAH J JDA J J= EJO
AH=> O
CE?= O F IIE> A M H @I IE ?A A ? K @ HAFHAIA J JDA CE?= @= EJEAI >O M IE L ) IA JA ?A EI F IIE> A EB EJ D=I = ? HHAIF @E C ANFHAIIE HIJ GKAIJE JD=J =HEIAI DAHA EI MDAJDAH = I ) IA JA ?A ?= = AH E A = JHKJD JDA IJ=JA @AI?HEFJE I HAGKEHA@ E
>A HABAHHA@ J
EI
A?AII=HO
N (S ) EB = @ I S EI F IIE> A
O EB EJ EI
(S ) EBB
O EB
N ( S ) EI JHKA ?B
EJ D @ AI @I E =J A=IJ J A J=E JD=J
+=H =F '"% FF %" %# A= I JD=J = IA JA ?A EI F IIE> A EB = @ 1 ? IJHK?JELA IA A= E C = JE?I 6DA ? IJHK?JELA A IJ=JA @AI?HEFJE
N ( S ) B N ( S ) EI JD=J
JDA =IIK
FJE @I
JD=J AI ?=
S
J ?
EI B= IA E J=E
IJ=JA @AI?HEFJE
I A=@I J
JH=@E?JE
>KJ
N ( S ) @ S
D
MDAHA
(S )
>A ?
A IJ=JA @AI?HEFJE
N ( S )
B H EA CAH
H =I I=OE C EI @A JE @I A@
)IIK
I EI ?D IA
= @ EI JDKI = IJH
BF I
@ MDE?D ?=
N ( S ) N
= @
N ( S ) D
B E JKEJE
(S )
>A JHA=JA@ E A K ELAHI= = @ ANEIJA JE= GK= JE AHI I 1J EI = JDA HA EIJE? FHA@E
B IJ=JA @AI?HEFJE
!
(S ) N ( S ).
)IIK A JD=J OEA @I = ? 6DEI JH=@E?JE
"
(S ) D
@I 6DA 0A ?A =?
FJE
N ( S ) D (S ) ?=
JE CAH
N ( S )
JD=J JDAHA EI
S ?=
JH=@E?JE
O JDA MA= AH
=I MA
JD=J
MDE?D
EI JHKA M K @
A=
JD=J FJE J @
(S ) ?=
JD=J JDAHA EI 6DEI MEJD KJ =
*KJ JDEI EI E
F IIE> A EB ANFHAIIE
N ( S ) EI ?
(S ) M
K @ >A ?
B H = IJ=JA @AI?HEFJE
F IIE>E EJO E
JDA MA= AH IA IA A@ J
N ( S )
EI JHKA
>A JHKA E
6DEI FH > A
>A = = OIA@ E
FH >=>E EJO E
?D=FJAH # "
!
1 ?
IJHK?JELA
=JDA
CE?= IF=?A
>A HAF =?A@ >O = ? ?AFJ IEIJ B? B = ?D E?A IA?KJELA E? =JE JDA KFFAH =JDA B
IJHK?JELA
IJHK?JELA IFHA=@
B =M AII >E =HO IAGKA ?AI HA CA AH= ? >AHI >O = =I = K =JA@ >O *H KMAH ` ? =JKH= >AH AI HABAHHA@ J
=M AII IAGKA ?AI =HA IFA?E= ?=IAI IAGKA ?A +D E?A IAGKA ?AI ` =I B H = @ E =CA J ?E= = E MD EJA O FH ?AA@E C ?D E?AI 6DEI AFEIJA ?= K ? ? EJA >AH E? =CA J EI I EJA J K B ?D E?AI IAI HIJ F AJA = O B AJE K
= E C
J F IIE> A DAHA J
@MA
@EI?KIIE
?AH E C JDA
n1
B
B H AN= =JKH=
n2 AJ?
MEJD KJ =
> K @ 6DA IFHA=@ EI JDA J J= EJO >AH BH 5E ?A ?D E?A IAGKA ?AI ? A JDA ? JE KK
JDA IAJ
B ?D E?A IAGKA ?AI ANEIJI JDA IFHA=@ B JDA += J H IF=?A 1 E F A ALAH =?JK= O >A
EI JDA AIIA JE= @EBBAHA ?A >AJMAA ? =IIE?= E JAHFHAJ=JE = O F IIE>E EJEAI J 6DA FH FAHJEAI JD=J ABBA?JELA O JE JDA HK A @AJAH IAGKA ?A ?= JDAH JD= KH= EI JAH K A E IK?D F IIE>E EJO ?=
B >E =HO ?D E?A IAGKA ?AI = @ JDA = IA IA JDAHA =HA IJHK?JE FH ?AII = JD KCD ME C = HK A EJA =FFH NE JDA IAJ JD JAH = = @
KJFKJI = L= KA B H = CELA E A@ H =M E A E
0, 1, 2, ...
B JDA
B =@@E C >A
) =M AII IAGKA ?A EI
n 1JD JAH
>AHI IK?D = IAGKA ?A EI CA AH=JA@ = @ E@A JE A@ >O = FH ?AII E L =BJAH = MDE?D I B A >KJ FA J J J= HAIJHE?JE =O >A E F IA@ KF A J B EJ J B A CJD E EJE= IAC ?D E?AI
AJJ '%% F "& " ! 6H A IJH= '%% F @=J= IJ=JAI JD=J JDA JHKJD O KF I B = O IJ=JA A J @AFA @ A E EJE= IAC
=@A => KJ =
=M AII IAGKA ?A ?=
( ) x (x = x ( ))
MDAHA M H@I EB
# 1 B
x = (0), (1), ..., (x 1) E A JDA E EJE= IAC A D @I B H JDA =M AII IAGKA ?A JDA JDAHA EI =
=M AII ?
!
A J
JE K=JE
B JDEI IAGKA ?A = I
I=JEIBO
?B
L=
,= A
EJ=JE
=M AII ?
JE K=JE
I EI
6DA FHE ?EF A ?= EJA IAC K >AH JDA =L=E => A E B H !! " A ?= )J ? J J ? AA @ I
>A
KIJE A@ =I B B =
MI ?D IA I= I
IE ?A
( )
B L= KAI =JE
D=LA >AA
A BH=
B H = = OIE C =
B ?D E?A IAGKA ?A JDA I= HAIJHE?JE A I?= A I =J = =FF EA@ EIIE> A =O >A JDAH
>A?=KIA JDAO ?=
IE@AHA@ J B JAH
B JDEI I?= A JDAHA =HA JDA =M AII IAGKA ?AI MEJD I = @ =J JDA
HAIJHE?JE
A =II ?E=JAI = IFHA=@ =M MEJD A=?D IFHA=@ MDE?D MDA A J @AJAH E AI MDAJDAH A ANJHA A JDA HAIJHE?JE IAJ KF >O JDA IFHA=@ =M
FJO MDE?D
A= I JD=J JDA IAGKA ?A EI = =M AII =O BK O @AJAH E A JDA JAH I E AJJ '%% FF $# $$ " !
)J JDA
ANJHA
A JDA HAIJHE?JE
=M E A IAGKA ?A +B ,K
"
. H
AJ KI ?
H ? =IIAI
?D E?A IAGKA ?AI HAGKEHAI JD=J JDA A A A J B = IAJ EI ABBA?JELA O HA? A= I B H HA E A =JE JE KK O HABAHI J I
LAH MDE?D JDA L=HE=> AI H= CA AJ KI IAA MD=J JDEI A >O = K >AH ALAH
IJHK?JELA IOIJA
I FHAI?HE>A JD=J =
EJA =FFH NE
0(1(0(0(...)))). 6DAHA ?=
0 M ?= J = A A A J IAC A J EI = A JDA
>KJ EJ EI KIK= O DA @ JD=J JDA ?D E?A IAGKA ?AI JDA >A IKHA JD=J JDA CELA A J ANFHAIIE A B JDA IAJ E EJE= IAC B >E =HO IAGKA ?AI B=?J HABAH J I 1
IA LAI ?
0(1(0(0(...)))) HA=
MI JD=J JDA A A EI JE K=JE A =IIK A A J E
A JD=J JDAO @
*KJ JDEI
A= I JD=J
A =IIK
>E =HO IAGKA ?AI >A ANFHAIIE> A >O F IIE> A J A J IE 6DA ANFHAIIE B JDA IAJ
6DEI E A= I
JKH B =
>O @ JI
KIJ J >A
IE ?A A JI
JDAHMEIA EJ M K @
HA? C E A EJ J
>A =
0(1(0(0(...)))) EI JDKI ABBA?JELA O HA? C E => A =I >AE C = A A B >E =HO IAGKA ?AI O EB ... ?= >A HAF =?A@ >O = EJA ANFHAI
?= =HJE 1 >A = L=HE=> A MEJD = BI E HA FA F IIE>E EJO B I JDEI EI JDA B 2AH AJD @ KIA@ B H HAFHAIA JE C ?D E?A IA IJ= @=H@ JOFA JDA HO '' EJA >KJ @A K AH=> A E K >AH JDAH M H@I = ?D E?A IAGKA ?A MDE?D =E I MDAJDAH JHKJD E EJO ?=
#
1 J
>IAHL=JE
=E A
IAGKA ?AI
FD=IEI EI B >IAHLAH J JDA ?D E?AI B = E@A= E A@ =JDA B H @I J =JE JDA I B M JD=J JDA HAFHAIA J=JE =JE I IAA IA?JE IAGKA ?AI MDE?D ? K >AH >AH B B >IAHL=JE I >IAHL=JE # ! >A B IAGKA ?AI E " => LA ? HHAIF IEIJ B JDA = IA IA I HO >IAHL=JE I MDE?D =HA ? IE@AHA@ JDA M H @
FEHE?= M H @ E A
>IAHLAH E
E C = O
LE C =
>IAHL=JE
1J ME
M MDAJDAH JDEI = =
#
6DA F JA JE= E
B = >AH K B I
EJO
E
>IAHL=JE
IAGKA ?AI
= F IIE> A M H @ M K @ HA >IAHL=JE = B= JE E A 1J E A JDA
2 IJK =JE C JDA ANEIJA ?A GKEHA KIJE ?=JE EI ? A=H JD=J EJA IAGKA ?A JDAHA ?= ? =IIE?= IA IA IE> A J ? ?AELA B JDAH JD= EJA O >A = K EJA
JD=J MDE?D ?=
>IAHL=JE
I J= A F =?A E
>AH
0 MALAH >O = =
>IAHL=JE =JDA = E A@
I =HA ?D IA JH
=JE?E=
A J= =CA J D=I ?
IA?KJELA JAH
JDA IAGKA ?A MDAHA=I E MD=J EI >AE C FHAIA JA@ J J A= JD=J JDA M H E C J M B JDA J >IAHLAH EI = IAJJE C = @ J =JKHA EI KJIE@A JDA >IAHL=JE 1 IJ=HJ =
F A ?
A J IIE C = ? E B JE
>IAHL=JE
JDEI F E J
>IAHL=JE
>A HAIJHE?JA@
>O = IFHA=@ =M C LAH E C JDA BKJKHA F AJA O @AJAH =JDA E EIJE? =JE?E= 6DA E@A= E A@ ) = C KI O ?
B =M AII ?D E?A IAGKA ?AI ?= AM JAH I E JDA IAGKA ?AI ME >IAHLAH ? B JDA
= IAJJE C MDE?D ME ?
@A?E@A =J JDA
KJIAJ JD=J 1 ME
@A?E@A JD=J 1 ME I ME ?
B JDA =IIK
J IIE C AN=
1B JDA
K @AH
@EHA?J ?
M K @ >A =
#
6DEI IA?JE => KJ = E
=M E A IAGKA ?AI
@EI?KIIAI JDA GKAIJE EJA =JDA >IAHL=JE EI ?AHJ=E O B MDAJDAH EJ EI F IIE> A J =JDA >IAHL=JE >IAHL=JE F IIE> A B >IAHL=JE I E FHE ?EF A O F IIE> A B H EI = BA=IE> A IEIJI B >J=E M A@CA 6DEI
=JE?= E @K?JE
EB F IIE> A =J = =M E A 1B ?AHJ=E 1B
=JE?= E @K?JE
AJD @ B H =M E A
>O KIE C
=JDA
=JE?= E @K?JE
EJ
= AI ? J
IJHK?JELA IA IA J E I
GKA ?A I=JEI AI = IA JA ?A MDE?D EI LAHE => A IA JA ?AI ? K @ >A ? JAH I HABAH J >IAHL=JE FH LA E I IAA >A BA=JKHA ME A= I F HJ= J E
ANF =E E C ?
B ANJA @E> A JHKJD = @ FH >=>E EJO E A ?D=H=?JAHEIJE? BA=JKHA IAGKA ?AI EI JD=J JDA ?=IA H >IAHL=JE JDAH JAH >IAHL=JE = A )IIK A >A B B >IAHL=JE )IIK >IAHL=JE B
B =M AII IAGKA ?AI > JD ?D E?A IAGKA ?AI = @ I = @ ?D E?AI J= A F =?A E I EJ EI J F IIE> A J ? JDA I= JE A 6DEI CA AH=JA >IAHL=JE
>IAHL=JE =
B = IAHEAI
B JDA IAHEAI E
CA AH=JA =
1J EI ? A=H JD=J B JE A @A
HA LAH JD=J =J t0
>IAHL=JE B JE
I >AB HA t0 JE A
n >IAHL=JE + t
)IIK
F E J I
A JD=J JDEI
IAHEAI =J J
t0
>IAHL=JE
A= I JD=J JDA GKAIJE M=EJ K JE EJ ?= JDA GKA ?A =FF EA@ J BK ?JE + J ALA JDAH D= @
<MD=J EI JDA A ?=
mJD JAH
(m > n) E
JDA JAH
?A
>A = IMAHA@ ALAH CA AH=JA = E EIJE? BK ?JE B JE B = O E EJA IA B JDA I B= EB JDAHA EI = @AJAH IA?KJELA JAH MDE?D ? K @ HAFA=JA@ O >A A@ =FF E?=JE IJ B JDA JAH
CA AH=JA ? =IJI B H =
I ) O =?JK= O FAHB H A 0A ?A
IAGKA ?A MDE?D EI C LAH A@ >O = @AJAH CE C J IK?D = IAGKA ?A =HA A?D= EI B JAH NA@ E @EJE I >AJMAA I
E EIJE? =M E A B IA
=@L= ?A
JDA CA AH=JE
IAGKA ?AI = @ =M E A ?D E?A IAGKA ?AI JDA JHKJD ? > JD =HA AIIA JE= O IE E =H 6DEI ?= I B JDA IJ=JA >A ID M >O AN= B JDA =MI C LAH E C JDA JAH B JDA IAGKA ?AI
E E C JDA E JAH
@EJE
w : N {0, 1}
6DA L= KA B JDA B
nJD JAH
$ EI
JDA IAGKA ?A
w EI w(n).
$
6DA ?
IJHK?JELA
A= E C 1J ?= E
B JDA
nJD JAH
JDA IAGKA ?A
w EI w(n).
'
%
1B 1
B JDA
nJD
JAH
EI
w(n)
E @A
FA @A J O L= KA JDKI D
= A = ? =IIE?= ? =E
w OEA @I = JAH
@EJE %
w(n)
>AH
6DA JHKJD ?
@I >O IJEFK =JE JDA =M HAFHAIA JI = HAIJHE?JE >IAHLA@ JAH F O ME BKJKHA >IAHL=JE B ?AHJ=E % I EJI E JAHFHAJ=JE D=LA JDA L= KA @AJAH I 0A ?A E A@ >O JDA BK ?JE JAH I E >IAHL=JE >A LAHE A@ B O >O M=EJE C A= I JD=J EJ ?= J= A F =?A AJD @ J
n EI w(n)
= @ JDEI ?=
EI
>IAHLA@
JDAH M H@I JDA =M @ AI >IAHL=JE A O >O M=EJE C = @ >IAHL=JE B B A?D= EI ME C FH >IAHLE C =JDA
EI
LAHEBO JD=J
EJI L= KA ?=
n >A w (n)
>IAHL= AJ E?
EI AIIA JE= O
B JDA E JAHFHAJ=JE
1E
= >E =HO IAGKA ?A EI E JAHFHAJA@ J =@E? =J I =HA ANFHAIIA@ >O =J ? @EJE B 0AOJE C '!" ?
JA JDAIA >O =
H=
HA ?
@ J=E I
0 J=E I H )J
6DA IJ= @=H@ LAHE ?=JE JDA IFEHEJ JDA LAHE ?=JE AJD @
IE@AH JDA
EI LAHE A@ EB JDAHA EI = GKA ?AI JDA LAHE ?=JE MDE?D = AI KIA M E JAHFHAJ
B LAHEBOE C
BP B H=
=M E A IA
(x)P (x)
=JE?= E @K?JE
x E (x)P (x) =I H= CE C LAH JDA JAH I B I A E EJA =M E A >IAHL=JE IAGKA ?A w = @ P (x) EI = ? F K @ FHA@E?=JA MDE?D ? IEIJI B ??KHHA ?AI B H (x) = @ CE?= ? A?JELAI 1B P (0) EI JHKA = @ EB A ?= E BAH P (x + 1) BH P (x) >O =JDA =JE?= E @K?JE P (c) D @I B H = O c = @ JDKI (x)P (x) D @I ) JD KCD P (x) ?= J >A @EHA?J O LAHE => A >O >IAHL=JE IE ?A EJ EI = ? F K @ IA JA ?A EJI LAHE ?=JE ? @EJE EI >=IA@ >IAHLE C MDAJDAH H (x)
D IK @I FJE H ? J 6DA E @K?JELA IJAF E ?AH E C JDA LAHE =>E EJO JDA B =JDA =JE?= E @K?JE E L LAI = =I
P (x) MDE?D E JKH E L LAI = =IIK F JE ? ?AH E C JDA >IAHL=>E EJO B H (x) 5E E =H O JDA JHKJD B P (x + 1) A= I JD=J EJ EI LAHE => A JDA >=IEI B >IAHLE C MDAJDAH H (x + 1) D @I H J 6DKI JDA ? ? KIE P (c) A= I JD=J P EI LAHE => A B H = =H>EJH=HO c JDA >=IEI B >IAHLE C MDAJDAH H (c) D @I H J
-LA EB JDA >IAHL=JE IAGKA ?A M=I J LAHE => O E JDAH >IAHL=JE EJA JDA =M C LAH E C EJ D=I = ?AHJ=E FH F JDA IAGKA ?A ? K @ E F O JD=J EB JDAHA EI = !
AHJO EB
=JDA
=JE?= E @K?JE H=
B JDA B H
c EI
P (c) B
c
EJO
A@ I AD M E A MD=J JDA > A?JI IEIJE C A B
#!
6DA @ =E
E @ E @AFA @A J E
B E @ELE@K= I KIJ >A IJ=JA@ JDA > A?JI EJO B JDA KIJ >A @A
. H E IJ= ?A E B = A
B IJK@O =HA JDA E @ELE@K= J IIAI FEHE?= HAIA=H?D FH ?AII EI JD KCDJ J JDAH M H@I EJ EI J JDA EJA 1 B JDA HAIA=H?D EI E ? K@A@ BH >IAHL=JE JH=IJA@ J =JDA K >AH M JDA JDA IA?JE EJO >A = B=?J @A => LA >IAHLAH 1 >IAHLAH MD
6DA F JA JE= E MDE?D EI E @AFA @A J ?E@AI JD=J JDA @ JDA E ME EJO B GKA ?AI E =E
B E @ELE@K= I >A ? B=
IAGKA ?AI M=I AGK=JA@ MEJD JDA E E JDA IAGKA ?A IAGKA ?A EI 6DA
>IAHL=JE J? >IAHLAH
F AJA O ?
J II = ? E
E C JD=J JDA =
?D=H=?JAHEIJE?I AN?AFJ ANEIJA ?A E J AGK= O F =KIE> A JD=J = >IAHL=JE =E = AI =E MDE?D FH @K?AI JDA >IAHLAH O
A = @ IF=?A EI E
KJELA J IIAI EI CA AH=JA@ >O JDA J CA AH=JA JDA E @ELE@K= I EJO B = ? B IJ=HI EI J= A J >A >=IA@ >IAHL=JE JDA ? K J=> A E IJA =JE = JE?I ?= EJA
>IAHLAH
B IJ=HI IAA A C =E
J IIE C ?=IA
#"
J IJ=JA@ MDAJDAH
!
>A B K @ '!% F I E A
" '"% F
%# '$
$
"
6DA F
I =HA @A
oB
H JDA
HIJ F IEJE
= @I =JA J =@ FJ ? H@E =JA = CK=CAI >A?=KIA J JDA ANFHAIIE = ? >O =@@E C I E HABAHHE C J
1J EI ? ?
IJHK?JELA O ACEJE
0 MALAH E JAHFHAJE C JDA E @ELE@K= JAH HE C J ? JDA A FEHE?= M H @ EI >A E A EJA >O = IE A HA FH > A EJA O KIJ =IIK ME I >A K@CA@ J
H@E =JA = CK=CA =I HABAH F A IF=?A JE 1 A ?= J JDAH M H@I J EJA J M E? IA JA ?AI KIA =
=JE? . H AN= IJ
H@E =JAI E
FDOIE?= IF=?A JE
J=E I E ? HHAIF
= O F IEJE >IAHL=JE I@
J HABAHHE C J
>IAHL=JE
J @AI?HE>A IJ=JAI
##
1 IJA=@
2 IIE> O E
EJA
>IAHL=JE
EJA >IAHL=JE
IAGKA ?AI
IAGKA ?AI ID K @ H=JDAH >A ?D=H JDA M A@CA J A=@ J EJA = B H E B =? B JDA JH= J IJ F @ AI
IAGKA ?A EI E
= IJHK? HAFHAIA J
KFFAH E JDA A J E
EJ M K @ D=LA JE
E C JDA IAGKA ?A 1J EI JDKI =FFH FHE=JA J IAGKA ?AI MDE?D EI JE JE B H = =HJE MDE?D @ AI >A >=IA@ " => LA B H A A A J BI J ? AA@ J J >=IA@ EJ ANFHAIIE JDAH HA=I 6DEI
) B H
I M K @
I HABAHHE C J E @ B B H = E =JE
I JD IA FAHJ=E E C J
B = IAJ JE I
A= I
IJ= @=H@ JOFA JDA HO B H E IJ= ?A ?B 0 B JHKJD = @ FH >=>E EJO ?= B >IAHL=JE
0 MALAH JDA E #
"
A ?
H@E =JAI
H JA
F H= F IEJE
I =HA CELA
=I AN=
F AI
B IK?D =
= CK=CA E
F $ HAIFA?JELA O
6DEI ?D=FJAH @EI?KIIAI L=HE KI ?D= A CAI = @ @EB ?K JEAI E JELA A@ E =JE JE H H=JE B B AFEIJA E? FH >=>E EJO E = @ACHAAI >IAHL=JE B >A EAB 6DA GKAIJE
!
6DA =NE
B FH >=>E EJO ?= ?K KI
LA JE B A A B A = O @A A@ KIE C JDA B JA@ >O ME C B H = =
6DA FH >=>E EJO ?= ?K KI EI ? ?DE AHO E IF=?A EI I + = @ E MDE?D JDA IF=?A A ? =II
A J=HO ALA JI EI @A
= @ JDA ALA J B
B IK>IAJI
) ? =II
IE@AH = EJA K E
=H>EJH=HO J=E I
FJO IF=?A
B IK>IAJI =JE B ?
EI = A JI
= CA>H= EB EJ ?
EJIA B = @ EI ?
F A
= CA>H= EI = I
? E
=JE
B ? K J=> A K E
EL +
A1 , A2 , ... F
@EJE EL A ?= =IIEC
A1 A2 ... F.
A=IKHAI J = CA>H=I ?B *E E CI AO ''# F MDAHA
=JKH= O E
F EAI EEE A@
FH >=>E EJO
= CA>H=I A=IKHA P : F R
JDA =NE !!
R EI JDA IAJ
B HA=
>AHI EI
I E JH @K?A@ >O
C H L '!!
=@@EJELEJO 5
AJE
AI
O=
HA
HAIJHE?JA@ ? EL 1B
A, B F
JDAO @
AB =
I @ J JA @EJE = JE?I A J
P (A B ) = P (A) + P (B )
E JAHFHAJ=JE B B JDA FH >=>E EJO BK ? 6DA =NE =? I O I IJHK?JELA KIJ >A LAH A@ H
=HA ?= ?K =JA@
IJHK?JELA IA
I E EEE E
B JDA =NE D
IJHK?JELA IA A @A@ I
=O >A GKAIJE
I ID K @ = I ?
@ B H = ? AD M
?AH E C JDEI EIIKA EI FH LE@A@ E I EI HABKJA@ JDA JH=@EJE = >A EAB B H = EJI
" MDAHA I B
E JAHFHAJ=JE E AFEIJA
FH >=>E EJO JDEI IJK@O EI B ?KIA@ >E EJO EI B H )? ? BK ?JE CE?= IA K =JA@ E IJHK?JELA E JAHFHAJ=JE F= OE C =HCK KIJ >A ?
E? E JAHFHAJ=JE
B H=JE
A J JD=J JDA FH FAH E JAHFHAJ=JE IJHK?JELA IA = JE?I MDE?D E AM H EI FAHD=FI JDA >AIJ
+=H =FI IJ=JA @AI?HEFJE = JE?I FH LE@AI = FH >=>E EJO +=H =FI ANF E?=JE B FH >=>E EJO CE?= E JAHFHAJ=JE JDA B B IK CE?= E JAHFHAJ=JE HIJ H@AH CE? E CE?= F IIE>E EJEAI FJE JD=J D= B A ?=
HECE = B H M
CE?= BH=
B H @EI?KIIE C JDA
B AFEIJA
FH F IEJE
I HAFHAIA J JDA IF=?A IA JA ?AI >O JEL=JA@ >O JDA FHA JDEI M=O JDKI
CE?= HA =JE
I @AHELA@ E
=HHELA =J
= @ACHAAI I EJ ?=
FH >=>E EJO EI
!"
JDAH D= @ >O CELE C K AGK= MAECDJI J ?= = I J >A I AJDE C A IA E A JDEI ?=IA ? 0 MALAH MDA >ACE JE IAA IA?JE = E " LAI J
??KH +=H =F @ AI
EJ E JAHFHAJ=
B JHKJD E
EJA ? =II
IA JA ?AI = @ JDAEH O MEJD JDA KJIAJ JDA H JE 6DAHA EI B JDA ? HA LAH JDA ?
B E @ELE@K= I IJHK?JELA FH >=>E EJO EI = @EB ?K J B ? B = IA JA ?A E H J IAA KCD J = E @A IJHK?JELA FH >=>E EJO MDE?D EI >=IA@ EJA IJ=JA @AI?HEFJE 6DA FH > A ?AFJ E D=I E EI JD=J JDEI ? A JI => KJ =@A JDA >O EJA @ IE@AH
HA CA AH= O E >IAHL=JE B H
EJA F IIE> A M H @ J A
JHKJD =I FH L=>E EJO JANJ >A?=KIA JDA A ? =??AIIE> A J =E I @ AI =JE JHA=J ! I FEHE?= M H @
A@ = KIABK ? = E =JE
FH LA CA AH= IJ=JA
= FH
F A M H @I MD IA =J = OI
B E @ELE@K= I E
JDAIA M H @I
KJIAJ IAA
FH >=>E EJO ?
6DA ?D=FJAH >ACE I MEJD = E? FH >=>E EJO IA?JE B E >A = ANF E?=JE JDA >AJJE C
CE? =I = IJ ?HA@E> A !
ANF E?=JE
B AFEIJA
@K?JELA B AFEIJA
A EB E @K?JELA IJHK?JELA IA
E JAHFHAJ=JE
B FH >=>E EJO = @ ?
1 @K?JELA
CE? H
CE? = @ AFEIJA
JDA IA IA M
E? FH >=>E EJO
B +=H =F '$ ? K @ >A ? IE@AHA@ =I = HA H AII A J >A H M CE? IE B A J=E F O FH B JDA
B =I = B H H J A@ ? =JDA
KIE C +=H =FI JAH F JDAIEI JDA BK ?JE @A ?AFJ JA@ >O
Ent
ANF E?=JE
FH F HJE I?HEFJE
!#
0 MALAH JDA HA=I >E EJO 1 @K?JELA H 6DA AFEIJA M A@CA =HA B A J=E E? CE? EI CE?= FH >=>E EJO
JEL=JE ?EH?K
>A EAB K @AH K ?AHJ=E 5KFF IA JD=J JDA B A J >AJMAA E C A IA JDEI FAHI =?? H@E C J F "" 1B JA JD=J A= I
MDAHA @A@K?JELA D @ BH J
>J=E E C
J =L=E => A ME C EI ? IE@AHA@ J >A EALE C E CE?= JHKJD JDAH JD= JDA B=?J JD=J JDA @ACHAA A> @O MI
h=
e EI p EJ B
MI JD=J EB I
e=
JD
EI KIJE A@ E = I >A =
JDA @ACHAA
= @ = I
=?JE C
F A E
e ?=
DAHA MDE?D =HA HAGKEHA@ >O JDA FHE ?EF A >A EALAI I O AJDE C
B J J= ALE@A ?A ?B
A EI ?AHJ=E
J KIJE A@ E
>A EALE C E
JDEI =?? K J E @K?JELA JELA E BAHA ?AI E H=JE 1 = @ACHAAI MD=J B B A J=E B >A EAB MI JDA ?EH?K A J J
= E @K?
@ACHAA
KIJE A@ @ACHAAI
>A AN=
HA @AJ=E
!
1
2H >=>E EJO E
I A FHA E
JDEI IA?JE 1
E =HO HA
E JAHFHAJ=JE B= IEJO
CE? = @ ?
E @K?JELA
B IA JA ?AI E
JDA =?JK= M H @
B MDE?D EJ EI I >A
EJ ? HHAIF E A@ E
>A @AJAH
CE?= IF=?A IJHK?JELA IA IJHK?JELA = JE?I = IA JA ?A EI JHKA = IJ=JA @AI?HEFJE =? O EB EJ EI LAHE => O JHKA H LAHE => O B= IA IJHK?JELA B JD IA IJ=JA @AI?HEF B E JAHFHAJE C JDA FH >= B JDA E JAHFHAJ=JE = JE?I B H JHKJD E . H AN= B= E B JDA F A EJ
CE?= IF=?A
CE?= FH >=>E EJO =I FH >=>E EJO MDE?D EI >=IA@ E A@ >O JDA MAECDJA@ FH F HJE 6DA GKAIJE H? IJHK?JELA O EI E @AFA @A J =@ FJ ? IJHK?JELA IA
B JHKJD EI @AJAH
JHKJD 0 MALAH EJ EI D=H@ O F IIE> A J > A?J = CK=CA = @ ? =IIE?= IA E JDA +=H =FE= =IO FJ JE? E
J = ? B ?
IEIJA J IA IJHK?JELA A= E C
E JAHFHAJ JDA GK= JE AH ? =IIE?= O EB JHKJD EI =HEIAI D MALAH MDA F=HA@ J JD=J
E ? K@AI JD=J EJ EI JDA FH >=>E EJO MEJD MDE?D JDA =?JK= M H @ EI B H KIE C FH >=>E EJEAI E @A?EIE =O >A IK?D JD=J EJ= E?I
S S
EI JHKA E A B
SJ
S EI LAHE
A@ -LA
EB = ?AHJ=E A= JD=J
IJHK?JELA O JDEI @ AI
S
KJ
EI LAHE => A E
p >A?=KIA EJ
JDA =?JK= M H @ ?= @ J M 1 I
=O ? HHAIF J ? =IIE?= IA
S EI ?
EB JDEI EI 1
SM
K @ JDA BH JDA
= JE?I JDA E
I JD=J ? =IIE?= FH >=>E EJO EI = >AJJAH CKE@A JD= JDA =?JK= M H @ >KJ JDA B? B ? KHIA B B ? =IIE?= JHKJD FH LE@AI = @EBBAHA J IJHK?JELA JHKJD 6DA FH >=>E EJO MDAHA=I JDA FH >=>E EJO B JDA ? C EJELA =CA J MDE?D B ?AHJ=E J M A?AII=H B ? =IIE?=
JHKJD D=I
JDA IJ=JA
M A@CA
A@CA EI =L=E => A 5K?D ?=IAI E ? K@A JD IA E E O >A LAHE A@ KIJ D=LA MDE?D C AH H B= IE A@ E =?JK= M H @ JKH E C KJ IK?D JD=J JDA
EI JHKA E
EJ=JE
JDA KIA
E? CKE@= ?A B H IEJK=JE
K ?AHJ=E JO ?KHHA J O FHAL=E I >KJ MDE?D ME " ! EJ ME J =>IKH@EJO JDA IK?D JD=J I A JDAH D= @ EI JHKA E = EJ A >A ID M JD=J JDEI
EBA M K @ B
EI
J => KJ JDA =?JK= M H @ >AE C IJHK?JELA E JAHFHAJ=JE A KIJ ? H = JAH =JELA O =@DAHA J A KF MEJD
5E ?A JDA
>LE KI ? J M H
IJHK?JELA E JAHFHAJ=JE
B H JDA FDH=IA !%
EI 1 1
>A JHKA E B = O
=O =?J
J >A
J B AM M
JDA =>IA ?A
JDA >=IEI
>AE C JHKA E J=
JDA M H @
>KJ EI H=JDAH => KJ JDA M H @ >AE C IK?D JD=J @=J= EI @EI? LAHA@ ) JD KCD JDEI B H FH >=>E EJO =I ME JE I E C FH >=>E EJO E JAH I B >A ID M >O JDA HA K =JE =H
B= IE =>E EJO EI ?
ME
?AH E C "
J = HA=I
JDA HAGKEHA J E
A J JD=J
S ID
KJ?
IE@AHA@ =I F IEJELA
S >A?
AI
S ?=
= O ALA J >A E JAHFHAJA@ =I JDA FH >=>E EJO JDA =?JK= M H @ JDAHA EI EJJ A = CELA IJ=JA @AI?HEFJE AA@ J I JDA = JAH =JELA IJ=JA @AI?HEFJE
B S E A A= JD=J
S I EI LAHE
w D=I
B
IEC E ?= ?A B H H=JE
6DA F E J EI JD=J JDA IEC E ?= J ABBA?J JDA LAHE =>E EJO B IA J B JDA B= IE =>E EJO B
S
=I
w
A JE
S MEJD HAIFA?J J
B JDA JHKJD
>A ? ME ME
?D=FJAH # MDAHA = ?
IJHK?JELA B H
= E =JE
M=> A @ACHAA
B >A EAB @ AI
B >A EAB
J D=LA J >A =?JK= O ?= JA I =E J=E A@ >O = O F=HJE? = KIJE A@ @ACHAA B >A M=> A B
) KIJE A@ @ACHAA
K =H ? C EJELA =CA J 0 MALAH >A EAB MDE?D ? K @ =J A=IJ E EAB 0A ?A = KIJE A@ @ACHAA EJ ? K @ 6DEI = @ J >A = O AI @ACHAA A= I JD=J E
HABAH J
JDAHMEIA JDA
F=CA !$
? C EJELA =CA J
KIJ = I
B A J=E
A J >AJMAA
h EI p
) KIJE A@ @ACHAA B >A EAB EI M >J=E A@ >O KIE C I K @ AJD @ E MDE?D MDA F A AJD @I 6DA @ACHAA A J EI M JDA ME C I A J EI ? = IE@AHA@ J AJD @ EI A J A J B >A EAB EI J @EJE >A @AJAH E A@ >O JDA @ACHAA AH B A J=E A J B H ME C JDA B H !& 0A ?A JDA O IEJK=JE >A IK?D = 1B JDA @ACHAA A JA@ ME B A J=E
B A J=E
OEA @ JDA L= KA
B A J=E
*O =FF OE C JDEI
AJD @
A JDKI CAJI J
1B JDA @ACHAA
MDE?D I A J EI ,ACHAA
A @ACHAA M B A J=E
>A
=HA JD IA E M
A J=E EJ EI
H=
>J=E E C EJ EI
O EB
M=> A B A J=E
IJHK?JELA O KIJE A@
@ACHAAI ?
IJHK?JELA IA
Ent(h | e) = p,
MDAHA JHKA
Ent EI = BK p
?JE
BH
= F=EH
B IA JA ?AI J JDA ?
Ent EI E
MI BH
eA
A= E C ANF = =JE
(x)[Ent(h | e) = x],
I=OE C JD=J JDAHA EI = @ACHAA LAHE => A B H I MEJD JDA =IO J JE? E AH ''$ A F=HJE?K =H 6DA ANEIJA JE= GK= JE ?=JE FJ JE? E A ?= EJ FH >=>E EJEAI =HA B A J=E =JKH= ? K A J >AJMAA >AH
!
e
E
= @
p
F HJ= J H EJA @ AC E A JI =E I >A?=KIA =IO /H LA 0= FAH
AI J
F =O =
EJ E JAHFHAJ=JE
B Ent E
(x)(LimEnt(h | e) = x)
MEJD KJ >AE C => A J FH =?D JDA E EJ B MI JD=J EJ ANEIJI IFA?EBO = L= KA B H JDA E O EB EJ EI EJ MDE A E M=> A 1B ! ! EI E JAHFHAJA@ ?
(x)(JDA
>KJ ID K @ =@ FJ ? IJHK?JELA IA
KIJE A@ @ACHAA
B >A EAB
B FH > A J IJHK?
9DAJDAH KIJE A@ @ACHAAI =>E EJO M=I @EI?KIIA@ E M=I BBAHA@ IJ JELA E JAHFHAJ=JE
IJHK?JELA E JAHFHAJ=JE ? A= =?
= JD KCD B JDA
FA E C =HCK
=JKH= O ?
E C => KJ
IJHK?JELA FH >=>E EJO JDA FH L=> A FH >=>E EJO IJ=JA O = @@ EB J E ? > EC=JE IEIJA J ? J =@ FJ = B JDA B >E =JE IJHK?JELA FH >=>E EJO EI IE ?AH E C JDA IA JA ?AI
A JI
B ? =IIE?=
JHKJD B H B I FDO
EI ?AHJ=E
=@ FJE C ? H IA J
F O JDA B=?J JD=J EJ IKEJI MEJD @ACHAAI HA CA AH= ? ANEIJ ALA J M > A?J = CK=CA B H AN= JDA ? F A
6DA ? =IIE?= FH >=>E EJO B >A EAB E FH >=>E EJO =I E BK ?JE IEJK=JE EJE C ?
B = IA JA ?A ?=
h EI
>KJ
h EI
B
B >A EAB M
h =I >AE
h MDA
ALAH
>A ?
IE@AHA@
1B = @ACHAA ALAHO
>A KIJE A@ EJ
0 MALAH EB JDAHA =HA FH >=>E EJEAI MDE?D ?= EJEAI ?= I AJDE C -LA KIJ JDA =I MA 6 = = OIA JDEI GKAIJE JEAI ? IE@AH JDA KIK= B H J >A E JAHFHAJA@ =I H=JE JDAH JD= JE = H=JE = @ACHAAI K JJ B >A EAB =HA ? =IIE?= FH >=>E EJEAI EI J= J= EB AFEIJA
B >A EAB
ANF =E E C JDA @?
= @ACHAA
= FH >=>E E
P (h|e) =
= ?AHJ=E FH >=>E EJO MDA ! #
P (h&e) P (e)
EJE I=OI JD=J
! #
hI ? =IIE?=
M J M H@E C J ALA
e EI ? =IIE?=
>A =
KIJ = I
B J J= ALE@A ?A
e EI e EI
h =??
= IJ=JA @AI?HEFJE
e EI ? =IIE?= e EI ? =IIE?=
A O JD=J J J
e EI
e EI =
@ AI M
e EI
J = @A?E@=> A IA JA ?A EJI
e ?=
EB EJ EI
M=> O
@AJAH
B >A EAB
e EI
M=> O JHKA 0A ?A
J >A KF@=JA@ MEJD JDA FH >=>E EJO A KIAI JDA FH >=>E EJO =?? K J JDA B=?J JD=J
B eI J J= A E J
EI
M=> O JHKA = @ JDKI A ID K @ =FF O ? B JHKJD I > JD JDA M IJHK?JELA JHKJD GKAIJE ! " >A
B J J= ALE@A ?A >A ? IEIJA J MEJD JDEI FHE ?EF A B? JDA > A?J = CK=CA MDA JDAH E A @EI?KIIE C JDA FH >=>E EJO B HA=I E C MDE?D DA ? =E
h=
e
?
2H >=>E EJEAI M K @ JDKI >A FH >=>E EJEAI D=I @EI?KIIA@ = = JE?I E IJHK?JELA IA JDA
B = F=HJE?K =H JDA HA
!
0=H
"
=
0=H
= @ >AJJE C E JAHFHAJ=JE
?AH E C JDA L= E@EJO B ! $ H >AJJE C E JAHFHAJ= B FH >=>E EJEAI B = JDA FH >=>E EJO
P (A) + P ( A) = 1.
0=H JE E JAH I = B H K =JAI DEI F E J E B >A EAB A@ J 1 JAH I B JDA IK> A?JELA B FH >=>E EJO MDE?D EI = >H= ?D B @ACHAAI EI =IIK HAFHAIA J JDA >A H=JE B AFEIJA @@I = E? E JAHFHAJ=JE
FH F IEJE
= O >AJJE C GK JEA JI ?= J ? DAHA J E J >A E JAHFHAJA@ E '$ FF $# $% >AJJE C E JAHFHAJ=JE . H +=H =F E
B = ? DAHA J >AJJE C GK JEA J A= J = B=EH >AJJE C GK JEA J ?B +=H = M=OI >A HAFDH=IA@ E AHA ? DAHA ?A >AJJE C GK JEA J E JAH I B = A J JD= A H=JE D=LA = B H CE?= FH >=>E EJO ?=
B = >AJJE C GK JEA J I J
=@L ?=JA JDA LEAM JD=J JDAHA EI CE?= FH >=>E EJO KIJ = I
" =HCKAI JD=J JDA >AJJE C E JAHFHAJ=JE = JE?I E JDA > A?J = CK=CA 0=H J JDA JHKJD H B= IEJO =
F EAI ?
IJHK?JELA IA
"
GKAIJE A=
>KJ JDA @EI? LAHO JD=J JDA FH F IEJE B? IJHK?JELA IA JDA I= A =I @EI? LAHO J E
EI JHKA
H JDA @EI? LAHO JD=J EJ EI B B= IEJO JDA >AJJE C A B=?J >J=E I = F EAI
IJHK?JELA IA
6DA B=?J JD=J EJ ?= H JD=J EJ @ AI DA ? =E F IEJELA FH >=>E EJO J I JD=J JDA HA @AHEL=>E EJO ME 0=H ? =
A ID K @ =IIEC @EJE
I B H EJI
B FH >=>E EJO EI
J L= E@ B H IK> A?JELA FH >=>E EJEAI @ AI J D MALAH ANF E?EJ O F E J FJE KIJ =I HA ? MI BH JD=J = O HA=I MDAJDAH ? I ! $ EI @AHEL=> A BH JDA FH >=>E EJO KJ JDA B=?J JD=J ! $ EI KIK= O I DA AHA O HABAHI J @EJE I .EA @ = FH >=>E EJO = AI JDA ?=IA F=JE> A IE@AHA@ J >A @AHEL=> A BH JDA FH >=>E EJO =NE
= JE?I EI E
B=?J E ?
IA O =J D M JDA HA JD=J
P (A A) = P (A) + P ( A).
AJ KI =IIK D A JD=J
! % F A A J B
A
@
A ?=
I MDAHA
A E A JD=J A @ AI J
! &
A = \ A.
6DA AEJDAH
A = M=OI D
MI BH FJE
@ = @ JDKI ! '
P (A A) = P () = 1.
4AIK J ! $ B ! % = @ ! ' E JDA FH FJE B EI ! & MDE?D EI EI FJE J = =NE ! & ?= 6DA ?HK?E= =IIK 0=H JE = '&! ?=
J >A @AHELA@
JDA IK> A?JELA E JAHFHAJ=JE A J=HO ALA JI EJI ? F A J >A @EI? LAHA@ A J A J EI J = I =HCK
AI ?=IAI A A
H B= IEJO
B JDA IA JA ?A ME AEJDAH J AH
A= E C JD=J JDAHA =HA ?=IAI MDE?D >A JB H K =JA@ E = A JEHA O ? 0=H IEIJA J
HJ ALA J
H FH F IEJE
D=LA = ?AHJ=E
FH >=>E EJO E
JDA >AJJE C E = I F E J
EJ M K @ D=LA J
6DEI EI = I
B = FH F IEJE
JDA CA AH= ?=IA EJ EI J >A @EI? LAHA@ E EI J >A ? IE@AHA@ E 0=H @EI
AJDE C ME
B @EI? LAHE C EJ EJ EI
= FH >=>E EJO L= KA J
L= E@EJO =IIK
JDA
D=LA J
K?D =I
F O IJ=JE C JD=J
JD=J EJ EI JHKA 6DAHA =HA IJ=JA @AI?HEFJE @I >KJ JDAIA @ J >AA FH LA@ A?AII=HE O A ? D=I JHKA
A ?= A
H
J >A FH LA@ E A
F=II =
A I MDAHA A
M J >A
AEJDAH J?
EI
0A ?A >A?=KIA ! & = @ JDKI ! ' =HA JELA E JAHFHAJ=JE E 1 =NE I B FH >=>E EJO @ AI J B FH >=>E EJO -NFHAIIE I ! $ EI IE
IJHK? I
A?AII=HE O ? F O J A=@ J
"!
EJO
A=IKHA E JDA
= O E @ELE@K= ? A?JE 1 IJA=@ EJA FH >=>E EJO E =>E EJO FH >=>E EJO >A ID M E E EJO
>A =HCKA@ JD=J +=H =FI =FFH =?D IAA FJ JE? =FFH =?D FH >=>E EJO ?= A?JE ? K@AI MEJD = @EI?KIIE = EI=JE E E EJO JKH I EJO ?= >A ?
CE?= IF=?A MDE?D M K @ AIJ=> EID = @EHA?J ? EJO 6DEI ?D=FJAH ? = += J H IF=?A B H A=IKHAI E
B IJ=JA @AI?HEFJE
"
0 M@ IF=?A EI @A
EJA @
=E I =?? H@E C J
A I EJ >AHI B JDA
+=H =F
@A K AH=> O E EJA E I CE?= F EJO =E I B
MA =IIEC B E =IO
6DEI FH > A
EI J=? ?
&' KIE C =
D(n) ?
= CK=CA
nE
ME C +=H =F IOIJA
Ln P (S ) = lim Pn (S ).
n
"
""
JDEI @A
EJE
JDA FH >=>E EJO L= KAI =HA ?= ?K =JA@ I J E A?JE EI EJA AI 6DA E EJ EI JDA E EJA @ =?DEALA E =H>EJH=HE O =HCA MEJD JDA JHKJD
JDA >=IEI EJ =E I
B JHKJD E A
B JDA IA JA ?A E
B IA JA ?AI MEJD KJ GK= JE AHI >A @EI?KIIA@ E = JDA BH= AM H = CE? =HA JHKJD BK ?JE B JDA JHKJD L= KA =IIEC @I J
JDA >=IEI
A= I JD=J EB = IA JA ?A MEJD KJ GK= JE AHI EI = JHKJD L= KA =IIEC EJA ANJA IE I = JDA EJA = @ E
= ?AHJ=E
IJ=JA @AI?HEFJE
MDE?D ? HHAIF
@EBBAHA J @ JDA I= AE
CO
IE ?A EJI JHKJD ? = I 6DA ?=IA B GK= JE AHI E LAH = ? MI JD=J JDAEH B E @ELE@K= ? I= IA JA ?A
B IK?D = IA JA ?A EI A= E CI
MDAHA EJ EI = IA JA ?A =J = +=H =F ANF =E I JDA B? K ?JE = @ @EI K ?JE F $ $ 1J B B E @ELE@K= =E I B F 6DA K ELAH B E IJ= ?AI EJA A@ JD=J JDA @ H = I
JDA E @ELE@K= ?
P (x)
$
6DA
(x)P (x) E
A= E CI
i
EJA ? =II
ALAHJDA AII ?
LAHCA I
(x)P (x) E
Ln
MEJD
n@
L S
+=H =F '$ B
A= I >O ?
LAHCA ?A
A= E C DAHA B IJ=JA B
+=H =F
Rn (S )
B JDA IA JA ?A
EI JDA ? =II
Ln E Ln
D
MDE?D
EI JHKA 6DA HK AI F E J
B H= CAI @AJAH I E A
B = HK A MI JDA
B H= CA EI J 1B A A= E C
@I
MI D M J B = IA JA ?A E A= E C A= E C
E? IA JA ?A E A
@EJE I >KJ JD=J @ AI
MEJD KJ
J = A
IJHK?JELA O
A M K @ D=LA J
IFA=
= O @EBBAHA ?A E
JDEI ?=IA
"#
B EJI FHA@E?=JA IO
>
I = @ E @ELE@K= ?
IJ= JI
6DA B
B = IA JA ?A = I
FHA@E?=JA ?= ?K KI MEJD E@A JEJO MDE?D JDA +=H =FE= IAA +=H =F '$ JDA E F $ JDAHA =HA IA JA ?AI MDE?D =HA EJA @ B? =E 1 ? IA?KJELA M=O ? EJA @ FJO = @ JDKI E LAHCA J
Ln
? B
IK?D IA JA ?AI =HA A 6DA E@A= JDA @EI?KIIE )HA JDA H= CAI JDA H= CA B
LAHCA ?A FHAIK
AI JD=J JDAIA IA JA ?AI =HA AN? K@A@ =E I =FFH NE B =E I JD=J @ >AHI =JE I ? >A B
B (x)P (x) E ? IA?KJELA EJA @ (x)P (x) E JDA E EJA @ =E 6DA H= CA I MDE?D D=LA ANJA IE EJA K >AH B IJ IE =HCAH @ B A E B ANJA IE I
(x)P (x) E Ln
J I=JEIBO
(x)P (x)
= E K >AH IA A?JI =
5E ?A = B E = O ?= C J
B JDEI H= CA ME B
AN? K@A@ BH
(x)P (x)
?
ALAHO HK A I MDE?D @
IJEJKJA JDA
EJA H= CA
L 1 (x)P (x)
JD=J >A @ @ ?=JE + D =E =E I
Ln
JDA HK A
O F E JI
KJ IJ=JA @AI?HEFJE B H= CA E
F IIE> O D JDA H= CA
AJD @ B H= CA E
(x)P (x)
JDA
Ln
B F E JE C EJA @
(x)P (x) D
EJA @
@I 6DA GKAIJE =E
B H= CA E @ B H =
IE@AH JDA HK A
B H= CA B H E EJAIE
an
MDA KIJ D
n EI =H>EJH=HE O
(x)P (x) E L
=HCA 6DEI = FH F HJE B H= CA E
A= I JD=J B=
P (an ) EJA Ln ?= ?
KIJ
JDA E @ELE@K= ?
IJ= JI B H
P (x)
JDA HK A M K @ IJE 6 E
B H= CA E = CELA D=LA J =
B H= CA E
BK
Ln =HA J =FFH NE =JE I B L -LA EB = CELA IJ=JA @AI?HEFJE (x)P (x) BK I EJI HK A IJ=JA @AI?HEFJE B Ln EJ EI J ? IAH J JHKJD E L IE ?A EJ
@ 0A ?A JDA HK AI JDA HK A B H= CA E = E EJA K >AH B =HCAH @ B =E I H = B
JDAH M=O AIJ=> EIDE C JDA JHKJD J >HE C KI = O ? IAH J B B E IJ= ?AI FJ JE? FH >=>E EJO EJA @ =E I B E @ELE@K= I ?=
P (x)
B H = ?AHJ=E
EJA IAJ
P (x) B
IA?KJELA
MDE?D
@AI?HEFJE
A= E C ANF = =JE =
(x)P (x) D @I 6DA >AIJ JD=J EI =?DEALA@ EI HK E C KJ IJ=JA MDE?D (x)P (x) @ AI J D @ 6DEI D MALAH EI E IKB ?EA J B H =
O JHKA JD=J JDA FH F HJE I JA @I J AH "$ EA B JDA H= CA B EJI FH >=>E EJO L= KA JA @I J
(x)P (x)
AH
J JDA I= =E I @ E E E ? A
A =I JDA ?
LAHCA ?A
EJA B
A= E CI J M=H@ JDA E
EJA
ECDJ >A I=E@ JD=J JDA FH >=>E EJO L= KAI LAHCA J M=H@ JDA FH >=>E EJO KIJ @A EJO BH JDA @EI?KIIE EJA @ E =E I ? A JDA FH >=>E EJO
6DA ? B =E
=> LA EI JD=J EJ EI LAHCAI J M=H@ EJI A KIJ ? B E @K?JELA =J?D JDA =IO
(x)P (x)
B JHKJD E
=E E C J=I
JDA FH CH= A
?AFJ
EJ =FFH =?D J
1B JDEI EI
B = IA JA ?A
JDAH JD=
S I
JHKJD E J
I @EI?KIIA@ E E
A?AIIEJ=JA = >HEAB @ECHAIIE JDA =IO FJ JE? EJA @ A?JE A =@ FJA@ E =E I E IJA=@ >AJMAA JDA
FH >=>E EJEAI E
= JAH =JELA =FFH =?D MDE?D KIAI E HA IJH=ECDJB HM=H@ ? EJO 0 MALAH IK?D = E =JE?
AI FH LE@AI =
=FFH =?D ME
>A ID M
"
EJA
>AH
B IJ=JA @AI?HEFJE
I ?= B E >A ?
I
A= I B JDA EJ=HO A B EJI J EJA I
MDE?D EI = ? I
EJA >E =HO IAGKA ?AI =I ANF =E A@ IE@AHA@ =I HAFHAIA JE C E E JDA += J H IF=?A ) A K AH=JE B IK?D E E? IA JA ?AI ME EJA F=HJI
ID K @ IFA?EBO JDA IJ=JA @AI?HEFJE B H JDEI FKHF IA IE ?A 1J EI F IIE> A D MALAH J LAH E @ELE@K= ? E A IJ= JI A IJ=JA @AI?HEFJE E IA?JE EIJ ?= E @ @A
M H @I ?=
JA ? >E =JE
I MEJD BK ?JE
6DA ?
I M K @ JDA
@AJAH I J AN
I >KJ
A= I JD=J JDA A
B JD IA IJ=JA @AI?HEFJE E
I JD=J ?= HEJO
JDA @EI?KIIE
+=H =F '$ I
A=IKHA
EJA IAJ
B IJ=JA @AI?HEFJE
"%
?=
J B K @ = IA A JI
= JE?I
B FH >=>E EJO
IK?D =
HEJO =J A=IJ
J MEJD KJ
BKHJDAH =HCK
"
1 JACAH ?D IA
=J H= @
F A B ?D IE C = F IEJELA E JACAH =J H= @ ,A
F &$ 9DE A JDA FH >=>E EJO @ >A?=KIA JDA IK B E JACAHI EI F A JDAHA =HA = F A EB
0A ?A ? K J=> A AH = @
B E JACAHI EI B A A
B JDA K E
1
E EJA K >AH A J=HO ALA JI A=IKHA ?= I =I A A IA?JE A J
,A .E AJJEI AN=
>A ? K J=> O =@@EJELA . H AN= J=HO ALA JI JDAEH K E E @ELE@K= FH >=>E EJEAI EI E EJA IJ=JA @AI?HEFJE MI >A M AH
1
I
IE@AHA@ =I A A
"!
6DA
AECD> KHD
@ =FFH =?D
HECE = O = ? =IIE?= @ JE EJ ?= >A CELA = ? ! >A E
) JD KCD JDA += J H IF=?A EI IJHK?JELA A= E C =I = IFHA=@ => LA 6DA >E =HO @ECEJI JAHFHAJA@ J MEJD A ? HHAIF
0=
M =FF O A= I @A
B MD=J =FFA=HI E
JDEI ?D=FJAH EI L= E@ E
B JDEI @EI?KIIE
= @ MDO JDEI @A
IJHK?JELA IAJJE C E B ?
IA?JE B @A
IJHK?JELA IA
FH >=>E EJEAI
IJHK?JELA LAHIE
B JHKJD JD=
"&
AECD> KHD B?
@I I B JDA += J H IF=?A EJ EI F IIE> A J B IJ=JA @AI?HEFJE F J @A I MDE?D =HA ?= A@ OA@ J I AECD> KHD =IIEC AECD
= FH >=>E EJO
@I 6DA
JA A=?D
@I EI JDKI @A K B A CJD
AECD> KHD
B = IAGKA ?A
wE
BK ?JE
rj (w) W (j )
MDAHA
(w ), j
6DA AECD> KHD @I E EJE= IAC A J A J
"
W (j ) EI JDA IAJ
BE AECD> KHD
B IAGKA ?AI @ @A
B A CJD
B JDA += J H
wj
EJA
AECD> KHD @I = C JDA L A=IKHA P CELAI JDA FH >=>E EJO B = E EJE= IAC A J B B JDA
2 n
. H AN=
20 = 1
= @ = AECD> KHD @ MDE?D EI @A A@ >O A >E =HO @ECEJ D=I = FH >=>E EJO B 1 6DA FH >=>E EJO B JDA AECD> KHD @ =FFH =?DAI 0 MDA JDA A CJD B JDA 2 ! @A E C E EJE= IAC A J CH MI MEJD KJ = KFFAH E EJ
"!
6HKJD E
JDA ? @I
AECD> KHD @
J (wj ) ?=
>A @A MI
= O FHAIA JA@ =I B
J (wj )
)?? H@E C J IJ=JA @AI?HEFJE JDEI @A EJE J =
S ).
@
S EI JHKA E
>A
O EB EJ EI JHKA E
CE C J A J
J (wj )
!
9D=J EI ?
A>AICKA
wj
6DA
A=IKHA ? HHAIF
I?HEFJE
"'
6DA
HIJ
>IAHL=JE
EI JD=J JDA ?
?AFJ
B JHKJD E IE@AH
= HAIJHE?JA@ =FF E?=>E EJO B H JDA FH >=>E EJO @AI?HEFJE I >A MDE?D =HA LAHE => A L= E@ IA JA ?AI MDE?D ? IA JA ?AI A KIJ HA?AELA B JDA =E KIAI CE C J
J (wj ) =I = F
IEJELA
KCDJ J
D=LA F IEJELA FH >=>E EJO B ALE@A ?A J B= E J *A?=KIA JDEI CH KF IK?D B ?AHJ=E JO I 5?EA J LAHE A@ >IAHL=JE D=LA = FEHE?= I B
B FH >=>E EJO EI J =
>IAHL=JE B
JDEI ID K @
5?EA JE ? DOF JDAIAI ID K @ >A A => A@ J J JDA ?=IA JDAO ?= EI => KJ JDA IA JA ?A J >A ?
(x)(y )C (x, y ).
6DEI IA JA ?A EI JE EJO *AB HA BKHJDAH @A E>AH=JE J=E E C = JM 6DA B AJ F =?A HA =JE ME C ?= I " # EJ KIJ >A ID M = JM =HA LAHE => A AEJDAH LAHE => A JDA >=IEI H B= IE => A 0A ?A EJA E EJE= IAC AEJDAH " # AH H EJI B = O A J MDE?D
" # AC=
A= I JD=J FH >=>E
B H A ? @E C JDA AN=
F A IA JA ?AI => LA
C = {} k=1
>A = ? K J=> A JE AJ KI @A H@AHA@ IAJ JA JDA B += J H IF=?AI ? HHAIF J H IF=?A >O @E C J A JM
" $ F =?A HA =
x 6DA JHKJD L= KA B = =J E? IA JA ?A C (x, y ) EI @AJAH E A@ >O JDA y JD @ECEJ E JDA IAGKA ?AI >A CE C J x . H AN= F A JDA HIJ E " $ ? IEIJI B >E =HO @ECEJI ? HHAIF @E C J JDA =J E? IA JA ?AI C (1, 1), C (1, 2), ... JDA IA? @ B >E =HO @ECEJI ? HHAIF @E C J JDA =J E? IA JA ?AI C (2, 1), C (2, 2), ... = @ I A ?= = I A ? @A = JDA IJ=JA @AI?HEFJE I E J = IE C A += J H IF=?A
E JDA B
"
xJD +=
ME C
AH
"
JDA
B
B JDA
LA EA J
= O FHA@E?=JAI
I =J A=?D
#
=J
E? IA JA ?AI
C (1, 1), C (1, 2), C (2, 2), C (1, 3), C (2, 3), C (3, 3), C (1, 4), C (2, 4), C (3, 4), C (4, 4)...
+ JA ?A E JDA K E IJ=JA @AI?HEFJE IE@AH JDA IA JA ?A (y )C (a, y ) B H I JDA K ? K J=> A += J H IF=?A B IJ=JA @AI?HEFJE IJ= J B A? AH IJ= J a 5E ?A JDAHA EI A>AICKA D M J ? A=IKHA M IJHKA JDA MDE?D I=JEI AI JDEI IA JA ?A JDA KIJ >A >A ANF =E A@ IJ=HJE C BH I MDE?D I=JEIBO I I=JEIBOE C IA?JE MDA
" %
B H JDEI IA JA ?A ME B IJ=JA @AI?HEFJE A=?D E @ELE@K= ? = AH A>AICKA HA LAH = JA ?A = @ EJI ? EJO 5E ?A EJ EI FH >=>E EJO EJO IE AH ? ID K @ = I 6DA AH D=I = FH >=>E EJO
" ! ! >A
(y )C (a, y )
(x)(y )C (x, y )
= IA = MI JD=J ALA AH A
LAHE => A IA JA ?A E A A ?=
(x)(y )C (x, y ) ID
ANFA?J JD=J = LAHE => A 5D K @
K @ D=LA = F IEJELA FH >=>E LAHE => A IA JA ?AI D=LA A @ABA @ IK?D = ? =E JH=@E?JE IAA I = I FH >=>E KIJ D=LA J >A E
J =HCKA JD=J I?EA JE ? DOF JDAIAI ID K @ D=LA AH AJE B AI > JD = IA JA ?A = @ EJI ? @ EJI AC=JE
(x)(y )C (x, y ) =
P (S S ) = 1.
0 MALAH D I @ 6DA IA JA ?A A E EJE= IAC AJ KI @A AJ >=IEI
EI
J JDA ? A J
F A
A J
MEJD HAIFA?J J
A= I JD=J
S I B= IEJO ?=
A J A J IE
6DEI EI ?AFJ A JI
AIJ=> EIDA@
HA FHA?EIA O
S @A
MDAHA S ?=
>A LAHE A@
JDA
SC = \ S = {w |w S }.
1 JDA JDAH M H@I EB
?=
JDA >=IEI
B=
w
A
S KIJ >A ? =IIE?= IJ=JA @AI?HEFJE E J (rj (w )) B H ALAHO j AJ KI @A JA JDA AC=JE B S ? HHAIF @E C J JDEI ? JHKJD ? @EJE B H JDEI AC=JE EI JDKI S EI JHKA E JDA EBB S EI JHKA E =J A=IJ A IJ=JA @AI?HEFJE E J (wj )
6DEI E JKH #
w SC
=J A=IJ
A J >O
AECD> KHD
S 6DA @ J (wj )
6DEI ?
?AFJ
AC=JE
D=I JDA ?
(x)(y )C (x, y )
EI JHKA E >=IEI ALAHO AECD> KHD @ >A?=KIA B = O E EJE= IAC A J 0A ?A
(x)(y )C (x, y ) ?=
"
P (S S ) = 1 =HEIAI >O JDA ? F A A J AC=JE 6DA FH > A MEJD EI JD=J JDA JDA JHKJD L= KA B S ?= ?D= CA MEJD AM ALE@A ?A . H AN= F A I AJE AI (x)P (x) ?= >A JHKA K JE ALE@A ?A LAHE AI (x)P (x) 6DEI EI = LAHO
K E JKEJELA ? B ?AFJE B AC=JE = @ @ AI MI JD=J ?AFJ ?AFJ J HA A?J JDA JE B B= IEJO E IJ=JA @AI?HEFJE HA LAH EJ B AECD> KHD J = HA=I JDA >=IEI => A ? DAHA = ?
1E
= F=HJE?K =H
(x)P (x) ?= B 0 EB
B FH >=>E EJO B JHKJD ?=
#
=L=E => A 6DEI EI 6 IK LAHE =>E EJO B FH >=>E EJO *KJ MD=J EB IJ=JA @AI?HEFJE >A M I IA JA ?A >A JHKA E
KF JDA @EI?KIIE
J HA=I
B E EJE= IAC
A JI
6DEI = I
=FF EAI J
J (wj )
+ IE@AH M JDA A=H EAH AN= EJA E EJE= IAC B ALAHO B >O = O @AI?HEFJE = FH >=>E EJO
S)
EI JHKA E I
A J MDE?D
B JDA
AECD> KHD
@ 6DEI
JD=J > JD
MDE?D EI
>LE KI O =>IKH@
"!! ) M=O J E A@ JE I E A
= CA>H=
AECD> KHD
@I = @ K E =@E? HIJ
AECD> KHD
@I M >A KJ A= I = O
=IIEC
FH >=>E EJEAI J B E I B H B H
H@AH IA JA ?AI ME @A @E C J
@I = @ J
6DEI HAIK J HA =E I I
=O ?=KIA FH > A
FAH=JE KJ ?
B K E
= @ E JAHIA?JE J ? =E = ?
?=
>A @A 6DA =E
A@ ? B JDA I
IJHK?JELA O ?B *EID F '$% F $" 0 MALAH EJ EI F AJA O E JHA=J A J DAHA EI J ME C JDA E@A= MDE?D EJ EI JHKA = JE?I =HA E C =J )J JDA I= @A HIJ @AI?HE>A B JDA H= CA A F IIE> A M=O J B = IA JA ?A ? I
FH >=>E EJEAI J
S S
E E
E A JI
EJA =M AII IAGKA ?A MDE?D EI LAHE => A B JDA IAGKA ?A ?= HA =JAI JDA C = I
A JDA @EI?KIIE JE E B ?
FH >=>E EJO JDA HO +D=FJAH # ME FJ J 6DA GKEHA B JM EI ? + = @ E A JDA >IAHL=JE IJHK?JELA FH >=>E EJO
JDA JHA=J B
AECD> KHD A J B JM
@I @ AI A A
JDA KIK= HA
B = IAJ
B ALA JI IE ?A EJ EI
6DA K E
000 =
111 EI
A?AII=HE O =
B IAGKA ?AI = @
AECD> KHD
@I 1J EI A=IO J
EI =
H =
EJA K E @I F
AECD
A, B F A B
A@ E A =
AECD> KHD
PL
AECD> KHD I B
@I ?B
= CA>H= MDE?D = I
E ? K@AI K E
AECD> KHD
ME C 5KFF IA JD=J
B JDA B
AB = 1B AB = P L (A) = Ax= @y B HI
"!"
PL
@EJE B ? K J=> A =@@EJELEJO IAA F !" JKH KJ J >A = E F HJ= J
AJ KI JDA
P L BK
I JDA ?
FH >=>E EJO
A=IKHAI 6DEI ME
#!
@EJE KIJ
= I
?AH I E
EJA ? K J=> A K E
0A ?A MA
EJA ? K J=> A
F
HIJ JD=J
5KFF IA
k=1
MDAHA JDA IEIJ B 1J B =>E EJO
Ak F
@I 6DA K E
" !
Ak
=HA @EI @I
E J
AECD> KHD B= O MI BH
B @E
AECD> KHD
Bl
Bl =
l=1
>A?=KIA
k=1
Ak
EJA K E I B AECD> KHD
" "
EI = ? =II
@I = @
@I
HA LAH EJ EI A=IE O ID M
(k )(l)(Ak Bl ).
IE ?A EJ EI ? A=H JD=J B H = CELA >A?=KIA JM JDAHMEIA
" # ?=
Ak
M K @ ? J
Ak Ak Bl = Bl
J=E A A @I B H =
A JI MDE?D @
AECD> KHD
@I ?=
LAH =F MEJD KJ
Bl Bl
ME C D
B = F=HJE?K =H
Bl Ai = Bl .
i
1B " $
Bl
? I
J >A B B
C J
C J
Ak
MDE?D EI
J = IK>IAJ
Bl
Ai JDAIA IAGKA ?AI KIJ >A i 0 MALAH =?? H@E C J " # JDEI Bl
>KJ JDEI EI E F IIE> A >A?=KIA
KIJ >A IK>IAJ B = JDAH A >AH n B =HA @EI E J JDA A >AHI B l=1 l .H " $ = @ " # MA CAJ
Ak
n l=1
-LAHO IAJ E
k=1
Ak
>A
CI J
=K E
Ai MDE?D AGK= I I
i
E J = @ E EJA K E EJA E B IK?D
Bl
>AH
" %
J =
Ak I
JDAHMEIA
#"
JDAIA
n I M K @ ? LAH JDA MD A EJA K E J >A l=1 Bl MDE?D ?= n JDA ?=IA 0A ?A =J A=IJ I A Bl KIJ AGK= = E EJA K E B Ak I l=1 Bl -LAHO AECD> KHD @ =JKH= O ? J=E I = E EJA K >AH B I = AH AECD
EJA K E > KHD > KHD B JDAIA @I HA LAH ALAHO AECD> KHD A JI @ ? J=E I = A CJD + A J EJA K >AH B I = = AH AECD AECD> KHD @I MEJD E EJE= IAC B = CELA IE@AH JDA B A CJD
Bl
6DA K E A
@I AGK= I
M JD=J A=?D
B I
Ak
MDE?D AGK= I
B JDAIA
KIJ >A =
Bl *KJ JDEI ?= J >A JDA ?=IA IE ?A Bl @EI E J Ak I 5KFF IA JDA 1J B MI =C=E Ak I MDE?D ? LAH Bl + JH=@E?JE
0A ?A JDAHA EI =J A=IJ IK>IAJ B A B JDA A H= AECD> KHD EJA K E @ E
JD=J JDAHA EI =
Bl
I=O
J (wm ) MDE?D EI
Ak I
A=?D ALA E = O
m+iI
EB JDEI M=I
A ANJA IE I A
wm+i
Ak
A
EB =
i MAHA E
? K@A@ E EJ = @ I
MDE?D EI E
Ak J (wm ) M J (wm+i ) EI
I
J (wm+i ) JD=J Ak
JDA I= A
Ak
E
A J =FF EAI J
IA?KJELA ANJA IE
wm
I
JDKI @A
AI =
EJA IA EJA
@I MDE?D =HA
J E ? K@A@ E
= O
IAGKA ?A
Ak A Ak
*KJ EI JDEI E
J (wm ) Bl EJ D @I JD=J w Bl 6DAHAB HA w B Ak I *A?=KIA JDEI K E ? IEIJI B @EI E J IAJI w KIJ >A C J A B JDA Ak I E JDA K E 5KFF IA M JD=J w EI E ? K@A@ E A B JDA Ak I I=O Ak MDE?D EI = AECD> KHD @ 6DA B H I A j EJ D @I B H JDA E EJE= IAC A J wm+j B w JD=J J (wm+j ) Ak + JH=@E?JE 6DAHAB HA w @ AI J >A C J JDA E EJA K E B Ak I + JH=@E?JE 1J B MI JD=J =IIK FJE " ! EI J ? IEIJA J
5E ?A CI J EA E JD=J = E EJA ? K J=> A K E B @EI @EJE E J JDKI D A JDA = CA>H=
FJO IAJI ?=
"!#
) FH >=>E EJO
A=IKHA B H IA JA ?AI IEIJE C M B JDA IAJ JDA HA AECD> KHD @I = @ K E I B AECD L = CA>H= = @ P EI = ? K J=> O =@@EJELA FH > JDAHA EI = K EGKA FH >=>E EJO I B A=IKHA AECD> KH B
5E ?A JDA ALA J IF=?A ? > KHD =>E EJO B JDA D @I A=IKHA >O = MA
B JDA += J H IF=?A EI =
= CA>H= CA AH=JA@ >O JDA IAJ B AECD> KHD @I = @ K E L @I MDE?D ? E ?E@AI MEJD P ?B *E E CI AO ''# F !$ !%
##
JDA
A ?= @A
B H A IAJI A
@E C J
GK= JE A@ IA
JA ?AI 1 . H AN=
x EI DA=@I
" &
(x)H (x) ?
HHAIF
@I J
VH (x) (k ).
B JDA H= CA B @EI E J B
" '
k=1
1 JDAH M H@I " ' EI JDA @A 1J EI ? A=H JD=J " & EI = K E E EJE= IAC " ' EI = A JI B A CJD EJE
F IIE> A DA ?A A O B
MDAHA
wk
EI = IAGKA ?A
1I
B A CJD
E JAHIA?JE
>AJMAA
AECD> KHD
(x)H (x) EI JDKI E JAHFHAJA@ =I = A IAGKA ?A 1111... MDA <H (x) EI JHKA EI HAFHAIA 6DA ANEIJA JE= GK= JE ?=JE (x)H (x) ? HHAIF
6DA IA JA ?A
B IAGKA ?AI =
xJD JAH
L= KA
1
JDA IAJ
B IAGKA ?AI
VH (x) (k ),
k=1
@I >O ? >E E C JDA MEJD
"
>J=E A@ BH
AECD> KHD OJ
FAH=JE
M >A ID M = IE E =H B=ID
F =?A FHA@E?=JA ?=
F E?=JA@ B H
JA >O 8
>E =HO L= KA
: N {0, 1}
E = CELA IAGKA ?A @I J HHAIF
JDA BK ?JE B
6DA IA JA ?A
(y )C (1, y ) ?
JDA IAJ
k=0
-=?D A A A J E JDA IAJ
{w|V (1 +
i=0
i, w) = 1}.
"
= IAGKA ?A E
MD
EI B
A JI @A AI = AECD> KHD @ 6DA K E k B JDAIA AECD> KHD @I AGK= I {w |V (1 + i=0 i, w ) = 1} 0A ?A " EI = E JAHIA?JE >AJMAA K E I B AECD> KHD @I = @ JDKI >A CI J JDA = CA>H= E GKAIJE 6DA CA AH= ?=IA EI
(y )C (a, y )
MDAHA
a EI =
k
=H>EJH=HO E @ELE@K= ?
IJ= J
k=0
6DA H= CA
{w|V (
i+
i=1 i=0
i) = 1}.
"
B JDA IA JA ?A
a=1k=0
6DA IA JA ?A IAJ 6DA ? F A
{w|V (
i+
i=1 i=0
i) = 1}.
F A A J
"
!
B JDEI
"
"
"!$
- A
A JI
B?
IJHK?JELA IAJI A ?= @ =J A=IJ ? =IIE?= O =IIEC I FH >=>E EJEAI J BE MDA B H I JDA EJA A A =I
ID M
=> LA JD=J
(x)(y )C (x, y ) =
E
H IJ=JA @AI?HEFJE
(x)(y )C (x, y ) E
B JDA H= CAI D M A
JDA += J H IF=?A
IJHK?JELA E JAHFHAJ=JE
A@ => LA
=@E? FHA@E?=JA =I MA
R (S )
= = CK=CA MEJD = IE C A JM
ID M JD=J JDA B H @E C IA JA ?A EI
EI JHKA E ME
FH LA JDA B
R ( (x)(y )C (x, y )) EI K ? K J=> A =I A ANFA?JI EJ ID K @ >A JDA (x)(y )C (x, y ) EI ? IJHK?JELA O JHKA E w 6DA IJ=JA A J w R (S ) A= I ? IJHK?JELA O JD=J EJ ?= >A FH LA@ JD=J w EI = A A A J B R (S ) 6DEI ?= >A @ A AEJDAH >O =FFA= E C J JDA HK A JD=J @A AI w H MDAHA w EI = =M AII IAGKA ?A >O ID ME C JD=J JDA AECD> KHD @ @A A@ >O I A E EJE= IAC A J rk (w ) >A CI J R (S )
+ IE@AH JDA H= CA
"
#
MDE?D ? H= CA
IEIJI
B = ? K J=> A
>AH
B IJ=JA @AI?HEFJE
" IEIJ
$ B= = O
O ? K J=> O
M JD=J
EI E
"
$
A M J C J B J
(x)(y )C (x, y ) ?=
B= E EJE= IAC B= EI JHKA E
J >A JHKA E
A J ri () B H I
Ai
M JDEI
(x)(y )C (x, y )
JDA >=IEI
J (ri ())
A J J CELA $ ?=
MDE?D EI E
E EJE= IAC
0A ?A $ 1J B
>O = HK A ?= J ? HHAIF
@J
6DEI A J=E I JD=J ? AECD> KHD LAHE => A = E =>E EJO JDA JE B ? IJHK?JELA JHKJD
A>AICKA
A=IKH=> A IAJI
5A JA ?AI MDE?D
H B= IE => A B H
B JDA FH > A
6DAEH F IEJELA FH >=>E EJO E J >A E JAHFHAJA@ =I JDA FH > IE ?A HA=I => A ? ?AFJ B IJHK?JELA FH >=>E EJO >=IA@ B = E EJE= IAC A J
B IJ=JA @AI?HEFJE
IJHK?JELA JHKJD E B ? B=
JHKJD B H =M AII IAGKA ?AI ANEIJI 6DAHAB HA = ? IJHK?JELA JHKJD ME E +D=FJAH # >AE C = F=HJ 6DEI =FFH =?D ME >A >=IA@
#&
#
1 JH @K?JE
BBAHI = B H B ? = E =JE B? E IJHK?JELA FH >=>E EJO E EJO HABAHHA@ J JDA E EJO 6DA = AM AM
?AFJ EI HABAHHA@ J
>A >=IA@
IJHK?JELA JHKJD E
JHKJD )I M=I IAA JDA 1 => LA ?B +D ! JDA @EB ?K JO E A?JE BE A JDA ? J JHKJD E E EJO E EJA IJ=JA @AI?HEFJE =FFH =?D EI JDA ? E J FH >=>E EJO H@AH J @A E @I JD=J JDA E B JHKJD E J @AIEC =JA A ID K @ H
B A JEJO JDA A A
# => LA A @ K>J M=I ?=IJ A= J >O F JA JE= E IAGKA ?A ME B F IIE> O E IJ F H 6DAEH E >IAHL=JE JDEI E @ EJO EI >AJJAH ?D=H=?JAHE A@ =I F IIE> A E J J >A >=IA@ I B JDA =IIK >IAHL=JE A ?= I E J >A J ANFA?J JD=J JDA IAGKA ?A KIJ >A @A =?? K J FHA@E?=JA ?= ?K ? IJHK?JELA O B JD IA EJA = O EI = I M JD=J E A@ IK?D JD=J JDA
IA IA JD=J EI KIK= O
EJA IAGKA ?A ?=
I =I HAFHAIA J=JE
KI MEJD KJ E@A JEJO = IA JA ?A JHKA E = O =HCAH ?=H@E = EJO = EJA @ =E IE JEJO FH >=>E EJO E IJ=JA @AI?HEFJE
= IJ=JA @AI?HEFJE
0A ?A E
IJ= @I B H JDA
#'
CHA=JAH ?=H@E = EJO E ? K@E C 1J B MI JD=J ALAHO D=I ? >A ANJA @A@ J
0 I
JDA ANJA IE I ?=
I = I
B JDAIA ANJA IE
EI JHKA E E J
wi wi
JDA ?= ?K KI EJ B JDA
MEJD KJ E@A JEJO JDA =IO FH >=>E EJO 6DEI E@A= JE ME AA@I I
K =JE
B JDA FH >=>E EJO >A E JH @K?A@ E 0 MALAH EJ D J >A JHKA E >O JDA =IO 6DEI JE I HA=I =
>IAHL=JE
) FHA?EIA
IA?KJELA ANJA IE I B E
B = IJ=JA @AI?HEFJE M ?=
MDE?D
J ?=FJKHA@ EJA @ =E I =
. H JDAIA HA=I
O B H IA JA ?AI JD=J =HA I=JEI => A E JDA IFHA=@ B E EJA IAGKA ?AI @
IJHK?JELA JHKJD E
=> LA E
6DA ANJA @E>E EJO FH FAHJO ME JEJO 6DA IEC E ?= ?A JHKJD = @ ? HHAIF E F HJ= J =FF E?=JE
>A FH LA@ B H FHA@E?=JA ?= ?K KI MEJD KJ E@A B EI JD=J EJ ID MI JD=J JDA ? B ANJA @E> A M D=LA = >A E JH @K?A@ >A
A> = ? FH LAI JD=J ALAHO IA JA ?A E E?=JA ?= ?K KI MEJD KJ JDA E@A JEJO IO IJ=JA @AI?HEFJE JE B
= CK=CA >
B FHA@ I A
H BK ?JE B
IO
I EI JHKA E
L '&!
FF B
'
A> = ?I FH
B IA JA ?AI BK
L EI =
L AN?AFJ B
H D=LE C ? K J=> O
L ?B
0E JE @A IAJ =
A> = ? '&! F '# 1J B @A IAJ B H = O JAH ANJA IE = '$' FF #% #& JDA IAJ 0A ?A EB = IA JA ?A @A IAJ JHKA E B B
@A IAJ B H
L EI =
= IJ=JA @AI?HEFJE
EI JHKA E B
wk
B
Lk
EJ >A
CI J
Lk
= @ JDAHA>O J
A> = ?I FH
EI JDA
= IJ=JA @AI?HEFJE
L+
= @ JDA =J
E? IA JA ?AI
wk
EI JHKA E
wk
= @ JDKI E
1 IJA=@ 0E JE
IJ=JA @AI?HEFJE
A> = ? J=
A JI B H JDA
=J
E? IA JA ?AI
L
@A IAJI
$
L+
EI JHKA E B
= IJ=JA @AI?HEFJE
Lk
EJ EI
ANJA IE
Lk
B JDEI FH
A> = ? '&!
T1 HAMHEJA T1 (S ) M
EI @A
IJ= J E
E? IA JA ?AI '
A> = ?I
# HA @AJ=E A@
L+ M (A) = T EB T1 (A) >A CI J M = @ F JDAHMEIA + IE@AH HIJ JDA ?=IA A M 6DA T1 (A) = A = @ JDKI T1 (A) M 1J B MI JD=J M (A) = T = @ M (T1 (A)) = T 6DAHAB HA M (A) = M (T1 (A)) AJ KI JDA ? IE@AH JDA ?=IA A M )IIK A HIJ JD=J T1 (A) M MDE?D A= I JD=J M (A) = T 1 JDEI ?=IA IE ?A T1 (A) M = @ JDKI T1 (T1 (A)) E M >A?=KIA T1 (A) = @ T1 (T1 (A)) =HA JDA I= A M (T1 (A)) = T D @I = @ DA ?A M (A) = M (T1 (A)) )IIK A JDA JD=J T1 (A) M 1J B MI JD=J M (A) = F *A?=KIA T1 (T1 (A)) M M (T1 (A)) = F D @I =I MA 0A ?A = I E JDEI ?=IA = @ JDKI = M=OI M (A) = M (T1 (A)) A
B 6DA ANJ IJAF EI J FH LA JD=J
# ??KH E
j P (aj /x)
EB =
JDA E @ELE@K= ?
IJ= JI E
P (a1 /x)
B E IJ= ?AI
B H = O
>A = IK>IJEJKJE
E IJ= ?A
GK= JE A@ F=HJI =HA HAF =?A@ >O JDAEH IK>IJEJKJE + GK= JE AH BHAA IA JA ?A B L
BK ?JE
B =J
AP E P (aj /x) EI HAF =?A@ >O T1 (AP ) + IE@AH = =H>EJH=HO =J E? IA JA ?A T1 (AP ) E T1 (P (aj /x)) 5E ?A >O # M (AP ) = M (T1 (AP )) D @I ALAHO T1 (AP ) E T1 (P (aj /x)) ?= >A HAF =?A@ >O AP MEJD KJ = JAHE C JDA JHKJD L= KA B T1 (P (aj /x)) E M 0A ?A M (T1 (P (aj /x))) = M (P ( (aj /x)) 5E ?A JDA JHKJD L= KA B = GK= JE A@ IA
E? IA JA ?A JA ?A @AFA @I O JDA JHKJD L= KAI B EJI IK>IJEJKJE E IJ= ?AI EJ B MI JD=J # !
T1 (P (aj /x)) = P (a1 /x) >A?=KIA = JDA E @ELE@K= ? IJ= P (a1 /x) ??KH E M = @ JDKI JDA O A E P (aj /x) MDE?D F IIE> O @ AI aj *O # ! M (P (aj /x) = M (P (a1 /x) 3-,
>IAHLA JD=J . ME C JDA JA?D EGKA =@ FJA@ E JDA A CJD A> = ? '&! F >O E @K?JE B IA JA ?AI EJ EI A=IO J EI JHKA E
JI
B J EI
MDE?D FH ?AA@I
M 6DA E JAHAIJE C ?=IAI =HA JD IA MEJD GK= JE AHI + IE@AH A C JDA IA JA ?A (x)P (x) MDE?D >A CI J M 6DA >O @A EJE B= @A IAJ P (ai /x) >A CI J M B H A=?D ai JD=J >A CI J M *O JDA E @K?JE DOF JDAIEI P (ai /x) EI JHKA E M B H A=?D IK?D ai 0A ?A >O # P (aj ) EI JHKA E M B H A=?D aj MDE?D @ AI J >A C J M = @ JDKI (x)P (x) EI JHKA E M 6DA ?=IA MEJD JDA ANEIJA JE= GK= JE AH EI IE E =H
JD=J ALAHO IA JA ?A E )?? H@E C J =>E EJO E C B JDA => LA HAIK J E A=?D EJA @ EJ =E E FHA@E?=JA ?= ?K KI MEJD KJ E@A JEJO JDA FH > B=?J @A A JI JAI JDA B E E J FH >=>E EJO ? IE@AHA@ J E B B EJA EJA IJ=JA @AI?HEFJE I I=JEIBO >A JDA EJO
IJ=JA @AI?HEFJE
I MDE?D =HA E EJE= IAC FJ JE? E E E EJO ?AFJ A?JI JDEI ? B IK?D
6DA =IO B
B FH >=>E EJO J A J
IJHK?JELA JHKJD E E
A=?D
wn
JHE>KJE C J
EJ
O HAGKEHA@ JD=J
>A JHKA E
wn
= @ JD=J
>A F IIE> A E
EJO JHKJD E
>A @EI?KIIA@ E
#!
EJA IJHK?JKHAI
A J=HO ALA JI B JDA FH > EJA IJ=JA @A
Ln
B
=E
nE
A J=HO ALA JI
JDEI ?=IA JDAO =HA IAJI ) B = EJA IJ=JA +=H =FI E EJA JDA
B IJ=JA @AI?HEFJE
B = IA JA ?A EI IK?D = B JDA IA JA ?A
wn
JDA H= CA
S EB S EI JHKA E wn
FH >=>E EJO IF=?A 0 MALAH IA IA ? JHKJD E B ?AFJ B E @ELE@K= I E >IAHL=JE =E I ME >A KIA@ J EJA E
0 B
E
#!
6DA ?
AIJA@ @
?AFJ
=E I
KJ E A@ => LA E B H MEJD JHKJD E E = O E = I # I 6DEI ? LA = JDAH
EJO ME
FH > A 5 JKH E C J
JDA
EJ @A = EI
EJE =HA E
=>E EJO = @ JHKJD +=H =FI E @K?JELA B E @ELE@K= ? B H A=?D ?=H@E = EJO = @ E =E I =HA AIJA@ E IK?D = M=O JD=J # " HIJ
D(i) D(j ),
MDA ? ?
j>i
MDAHA
D(i) =
D(j ) @A
I
JA @
=E I MEJD JDA @A
i=
jE nE
IJ= JI HAIFA?JELA O 1 @ELE@K= ? IJ= JI +B +=H =F '$ +=H =F '$ @ AI B JDEI ? @EJE F #&
H@AHA@ E HIJ
a1 , a2 , ..., an J
JA JDA
A J B H JDA
0 MALAH EJ EI =E
JDA E
HA=I
EA
D(i)
=E I ?=
D=LA
KFFAH > K @ E
A= I JD=J JDAHA ?=
i k
1J EI = I
IK?D JD=J
# # IJ= J
# $ HA LAH
=E I ? K @
H@AHA@ E A JDEI = IAHEAI KFFAH > K @ MDE?D EI AIJA@ AII EI M K >AHI 1, 2, ..., n B JDA E @ELE@K= M 0A ?A
IE@AHA@ =I = @
MEJD KJ =
AA@A@ B H HAFHAIA JE C A?AII=HO B H JDA 5E ?A JDA IJ= JI ? A ?= JDA =@L= J=CA IJ= JI =HA E
?AH E C JDA
$!
#!
>IAHL=JE L=JE I
E JE
B F IIE> A
>IAH
0 M @ AI = @ E E J E =E EJA O JDA IA * JD
AIJA@ E
EJA @
= K
E >AH
EJA B
E C O HABAH J =E I
= O
=E I 1
B E @ELE@K= I EI JDKI E
? KIE
MD=J B
EJA @ EJA ? E?
@A E C
B = F IIE> O E B JDEI IA
= JE?I =HA
AHA JA?D E?= EJO MEJD KJ JDA =IIK JDA IA I FJE = JE?I B =J A=IJ
I FDE?= IEC E ?= ?A CE?= IF=?A E = JE?I ?= J >A >=IA@ KIJ >A E ? K@A@ E IJ F -=?D @
D(n)
>IAHL=JE
nE
wi
B JDA H IJ F
>IAHL=JE
>IAHL=JE =J = O CELA
JE KA A J
wi
wi EI LAHE
=> O =
wi
o o
wi+1
HA LAH
wi+1 ME
A J JDA A J B
E EJE= IAC
o
B
wi+1
EI IK?D = IAC
wi+2
EI =
wi+1
EI = I A J
= F IIE> O
w
B
E EJE= IAC B
o
B EJO
wi+2
w EI = F
B EJI E
A J
o E
JDA IA IA EB A ?=
J F IIE> A J
LAHEBO JDA E
HA LAH ALA
J LAHEBO
SE
!
KFFAH > K @ E
B F IIE>E EJO = IAHEAI
JDA A CJD
IEIJA ?O
JDA ? =HJE
H ?
B A?JKHAI =J 5J ? D
$"
?=
F IIE> O >A LAHE => A E EJE= IAC =J ALAHO EJA E M JDA ? B IIE> O E IE@AH EI = ANJA IE
A JI
B =O I
6DA IAGKA ?A
EJA IJ=CA K
AII
o EI F
+
ALAH >A E
D=LA IJ FFA@
wi+1
?
wi
AJ?
+ A=H O JDAHA EI = = E
I MDE?D B H
JDEI IAGKA ?A EJIA B @ AI ? HHAIF ?B = I L=JE I = =M AII # # M ME E C? B F IIE> A 6DA IA?JE H F JA JE=
EJ EI H=JDAH =
ALAH >A IE
#!!
JDA IA
= JE?I
>IAHL=JE
o EI F
I
IIE> O E
EJA 1B
S EI JHKA E o wi
B
EJ EI JHKA E
EI JHKA E
JDA ANJA IE
A J
o ` E JDA IA o JKH I
JDA @EI?KIIE J = HA=I E
EI JHKA E JDEI
A?AIIEJO E
I K @AH ? E @ OJ
wi
B LAHE HA LAH EJ EJA ANJA
?AFJ
IJHK?JELA JHKJD
JHKJD E
wi
A JD=J ? =IIE?= IJ=JA A A JI => KJ JDA BKJKHA >AD=LE KH H B= IA E A
o ?=
>A A=
?=
9D=J @ AI EJ JDA
EI ? =IIE?= O JHKA E
o
EJA IJ=CA 6DA
o o
IJ FI =J I E B=?J ?
EI
o EBB EJ EI JHKA E
EJA IJ=JA @AI?HEFJE JE KAI B HALAH 1 JDEI ?=IA >A @A JD=J E EJA IAGKA ?A MDE?D EI HABAHHA@ J I DAHA IE ?A EJ ?= IALAH= EJI A JEHAJO HABAH J
o EBB EJ EI JHKA E
J IAA F E J J KJ
S >O o
F IA = O FH > A
A@ MEJD KJ
o
A
AA@I J
o ME
IJ F EB EJ ME B
IJ F =J =
6DA
CE?= IF=?A
W (n)
=E ?
6DA
Wf in
I
B E @ELE@K= I E IEIJE C
>IAHL=JE
$#
K B H
>AH = ?
B E @ELE@K= ? JE KK KJ E B IA?JE
IJ= JI JDEI
6DA E
B F IIE> A
>IAHL=JE
I =I
B F IIE> A M H @I J >A
#!
) JD KCD JDA F IIE> O E EJA IAGKA ?AI ANJ >IAHL=JE >A ID M 6DA I B = ? B IAGKA ?AI ?=
Wf in
JDA
Wf in
>IAHL=JE
IAGKA ?AI JDA = I E =JE?I JDA JDAH =IIEC JDA I= -LAHO KJFKJ
A@ =I BK ?
= CK=CA = BI
IAGKA ?AI
A M=O =I =M AII ?D E?A IAGKA ?AI =HA CELA >IAHL=JE = IAJJE C MDE?D EI CELA JDA ALA J JD=J
IJHK?JELA A M=O
AHA@ =I HABAHHE C IE
= FH >=>E EJO
A=IKHA J B ?KI
H@AH J
EI
S I
IJHK?JELA JHKJD E
?=
= E EJA IJ=JA @AI?HEFJE 1J EI = I ? A=H JD=J S I JHKJD E I A wi B o EI J IKB ?EA J B H EJI JHKJD E JDA MD A B o ? IE@AH B H AN= F A JD=J S EI JHKA E wi >KJ B= IA E JDA E EJE= IAC A J wi+1 B o MDE?D EI = ANJA IE B wi 9D=J => KJ @A E C S I JHKJD E o =I EJI JHKJD E = JDA ? IA?KJELA E EJE= IAC A JI B o >ACE E C BH I A IJ=CA wi 6DEI ? ?AFJ B JHKJD A= I JD=J JDA J J= EJO B ? IA?KJELA >IAHL=JE I ? IJEJKJE C o I=JEIBO S MDE?D JDKI E = IA IA HA =E I JHKA =?? H@E C J JDA >IAHL=JE I E o 1B S EI JHKA E JDEI IA IA EJI JHKJD E A J EJ M K @ >A JHKA => KJ I => KJ ? I IA?KJELA IJ=CAI ) JD KCD JHKJD E A ANJA J CA AH= ?=IA J ?=KIA @A J >A = ? B F IIE> A LAHEBO AJDE C JD=J >A B CI J A J ? B IJHK?JE EJ EI I MDE?D =HA J J F IIE> A E JDA *A >A A JI JDA HA= B ANFAHEA ?A = A O
o I @ALA
>IAHL=> A JDA
o
S =>
E
EJA O FH ?AA@E C B
JDEI IA IA ?= E EJO ME
1 IJA=@ JDA ?
IJHK?JELA JHKJD B = E
SE
I 5K?D = IAGKA ?A HAFHAIA JI JDA FH L=> A F IIE>E EJO JD=J B JDA @ALA
"
A J
B JDA =M AII
GKA ?A
"
o ?B
B = KJ? E
=> LA
JA JD=J HAGKEHE C A JI
E IJA=@
JDA ? #
IAC
>IAHL=JE
I M K @ AC=JE JE J >O
F IEJELA J >A @A
S
I
= @ EJI A
B= IE =>E EJO
A@ MEJD HAIFA?J J
B JHKJD E A= I
A@ B H JDA E
EJA IAGKA ?A =I = MD
A E A
$$
A J S EI ? B >IAHL=JE
>A E JAHFHAJA@ E
JDA
= JE?I
@I E
0 MALAH JDAHA
o =?? S EI JHKA =
MDE?D ? E ?E@A
H@E C J @ MDE?D
B F IIE> A
IE
EI JHKA O MEJD
SD
@I E
o ME
IAGKA ?AI
B F IIE> A @A
>IAHL=JE E C ?
EI JHKA
EI =
>IAHL=JE
IJHK?JELA A @A
FEHE?= JHKJD EI
AJDE C FHE H J
ANFAHEA ?A ?AHJ=E A?
IEJK=JE A@
FHE H J
0A ?A EJ ?=
S
B
EI ?
o I IJ=CA x
JDA IAGKA ?AI
C E EJE= IAC I MD IA ? A= I
? E ?E@AI MEJD
>IAHL=JE EI @A
MEJD KJ =
6DA FH >=>E EJO IJHK?JELA JHKJD E ME L=JE JHKJD E B M E B FH >=>E EJO 0 M ?= E B 1 FH FAHJO IAGKA ?A JDEI M=O JDA MDA JDA B
A@ >O I A
S I
? EJE EJ >IAH
o I
4 KCD O IFA= E C =
HA FHA?EIA @A
p E o
EBB JDA E
o J ? E ?E@A MEJD S EI p
JE = A O B JHKJD =J = B I 6DA FH >=>E EJO >IAHL=JE
B JDA E
B F IIE> A B ? I
o EI ? A=H O =>
JHKJD E
B F IIE> A
KIJ >A F IEJELA IE ?A JDA FH FAHJO E FEHE?= M H @ MEJD HAIFA?J J B F IIE> A >IAHL=JE B IAGKA ?AI
IJ JD=J EI JHKJD EI @A
#!"
)IO
FJ JE? E
EJI = @ JHKJD E
B JDA B H =E I J EI A
?
= @A J E
IA?KJELA
JE I
EJA @
=E I
FH >=>E EJO 0AHA MA @EI?KII = F=HJE?K =H @EB ?K JO =II ?E=JA@ MEJD JDA +=H =FE= A FH >=>E EJO E I @EB ?K JO ID MI JD=J +=H =FI I B JHKJD E
=JE? ?
EJO MEJD KJ I
@E ?=JE
E
IE@AHE C ?
$%
ri (wn ) OEA @I JDA HAIJHE?JE B=n C IAGKA ?A wn J JDA HIJ i E @ELE@K= I i n ?B " ! 6DA L= KA B ri (wn ) EI JDKI = IJ=JA @AI?HEFJE B JDA ?=H@E = EJO i MDE?D EI = F=HJ B = =HCAH IJ=JA @AI?HEFJE wn B ?=H@E = EJO n 1J EI = I I=E@ E JDEI ?=IA JD=J wn EI = ANJA IE B ri (wn )
6DA BK ?JE )IIK A JD=J
wn
= @
S,
# %
S)
# &
ki I IK?D JD=J k1 < k2 < ... 6DAHA EI JDA = E EJA K >AH B ?=H@E = EJEAI n + k1 , n + k2 , ... E MDE?D S EI J JHKA B H = O ANJA IE B wn 6DEI A= I JD=J wn ?= J >A ANJA @A@ E IK?D = M=O JD=J S M K @ >A JHKA E = O IAHEAI B ? IA?KJELA ANJA IE I E A JD=J S EI JHKA B H I A wn+1 IK?D JD=J wn = rn (wn+1 ) B H I A wn+2 IK?D JD=J wn+1 = rn ( w ) AJ? =@ E EJK n+2 +1 1 JDAH M H@I EB JDA >=? CH K @ E B H =JE ? IEIJI B wn JDAHA EI F IIE >E EJO B S >AE C JHKA MEJD KJ = KFFAH > K @ E ? IA?KJELA IJ=JA @AI?HEFJE I
HAFHAIA JE C JDA 6DEI @ ? < E @ =E I =HA IA?KJELA AJ M B AM E B H =JE ME C AN= A=?D @ + F A 5KFF IA JD=J JDA =E =HA @A = JA@ >O =@E? > IE@AH JDA IJ= JI E B IEJK=JE =JKH= > K EI E KIJH=JA@ >O JDA B >AHI ?B IA?JE
# ! => LA
= CK=CA MEJD IO
>A
# '
#
OddD = EvenD .
6DA = JA?A@A J E ? ? K JDA @ =E B JDA E F E?=JE ALAHO >AH E EJA @ # I=OI JD=J JDAHA EI = =HCAIJ IAGKA J JD=J JDEI =E 5E E =H O EJA @ K >AH EI ALA ALAHO EI JHKA ? EJA @ # EI JHKA E =E B E @ELE@K= I = @ JDA ? ALA K
# K >AH =E @@
5E ?A O EB JDA
B E @ELE@K= I
OddD
ALAHO
J=E E C =
$&
1 D JE
=E I
B ALA
EI JHKA E
JD IA IJ=JA @AI?HEFJE
I MDAHA
= @E =E
@@ ?=H@E = EJEAI E
JD IA IJ=JA @AI?HEF
D(1) MEJD JDA IE C A A A A J 1 6DAHA =HA JM IJ=JA @AI?HEFJE I MEJD JDEI @ =E A(1) = @ A(1) 5E ?A JDA ?=H@E = EJO B D (1) EI @@ JDA IA? @? K ?J B S E F EAI JD=J A(1) ?= J >A JHKA EB S EI J >A JHKA 0A ?A S EI JHKA E A(1) >KJ J E A(1) + HHAIF @E C O E JDA @ =E D (2) MEJD JM E @ELE@K= I = @ JDKI ALA ?=H @E = EJO S EI JHKA E O JD IA IJ=JA @AI?HEFJE I E MDE?D A(1) EI JHKA 1 D (2) S EI JHKA E A B JDA ANJA IE I B A(1) = @ E ALAHO ANJA IE B A(1) 6DA ?=IA B D (2) EI IE E =H J JD=J B D (1) S EI O JHKA E ANJA IE I B A(1) >KJ E A B A(1) 6DA ?=IA B D (4) EI =C=E IE E =H J JD=J B D (2) AJ? 1J ?= >A ? ? K@A@ JD=J E @@ ?=H@E = EJEAI S EI JHKA E JD IA IJ=JA @AI?HEF JE I MDE?D ? J=E A(1) = @ E ALA ?=H@E = EJEAI E JD IA MDE?D ? J=E A(1) 1 S JDKI D @I E A=?D @ =E E AN=?J O 2 B JDA IA JA ?AI S JDKI D=I = E EJ
IE@AH HIJ JDA @ FH >=>E EJO JDA
AD
@I B H
HAIFA?JELA O
1 2 JDAH D= @ EJ D
B
@I JD=J #
n=
E
wn
EJ FH >=>E EJO E +=H =FI IA IA JHKJD E EJO MDE?D EI >=IA@
FJ JE? E
B JHKJD E
#"
6DA ?
B FH >=>E EJO E
wi+m ANJA
@I JDA JHKJD
S BH
i J i + m wi+m S ).
i,m i,m
i,m
(wi+m ) (j )(i j i + m rj
6DA JHKJD B
EI ANJA @E> A BH
wi J i + m wi
S ). wi wi
i,
EBB # #
(m)(wi
$'
i,m
S ).
?AFJ A@ E
B JHKJD E E
0 =HA = I
JAH E
O IK?D =I # $
AEJDAH = ? =IIE?= H = ? IJHK?JELA E JAHFHAJ=JE E # # i, B JHKJD MEJD KJ KFFAH > K @ EI J @A?E@=> A 6DEI A J=E I B EJ EI J JDA ?=IA JD=J =NE
AEJDAH EI
H EI
ANJA @E> O JHKA MEJD KJ KFFAH > K @ + =IIE?= O JDEI B H B AN? K@A@ >A E JH @K?A@ =I =
K =JE
#"
6DA ? JDA
+
?AFJ
KJ=JE
CE?=
B?
FAH=JE
KJ=JE
MEJD EI
CE?=
JDAH M H@I B H
FAH=JE
JHKJD @ AI JHKA EB = @
A EI JHKA
?
B EI JHKA AJ?
J LE =JA =J A=IJ JDA M
AB
EJO = JD KCD ANJA @E> A FH >=>E EJO @ AI B JDA FH >=>E EJO ?= ?K KI IAA IA?JE IE@AH HIJ JDA ?=IA B AC=JE
1J EI ? A=H JD=J ALA EB S EI ANJA @E> O B= IA E A EI J ANJA @E> O JHKA BH wi i + m S =O IJE >A JHKA E wi E JDA H@E =HO IA IA B JHKJD 6DEI A= I JD=J S EI J ANJA @E> O JHKA BH wi J i + m AEJDAH 1J B MI JD=J ANJA @E> A JHKJD @ AI J? KJA MEJD AC=JE 6DA ?=IA B @EI K ?JE S S EI JDA ? =IIE?= O = @ ? IJHK?JELA O L= E@ E JDA IA IA B ANJA @E> A JHKJD IE ?A = O CELA A B JDA @EI K ?JI EI JHKA E FH LE@A@ =O >A ?=IAI E JDA IA IA =J 1J B ? + B JHKJD E EJA IJ=JA @AI?HEFJE 0A ?A JDAHA AEJDAH J ?
H@E =HO
EI ANJA @E> O JHKA IE ?A EJ EI L= E@ >KJ MI JD=J ANJA @E> A JHKJD @ AI IJHK?JELA O K ?JE 1B > JD
S S
H
A=
B =HA ANJA
A&B EI ANJA
K ?JE
@E> O JHKA = @
KJAI MEJD ?
%
1 JD=J ?= MEJD E
F E?=JE EI E
1B
B
B
AA
A BB
H@E =HO IA IA = @
EI
J KJA
JHKA ALA
A B
J JHKA = @ JDKI J ?
(x)(y )C (x, y ) 1B EJ EI a E wi 0 MALAH E JDA ANJA IE wi+1 B wi MDE?D I=JEI AI (x)(y )C (x, y ) EJ =O >A JDA ?=IA JD=J C (a, b) EI B= IA B H JDA AM ? IJ= J b D(i + 1), b D(i) MDE A C (c, y ) EI JHKA B HI A c D (i + 1) = @ = y D (i + 1) 0A ?A (y )C (a, y ) EI B= IA E wi+1 = @ EI JDKI J ANJA @E> O JHKA BH wi 0A ?A = IA JA ?A B JDA B H (x)P (x) ?= >A ANJA @E> O JHKA ALA EB P (a) EI J ANJA @E> O JHKA B H = O a MDE?D A= I wi (y )C (a, y )
A JD=J ANJA @E> A JHKJD @ AI .E = O JDA ?=IA BH D= I J? KJA MEJD ANEIJA JE= GK= JE ?=JE B K ELAHI= GK= JE ?=JE 1B (x)P (x) EI ANJA @E> O JHKA wi P (a) KIJ >A ANJA @E> O JHKA BH wi B H = a D(i) JDA JDAH @ EB P (a) EI ANJA @E> O JHKA BH wi B H = a D(i) P (b) =O >A B= IA B H A b D (j ), j > i 0A ?A (x)P (x) EI J A?AII=HE O ANJA @E> O JHKA BH 6DEI A= I JD=J ANJA @E> A JHKJD @ AI J? KJA MEJD K ELAHI= GK= JE ?= O MEJD ? @E CI ?AFJ EJO K ?JE KIJ >A F IJ B ANJA @E> A = EI A J
wi
JE
6DA => LA ID MI JD=J ANJA @E> A JHKJD ? ) @AJ=E A@ @EI?KIIE F A@ J J = IO K E JKEJELA JD=J EB B >A M >IAHL=JE
KJAI
B JDAIA E
= BKHJDAH IJK@O 0 MALAH EJ EI = HA=@O ? A=H JD=J JDA ? = LEAMI => KJ JHKJD E F A O + B H E JKEJELA JDA => LA HAIK JI @ IE@AH B H AN= JDA IAGKA ?AI
A B EI JHKA
A EI JHKA
6DEI GKAIJE
#"
1
EJO
MD=J B E E +
E JE
JDA IA IA B JHKJD
B B
?=H@E = EJO ME
EJO ME IE@AH
>A >=IA@ E O
HIJ = B=
i,
S} S
=H>EJH=HO
EI = IA JA ?A = @ A=?D
>A E EJE=JA@ BH
iN
E A JI
B JDA A A
i Wu (i, S )
%
B JDEI E @ A JI MDE?D
E @
0A ?A
Wu (i, S ) =I = B=
E O
B IAJI EI
J = IJ=JA @AI?HEFJE
i P (Wu (i, S ))
Wu (i + x, S )
BA A EI => KJ =
AM IJ=JA @AI?HEFJE
Wu E
>IAHL=JE @E C O
IAGKA ?A
W (i) BH
S I JHKJD EI ANJA @E> A MEJD KJ KFFAH > K @ P (Wu (i + 1, S )) A=IKHAI JDEI FH >=>E EJO B H W (i + 1) 6DA E EJ B P (Wu (i, S )) MDA i ?= >A F IEJELA ALA EB JDA FH >=>E EJO B JDA ANJA IE I B = wi Wu (i, S ) I=JEIBOE C S JA @I J AH 1 JDAH M H@I JDA E EJ B P (Wu (i, S )) EI J => KJ S >AE C ? IJ= J O JHKA MEJD KJ KFFAH > K @ IJ=HJE C BH I A ?=H@E = EJO EJ EI => KJ S >AE C JHKA I JD=J EJI JHKJD ?= >A ANJA @A@ MEJD KJ = KFFAH > K @ 0A ?A JDA E EJ B P (Wu (i, S )) EI JD=J B JDA FH >=>E EJO B S I F IIE> A JHKJD E E EJO 1J M K @ JDKI J >A ? HHA?J J KIA JDA E EJ B P (Wu (i, S )) J HAFHAIA J JDA FH >=>E EJO B ANJA @E> A JHKJD B S E o 1 IJA=@ JDA B ME C =FFH =?D EI
+ HHAIF FHABAHHA@ AJ KI @A A = IAJ B JDA B H
#
= FR (i, wi , S, x) W (i + x),
# &
MDE?D B H = CELA IJ=JA @AI?HEFJE wi = @ ?=H@E = EJO i + x ? IEIJI B JDA ANJA IE I B wi = ri (wi+x ) E Wi+x B H MDE?D EJ D @I JD=J ALAHO wi+x FR (i, wi , S, x) ANJA @I S I JHKJD BH i
i,x
S ).
B
# '
S EI ANJA
@E> A E
FR
wi KF J
ALAHO
FR
MDE?D
AII=HE O ? 0A ?A
O IJ=JA @AI?HEFJE
I BH
MDE?D
FR
#
?=
JDKI
O >A B
C J
FR
EB
S I
EJ KJ
FR
HAGKEHAI JD=J
wi+x
EA
wi+x
= @
R IJ=
@E C B H
?= KFFAH = CELA 5E
J >A
FR (i, wi , S, x) K AII EJ EI FH L=> A JD=J EJ D=I ANJA IE I MEJD KJ E EJ MDE?D I=JEIBO S 6DEI A= I JD=J EJ EI J E CA AH= @A?E@=> A MDAJDAH wi+x >A CI J FR (i, wi , S, x) H J ?A JDEI EI J @A?E@=> A EJ ? K @ >A ? IE@AHA@ JD=J FR EI J A ECE> A J >A
CJ ? IJHK?JELA A?JE =JDA =JE?I B H AN= F A E =HJE 1 1 E C ? = E =JE BI JOFA JDA HO EJ EI JDEI ?=IA @EJE I A ? K @ HABAH B
HAGKEHA@ JD=J
>A =
FKJ=> A HA =JE
B A A
FR
MEJD = B IA 1J EI = IA B
?= E C EJ = IAJ
IA?KJELA I CI J
IJHK?JELA B H
M B H K @A?E@=> A IAJI
B IJ=JA @AI?HEFJE
B JDEI JDA
EI JHKA E
S EI
IA?K IA B B I
IJHK?JELA O KIJE A@ EB EJ EI LAHE => A >A I=E@ JD=J JDA E I B >IAHL=JE EJA O FH ?AA@E C IAGKA ?AI CA AH=JA@ >O ? = A
FR I=JEIBO S
S JHKA E E FR @AI?HE>AI
I
EJO E
JDA IA IA
JDA M=OI = A JI
S ECDJ FH FR (i, wi , S, x) B H =
>IAHL=JE I
FR
E
HAGKEHAI JD=J JDA FHE ?EF A EJA IAGKA ?AI MD IA JAH # => LA
#"!
B FH >=>E EJO
CE? MEJD KJ E@A JEJO B = IA JA ?A BH H BK ?JE = CELA B I
ABBA?JELA
= O =HCAH I E JDA
wi
JDA JHKJD
?=
>A ABBA?JELA O ANJA @A@ MEJD KJ KFFAH > K @ H BK ?JE JDA IA IA A ?= B # # ? E ?E@A E FHA@E?=JA @ JDA A A 1B
0A ?A E
FHA@E?=JA
CE? MEJD KJ
W (i + x) I A wi+x
MDE?D ANJA @ A JI
S I
A ?=
ABBA?JELA O
@ JDA A A ?AFJ
B ANJA @E> A JHKJD I 6DEI ?= >A HAF B @AI = @ >H= ?D B JDA IAGKA ?AI
M ? A E A= I E
IE@AHA@ J
>A
EJA IJ=JA @AI?HEFJE I 6DA ? IA?JE A@ => LA @ EJA IAGKA ?AI AIJA@ EJA B !
I E IJA=@
B ANJA @E> A JHKJD = @ FH >=>E EJO =I @A +=H =F '$ = =CA MEJD A JI >A @A K B
CE?= IF=?AI
)I ANF =E A@ => LA JDA A A EJA IAGKA ?AI HA JD= K >AH B F IIE> A ?= EJA IJ=JA @AI?HEFJE = @A K BE B
FR (i, wi , S, x) HAFHAIA
I *A?=KIA = O B E EJE= A JI E IAC A JI
>IAHL=JE >AH
JDAHA ?= = @A K AC ECE> A B 6
AH=> A
IJHK?JELA O JDA A A
FR (i, wi , S, x) =HA
ANJA @E C B H = I A
S I
wi+x FR (i, wi , S, x) EI KIJE A@ >A?=KIA wi+x = ri +1 () =M AII 6DA JDAHA KIJ >A y 0 IK?D JD=J S EI ? IJHK?JELA O JHKA E wi+x+y W (i + x + y ) = @ E = B EJI EJA ANJA IE I ` MDE?D =HA =
JD=J JDAHA ?= >A @A >A O = @A K K >AH 6DEI CKHA E K AH=> A B E K >AH B =M E A IAGKA ?AI B ANJA IE I B EJA J >A
O = @A K JA@ J
AH=> A
wi
@A
MDE?D ?= B
IJHK?JELA FH
IA JA ?A
AH=> A
B = CELA @A
IJHK?JELA IA AC=JE EI
EI
IA IA JD=J EJI
CE?= O
A?AII=HO EJ EI
J=> A IAGKA ?A
#""
6DA IAJ MDE?D
W (i + x) MDE?D ANJA
=
S I JHKJD BH
i=
@ BH
S I JHKJD EI ANJA
@E> A J
E (S, i, x) =
1 JDA IAJ
FR (i, wi , S, x).
wi W (i)
B
#
W (i + x)
S I ANJA
@E> A JHKJD BH
iJ
=H>EJH=HE O
#
. H HA=I EA E A OJ
B IE
F E?EJO EJ ME JDAH
>A =IIK
A@ JD=J
? HHAIF
@I J
+=H =FI
MD=J B EB
1J EI @A?E@=> A MDAJDAH = CELA JHKJD MEJD KJ KFFAH E CE? MEJD KJ BK ?JE )IIK EB JDA E A = ? B IAGKA ?AI B H=JE I = EJ BH
wi+x
wi+x
E (S, i, x)
S I
IJHK?JELA O @A
EJ ANEIJI MDA
x CH
F A >O ETi
i
x
S I ANJA
@EJE
C JDA
#
#
@EJE
J >A
#""
) HA
=H
=> KJ =@@EJELEJO
6DA AGK=JE
(A B =
#
$
A EI JHKA = @ IE E =H O MEJD E (B, i, x) 0A ?A IAGKA ?AI B IJ=JA MDE?D A = @ B =HA = JAH =JA O JHKA =HA J E ? K@A@ = JD KCD JDAO =HA E ? K@A@ E E (A B, i, x) 0 MALAH JDA ANJA @E> A JHKJD B A B BH wi EI J JDA I= A ALA J =I JDA K E B JDA ALA JI <A EI ANJA @E> O JHKA BH wi = @ <B EI ANJA @E> O JHKA BH wi ?B IA?JE # " 0A ?A JDA ? ?AFJ B ANJA @E> A FH >=>E EJO @ AI J
@AI?HEFJE @EHA?J O LE =JA JDA =@@EJELEJO =NE
E (A, i, x) ?=
J=E
O IAGKA ?AI
B IJ=JA @AI?HEF
P (A B ) = P (A) + P (B )
%#
(A B =
).
#
%
JAH
I EBB
B = IA JA ?A
EI ? EBB
A@ >O =
JDA
M=H@I E A ?
MEJD KJ KFFAH E
wi
H
A@ >O = AEJDAH
JDA IJ=CAI
wi
ALA
AB AB
=J =
MEJD =
AB
E J FH >=>E EJO
#"#
6DA HA=
6DA ANEIJA ?A
K >AH
B JDA E
EJ B H
?JE >AH
P ETi
EB = @
O EB B H =
n nk
JDA
|P (n) L| < .
LA JE = =IO FJ JE? FH >=>E EJO IO >
1J EI
EJ B H JDA ? E L H@AH
P (Even(n)) MDA
Even(n)
HIJ
P @ AI n
FJ JE? I MDA
JH=@E?JE
MEJD
=?? H@E C J
MDE?D =IO
I =HA AGK= O E A O
P ETi
E
D=I =
=@L= J=CA
LAH ? ETi
LA JE =I ME
= >A
LAHCAI J
A @ AI
J D=LA
CA AH=JA JDA
AHE?= L= KA
B JDA E
JDA E
E ?HA=IE C BK ?JE B H A=?D ? ETi ?A P (S, i, x) EI > K @A@ BH MDE?D EI > K @A@ BH >A
i=
M = @ => LA
M D=I = CHA=JAIJ
x .
) IE
B = = OIEI JDA E F EAI JD=J EB a EI JDA CHA=JAIJ ETi E? BK ?JE E AP (S, i, x) P ETi (S, i, x) L B H I
=FF EA@ J = E E
B JA?D EGKA MEJD KFFAH > K @I E IJA=@ B MAH > K @I ?= >A ET @A?HA=IE C BK ?JE MEJD EJ IE ?A P (S ) EI ? A=H O = KFFAH > K @ 1 6DEI ? ? K@AI JDA ? =IIE?= FH B JD=J JDA HAGKEHA@ ? =IIE?= JDA KJAH E EJI = M=OI ANEIJ 6 FH LA JDA ? IJHK?JELA ANEIJA ?A EJ KIJ >A M M B JDA E 6DA AI JDA @A EJ FH >=>E EJO B = B= E M EJE A E KIJ @ EJ JDAH M H@I JDA E A= E C EJ EI JD=J EJ
E =H FH
L I=JEI
EJ 0 MALAH JDEI
%$
H? E
A ?= AI
AIA B J
L EI JDA ? =IIE?=
L?
#"$
6DA
EJ EI
=H
= EJ M
L ?
M
IJHK?JELA
? =IIE?= B ? = E EJ = @ = M ?
>AJMAA E
? =IIE?=
J = M=OI = ?
IJHK?JELA E = I
EJ =I MA ALA =
IJHK?JELA IA HA E>AH= ?
0 MALAH =I ME
EJ EI = M=OI ?
?=JA ?= ?K KI MEJD =
L '$
6H A IJH= L=
= C HEJD
@I D= JI =BJAH =
JDAH M H@I JDA ANEIJA JE= GK= JE AH <= E A= E C JD=J = FHA?EIA JE J M 6H A IJH= L= JDA ? >AB HA EJ =?JK= O @ AI I ,= A JANJ '&& B CA AH= F ?
? =IIE?= O
IJHK?JELEI
JD=J
ET M JDA @A EJE B P (S ) 1J B MI BH JDA @A?HA=IE C ETi ET FH FAHJO B P (S, i) JD=J EJ KIJ =FFH =?D JDA E EJ P (S ) BH >A M 1B JDEI E EJ EI E JAHFHAJA@ ? =IIE?= O = @ EI M EJ EI M JD=J B H ALAHO = i ANEIJI $ ETi ? =IIE?= O IK?D JD=J B H ALAHO i i JDA L= KA B JDA BK ?JE P (S, i) EI ET MEJDE BH P (S ) A ?= @ IK?D = i E = EJA JE A >O IE F O AJJE C ETi i CH M >A?=KIA E = EJA JE A JDA L= KA B P (S, i) KIJ >A =HCA A KCD ALA
JD KCD JDA L= KA ? H@E C J =BJAH = JE
$
?=
@E C
?=
J F IIE> O HK
B= E
KCD J FH LA JD=J JDA FH ?A@KHA D= JI ET I JDA ? IJHK?JELA @A E KJAH E EJ P (S ) BK =H LI 2HE ?EF A
>A FH LA@ IK?D J A=@I J O >O FH @K?E C JDA =? JH=@E?JE
B JDEI
?=
EJIA B >KJ = I
>O
JD=J JDAHA EI
%%
) IE
E =H =HCK
A J =FF EAI J B
JDA E
AH E
EJI
B H ALAHO
i
=H
0A ?A JDA LI IA IA
ETi P (S, i)
IE ?A
P ETi (S, i, x)
EJ FAH=JE
AIJA@ E
IJHK?JELA E
#"%
6DA =E @ AI J
EJ = @ LAHE ?=JE
EI J FH LA JD=J = F IEJELA E KJIAJ JDEI EI J B J EJ FH >=>E EJO B H = IA JA ?A B I A E EJE= IAC A J
S
B
JDA >=IEI
>LE KI 9A IAA JD=J ANJA @E> A FH > JDA >=IEI LAHE => A IE@AHE C B H
B JDA IA JA ?A >AE C LAHE A@ M JD=J JDAHA =?JK= O EI = EJA O LAHE => A IA JA ?AI ? JE
IA JA ?A D=LE C = F IEJELA ANJA @E> A FH >=>E EJO 1J EI E JA @E> A FH >=>E EJO EI E IJ= ?A JDA F IIE>E EJO 4A?= JD=J A B JDA MDE?D ?= 1J ME >E EJO B H + J >A LAHE A@ HIJ >A ID M
B =IIEC E C F IEJELA FH >=>E EJEAI J JEL=JE I B H JDA B LA JE JDA >=IEI JD=J JDA ? EB EJA ALE@A ?A = +=H =FE=
FH >=>E EJO
H@AH IA JA ?A MEJD KJ ? '%$ JDA =IO KIJ >A A J EEI 1 B HAIK J H@AH J
H BK ?JE
I EI AEJDAH
0
JE
JD=J >=IEI
B EJI
1 B
JDAH M H@I
= JD KCD
JDA B
IA JA ?AI => LA D=I = FH >=>E EJO HAIK J M K @ >A D= @O DAHA 0 MALAH MEJD KJ =IIK IJHK?JELA O EJ EI E ? IJHK?JELA 1B JDA AC=JE GKAIJE F IIE> A J
(x)(y )C (x, y )
EI @A?E@=> A
IJHK?JELA O JD=J
@E CI D
J D=LA F IEJELA ANJA @E> A FH >=>E EJEAI B .=CE I HAIK J E A M=I ? ? F IIE> A JH=@E?JE
JD=J JDA
IA JA ?AI E
IJHK?JELA O FH L=> A EJ M K @ = I
01
@ B H JDA AC=JE
>A ? =IIE?= O
FH L=> A *KJ JDEI EI E B .=CE I HAIK J EI E 5KFF IA JD=J =>E EJO H EJI B
MEJD .=CE I HAIK J EJIA B 0A ?A JDA H EJI AC=JE A@ JD=J B D=I = AEJDAH =IO
6DA
MDE?D EI E
F IIE> A
FJ JE? FH >
@ B H EJ 6DEI ?
J >A =IIK
AC=JE
D=I =
(x)(y )C (x, y )
%&
AJ KI @A ?
JA
IJHK?JELA O JD=J
6DA =HCK
@I
(P (S ) = 1 P ( S ) = 1)
MDAHA 6 IJAFI
# B
'
P (S ) @A
AA@ J
LA JE A JI J
= =IO
S
BKHJDAH +=H =FI
B = F IEJELA FH >=>E EJO MEJD KJ B H K =JA JDA =HCK A J K @AH JDA =I E AEJDAH
=IIK FJE JD=J = IJ=JA @AI?HEFJE I =HA AGK= O FH >=> A E A m JDA CA AH= ?=IA M K @ HAGKEHA I AMD=J HA =HCK A J=JE AA@I J >A FH LA@ JD=J EJ EI ? JH=@E?J HO J =IIK ET H P ( S ) EI F IEJELA MDAHA > JD S = @ S =HA A ?= FH LA JDEI B H = =H>EJH=HO IA JA ?A S 1J ME >A HIJ FH LA@ JD=J 1J A JD=J
LAHE => A
ET P (S )
ET P (S ) = 1 P =1
MDAHA < EI 1B CE?= E F E?=JE
# !
P (S ) = 1 B H = O b < 1 JDAHA KIJ >A i IK?D JD=J JDA FH >=>E EJO B S E = j i EI CHA=JAH JD= b )IIK A HIJ JD=J P (S ) = 1 JDA JDA => LA ? @EJE KIJ >A BK A@ AJ 1 ET KI ?D IA b IK?D JD=J b > AJ KI JDA =IIK A JD=J P (S ) EI AH 6DEI A= I 2 JD=J B H I A j i = @ B H = j j S EI B= IA E HA JD= D= B B JDA IJ=JA ET @AI?HEFJE I E W (j ) + JH=@E?JE 0A ?A P (S ) ?= J >A AH . H = O
ET P (S ) = 1 P (S ) = 0.
6DA ANJ IJAF EI J FH LA JD=J # ! # !
ET ET [P (S ) = 0 P ( S ) = 0]
ET ET (P (S ) = 0)& (P ( S ) = 0).
E IJ= ?A B JDA CA AH= JDA HA # !!
6DEI EI A=IO IE ?A # ! EI =
(A B ) ( A& B ),
MDE?D EI ? AJ KI IJHK?JELA O FH L=> A M FH LA
[P (S ) = 1 P ( S ) = 1] [ (P (S ) = 1)& (P ( S ) = 1)]
%'
# !"
6DEI EI =
E IJ= ?A
(A B ) ( A& B ),
MDE?D ?= >A FH LA@ =I B MI )IIK A
# !#
A& B.
1J EI ? A=H JD=J B JDA @EI K ?JI A ?= B @AHELA = ? JH=@E?JE JH=@E?JE DA ?A MEJD # !$ >O =IIK
(A B ) OEA @I = ?
FH LAI # !# 9EJD #
A B EI JHKA
(A B ) KIJ >A JHKA 5E ?A =IIK E C MEJD JDEI ( A& B ) KIJ >A JHKA 6DEI
# !%
[ (P (S ) = 1)& (P ( S ) = 1)].
5KFF IA M JD=J
P (S ) = 1
1J B
ET P (S ) = 0.
)IIK A= I JD=J
ET ET [P (S ) = 0 P ( S ) = 0].
9EJD # ! JDEI OEA @I
# !'
ET ET (P (S ) = 0)& (P ( S ) = 0)
= @ BKHJDAH
# "
(P (S ) = 1) ) IE E =H FH B MEJD JDA =IIK FJE P ( S ) = 1 CELAI (P ( S ) = 1) = @ JDKI (P (S ) = 1)& (P ( S ) = 1) MDE?D EI E ? JH=@E?JE MEJD # !% ET ET 0A ?A A KIJ @A O # !' = @ JDKI [P (S ) = 0 P ( S ) = 0]
MDE?D ? JH=@E?JI # !& 0A ?A D @I 3-, 0A ?A @A OE C JDA ? =E FH >=>E EJO J =E J=E B AH L= KA B JD=J = JD=J JDA ANJA @E> A FH >=>E EJO = ? JH=@E?JE KIJ D=LA = B
ET (P (S ) = 0)
EI F IEJELA A=@I J
1J EI JDKI
#"&
B JHKJD
B IFA?E= ?
&
#"& 9A ME
FKJE C E
EJI
B ? =IIE?= ANJA @E> A FH >=>E EJO A? K @ >J=E ? =IIE?= = @ ? IJHK?JELA L= KAI I I > I A JDA
M E LAIJEC=JA D M
B H ANJA @E> A FH >=>E EJEAI MEJD KJ = MD=J @EB ?K J 1 JHKJD ?B ? JDA ?=IA IA?JE #
KFFAH > K @
B = IA JA ?A ?=
JHKJD MEJD KJ KFFAH > K @ BH @A?E@=>E EJO MEJD KJ = =IO B JDA IAJ
S EI JHKA E = =H>EJH=HO wi S I JHKJD ?= >A wi 6DA FH >=>E EJO B S I ? IJHK?JELA ANJA @E> A i EI JDKI @A?E@=> A E A=?D i + x
CE? JDA GKAIJE E # D=I B JDA ? J >AA IJHK?JELA H ? =IIE?= AIJ=> EIDA@ >A?=KIA JDA B S I ANJA @E> A JHKJD ? FKJA JDA B
H@AH
FHAHAGKEIEJA B H JDEI @A?E@=>E EJO FH FAHJO EI JDA @A?E@=>E EJO KFFAH > K @ B H = CELA AJ EJ B
E (S, i, x)
wi+x
ECDJ >A = A=IEAH M=O J @E C KJ JDA ANJA @E>E EJO
S I ANJA
S I JHKJD MEJD
KJ KFFAH E
EJ BH
wi+x S}
# " MDE?D
i,x
W (i + x) BH
J=E I
S I
B JDA IAJ
Ext(S, i, x)
IJHK?JELA E JAHFHAJ=JE
E (S, i, x)
)
M JD=J JDA ? =IIE?= E EJ FH >=>E EJO B Ext(S, i, y ) MDA ETi AGK= I JDA ? =IIE?= E EJ P (S, i) E # ! + IE@AH JD IA wi+x W (i + x) B H MDE?D wi+x E (S, i, x) 1B wi+x >A ID M JDA
wi+x
?=
= A
Ext(S, i, x) =
JDAH 6DA
AEJDAH
E (S, i, x) @EBBAH BH
A=?D
wi+x
ANJA @I
S I JHKJD BH
H
i >KJ S I JHKJD ?= i
> K @ BH *
wi+x
AI
wi+x @
J ANJA @
S I JHKJD BH
w Ext(S, i, x) AEJDAH 6DAIA IJ=JA @AI?HEFJE >=>E EJEAI B E (S, i, x) = @ Ext(S, i, x) @EBBAH BH
B BKHJDAH @A E>AH=JE I
I JDKI ?= A=?D
JDAH = @
)IIK A JDA JD=J ) EI JDA ?=IA B H wi+x 1 JDEI ?=IA wi+x >A CI J Ext(S, i, x) MDE?D A J=E I JD=J P (Ext(S, i, x)) P (E (S, i, x)) ) = I JD=J wi+x S D @I B H I A x x = @ B H = wi+x BK E C JDA ? wi+x = ri+x (wi+x ) &
A J=E I @EJE
x x JDA IAJ Ext(S, i, x ) ? J=E I O ANJA IE I B IJ=JA @AI?HEFJE I wi+x Ext(S, i, x) B H MDE?D wi+x E (S, i, x) =I MA HA LAH ? IE@AH = CELA wi+x E (S, i, x) 1J EI F IIE> A JD=J I A ANJA IE I B wi+x E W (i + z ) z > x @ J I=JEIBO S = @ JDKI @ J >A C J Ext(S, i, z ) 6DAIA B=?JI A= JD=J P (Ext(S, i, x )) ?= J >A CHA=JAH JD= P (E (S, i, x)) 1 B=?J P (Ext(S, i, z )) ?= J >A CHA=JAH JD= P (E (S, i, x)) B H = O z x
1J B MI BH JDA => LA JD=J E I A ?=H@E = EJO 0A ?A EJ D @I JD=J
EJO
O IJ=JA @AI?HEFJE H=
1J JDKI D
zx
z
# ""
x
EJ KIJ D @ JD=J
x
-GK=JE # "#
# "#
A= I JD=J EJ EI A
E (S, i, x) EI
EJI B?
#"& 1
IJHK?JELA ANJA @E> A FH >=>E EJO ME >A @EI?KIIA@ B H JDA ?=IA A J E 5A? JDA FHALE KI IA? B MDAJDAH JDA @ JDA ? IJHK?
@E C
IJHK?JELA
B =IO
B JDA =HCK
JE ?
?=
>A IF EJ E J
.EHIJ JDAHA EI JDA GKAIJE JDA M=O IKCCAIJA@ >A AN= E A@ JDA M
IJHK?JELA E
B JDA HA=I L= KA EJ EI @I B
Ext(S, i, x) MDA
=> LA *KJ ) D BH
E (S, i, x) ?=
M M=> O
O EB EJ EI
wi+x MEJD
KJ KFFAH > K @
&
E C
E C
?=
>A ABBA?JELA O B K @
1J EI JDA
x
?= MDA L= KA JE J =JE JDA E EJI ANEIJ ?
IJHK?JELA O B H @AHELE C # "# => LA M=I J B JDA K @A?E@=> A M MDAJDAH I A H >A => A J
Ext(S, i, x)
MDE?D EJ EI
I E I E
E (S, i, x)
J JDA ?HKN
MDE?D AEJDAH
=JJAH JDA MD D
wi+x E (S, i, x)
@I MDA B B JDA FH EB
wi+x E (S, i, x)
=L E@ JDA J HA O
=HA M
MDAJDAH 1 JDA ?
wi+x E (S, i, x)
IJHK?JELA LAHIE
S I
AB K @
P (E (S, i, x))
JD=J EJ >A JDA ABJ IE@A ?
P (Ext(S, i, x))
FKJE C JDA IJHK? B JDA HECDJ IE@A EI ?
J =BJAH =
IJHK?JELA O L= E@ +
JD=J JDA L= KA
wi+x
S I JHKJD MEJD
E >
ABBA?JELA O I
iE
MDE?D
wi
B
I=JEI AI HIJ
JDEI
E @
B BK ?JE
0A ?A B H JDEI
H@AH
CE? # "# D
MD=J B
MI EJ ME
ANEIJI ? IJHK?JELA O EJ EI F IIE> A J ETi P (S, i) MEJD =H>EJH=HO FHA?EIE #"&! 2H @K?E C JDA E EJE= IAC
B ALAHO
FR (i, wi , S, x) EI =
&!
1J ME
x
D @I ? IJHK?JELA O JDAHA EI = EJE JDA E I @ AI I?
E J FH >=>E EJO F E J
. H
HAFHAIA J ? A ?=
S I JHKJD EI ANJA
=> LA MDAHA=I
EJ FH >=>E EJO EI
L =I JDA
i IA JDA ? IJHK?JELA E EJ B P (Ext(S, i, x)) EI L = 0 AJ JDA IAJ I E W (i) BH MDE?D S I JHKJD EI ANJA @E> A J i + x >A
M B ?KIAI
B IJ=JA
i,x
S}
@
# "'
W (i + x) MDE?D ANJA
S I JHKJD BH
wi >A
# #
{wi+x |wi+x
1J EI ? A=H JD=J
Ext(S, i, x) =
wi
6DA
EI (S, i, x, wi ).
# #
x
6DA BH=?JE
lim
# #
L |Res(S, i, x)|
E MDE?D =LAH=CA E
# #!
|Res(S, i, x)|
EI JDA I
>AH I
B IJ=JA @AI?HEFJE BA A A JI E
EJ FH >=>E EJO
B ANJA IE B A=?D EJ
# #! = JD
I MEJD KJ KFFAH E
&"
Res(S, i, x) EI =
E ?HA=IE C BK ?JE
x MDE?D B Ext(S, i, x) BH
B
xE
A?AII=HE O
?=
L EI = ?
IJHK?JELA E
L > D(S, i, x , L). |Res(S, i, x )| Res(S, i, x ) ? IEIJI i + x 6DA ? >E Res(S, i, x ) KIJ D=LA = F IEJELA
4A?= JD=J ANJA @E> A J FH >=>E EJO ?= EIDA@ E A F IEJELA E 1 D ? @I JDA EJ J @A?HA=IA MDE?D MA D=LA F E JA@ B IJ=JA @AI?HEFJE A@ FH >=>E EJO FH >=>E EJO =J I BH B ANJA IE 1B MDE?D I
# ##
S I
JHKJD EI
wi D(S, i, x , L) = 0 JDEI
B ALAHO AIJ=> D=LA = I I=JEIBOE C FJ JE?= O B
KJ JD IA
wi
MD IA ANJA IE
P (Ext(S, i, x))
B ANJA IE
I E A JE
L W (i + x )
=IO
1B # ## A J B
=C EJK@A
D(S, i, x , L) EI JDKI
O=
Res(S, i, x )
Res(S, i, x )
JD IA B H MDE?D EJ D
# #$
wi
# #%
=@A J D IEIJ @
HA ? 1 CA
AH MDE?D ME
wi Res(S, i, x ) B H MDE?D # #$ @ AI AH= B H = =H>EJH=HO x JDEI IAJ EI A FJO = @ ?= ALA ? Res(S, i, x) AJ KI @A JA JDEI IAJ B H x >O
IE@AH JD IA
B =
wi
# #&
T (S, i, x , L).
1B
P(
wi T
# #'
&#
MDA
>=>E EJO B
B ANJA IE
B =
wi x0
# $
P(
wi T
AJ KI ?
P(
wi T
# $
5E ?A MDE?D
D(S, i, x, L) EI = @A?HA=IE P(
A ?=
ABBA?JELA O
@=
B H
D(S, i, x , L) <
0A ?A B H JDA =LAH=CA
wi T
# $
wi T (S, i, x , L)
# $!
x EI IK>IJEJKJA@ >O x A ?= JDKI ABBA?JELA O @ =J A=IJ A wi T (S, i, x , L) B H MDE?D # $! D @I 6DEI HA=I E C ?= >A HAFA=JA@ B H T (S, i, x , L) ABBA?JELA O K JE # #' @ AI J D @ B H I A y > x 6DA L= KA D (S, i, y, L) EI JDA FH F HJE B JDA E EJ L= KA L B H MDE?D EJ ?= J A?AII=HE O >A F E JA@ KJ MDE?D wi Res(S, i, x) ? JHE>KJA J JDEI F=HJ B JDA E EJ 1 JDAH M H@I D (S, i, y, L) @ AI J A?AI
I=HE O ? JE @ M 1 = EBAIJ ? IJHK?JELA ANJA @E> A FH >=>E EJO E A 0 MALAH IE ?A ? K J A >AH KCD J ID M JD=J >A ABBA?JELA O IA A?JA@ J = FH >=>E EJO E JDA IA IA B IJHK?JELA ANJA @E> A JHKJD B y MDAHA y ?= J = HA@K?A JDA IE E =H HA=I
D(S, i, y, L)
OEA @ = CELA
L= KA B H D (S, i, y, L) B JDA E
EJ EI F IIE> A J CA AH=
IJHK?JELA FH F HJE
=H>EJH=HE O I
AN =
KFFAH > K @
Res(S, i, x) HAIK JI E
IKCCAIJ =
wi Res(S, i, x)
5KFF IA JD=J
# $"
M JDA IAJ
B ANJA IE
wi
Wi+1
# $# # $$
1 2 P (EI (S, i + 1, u, wi +1 )) > D (S, i, u, L) H P (EI (S, i + 1, u, wi+1 )) > D(S, i, u, L) D @I JDA wi D=I = ANJA IE E W (i + 1) I=JEIBOE C S 3-,
JDAH D= @ EB EJ L= KA B AEJDAH B JDAIA E AGK= EJEAI D @ ? IE@AH JDA A=IJ F IIE> A
. HI
z MDE?D ?=
>A ABBA?JELA O B K @ EJ D
> D(S, i, z, L)
>
D(S, i, z, L) D @I JDA wi D=I JDA HAGKEHA@ ANJA IE 3-, JDA JDAH D= @ EB 1 2 P (EI (S, i+1, z, wi )) D ( S, i, z, L ) = @ P ( E ( S, i +1 , z, w I +1 i+1 )) D (S, i, z, L) 1 2 JDA E EJI B > JD P (EI (S, i + 1, z, wi+1 )) = @ P (EI (S, i + 1, z, wi+1 )) KIJ >A F IEJELA MDA x IE ?A JDAHMEIA JDA E EJ B P (EI (S, i, x, wi )) x
M K @ >A AII JD= # $% E A = AII JD= EJI E E K 3-, 0A ?A JDAHA EI = I = @ AJD @ B H @I JDEI IA?JE 6DAHA EI = 6DA I JD=J A ?= @ = IJ = @E C KJ =J A=IJ A ANJA IE B H A=?D B H = CELA J D=LA = A HAGKEHA@ J FH LE@A JDA IA IA
wi B
1J D=I >AA
wi S
@ @ C
B MDE?D EJ ?=
J >A =IIK
wi
AJD @I E JH @K?A@ E ID M
EJ FH >=>E EJO IA J
B JDA ANJA IE
wi I=JEIBOE
B IK?D E
SE
EJ FH >=>E EJEAI
&%
6DEI ?D=FJAH IJ=HJI JDA @EI?KIIE LEAM B JDA FH > A B E @K?JE B *=OAIE= E BAHA ?A = I
A O JDA @AFA @A ?A
FH >=>E EJO E BAHA ?AI MDE?D FHE H @EIJHE>KJE ALA FHE H @EIJHE>KJE 6DEI EI JDA ?HKN
B ALE@A ?A E J
K =JA@ MEJDE
JDA BH=
AJD @I E A ? JE KK = E =JE
JE KK
AJD @I
IE C JDA E @K?JELA
=HO M=O J
P (h|e) =
+ @EJE = E =JE HK A $ E
P (h&e) . P (e)
AI = FH >=>E EJO BK ?JE
$
B=?J @A
Pe (h) =
P (h|e) MDE?D EI @EBBAHA J BH JDA FHE H FH >=>E EJO BK ?JE P (h) 0 MALAH IE ?A Pe (h) EI @A A@ >O KIE C P JDA FH >=>E EJEAI JD=J =HA >J=E A@ >O =FF OE C Pe (h) @AFA @ JDA ?D E?A B P
) F IIE> A I @EIJHE>KJE 6DEI E @ I EI J B IA? KJE =IIEC @ B JDA J JDA FH > A B ?D IE C >AJMAA JDA =L=E => A FHE H I JDA IA LAI E A@ >O
+=H =F '# @A
AI JDA
JE
FJE
IJ=JA @AI?HEFJE
&&
B = IA?
?=
JDA ?D E?A
A ? K @ KF@=JA JDA FH >=>E EJO KF@=JE C =?? H@E C J B IA? = E =JE IA? @ ?= @ ? @EJE KJ
>O ALE@A ?A E IJA=@ ANJA @A@ J @AJ=E I )F=HJ BH JDA ALA @EJE
HK A $ M K @ >A
H@AH FH >=>E EJEAI FH LE@A@ JD=J JDA JA?D E?= >A I HJA@ H@AH FH >=>E EJEAI JDAHA EI = I I A JDAH M=O JD= = JDAH F I =@ KIJ JDA @E
HAI HJE C J
IE> A IJH=JACO B H =@ KIJE C JDA FHE H FH >=>E EJO @EIJHE>KJE FHE H FH >=>E EJO @EIJHE>KJE JE = I ?KIJ = E =JE HK A $ MEJD ALE@A ?A E K J J 6DEI M K @ =
6DEI EI J
KIE C ?
B IA JA ?AI >O KIE C = IFA?E A@ FHE H FH >=>E EJO @EIJHE>KJE =@ KIJE C MDE?D FH >=>E EJO @EIJHE>KJE E @ B KF@=JE C HK A $ A FH > A I FHAIA J E B=H D=LA B=L KH = AJD @I AJD @ =HO *=OAIE=
P (h) E
$
P (h) ME
*=OAIE=
>A KIA@ E
= O ?= I JDEI
6DEI ?D=FJAH E
>E EJO =FFH =?D 6DAIA ? JDA EJAH=JKHA ME *=OAIE= = IEJK=JE KIJE C JDA FHE H @EIJHE>KJE IK?D = E C EJ E
I MDE?D I
CE? = @ =
=L=E => A B H ?D
@EBBAHA J E @K?JELA
$
1 JAHFHAJE C IA?
= A =@ KIJ B BK O ? AJD @I
A F IIE> A M=O J FH >=>E EJEAI E IJA=@ =>E EJEAI J IE ?A JDA JE E @K?JELA =E =JKHA MD=J EI HA= O B AFEIJA
A JI J EJJE C J
> A?JELA
E? FH >=>E EJO B E @K?JELA B IA JA ?AI AJD @I ?= B JDA > A?J A= E CI E J >A @AJAH = CK=CA 6DEI EI ANF =E A@ =I B B =FF OE C = FH >=>E EJO = ? >J=E E C B
MI 5A JA ?AI ?=
>A =IIEC A@
IA JA ?AI >O
JA JI 2H >=>E EJEAI E
HA @AJ=E E
MD=J B
&'
AJD @I ?= J A=IE O
>A ?
I BH @
IA JA ?AI J
HA=
K J
>AHI =
1J @ AI B
= A IA IA J
H@AH FH >=>E EJO BK ?JE J @AI?HE>A = IJ=JA `E A= JD=J = JDEI ?=IA JDA ? HHAIF E @K?JELA
E @K?JELA
AJD @ >A?=KIA IK?D = = IA JA ?A ) IJ=JA EI JHKA ` >KJ EJ EI 2H LE@A@ JD=J IA? H= E L JDAH EJ LA@ E
B =BB=EHI E
JDA IA IA
B =BB=EHI ?= @
J ? A=H MD=J EJ M K @
H@AH FH >=>E EJEAI @A= MEJD E @K?JELA >A =IIEC A@ J A FJE EI J FJE B K
AJD @I ?=
5E ?A F=H= K EGKA O @A
H=
CAI
JE KK
E @K?JELA
L= KA
LEAM JDA FH >=>E EJO =IIEC A@ J JDA IJ=JA @AI?HEFJE 6DEI M=O JDA FJE A= E C K KIA@ E
= F=HJE?K =H L= KA
EI E JAHFHAJA@ =I K L= KA ?
EI JDA
FJE
MDE?D ? HHAIF K
JDA =?JK= M H @ = BKHJDAH GKAIJE A ?AH E C >A JANJ K 9D=J =HA JDA ?HEJAHE= J
@
MI
B H A=?D B
EI
JDA
pI
H@AH @ACHAA
>AE C A ?=
KIJ >A
A?AII=HE O =??AIIE> A J
A @ AI J >A
A?AII=HE O
6DEI =HCK
A J M K @ B=L KH JDA LEAM JD=J IK> A?JELA IA? EIIA@ MEJD JDA JHELE= EJO =HCK 0 MALAH ALA E JAHFHAJ=JE JE EB IA? @ B FH >=>E EJO IA? IA AII @ B I A
H@AH IK> A?JELA FH >=>E EJEAI ?= >A EABI = @ >AD=LE KH 6DAHA EI H@AH FH >=>E EJEAI J H JE JDA JHKA JJ
FH >=>E EJO >A?=KIA IK?D = JDE C =I JHKA FH >=>E EJO EI IKFF IA@ H@AH FH >=>E EJEAI =HA KIJE A@ EJI M B FH >=>E EJO EI = HAIA=H?D J FE? E
ANEIJ HA
'
@E C = M=O
JDA
EI JDKI J
IAA D M ?
IE@AHE C IA?
$!
) HA
6DA
FJE
AJD @
JDA GKAIJE ?AFJ B E JAHFHAJE C IA? B FJE K A ?= ME FJE @ BH K @ H@AH FH > AJD @ E
=>E EJEAI ?= +=H =FI JDA JD=J = IA? =FI JHE>KJE L= KA E FJE
E @K?JELA
JE KK
EI
M IJ=JA @AI?HEFJE
EI IK?D +=H K
OEA @I JDA @ ? JE KK
5E ?A A=?D L= KA
EI F IIE> O JDA
JDA K
M =?JK= IJ=JA @AI?HEFJE LAH JDA A JEHA >A KIA@ K = B H JDA >AHI = FJE
JDA IA? ? JE KK K
ID K @ >A @A
I ECDJ O @EBBAHA J =FFH =?D ME +=H =F '# @AHELAI = B H I?HEFJE 1 MDE?D EI >=IA@ =@E? FHA@E?=JA K CE?
0J
AJD @ E K ?JE
= CELA
H EJI
AC=JE
@ AI
FHA@E?=JA ?= I B =J
E @ELE@K= ? F IIE> A ?
FHA@E?=JAI E ? HF H=JAI =
E? FH FAHJEAI = E @ELE@K= ?= D=LA 6DA K >AH B 2 MDAHA EI JDA K >AH B =J E? FHA@E?=JAI B JDA = CK=CA 0A ?A E @ELE@K= ? IJ= JI ?= >A @ELE@A@ E J 2 @EBBAHA J ? =IIAI
Q
.
FHA@E?=JAI E
JDA = CK=CA EI
>AH
FHA@E?=JAI ME EI CELA =I B
>A @A MI
JA@ >O
MD=J B
B = IJ=JA @AI?HEFJE
2 ri i
MDAHA GKAIJE
$
?O
B JDA
FHA@E?=JA
Qi E
O
=JE
'$
C AI J
= @ '# A ?=
KIA ?
H@AH @ACHAA
B K EB H
EJO @ACHAA
B JDA K ELAHIA
=> LA MDE?D EI =
'
w
JDA
B JDA
FHA@E?=JA =
wI @ACHAA
O=
=NE
F IIE> A
FHA@E?=JAI
wI @ACHAA
E E
F $$
+=H =F '# JDAHA EI = K EGKA E @K?JELA JD=J OEA @I JDA >AIJ AIJE JDA >=IEI B = O I= F A MDE?D EI I = ?
FHA@E?=JAI
>AH
B E @ELE@K= I
B JDA I ?AFJ B
A= J JDAHA =I = = B J JA
)?? H@E C J
H@AH EI JDAHA @A
= I ECDJ O @EBBAHA J M=O = @ EI HABAHHA@ J A JE / E C JDH KCD +=H =FI K FK> EIDA@ +=H =F '# B B AJ KI H@AH EI H@AH EI
B @ACHAA
HA @AJ=E
= KI?HEFJI
0 MALAH = FH
J =L=E => A E A
HIJ FH LA JD=J
EB = JHELE=
E @ELE@K= I =HA ?
= @ K
O @EIJHE>KJA@
JDA
Q 2 r = 1 i i
i ri =
E E B JDA K
1 JDA
= @
B EI J
B H JDA @ACHAA FHA?EIA O '# MDA = @ JDA =NE =NE HAC=H@ K =NE
FHA@E?=JAI
6DA FH
KEFAHI 6DEI HAGKEHA EI HA=?DA@ MDA A JDA E @ELE@K= I =HA K EB H HA=?DA@ MEJD I = O D B H@AH CA A KI
A J EI E
F E?EJ O =IIK
O @EIJHE>KJA@
L= KAI
2 i ri
MAHA = I =NE
= O DAJAH CA A KI = @
2 i ri
B JDA K ELAHIA
>IAHLA
HIJ JD=J
0 ri 1, B
= @
H=
i = 1, 2, ...,
$ !
ri = 1.
i
>IAHLA JDA B H I A JD=J
$ "
2 ri < ri
B H ALAHO
i
K
EB JDA K ELAHIA EI C AI =I B MI
J D =NE K
CA A KI = @ EJ JDA B
2 i ri <
CA A KI . H JDA
MI BH
(ri
(ri
1 2 ) =
2 ri
ri +
i
. 2
$ #
0<
IGK=HA AHH H
B JDA AIJE
=JA BK ?JE
'
. @K?JELA
$' ME B @AFA @I
F H@AH
>A KIA@ J
@A
JA JDA K
FJE >AH
K AJAH B FHE
JDA L=HE=> A
= @ JDA F=H=
E M
= @ JDA
JELA FHA@E?=JAI E JDA = CK=CA HAIFA?JELA O ?= >A JHA=JA@ =I JDA BK ?JE (r, ) +=H =F '# @AHELAI JDA B E C AGK=JE B H (r, )
(r, ) =
1J EI A=IE O IAA B H A=?D FJE EI K = @ AJ FJE K BH
1r 1. r (r, )
B EI HALAHIE> A A @ACHAA
$ $
0A ?A
AJ KI @A
I MD IA @ACHAA @E C J
wa
JA JDA K
IJ=JA @AI?HEFJE
? HHAIF AJD @ B H
JDA =?JK=
IJ=JA 1
B =BB=EHI
EI JDA
wa
JDA =JJAH C J
EA
wa
KIJ >A
Desc(r)
I=O JD=J
wa
JDEI ?=IA EJ
9D=J @ AI JDEI
IJHK?JELA O KIJE A@ J 0A ?A E
FJE
ID K @ >A
M=> A JD=J
wa Desc(r).
1 JDAH M H@I MDA ALAH I=OE C JD=J B H@AH B JDEI >IAHL=JE ME JELA O KIJE A@ JDA @ACHAA
$ % AJD @ E M
wa EI ?
IJHK?
M=> A 6DA ?
IAGKA ?AI
>A @EI?KIIA@ E
$!
6DA
ME
FJE
AJD @ = @ E
B @A
@EI?KII = @EB ?K JO B
=I HAFHAIA JE C JDA
@A= E C MEJD E
5KFF IA JD=J JDA @ACHAA IJ=JA @AI?HEFJE KJ JDA @ACHAA 6DEI EI JDA ?=IA E
CELA
$
H@AH
? HHAIF
JDA =?JK= M H @
I CELE C HEIA J
F $ $ 6DEI EI @EI?KIIA@ E
@AJ=E E F $'
H@AH EI
1 JDA
MDA r
'!
JDA
FJE +
K IE@AH
AJD @ 1B IJHK?JELA
B JDA =?JK= IJ=JA FJE K A AJD @ =I JDA AJD @ M K @ AJD @ *KJ EJ EI IJHK?JELA O B H = M=OI F IIE> A FJE K A J >A EJ M K @
AM K @= I
B CAJJE C J
EI JDA
AJD @ M K @ = M=OI D I EJ EI
IE
?A MEJD E
FHE ?EF A J JA
AIJ=> EID JD=J = F=HJE?K =H E @K?JELA MDAJDAH JDEI IJ=JA @AI?HEFJE A= B=?J B B H IA? A ?= LA @ ? HHAIF
AJD @ EI JDA @I J
JE KK LAH JDA
@A ?A MEJD
>AJMAA
6DA @ACHAA B >A JHA=JA@ D=I = ? JE K KI H= @ 1 = @ 1 1 JDEI JHA=J A J A=?D L= KA B r M K @ @A JDA ? HHAIF @E C L= KA B =?? H@E C J $ $ EI JDA FJE K JDAIA ALA JI L= KAI B = ? L= KAI B H= @ L=HE=> A ? HHAIF L=HE=> A
r
? K @ >A =IIEC A@ = @A IEJO BK ?JE JDA FH >=>E EJO BK ?JE J >A JDEI E @ A@ B H= @ LAH JDA L=HE
JE K KI @EIJHE>KJE B = @EI?HAJA H= @ ?
@E C J
?=
@A IEJO BK ?JE
f (r) @A
MDE?D M
f (r)dr = 1
1
$ &
MDE?D EI HAGKEHA@ BH ?
= O @A IEJO BK ?JE
E JAHFHAJA@
IJHK?JELA O JDA ANFHAIIE $ & M K @ A= JD=J JDA @ACHAA B H@AH D=I = 1 M=> A L= KA >AJMAA = @ 1 MEJD = FH >=>E EJO B 1 1 JDAH M H@I JDA @ACHAA B H@AH M K @ = M=OI >A M=> A MDE?D ?= J >A JDA ?=IA E IA = JE?I MEJD E EJA IJ=JA @AI?HEFJE I
$!
4A?= @ACHAA @EIJHE>KJE @EIJHE>KJE ?
6DA
FJE
K
A?JE
AJD @ MEJD
$ $ >AJMAA JE KK B M K @ E H@AH EJE B IA? JDA
LAH @ACHAAI JE
1J EI ?
EJA IJ=JA
'"
@AI?HEFJE
I 6DEI M K @
A=
@EI?KIIA@ => LA E
IA?JE
$!
? K @ >A =L E@A@ 0 MALAH ALA J B EJO JDA FH > A ME C =HCK IK?D = JHA=J J OEA @ IEC E ?= J HAIK JI MEJD HAIFA?J AJD @ 6 IAA JDEI ? IJHK?JELA IA KIJ AGK= JDA ? B HIJ H@AH 1 B B=?J JDA IE@AH JDA = JE?I JDA B ?D IE C JDA ? HHA?J E @K?JELA B = CELA @ACHAA B H@AH
A J MDE?D EI L= E@ E
> JD ? =IIE?= = @ ?
H@AH >O =IIEC E C FH > J HA= B H@AH =J JDA A LAH @ACHAAI H@AH ALA JD=
=>E EJEAI J
HA
1J EI JDKI
?AELA@
B =I FH >=>E EJEAI
O(i ) @A O()
?=
JDA FH F IEJE
i
=
EI JDA
H= CAI I =HA
F IIE> A @ACHAAI
B=?J
IJ=JA @AI?HEFJE
i
K @AH JDA ?
B i = @ i EI JDA
(O(i )) P i (S |O(i )) P
=O >A KIA@ J )?? H@E C J ? ANFHAII JDA FH >=>E EJO JD=J @EJE = E =JE
$ ' @
S EI JHKA =
EI JDA
FJE
AJD @
HK A $ B H
O(i )
??KHI =I = J =IIEC JM
=HCK
A JE
JM
= P
Pi
A ?=
A= I JD=J O @ AI
P
J
@EBBAHA J FH >=>E EJEAI J = O IA JA ?A =J JDA I= A i = @ P KIJ @A JA JDA I= A BK ?JE JDA JDAH = A IA IA J E @AN JDA IA? @ IE H@AH FHE H @EIJHE>KJE $ JDKI OEA @E C $
D= @ EJ ?AHJ=E LAH
??KHHA ?AI
P (O(i ))
9DA
EJ EI
MDE?D
O(i )
>J=E I JDA
LAH=
FH >=>E EJO
S ?=
>A
?= ?K =JA@ =I JDA IK
B=
FH >=>E EJEAI
P (S &O(i ))
$
P (S &O(i ))
i
5E ?A JDA L=HE KI @EIJHE>KJE IA? EI @ J=I KJE
O(i )
AND=KIJ =
P (S )
6DEI
B FH >=>E EJEAI
$"
1
6DA H=JE
JDA IA? = CELA
= EJO
@
B E @K?JELA
AJD @I
AJD @I =HA @EI?KIIA@ AJD @I JD= JDAEH JDA @EI?KIIE LAH JDA >IAHL=
B E @K?JELA
= EJO
B E @K?JELA
IJ=JA @AI?HEFJE
? =IIE?= = @ ?
1J M=I ID M
H@AH =IIEC
1J IAA
H@AH FH >=>E EJO @EIJHE>KJE JDA IA IA JD=J JDA IA? J @EBBAH BH JDA
A?JA@ BH
JDAHMEIA JDA IA? EI = JHKA IA? )F=HJ BH JDAH H=JE J ? IA? 6 E JE ID K @ I ?=KIA EJ EI JDA A?AII=HE O IE@AH=JE @
H@AH FH >=>E EJO @EIJHE>KJE B IK?D = @EIJHE>KJE M=> A I B H ?D = M=> A IJ H=JE = FJE IE C B = FJE A HIJ HIJ @ = EJO
AJD @I F IIE> A
B JDA E @K?JELA
AJD @
JDAHA
=O >A >A
A =@ FJI = FH >=>E EJO @EIJHE>KJE I >KJ H=JE A FHE H J = JD= ECDJ >A I HA H=JE ?=
IJ H=JE
JDA =L=E => A @EIJHE>KJE = EJO 6DAHA AJD @I =HA H@AH @EIJHE>KJE H@AH FH >=>E EJEAI H@AH @EIJHE>KJE @
I E @E?=JE C JD=J I
H@AH FH >=>E EJO @EIJHE>KJE =L E@ E JAHBAHA ?A MEJD $! JE => LA JDA IA? F O JD=J I JDA EIIKA MDE?D ?=KIA@ FH > A LAH JDA E @K?JELA ID K @ AJD @I
IA?JE
B JDA
H@AH @EIJHE>KJE I = @
K ?AHJ=E JO A B H @AJAH
B JDA E @K?JELA
B IJ=JA @AI?HEFJE
JDAH IA JA ?AI
'$
$"
+= ?K =JE C IA?
ME
H@AH ?
MDA
@EJE
IA? @ JKH EJ ?
= FH >=>E EJEAI
H@AH FH >=>E EJEAI =HA ? KJ JD=J ? AI J JDA ? @EJE @EJE = E =JE = FH > JA@
@EJE
ALE@A ?A 1J ME
B DOF JDAIAI A =I => LA JD=J JDA =L=E => A E @K?JELA >AHI AJD @I ?= AJD @ >A @A K
AJ KI =IIK
B =
E @K?JELA
() = P
EI @A
JA@ >O
@ EJ EI HAGKEHA@ JD=J
(i ) = 1. P
i
$ !
i EI JDA i = @ EI @A
1B FHAIIE JDA I
EI @AJAH
E A@ =?? H@E C J J AN
P i (S ) I i B H JDA E
A
AJD @ = @ K J= A KI O
B H = IA JA ?A =HA
EI >A
AJD @ = @ JD=J
IE
S
?=
IJ=JA@ =I
(i ) P i (S ). P EI = O FHE H IA? @ H@AH @EIJHE>KJE @A A@ >O E @K?JELA 0AHA P i P = FH >=>E EJO BK ?JE ? HHAIF @E C J JDA AJD @ @A JA@ >O i
6DA LAH= FHE H FH >=>E EJO B
$ " AJD @I = @
S P (S )
?=
>A IJ=JA@ =I B
MI $ #
P (S ) =
i
9DA + JDA ? @A A IA? @
(i ) P i (S ). P
LA@ ? @ @EJE = FH >=>E EJEAI @
B DO
>A @A = E =JE
(i ) P i (h&e) P
i
(i ) P i (e) P
B
$ $
h&e >O
A= I
B KIE C JDA
h=
6DEI ?=
>A @
ME C FH >=>E EJO
$ %
@EJE
A@ >O
A= I
$ $ JDA
6DEI ME
AJ KI ?DA?
P (h&e) =
i
(i ) P i (h) + P
i
(i ) P i (e) P
(i ) P i (h e) P
$ &
=
i
=
i
1J EI E A@E=JA O IAA
AH=J H I= @A @ @
H@AH FH >=>E EJEAI JDA GKAI H@AH FH >=>E EJEAI E A ? @EJE = E =JE MDAJDAH $
>A KF@=JA@ MEJD ALE@A ?A KIE C JDA *=OAIE= >A = IJH=ECDJB HM=H@ >A ID M JD=J JDA M HK A $ B JDA ALE@A ?A M 1J ME
e EI
=?? H@E C J
$ # $ '
i
= @ JDA FH >=>E EJO B i = @
(i ) P i (e) P
e EI (i ) P i (e) P
@EJE = FH >=>E EJO B
$
=?? H@E C J =I
$ " 0A ?A JDA ?
i K
@AH
e ?=
>A IJ=JA@
$
@
%
E @K?JELA ALE@A ?A
AJD
e >O
>IAHLA JD=J $
=FF E?=JE
B *=OAII JDA HA
P (H |E ) =
P (H ) P (E |H ) P (E )
'&
$
1J ID K @ D B IA? @
@ JD=J
(i |e) = 1 P
EA
= A JDA IK 1J EI A=IE O
B E @K?JELA
(i |e) = P
(i ) P i (e) P = 1. (j ) P j (e) P
$
!
AN=
E A D M DOF JDAIAI =HA KF@=JA@ MDA AJD @I EI E ? K@A@ E B? @EJE IE@AHA@ >A M @A JA@ >O EJE >A ?
B E @K?JELA
= FH >=>E EJO
P (h|e)
?=
KIE C
h KIE
C A=?D
P u (h|e) =
= @
(i |e) P i (h|e) P
$
"
EI =I => LA @EJE = E =JE HK A =JKH= O D AJD @I $ B IA? # @ @I B H HIJ H@AH E A@ >O JDA E @K?JELA
E J
JDA
AH=J H = @
(i |e) P i (h&e|e) P
i
(i |e) P i (e|e) P
$ $ AA@ J ? @EJE
$
$
JA JD=J EI =IIK 5E
P i (h&e)
= @
P i (e)
P (e|e) 1
EB
P (i ) EI = I
e`E
$
P i (h&e|e)
= @
JDAH M H@I EJ
@ =?? H@E C J B @A E C?
!
i
@EJE B=?J AGKEL= A J
(i |e) = P
$
$ AGK= I $
M=OI
= FH >=>E EJO
MEJD KF@=JE C
A IAJI
(i ) P (E |H ) = P i (e) = H = i P (H ) = P
''
P (E ) =
j
(j ) P j (e) P
1J B
MI BH
$
" JD=J
P u (h|e) =
)?? H@E C J $ JDEI ?=
$
%
>A MHEJJA
(i ) P i (e) P
j
P i (h&e) P i (e)
(j ) P j (e) P
$
&
0A ?A
P u (h|e) =
= @ MEJD $ #
(i ) P i (h&e) P
j
(j ) P j (e) P
$
'
P u (h|e) =
? H@= ?A MEJD JDA HA= E A EI JD=J $ B IA? $ EA @ H@E =HO ?
$ !
=?
0 MALAH JDA IJHE E C JDE C J MDE?D JDA KF@=JE C K = B GK=IE KF@=JE C JDA = FH >=>E A E@A= B 6DEI E @E?=JAI JD=J B H E @ ABBA?J
A= I JD=J JDAHA EI @A A =
F O HA@K?AI J
&
1J EI E JAHAIJE C J
A ?D IA
EA
P (h|e) =
E IJA=@ B ? B $ " JDA HAIK J $ ! M K @ = FH >=>E EJO LAI $ AJE D @EJE
(i ) P i (h|e) P
" E JDA @A KIJ
$ !
EJE
@EJE
>LE KI O 0A ?A
?D= CA =?? H@E C O =J A=IJ I AGK= EJO MDE?D E L EI JE =?? H@= ?A MEJD JDA ?
(i |e) = P (i ) P
A= I JD=J $ !
B IA?
B E @K?JELA
JI
LA O
HECE = FH > A
E E C FH >=>E EJEAI
M=O IA?
AJD @ EI JDA F IIE>E EJO JD=J IJH=E E C JDA ?D E?A =I EJ IJ= @I IK?D ?HEJAHE= =HA
AJD @
AJD @ LAH JDA CE? I B
B ALE@A ?A 1J ME
>A =HCKA@ JD=J JDA HK A ID K @ >A B=L KHA@ B E @K?JE FJE K = EBAIJA@ E E @K?JELA ?
B JDA B H
B JDA FH > A
A O JD=J ?
AJD @I =I B H
6DA HK A B H KF@=JE C JDA E @K?JELA IJHK?JELA E JAHFHAJ=JE )?? H@E C J EJA IJ=JA @AI?HEFJE >J=E A@ A=IKHA E
B ANJA @E> A FH >=>E EJO MDE?D M=I @A I 1 JDAH M H@I MDA JDA ECDJ E EJO E ME B
A= I JHKJD E
KJELA
S HA
=E I JHKA E JHKJD E
B JDEI ALE@A ?A 7F@=JE C JDA JDA IA IA B ANJA @E> A JHKJD ?D=FJAH AH =IIK A
JDA ? KHIA @I J
6DEI GKAIJE
IJHK?JELA =IO
>E A@ MEJD JDA KF = JE?I = @ FH >=>E EJO MEJD = *=OAIE= B E >A A EJ FH ?AII
@=JE C HK A 6DEI AIJ=> EIDAI = E HAIK JI MEJD JDA KF@=JE C HK A 6DA E@A= HK A EI @K?JELA J CE?I
B ?D= CE C JDA FHE H FH >=>E EJO @EIJHE>KJE . H AN= 0 MALAH F A , KLA @EI?KIIAI A !' 6DA ? HHA?JE AJD @ = =
AM
KEFAHI '&$ @ AI
? A=H O HA? C E AI DE
HK A =O ?
AJD @I
B JDA
JE KK
ME
E IJ= ?AI
AJD @I ?=
IJHK?JELA AGKEL= A JI
%
1 @K?JELA I AFJE?EI
A E C I A JE AJD @
EA
=I IAA
. H AN=
JDA ALE@A ?A IJ
> =?
H=LA I @ AI
n + 1JD H=LA
EI > =? FHAIKFF IA JD=J E @K?JELA HA=I JDA AJD @I MDE?D >=IA FHA@E?JE H=JE E C ID K @ I >IAH JDAH D= @ IKCCAIJI JD=J JDAHA = CH K @I B H JDAH A J ANJHA AJD JDA A O C JDA IJHK?JA@
= O @ACHAA 1J B MI BH JDEI JD=J JDAHA =HA HA A?JE C c JDA = JE E @K?JELEIJ AJD @ 0 MALAH EJ @ AI J B M JD=J c ID K @ >A FHABAHHA@ @I 1J EI JHKA JD=J c @ AI J J= A ANFAHEA ?A E J =?? K J JDA = JE E @K?JELEIJ =JJEJK@A >KJ ? EJJE C J c EI J IJH >=IEI B AHA E @K?JELA I AFJE?EI AJD @ c EI FJE = DAJAH CA A KI K ELAHIA E MDE?D JDA E @ELE@K= I =HA ALA
= @ JDKI HAFHAIA JI
O @EIJHE>KJA@ =
FHA@E?=JAI 5E ?A EJ EI A ?= J
J F IIE> A J M MDAJDAH JDA K ELAHIA EI ? M EB c EI JDA HECDJ ?D E?A AIJE =JE EJ AJD @I >=IA@
AJD @I =HA IA B ? HHA?JE C MEJD JDA I 5KFF IA JD=J JDA E EJA IAGKA ?A =JAI EJ B E @ELE@K= I
FHA@E?=JA EI
r r
EI
=FFH =?D
F=HJE?K =H FHA@E?=JA =
0A ?A EB JDAHA EI = E EJE C HA =JELA BHAGKA ?O B H = c ? LAHCA J M=H@ r AJ KI @EI?KII MDO JDA IA B ? HHA?JE C AJD @I ID K @ >A FHABAHHA@ LAH c AJD @I AN?AFJ
EJA @ =E I JDA GK= JE AHI =HA @A FF $ $ 6DEI A@ >O A= I A JE B EJA ? K ?JE I B JDAEH E IJ= ?AI B AL JDA =E I
JDA E
A= I JD=J EB JDA DOF JDAIEI ? =JE?= O ?= I ?D= CA ALA H @EI K ?JE EJA @ MDA
EJA IOIJA
I 1
I >KJ EJ EI K
A?AII=HO J
=E I =HA @A
!
JE
JD KCD JDA E @K?JELEIJ AJD @I =HA IA B ? HHA?JE C JDAO CELA >AJJAH AI =JAI JD= c O EB JDA K ELAHIA EI J =NE = O DAJAH CA A KI 1J IAA I AJD @ ID K @ >A ?D IA ANJHA A = @ K I ?= >A?=KIA = =NE = O DAJ O = E A O ?=IA >KJ JDEI EI
-LA
KH K ?
E BAHA ?A IE ?A JDAO AIIA JE= O >AC JDA GKAIJE 6DAHA EI = IE JDA MA =I B MI M IE C = IA B ? HHA?JE C B E @K?JE 4AE?DA >=?DE= AJD @ ME J KIJE ?=JE 6DEI =HCK A J C AI
EB JDAHA EI = E
EJE C HA =JELA BHAGKA ?O B H = F=HJE?K =H FHA@E?=JA = =FFH =?D JDEI BHAGKA ?O =IO I 1 ANFAHEA ?A EI F IIE> A JDA FJ JE?= O MDAHA=I JDA B JDA JDAH M H@I EB JDA K ELAHIA EI
A?AII=HE O @
MDE?D A=H E C BH
O JDA IA B ? HHA?JE C =FFH =?D JDA JHKA HA =JELA BHAGKA ?EAI MDAHA=I c ME J J ?D= CA JDA B=?J JD=J = IA B ? HHA?JE C MDA JDA K ELAHIA D=I I AJD @ EJO J >A = M=O KJ B JDA =FF=HA J E AJD @I 6DEI ME HK A MDE?D ME HK A F IIE>E EJO >A >=IA@ B = JDA E @K?JELA @EJE A K EB H FH LE@A >AJJAH AIJE A K EB H A K EB H =JAI JD= AJD @ ?= O FAHB H K E EJO 1B JDA K ELAHIA D=I
ME
= O IA B ? HHA?JE C J
A IK?D FHABAH =
LAHIA MEJD I =?JK= O D=I I = E C = H=JE ?AHJ=E E J = I E @ =?? K J 1J ME AJD @ E I = >KJ FAHB H ? HHA?JE JDAH ? JDAHA EI
EJO EB JDAHA EI
= ?D E?A >AJMAA
J= A ALE@A ?A
AJD @I MD IA ?
=@A =H>EJH=HE O
>AJJAH JD=
>KJ EB
= @ JDA
JD=J JDAHA EI
B=L KH
A J B H FHABAHHE C JDA ? HHA?JE HK A FH LE@A@ 5E ?A c EI HA KIJE A@ JD= = O E C = I =FF EAI J = c 0A ?A = JD KCD IJ= J AJD @ LAH = JDAH JDAHA EI = HA=I J IJ= J AJD @ B E @K?JELA E BAHA ?A EI @AFA >J=E A@ ID MI I A K EB H = E C FH >=>E EIJE?
EJI F=IJ FAHB H
LAH = O ?
F ##
A JI = @ FHABAHI =
'$&
FF !! "
"
E @K?JELA E BAHA ?A F IIE> A 0 MALAH EJ EI MDAJDAH JDA => LA =HCK JELA E BAHA ?A A JE B=L KH
J F IIE> A J
AN=
E A E
JDEI IJK@O
B JDA ? HHA?JE
@AIJO
@EI?KIIAI JDA E A?AII=HO ?HEJAHE @AIJO ?HEJAHE B H= AMEI '% ? MDE?D D=I >AA IKCCAIJA@ E JDA ?AFJ =
EJAH=JKHA =I = '%
=??AFJ=> A E @K?JELA
AJD @ 6DA ?
'%" 0 HME?D '& = @ .AIJ= ''" @AIJ EB EJ AL= K=JAI EJI =JAI B HA= L= KAI I =I JDA B = ?AHJ=E =
IJ =??KH=JA
=@A I = ?A
=HA ?
E @E?=J H
AJD @I
AJD @
EI
? A=H O ?=
J >A ?
IE@AHA@ =I JDA =
A MEJD KJ ?
AMEII
JDAH D= @ 5FEA
E @K?JELA
AMEI '%" ANF =E I JDA @ALE=JE KIA@ E '# =FI JE I JDA I= =FFH NE E @K?JELA JDA =FFH NE JDA JELA JDA ?= ?K =JE = A O JDA IGK=HA AHH H EI L= E@ B =
B HAIK JI >O @EBBAHA J =FFH NE M AJD @ IAA IA?JE =JE MDE?D IE % ! >A M
F A MDE?D EI KIA@ B H FHA@E?JE MEJD JDA AN=?J B H @AIJ AMEI @ AI =JE EI JDA AJD @I =HA E
0 MALAH
J ANF E?EJ O ID M JDEI 5E ?A JDA =JDA =JE?= E JH=?J=>E EJO IJ >J=E => A =I =JE I ?
JDAH D= @ 0 HME?D ? =E
B=
?AH E C JDA IE A
KF JDEI @EI?KIIE
@AIJO ?
>A L= E@ E
JDAH
JDAH M H@I EB
EI ?D
IA
AJD @ ID K @ >A ?D IA
#
HK A = O E @K?JELA AJD @
AJD @ = @ JDKI ?=
J >A = >=IEI B H ?D
IE C JDA ? HHA?J
%!
1
+=H =FI
1 ME
A=IKHA
B IK??AII
HECE = M H AJD @ = '# A= JDA A=IKHA B
JDEI IA?JE
IK??AII
H FAHB H
= ?A
A O JDA
IGK=HA AHH H
6DA ANFHAIIE
Est, (x, Xi ) =
EI JDA = EJO
1 Xi + ( ) x+
B FH FAHJO
%
AIJE
=JA
>J=E A@ BH
Qi E = wn >AE
B = I=
I=
F A K
B ?=H@E >AH B
C JDA
Q
=
=JA EI @AJAH
Xi
Qi x
1J EI =IIK I
K ELAHIA
F=HA@ J
@I JD=J JDA MD
=FFH NE
>IAHLA@ F=HJ
U (n, x)
BK ?JE B MD=J B
B JDA K ELAHIA MD IA MDE?D @AFA @I >A >J=E A@ BH +=H =F '# B JDA AIJE =JA
?=H@E = EJO EI H= @
nx L=HE=> A Xi
E
Xi ?=
x=
FF
wn
MI ?B
#% #& AJ
E A JDA AHH H
ri
Qi
? =
F=HA@ J JDA I=
x ri EI =FFH
B I= B IE A
NE
Qi E
6DA FH F HJE F AI
F AI MEJD = CELA
KJA BHAGKA ?O
x EI =FFH
P (Xi = si )
E JDAH M H@I JDA H= @ 6DA >E JDA H= @ EI HAFA=JA@ JDEI ?=IA A=?D JHE= B E= @EIJHE>KJE L=HE=> A @A L=HE=> A EI ?KIJ K JHE>KJE
x si r (1 ri )xsi , si i Xi
=FFH NE =JA O B MI JDA >E IE
%
E= @EI MDE?D
JAI JDA
x
E
JE
AI = @ MDAHA JDA FH >=>E EJO A=?D JHE= B =IIK 6DA ?HEJE?= F=HJ E C JDA FH >=>E EJO F=HA@ J JDA I=
B IK??AII HA >A ?
ri
B JDA B H
K = ? = ?
IJ= J E A ABBA?J
ri E
A?JE
1B JDA I=
F A EI =HCA ?
JDA J J= F FK =JE
I => KJ E @ELE@K= I E
F A @ AI D=LA =
MD=J JDA
$
Qi
E @ELE@K= I E %
JDA HAIJ
B JDA I=
F A EI 0A ?A
O =FFH NE 9DA
n EI IKB
?EA J O EJ
x X
6DA ANFA?JA@ L= KA = I EI @A
@E C E
?= A@ JDA
B = @EI?HAJA
A@ =I
E (X ) =
k
MDAHA xk =HA JDA @EBBAHA J F IIE> A L= KAI P {X = xk } FH LE@A@ JD=J JDA IAHEAI ? L= KA B X EI JDA MAECDJA@ =LAH=CA B X JE?A JD=J I IEC E AI IE AJE AI E F O JDA =LAH=CA L= KA B
xk pk
B
% !
= @ JDA
pk
LAHCAI =>I A=
KJA O B=
L= KA
C (C = c1 , ..., cn ). X
EI @A A@ =I % # % "
k=1
6DA L=HE= ?A B = H= @
ck
1 n
L=HE=> A
D2 (X ) = E ((X )2 ),
MDAHA
= E (X ) X
B ME C JDA >E E= @EIJHE>KJE MEJD F=H= AJAHI
. H = O L=HE=> A
p=
A D=I
% $ % % B HAFAJEJE I = @
MDAHA
EI JDA
>AH
EI JDA
A=?D JHE=
0A ?A
E (Xi ) = xri
= @
% &
V ar(Xi ) = xri (1 ri ).
6DA AHH H E JH @K?A@ E JD=J B JDA AIJE =JA BK ?JE @AJAH =E F=HA@ J B JDA @
Est, (x, Xi )
E A@
Xi
JDA >=IEI
ri
n EI IKB
B
x IE
?A
BHAGKA ?O
Qi B
H JDA F=HJ
MD IA IE A EI
%
M @EBBAHI I ECDJ O BH
JD=J
B +=H =F '#
$# *O LEHJKA
B % % = @ % &
%
V ar(aX + b) = a2 V ar(X ),
MDAHA I=
%
a=
b =HA ?
A =I JDA L=HE= ?A
@I >O % JD=J
6DA B
ME C EI L= E@ B H =
Y
% " B IGK=HA AHH HI B H F A EA JDA MAECDJA@
[E (Y )]2 + V ar(Y ) = E (Y 2 ).
6DA A= E F A E JDA IA IA B ANFA?JA@ IGK=HA AHH H EI JDA IK B JDA I= A= IGK=HA AHH H A=?D I= =LAH=CA HAIFA?J J
A ?=
@AHELA JDA B H
K = B H JDA
A=
Qi
2 E (Err, (x, Xi , ri )) = 1 xri (1 ri ) + ( ri )2 2 . (x + )2
J @AFA @ % $
+B
+=H =F '# =I
Xi
EJ ?=
>A
MHEJJA
Err, (x, ri ).
9EJD HAIFA?J J =
% %
Qi
JDA
A=
IGK=HA AHH H EI
Err, (x, ri ).
i=1
% &
&
6DEI ?=
= I
A=
IGK=HA AHH H
x
MDE?D A= I JD=J JDA A=
+ (2 x) (x + )2
2 i=1 ri
,
=
% '
FHA@E?=JAI E
JE?K =H K ELAHIA IJ=JA @AI?HEFJE @AFA @I O JDA I= F A IE A x JDA 2 = @ JDA IK r MDE?D EI JDA @ACHAA B H@AH B JDA IJ=JA @AI?HEFJE E i i JE ?B IA?JE $ ! => LA 0A ?A % & ?= >A @A JA@ >O
Q Err, (x,
%" 6DA ? HHA?JE
B JDA ? HHA?JE F
2 ). ri i
%
HK A
HK A J >A E JH @K?A@ E B JDEI IA?JE HA = @ EI J KF@=JA JDA =JE >A
6DA E@A=
OA@ E
JDA ? KHIA
>J=E E C
HA E B H
= ?A JD=
L= KA B EA
MDE?D ?=
H@AH
AJD @ B H = CELA
do (w)
JD=J MDE?D
H@AH EI % >A ?= ?K =JA@ = I >A @AJAH MI O E A@ AJD @ O = HA B E @K?JELA J AJD @ B JDA AJD @
1 (do (w)) =
6DA FH > A B H CELA EI JDA FJE = O B H CELA K F=HJ =JELA O I AJD @I M +B A= MEJD +=H =FI B H@AH B @ACHAAI A=IKHA
1 do (w) 1. do (w)
B IK??AII EI JD=J EJ ?= K AJD @ ?=
@ACHAAI
0A ?A JDA H@AH +
FJE
A B H JDA =?JK= IJ=JA @AI?HEFJE B JDA K ELAHIA EJ EI KIJ JDEI B=?J JD=J B H@AH @ JDA I J M=O J 1
MDE?D
+=H =F '#
c ?=
? HHA?JE
'
1B JDA K ELAHIA I?HEFJE =NE = F IIE> A JDAIA JM >A ? EI = FJE . H B FJE 6DA K EJA @
wn Q
= JDA
I=JEIBO = ?AHJ=E B E
FHA@E?=JA E E =
wn I
@ACHAA
FHA@E?=JAI
wn I @ACHAA
H@AH EI
ANJHA K
B = I=
B E @ELE@K= I ?=
B JDA IE A
JDA @
=E I EJ EI A=IO J
ME C E A ?=FJKHAI JDA
%
Corr(wn , a )
JDA I= F A B % EI =
EI JDA
AJD @ MDA
JDA @=J= ?
wn
a
FJE
EI JDA E EJE=
IEIJI
FJE
wn
K
0A ?A EB JDA I=
AJD @ B H JD=J IJ=JA @AI?HEFJE F O ?D= CAI JDA E @K?JELA A= I JD=J FHAIKFF IEJE F A ?= >A @A I A@
=H>EJH=HO I=
6DA K
%
!
wx J
? HHAIF
@J
JDA
FJE @ =N JDA A O HA =O
AJD @ B H JD=J IJ=JA @AI?HEFJE HA E B H =JE EI HA?AELA@ E A B H JDA =IJ ? E @K?JELA AJD @ ME
AJD @
a
9DA
xE
E C O 6DA KIJE ?=JE E @EJE => LA EI JD=J MDA HA=?J KF A AIJE = O DAJAH CA A KI AJD @ ?= = O K EB H =JA B H =
FH LE@A JDA I=
Qi
@EBOE C EJ E
@EJE
MAH E
x MDA
= ?
JDA HK A ? KIE
I => KJ
B JDA HK A E
6DA
=@@E C = ?=KJE
B=?J H MDE?D
1=
CH=JABK J
KEFAHI B H JDEI
>IAHL=JE
JA I KI D M JE % # ! %
%#
A ?=
2AHB H
M =I
= ?A
MDAJDAH JDA ? HHA?JE HK A JDA
KJH=
I JDA JDA
FJE A=
A=
HK A KF@=JAI JDA
+=H =F '# 6DA J=I ID M JD=J JDA AJD @ MDA IGK=HA AHH H F A EI =HCA A B H@AH
EI I
= AH JD=
JD=J
B = B
CELA
IJ= J
JDA I=
KCD B JDA I= ? F A =FFH =?DAI JD=J IJ= J AJD @ MDA A= I JD=J JDA ANFA?JA@ L= KA JDA
1J EI ALE@A J JD=J JDA ANFA?JA@ @ACHAA JDA K ELAHIA =I JDA IE A B B JDA I= FJE K KCD
ME
>A ?
IAH J
JDA
IE A
B JDA I=
F A EI =HCA A
FH @K?A@ >O
+=H =F FH LAI JD=J JDA A= IGK=HA AHH H =FFH =?DAI '# FF $& $' 0 MALAH JDA AI B J A?AII=HE O AGK= JDA IA J JD=J A= IGK=HA AHH H A F A = AI JDA EIIKA JA?D E?= O ? H@AH EI ? A= B B JDEI F E?=JA@ E @ B I=
= I I
0A ?A ALA ?EH?K
=> A J
=O >A => A J
ID M JD=J EJ = CELA
B = CELA
JD KCD =O >J=E ?
GK= E
>AH = I
AI >AJJAH JD= F AI A= I=
MDA JD=
x EI
=HCA A A
=JAI B H I
= AH I=
=JJAH =I MA
JDAH J ? A=H
M H@I JD=J ?D
B =HCAH KJE
F A IE A
1J EI
=J JDA
EI = = JDA E
IJ= J E @K?JELA
IGK=HA AHH HI
IA B ? HHA?JE C ?
JDA I=
F A IE A E ?HA=IAI =I ME
A J=J HI D=LA =HCKA@ JD=J B H JDEI HA=I =JJAH >KJ JDEI EI J =?JE C E JDA =IO AJD @ ) FJ JE? E
=JJAH MDA
AJD @I @
J E IEC E ?= J
>AH 5E
B E =H O
HA E =??KH=JA AIJE A ?=
=JAI JD=
JDA
FJE
A MDA
JDA I=
F A IE A
IJ= J
B = CELA AJD @ EI
1J EI ALA =
= AI EJ AJD @I M
M=> O
HA E =??KH=JA E = BAM
IJ= J
HA E =??KH=JA JD=
AJD @I = @
IGK=HA AHH H EI
F AI MDAHA
F A FHALE KI O
Xi
F A IE A
#
= @ B H JDA I= B JDA
x+1
JDA =
x + 1JD E
@ JDA =JE I BH
@ELE@K= J K AIJE
B JDA L=HE=> AI B H ?
Xi = HA=@O
A FH ?AII B H ?D
>J=E A@ B
IE@AHE C = IAHEAI
B I=
F AI EI J FJE K
FJE
>J=E E C E B H B FHA@E?JE
IE C JDA
A B H = IAHEAI AIJA@ I=
F AI JDKI D=I I
K =JELA IGK=HA AHH H HAFHAIA JI JDA J J= AHH H =JAI MDA M E A= IA?JE AM E @ELE@K= I =HA =@@A@ J % # " JD=J JDA B = B KJ E A= A= ?K JDA I=
= AI E F A
A@ =I JDA
F IIE> A ?K
IGK=HA AHH HI B H ?
= ?A
HA CA AH= B
MDA
7.5.3 JD=J JDAHA EI = JDAH M=O B AL= K=JE C H B JDA HK A MDE?D E ? K@AI JDA HAIJHE?
A >IAHLAI JD=J JDA L= KA B
1J DA FI J
Xi
?=
>A ?= ?K =JA@
>O ?
IA?KJELA = IMAHI J
JDA I=
F A
Qi
Qi AJ? 0A ?A Xi ?= >A HAFHAIA JA@ >O A= I L=HE=> AI 1i(1) , 1i(2) , ..., 1i(x) MDAHA 1i(y ) EI 1 EB JDA y JD E @ELE@K= EI Qi = @
E @ELE@K= E
B = IK JDAHMEIA
1i(y) = 0
% "
Xi =
y =1
6DA H= @ L=HE=> A B H JDA I= F A IE A
1i(y) .
>A ANFHAIIA@ =I
x + 1 n ?=
x+1
1i(y) =
y =1
0A ?A JDA L= KA B JDEI L=HE=> A EI
%
#
Xi
JE
JD=J JDA HK A F F AI
=O IJ=HJ J
F A EI =HCA A = ?A
KCD
IAA F E J AIJA@ I=
A=IKHA KIE C
%#
+ @I
LAHCA ?A
A=
IJ= J
AJD
6DA JDA ? ?=
HIJ IJAFI J M=H@ JDA AL= K=JE AJD @I ME B JDA HIJ AN= =I >A J= A A= E LAHCA ?A AJ KI
HK A =I ?
F=HA@ J A
IJ= J
E @K?JELA
@E CI
IGK=HA AHH H
E A JDA IEJK=JE
>A MHEJJA
<
x
. H =HCA L= KAI B
2 2 + 2 ri x ri . x2 + 2x + 2
%
$
JDA @A
+ IE@AH HIJ JDA ?=IA E MDE?D 1 B H = IKB ?EA J O =HCA x AGK= J x 1 B x + IE@AH JDA JDA ?=IA E MDE?D 2 MDE?D x ??KHI E JDA @A E =J H JDEI ?=IA ?B +=H =F '# 6DA F !! KIJ ? ? F $' IE@AH JDA ?=IA MDA 0A ?A J EJ $ JDA
2 E =J H B % $ EI =FFH NE =JA O AGK= J x 2 ri < 1 5E ?A % $ EI JDA =FFH NE =JA O EJI ? LAHCA ?A H=JA ?= >A ? F=HA@ J JD=J 2 ri =1 1B = 0
E M % JDA EJ ? B A= $ HA@K?AI J = B H AH E E
IGK=HA AHH H EI
LA JE B
B +=H =F '# EI A
L= KA
lim f ()
*AIE@A %
IGK=HA AHH H = I
f () MDA = B H = F=HJE?K =H x
=I
>A MHEJJA
+ 2
2
x 2 ( 2 + x 2
2x
2 x ri
2 ri
+ 1)
=
% %
1 2 x2 2
+ +
2 ri x r2 2 i 2x +1
.
JAH IE JDA @A
6DA
HIJ JM
E =J H JA @I J 0A ?A JDA MD
6DA
HIJ
A ANFHAIIE
2 1 ri 2.
!
%
&
6DEI ?
IJ= J EI JDA A= IGK=HA AHH H B H = 1 2 1B ri > % & EI CHA=JAH JD= AH 6DA HA =E E C ?=IA EI MDE?D % & EI AH =I +=H =F '# F $' = I FH LAI
2 ri =
1 E
%#
%# 1 JM E
F=HE C JM
IJ= J
A=
AJD @I
IGK=HA AHH HI A= IGK=HA AHH HI = J B 1 x2
=H>EJH=HO ?
IJ= J
HIJ AN= E A JDA ?=IA E MDE?D 1 , 2 < 2 1B ri = 1 = @ 1 = 0 = @ 2 > 0 JDA A= IGK=HA AHH H MEJD 1 EI 0 1 = @ ? LAHCAI J AH =J = H=JA FH F HJE = J MEJD 2 DA ?A JDAEH @EBBAHA ?A x2 1 ? LAHCAI J AH =J = H=JA FH F HJE = J x2 2 1B ri = 1 = @ 1 , 2 > 0 JDA JDA A= IGK=HA AHH HI B > JD 1 = @ 1 2 ? LAHCA J AH =J = H=JA FH F HJE = J x A= I JD=J JDA @EBBAHA ?A 2 MDE?D >AJMAA JDA ? LAHCAI =J A=IJ =J JDEI H=JA 2 6DA =IIK A JD=J ri < 1 + IE@AH JDA ANFHAIIE % $ B H JDA A= IGK=HA AHH H MDA
AA@I J
KJ JDA H=JA
B?
LAHCA ?A
x
1J EI
2 1
2 + 2 ri x 1 (1 + x)2
2 ri
2 2
2 + 2 ri x 2 (2 + x)2
2 ri
%
'
IGK=HA AHH HI E 1J EI = I
MDE?D EI FH F HJE
2 1
2 2 2 + 2 ri + 2 ri 1 2 (1 + x)2 (2 + x)2
% !
x
EI D M B=IJ JDA @EBBAHA ?A
1 (1 x
2 ) ri i
x2 1 (1 2 (1 + x) x
2 ) ri i
x2 (2 + x)2
% !
1 = (1 x
$
x2 x2 2 ri )[ ] (1 + x)2 (2 + x)2
A B H ALAHO @EIJHE>KJE B
I=
F A JDA HAIK J %
= I
=
>A
EI JDA I=
FHA@E?=JAI E
JDA
>J=E A@ @EHA?J O BH
JA@ >O
JDA ANFHAIIE
"
% !
LAHCAI J
AH
= J
1 x2
2 (2 1 ) x
? LAHCAI E FH F HJE = J J IFAA@ FH F HJE EI = I IGK=HA AHH HI 6DA HA AHH H 1B B
% !!
x
6DA JDA A=
=E E C ?=IA EI MDA
% & EI 0 MEJD 1 = @ JDA A= IGK=HA AHH H B 2 ? LAHCAI E 1 FH F HJE J IAA IA?JE % # => LA 0A ?A JDA @EBBAHA ?A >AJMAA 1 = @ x 1 2 EI ? LAHCAI J AH E FH F HJE J x 1 2 1B IJ= J i ri > >O % & JDA A= IGK=HA AHH H B 1 = EI = F IEJELA ? 1 MDE?D ?= >A @A JA@ >O c 6DA A= IGK=HA AHH H B 2 < EI FH F HJE = J x + JDA @EBBAHA ?A >AJMAA JDA A= IGK=HA AHH H 1 1 EI =FFH NE =JA O c B H =HCA L= KAI B x 5E ?A JA @I J x x 1 ? LAHCAI J c MEJD JDA IFAA@ FH F HJE = J x IE@AH JDA B
1 EI % 1 2 i ri =
1 =
2 <
= @
MDE?D
AH
JDA @EBBAHA ?A
%#!
+ @I
F=HE C JDA
HK A = @
FJE
IJ= J
AJD
JD=J
KH FKHF IA EI J AJD @
= ?A
F=HA@ J
E @K?JELA AJD @
EI MDA B
B JDA
= O ALE@A ?A =
F=HE C JDA FAHB H = ?A B = @ = FJE K ? 2 = 1 1 JDEI ?=IA ALAHO I= F A KIJ >A K EB H ri KIJ >A 1 =BJAH >IAHLE C = I= F A B =J A=IJ A E @ELE@ FHE H AJD @ a E % ! =JJAHI O B H JDA AIJE =JAI @ JDA FKHF IA B JDA HK A EI J J FH LE@A CKE@= ?A B H
#
B = ?
IJ= J B
AJD @
=JA FHE H J
JDEI EI
IEJK=JE K
= 0
= ?A EI AGK= J JDA B
JD=J
AJD @
F E?=JA@ EB
2 ri < 1
6DEI ?=IA ME
ME C IA?JE
%#! 5
A FHA E A
wx EB
JDA MD
A =IIK
AI = F=H A= I
JE?K =H @ACHAA B H= @
F A EI IA A?JA@ >O
JDA F FK =JE
A K ELAHIA
wx EI
E (do (wx )) = E (
i
[R(wx , i)]2 ) =
% !"
i
1 JDA => LA
Xi2 E( 2 ) x
F A= @
1 x2
E (Xi2 ).
i
JDA
wx EI = I=
iC
AI JDH KCD =
2 2 E (Xi2 ) = xri (1 ri ) + ri x,
KIE C % & = @ % ' MDAHA ri EI JDA HA =JELA BHAGKA ?O 0A ?A >O % !" B Qi E JDA MD
% !$ A K ELAHIA
E (do (wx )) = = = =
1 x2 1 x
2 2 x] [xri (1 ri ) + ri
1 ri + (1 ) x
2 ri i
2 ri i
% !%
1 1 + (1 ) x x
1 2 ri + (1 x
2 ri )
2 ri . i
$
1J EI E JAHAIJE C J
H@AH
B JDA MD B H@AH
A K ELAHIA ?= B JDA I= F A
>A
wx
% !&
2 ri = i
%#! 4A?= FJE JDA 1 FH >=> A I= EJE % B ! F AI B JDA
1 E (do (wx )) x . 1 1 x
JDA @A K HK A A
HK A 6DA F A K
HK A OEA @I =
JDA >=IEI
>J=E A@ AJD @
= F=HJE?K =H @ACHAA
H@AH MDA
JDA I=
F A IE A CH MI MEJD KJ =
>LE KI O JA @I J F A IE A
IE@AH = I=
xE
MDE?D
|
B H = CELA EI ? EI BK IAH J @ACHAA A B
2 ri d1 |,
@EJE A= I JD=J
% !'
H@AH B
6DEI ?
E (do (wx ))
@EJE
JDA @ACHAA
H@AH
A K ELAHIA JD=
d1
9DA
JDA ?
>A BK A@ B H = I= F AI 2 =HCAH JD= x =I MA IE ?A E (do (wx )) ME >A ? IAH J i ri MDA x E ?HA=IAI 1J 2 EI = I ? A=H JD=J JDAHA EI IK?D x JD=J % !' D @I B H = =H>EJH=HO d1 = i ri 6DA FAHB H J JD=J B = ?A B
A@ B H I
EJ EI ? A=H BH
% !% JD=J EJ ME
JAH
A=
IGK=HA AHH H ME
>A ?
F=HA@ >A
= 1 (d1 ).
% "
AJ
d1 >
2 i ri EJ D
@I JD=J % "
d1 <
2 i ri EJ D
@I JD=J
(x)(
2 EJ B d 1 > i ri 2 ?=IA d1 < i ri 2 d1 | | i ri
1B H@AH
2 +( ri i
MI BH
2 d1 ) E (do (wx )) ). ri
% "
% " JD=J
5E ?A E
E (do (wx ))
2 i ri 2 i ri EJ B
d1 |
MI
+ M BH
IE@AH JDA
JDA
% " JD=J
% " = @ % " EI JDA B ME C + IE@AH = @ACHAA B 2 2 d | 6DA @EIJ= ?A B d2 BH r 1 i ri i i 2 EI JDA >LE KI O =J A=IJ 5KFF IA HIJ JD=J d2 < i ri *A?=KIA E (do (wx )) 2 2 MI JD=J |d2 E (do (wx ))| D @I 5KFF IA JDA JD=J d2 > i ri i ri EJ B
d2
B H MDE?D
2 i ri d2 | |
%
1B
% " >LE KI O A J=E I |d2 E (do (wx ))| JDA JDAH 2 2 2 D= @ EB d1 < i ri JDA d2 i ri + ( i ri d1 ) MDE?D J CAJDAH MEJD % " A J=E I d2 E (do (wx ))) B H JDA I= A x B H MDE?D % " D @I 2 2 0A ?A EB | A d2 JDA @EIJ= ?A B d2 i ri d2 | | i ri d1 | B H I BH E (do (wx )) EI =J A=IJ B H I A x = @ JDKI ? A=H O B H = y > x >A?=KIA 2 % E (do (wx )) =FFH =?DAI i ri MDA x E ?HA=IAI + IE@AH M JDA FH >=>E EJO
d1 >
2 i ri JDA
% "!
1 b2
% ""
b>0=
@ =
x JDA FHA?
D
@EJE IE@AH=JE
A@
)I FH >=>E EJO % "! EI K @AH ? +DA>O?DALI 1 AGK= EJO = I 1J ME >A FH LA@ >A = J =J = IFAA@ FH F HJE AJ =I ?D IA
@I JHELE= O B H = O b B H MDE?D
ar(do (wx )) = bV
bI
JD=J
M E % # ! $ JD=J V 1 MDA x x
ar(do (wx )) ?
EI I=JEI A@
b V ar(do (wx )) = b=
V ar(do (wx ))
JDA I= A H=JA =I
% "#
6DA
b2 E
?HA=IAI =J = OJ
J AII JD=
V ar(do (wx )) ?
LAHCAI E A = J
=J
x
? LAHCA =J = H=JA MDE?D EI FH F HJE MI JD=J % "! D=I J B ?
MDE?D EI FH F HJE
b =>
do (wx )
MD IA @EIJ= ?A BH JDA I=
E (do (wx ))
EI =J
F A IE A CH MI
%#!! + IE@AH
B JM
JOFAI
B B
AJD @ H@AH
wx
MD IA @ACHAA
do (wx ) I=JEI
AI % "$
JA JD=J B H I
>KJ JDEI @ AI
?=
EB
2 i ri
d3 | < |
2 i ri
&
IA?JE
%#! B
JD=J JDA FH >=>E EJO B JDEI E @ B I= F A 1 = J x H@AH MD IA @EIJ= ?A BH E (do (wx )) EI AII
wx G (x)
A JE
(a , x, wx ) EI ?
FJE F K
IAH J
AJD @ ? HHAIF A= K
@A?HA=IAI MDA
A@E=JA O >LE KI JD=J JDA AHH H EI = @A?HA=IE C BK ?JE B JDA @EIJ= ?A >AJMAA = @ IE ?A JDA H=JA B @A?HA=IA =O >A @EBBAHA J @AFA @E C MDE?D IE@A EI =FFH =?DA@ BH 0A ?A MDA B H I A EJ D @I JD=J < < H < < ?= >A IK?D JD=J ALA EB | | < | | JDA A= IGK=HA AHH H B EI CHA=JAH JD= IK?D = ?=IA JDA ? IJ= J E % " ME >A ?D IA o I JD=J d1 ?= >A HAF =?A@ >O ( ) I=JEIBOE C JDA B ME C ? IJH=E J B H = EB | | < |o | JDA A= IGK=HA AHH H B EI I = AH JD= JD=J B 5E ?A 1 JDA A= IGK=HA AHH H ? LAHCAI FH F HJE = OJ B H= < A=?D IE@A B x o EJ EI FHAIK A@ DAHA JD=J ?= >A ? IE@AHA@ H KCD O ? IJ= J B H A=?D x JDA I= A B FJE @EI?KIIE I = AH MI JHELE= O E K JDA ?=IA J? JD=J B
AEJDAH BH
IGK=HA AHH H EI ? A=H O = @A?HA=IE C BK ?JE B JDA @EIJ= ?A >AJMAA = @ & 1B 0 < < D @I JDA A= IGK=HA AHH H @A?HA=IAI MDA =FFH =?DAI >A M H BH => LA >KJ EJ EI J E
@ AI
LAHCA J
= >A?=KIA JDA
AH IJ= J
A=
B IK?D E JDEI
A J @ AI JDA ? E
=@DAHA J
d1
JDA @AHEL=JE
1J ?=
G (x) JDA ? HHAIF @E C L= KA B FH @K?AI = 6DA L= KA B () >A CI J G (x) MEJD = FH >=>E EJO MDE?D EI =FFH NE =JA O 1 1 x B H =HCA x AJ KI ? F=HA JDA ANFA?JA@ A= IGK=HA AHH H B MEJD JD=J B 1 JDA @AHEL=JE I >A M JDA L= KAI B < B H MDE?D () G (a ) ME >A @A JA@ >O 1 (a ) = @ JDA HAIJ B JDA L= KAI >O 2 (a )
IGK=HA AHH H JD= 1B JDA E AGK= EJO
wx
1 2 (Q Err, (x, a
2 ) Q Err,1 (a ) (x, ri 2 ) ri
E C
2 )) + ri i 2 )) > 0 ri i
% "&
2 Q Err,2 (a ) (x,
%#!
B IA?JE
'
@I B H I B
A ?=H@E = EJO
x=
@ A=?D L= KA AH 6DEI E
1 (a ) =
2 (a ) I=JEI
A= IGK=HA A=
JDA
= @
IGK=HA AHH H
x
2 ri )) > i 2 ri ))). i
@EI?KII JDA % "'
6DA ANFHAIIE
>A MHEJJA
=I
Q Err, (x,
2 ri ) Q Err,2 (a ) (x, 2 ri )) i
1 2 (Q Err,1 (a ) (x, a
1B ?=IA 1
2 Q Err,2 (a ) (x,
KCD
JDEI D
@I JHELE= O B H =HCA A MI
AJ KI JDA
MD=J B
=
% #
U (a , x) = Q Err,1 (a ) (x,
= @
2 ri )) Q Err,2 (a ) (x,
2 ri )) i
V (a , x) = Q Err, (x,
MDE?D CELAI
2 ri )) Q Err,2 (a ) (x,
2 ri )), i
% #
U (a , x) V (a , x) = Q Err,1 (a ) (x,
IE ?A MA EI CHA=JAH JD= FH F HJE H=JA 1J B = OJ O AA@ J ? H AGK= J JD=J
2 ri )) Q Err, (x,
MDE?D JDA %# B JM
i
A=
2 ri )) 0
IGK=HA AHH H
% #
B 1 (a
EJ M=I @A AJD @I ?
@EBBAHA ?A >AJMAA
1 , 2 < ?
U (a , x) V (a , x) +
B H I A ? IJ= J
c 1 1 c U ( a , x ) V ( a , x ) + . x2 a a a x2
=HCA A KCD
% #! @EJE I
= @ =
AJ KI JDA
AN=
E A JDA ?
K @AH MDE?D
V (a , x) >
D @I 5E ?A
c 1 V (a , x) + , a a x2 c (a , x)
% #"
V (a , x) 0
a >1+
x2 V
% ##
V (a , x)
IJ= J MI JD=J
? K
= O J A
1 U (a , x) < V (a , x). a
0A ?A A KCD JDA E AGK= EJO % "' D @I B H I A
% #$ =HCA
=JJAH JDA
B JDA @EBBAHA ?A A A= F AI B
F AI = HA=@O A D=I J
wa
= ?A ?HEJAHE
J JDA
IGK=HA AHH H B H I=
x>a
1 IJA=@ I B
A= I JD=J B H AN= @E C J
wa B MEJD JDA JM
@E C J
J HA@K?A@ =M=O BH M B H @A
% "& = @ =
AGK=JE
% "' EI JDKI
F AI OEA @E C
1 (a ) =
2 (a ) =I
% "'
JDA AGK=JE
? HHAIF
@E C J
% #%
2 B JDA =JJAH I= F A E A wa ? HHAIF @E C J 2 (a ) EI 2 r =IIK A@ J >A ? IAH J HA?= JD=J JDA ?=IAI E MDE?D 1 (a ) ? IAH J JDA i i FJE K AJD @ JD= 2 (a ) ?= >A ABJ KJ BH KH ? IE@AH=JE I JDA I= F A 2 1 wa FH >=> O HAIA > AI JDA K ELAHIA HA JD= wa =J A=IJ B H =HCA a 0A ?A EJ ?= >A =IIK A@ JD=J JDA =@@EJE = JAH B JDA B H % #% EI F IEJELA = @ A ?=
JDKI =@DAHA J 4A?= JDA AGK=JE % "' @E A@ >O JDA ABBA?JI B JDA AIJE B JDA JM B I= F AI = JDA B H K = % B H JDA AHH H =JA % MEJD HAIFA?J J
Qi 1J B MI BH Q FHA@E?=JAI EI
MEJD HAIFA?J J
1 =
1 Xi + ( ri )2 . x + i=1
= @ AJ F A
% #&
Ai @A
JA JDA =>I
KJA BHAGKA ?O
Qi E wa
Yi >A = H=
L=HE=> A
B H JDA ? HHAIF
@E C BHAGKA ?O E
JDA F=HJ ME C B H
B JDA I=
J ? LAHA@ >O
wa
6DA
1 Ai + Yi + ( ri )2 . x + i=1
% #'
6DA ANFHAIIE
% #' AGK= I
1 1
+
(
i=1
1 Yi + Ai + ri )2 = x+ x+
% $
1 1 Yi + Ai 2 Ai Yi + ) +2 ( ri ) + ( ri )2 ]. [( x+ x+ x+ x+ i=1
HIJ JAH I E JDA ANFHAIIE B H K @AH JDA IK @ =JE IEC
6DA @EBBAHA ?A
>AJMAA
B JDEI B H
1 < =
2 < EI
% $
(
B H JM
A1 A2 i i )2 ( )2 x + 1 x + 2
@EBBAHA J I= F AI 1J EI ? A=H JD=J JDEI @EBBAHA ?A ? LAHCAI =J = H=JA FH 1 F HJE = J + IE@AH JDA JDA IA? @ JAH K @AH JDA IK =JE IEC 5E ?A x2 JDA =NE K =>I KJA L= KA B
1 Yi + ri x+
EI
1 JDA ? 1 < =
LAHCA ?A H=JA @
2 < B
H =HCA
x @AFA
@I
2 2 A1 A2 A1 x + A1 i i i 2 Ai x Ai 1 = i , x + 1 x + 2 (x + 1 )(x + 2 )
MDE?D ? JAH FH F HJE LAHCAI E FH F HJE
% $!
B JDA IA? @ B H A= IGK=HA AHH H B H < ? LAHCAI E 1 J J E CA AH= ? LAHCA J AH EJ = JD KCD JDA IGK=HA AHH H @ AI x I ?HA@E> A JD=J = JAH B JDA IA? @B H E % #' ? LAHCE C FH F HJE = O J =BBA?J JDA ? B JDA B H =E E C JAH J E ? K@A@ E E LAHCA ?A H=JA JKH B JDA @EBBAHA ?A >AJMAA JDA A= I B % #' CELAI JDA IGK=HA AHH H B H JDA F=HJ 1J B B JDA I= F A JDA
1 x 5E ?A JDA
J
6DEI EI = I
JDA ?
LAHCA ?A H=JA
6DA HA
Ai i = 1, ...,
ANFA?JA@ L= KAI B AHH HI B JDA B H % #' B H 1 < = @ 2 < @A?HA=IAI E 1 5E ?A JDA HAIK JI MEJD KJ =IIK E C JDA I= F A wa A=H EAH E JDEI FH F HJE J x2 IA?JE = I >J=E =JJAH JDA =C EJK@A B JDA @EBBAHA ?A >AJMAA JDA AHH HI =J
JDAO ?=
6DA
(a , a , wa ) = ?=IA
MDE A >AE C ? IAH J
JDA ?=IA MEJD JDA I= F A wa 1 EI D= @ A@ >O IE F O @A? =HE C AJD @ J >A KIA@ >AE C JD=J MDE?D EI ? IAIJ J
do (wa ) = =
JD=
6DEI EI =
=@ D ? I
KJE
>KJ
@A
IJH=JA@ JD=J
@E C JDA L= KAI
= @ =HCA A
6DA >A A
A x = @ JDA
(a , a , wa )
6DA
IGK=HA AHH H
B E @K?JELA
AJD @I M K @ JDA
>A I
= AH JD=
6DA ?
JDAH GKAIJE
FH ?AII =J
(a , a , wa ) @
J BK O
=J?D JDEI E@A= 0 MALAH @KA J JE K KI KF@=JE C J >A =@@HAIIA@ E JDEI IJK@O
B MDAJDAH JDA ?
>AJJAH JD=
ME
%#!" A ?= B H
.E @E C JDA I= ?D IA JE
F A IE A KIA JDEI F B
a =
A@ E
KF J
= @ =J JDEI @ J
(a , a , wa ) B A
AJD @ B H ?
6DEI ?
>E =JE
JDA CA AH= E A@
JELA IA IA
B = ?
FKJ=> A HK A ` @ AI
0 MALAH B H
A L= KAI B H
= @
MDE?D =HA
A=IJ F IIE> A L= KAI 6DA @EB ?K JO DAHA EI JD=J JDA @EBBAHA ?A >AJMAA EI F IA J M B H = CELA B K AHE?= L= KA B JDAH D= @ JDA B H M A@CA
K =JE B JDA CA AH= E J FHAIKF 2 2 r r EB M=I M=> A JDA MD A FH > A B ?D IE C i i i i JDA FJE K E @K?JELA AJD @ M K @ L= EID ALAHJDA AII JDA I= F A IE A KF J 2 MDE?D A KIJ =@DAHA J ?= J >A ?= ?K =JA@ MEJD KJ A= I JD=J i ri 6DEI 2 r A D=I J =IIK A JD=J d1 E % !' @EBBAHI BH =J A=IJ MEJD I A Y >0 i i 7 @AH JDAIA ?EH?K IJ= ?AI EJ IAA I F IIE> A JD=J = HK A B H ? FKJE C JDA E C JDA => LA HAGKEHA A JI ?= >A B H K =JA@ IK?D JD=J EJ 2 @ AI J? J=E A =@@EJE = M H EI HAGKEHA@ i ri =I = F=H= AJAH = JD KCD I J >J=E EJI AN=?J B H K =JE 2 0 MALAH EJ EI F IIE> A JD=J E HA= EJO |d1 i ri | < Y D @I E A d1 EI ? IAH J JDA @ACHAA B H@AH B JDA K ELAHIA JD= Y 6DA FH ?A@KHA B ?= ?K =JE C a = @ x B @A B H JDA >=IEI B Y JDA (a , a , wa ) EI IJH=> O FAHB H I >AJJAH JD= @ AI J OEA @ = ? HHA?J HAIK J = @ JDA ANFA?JA@ FAHB H JD=J B = ?A J >AJJAH JD= = >AJJAH JD= L= KAI B
= @
x BK
B H I=
F AI CHA=JAH
H AGK= J
x
J
=H>EJH=HO
JDA CA AH= E A@
HK A @ AI
ALAHJDA AII EJ ?=
B H MDE?D
| ( )
2 ri | Y,
% $"
!
Y EI = =H>EJH=HE O I = AH =JKH= K >AH 1 JDAH M H@I EB JDA ?D IA a = BK I JDA => LA ? @EJE JDA CA AH= E A@ HK A ME FAHB H >AJJAH JD= >IAHLA JD=J JDA CA AH= E A@ HK A @ AI J A?AII=HE O FAHB H >AJJAH JD= ALAHO AJD @ B H MDE?D % $" D @I 6DA HAIK J =HCKA@ B H DAHA ?= D @ O B H = B H MDE?D a = JDAHA =O ?AHJ=E O = I >A JDAH AJD @I B H MDE?D % $" D @I = @ MDE?D =HA E =@@EJE ? IAH J JDA FJE K AJD @ JD=
D @I MDAHA 6DAHAB HA EJ EI = F=HJE?K =H 6 IK O =HCKA@ DAHA JD=J MDA JDA CA AH= E A@ EJ CELA = K = AHE?= L= KA JDA B A @A E>AH=JAI => KJ MDAJDAH J I >AJJAH JD= JDEI KIA
HK A FAHB H
>A FHABAHHA@ J
HK A EI
EI BK O B H @EIJ= ?A BH I = JD= EI
AJD @ MDE?D D=I =J A=IJ = CELA >A =H>EJH=HE O I >AJJAH = A O JDEI IAJ
0A ?A EJ ?= = O CELA J M K
E @K?JELA
=H>EJH=HE O I
JDA IAJ
B JDA K ELAHIA EI
%#!#
6DA E LAHIA E BAHA ?A FHAIA JA@ = B JDA =HCK A J E B=L KH ? >AJMAA B JDA CA AH= E A@ JDA
HK A
6DEI IA?JE
IJ=JEIJE?= E BAHA ?A BH
HK A @ AI I= M
= CELA ) MA ME C CELA
F AJ
= H= @ JDA MD EJAH=JKHA I= E
Q EI rx
E JAH JDA I
Q D=I = BHAGKA
?O MDE?D EI MEJDE
A CELA
rx
A F FK =JE
'
I FDE?=
@EHA?J E BAHA ?A E
JH=IJ J
=> KJ = H= @ A J=JE
F A >=IA@ B
6DA =H JDA K E
JDA IA IA JD=J
E C = O F=HJE?K =H
A J . H AN=
8=HE KI B H % & I
F A JDA @AJAH
FF
"
E @K?JELA E BAHA ?A
AJD @ E A ?=
= CELA
K ELAHIA = @ I=
F A IE A EI >=IA@
) JD KCD EBA = O ? JE I ?
H=EIA @ K>JI => KJ MDAJDAH = I= F A ?= >A M J >A = H= @ A F FK =JE =JE? JD= JDA MD
F A EI ALAH H= @
E LAHIA E BAHA ?A E
J =JJHE>KJA FH FAHJEAI J
HA =JELA BHAGKA ?O
Q rx
EI ?
IA J
rE
JDA I= EB J
F A
wx
1B B
E JKEJELA O KIJE A@ J
x EI =HCA EJ Q KIJ = I
rx
JDA MD
wu
0 MALAH EJ EI MA I =I ?=
P (ru r|rx r) =
P ([ru r]&[rx r]) = P (rx r) P ([ru r]&[rx r]) P (ru r) = P (ru r) P (rx r) P (rx r|ru r) P (ru r) . P (rx r)
?O B
% $#
0AHA
QE
JDA MD
A K ELAHIA
wu =
@ % $$
P (rx r|ru r)
? HHAIF @I H KCD O J O =IIK JDA FH >=>E EJO @AHELA@ E +=H =F '# ?B IA?JE JDA F FK =JE 1B % $$ EI CELA >O % $# >KJ =HA M `= @E A ?= = A JDA E LAHIA E BAHA ?A J E C JD=J JDA FHE H FH >=>E EJEAI J >A @EI?KIIA@ E
% !
E KIJH=JA@ @
P (ru r) =
>AJMAA
P (rx r) JDA HK A
6DA ? =E I
V ar(do (wx ))
? = J
>IAHLA
x =J
HIJ JD=J
A=IJ =J = IFAA@
LAHCA ?A FH F HJE
LAHCAI J M=H@ 1 x
% $%
#
6DEI AGK= I
E ([
i
+ IE@AH JDA HIJ JAH => LA
Xi 2 2 ) ] ) [E ( x
A >J=E I
(
i
Xi 2 2 ) )] . x
% $&
E ([
i
Xi 2 2 1 ) ] ) = 4 E( x x 1 2 )= 4 Xi2 Xj x
E % $&
Xi2
i i
Xi2 ) =
2 ). E (Xi2 Xj
% $'
1 E( x4
+ IE@AH JDA JDA IA?
@ JAH
[E (
i
Xi 2 2 1 ) )] = [ 2 x x
E (Xi2 )]2 =
i 2 E (Xi2 )E (Xj ).
% %
1 x4
5K>IJEJKJE E
E (Xi2 )
i i
1 E (Xi2 ) = 4 x
% %
% $& OEA @I
V ar(do (wx )) =
1 [ x4 =
2 E (Xi2 Xj )
2 E (Xi2 )E (Xj )] i j
% %
1 x4
% %!
|E (XY )|
0A ?A
E (X 2 )E (Y 2 ).
% %"
2 |E (Xi2 Xj )|
4 E (Xi4 )E (Xj )
% %#
1J B
MI JD=J
4 E (Xi4 )E (Xj )
x ?=
E
A= I JD=J ALA % % JA @I J
L= KAI JD=
JA = I = I B
AH
H F IEJELA AJ KI
0A ?A EJ
6DA B=?J H
% %
M ID M JD=J
% %%
x =J = H=JA
@I EB
B ?
= J
1 x
1J
1 1 4 2 2 E (Xi4 )E (Xj ) 8 [E (Xi2 )]2 [E (Xj )] = 8 x x 1 1 1 1 4 2 2 E (Xi4 ) 4 E (Xj ) 4 [E (Xi2 )]2 4 [E (Xj )] 4 x x x x
JA @I J AH =J JDEI IFAA@ B ? LAHCA ?A AJ M
% %&
a=
1 2 b = E (Xi2 )E (Xj ? IE@AH JDA ? LAHCA ?A B )0= @c= x 4 6DA 2 2 2 2 c (a b ) = c (a b)(a + b) = (ca cb)c(a + b) 6DA B=?J H c(a + b) AGK= I
4 E (Xi4 )E (Xj )0
% %'
4 4 2 6DEI ANFHAIIE @ AI J JA @ J AH K AII E (Xi ) H E (Xj ) EI AH = @ E (Xi ) 2 H E (Xj ) EI AH E MDE?D ?=IA EJ EI JHELE= JD=J % %% ? LAHCAI J AH =J A=IJ 1 1B JDEI EI J JDA ?=IA JDA ANFA?JA@ L= KAI E % %' KIJ >A =J JDA H=JA B x @AJAH E A@ >O JDA FH F HJE I B JDA ? HHAIF @E C Q FHA@E?=JAI E JDA K ELAHIA
MDE?D ? A=H O A J=E I JD=J % %' @ AI KIJ ? LAHCA J HA LAH AH LAHCA J M=H@ AH 0A ?A (ca 1 = @ JDA @AIEHA@ HAIK J >J=E I x >IAHLA JD=J B H =H>EJH=HO a, b, c, d EJ D @I JD=J J? =J A=IJ =J JDA H=JA B
cb)
ab cd = ab cb + bc cd = (a c)b + (b d)c.
0A ?A MDA ?
% &
IJ= JI EB (a c) 0 = @ (b d) 0 =J = H=JA B 1 = @ b h1 , c h2 JDA (ab cd) 0 =J = x 1 1 1 4 4 IFAA@ B ? LAHCA ?A FH F HJE = J AJ M a = 4 E (Xi ) b = 4 E (Xj ) x x x 1 1 2 2 c = x4 [E (Xi2 )]2 = @ d = x4 [E (Xj )] 1B MDA x =HA ? LAHCA ?A FH F HJE = J
h1 , h2
% &
1 1 4 2 2 E (Xj ) 4 [E (Xj )] 0 4 x x
%
% &
B ? A ?
LAHCA ?A FH F HJE = J
= J
CA ?A FH F HJE
IJ= J K >AHI JDA 1 MDE?D A= I JD=J % % JA @I J AH =J A=IJ = IFAA@ B x 1 ? LAHCA ?A FH F HJE = J x = 1J JDKI D=I J >A ID M JD=J % & D @I =J = IFAA@ B ? LAHCA ?A FH F HJE 1 1 1 4 2 2 J B H = =H>EJH=HO i = @ JD=J 4 E (Xj ) = @ 4 [E (Xi )] =FFH =?D I A? IJ= J x x x K >AHI ?A JDEI D=I >AA FH LA@ EJ D=I ? A=H O >AA ID M JD=J % $% JA @I 1 J AH =J JDA IFAA@ B ? LAHCA ?A FH F HJE = J x + IE@AH HIJ JDA JAH E (Xi4 ) 2 A ?= ANFHAII Xi >O KIE C E @E?=J H L=HE=> AI 1y EI KIA@ =I ID HJ B H 1i (y )
(
y =1
MDAHA
1y )2 =
y =1 x y =z x
= @
12 y +
y =z
1y 1z =
y =1
B=
1y +
y =z
MDAHA
1yz , y=z
1J B
% &!
1y 1z = 1yz
1yz
EI JDA IK
1yz
MI JD=J
Xi3 =
=(
y =1 x
1y ) =
y =1 x
1y (
y =1 x
1y +
y =z x
1yz )
% &"
1y +
y =1 y =z
1yz +
v =1
1v
y =z
1yz .
6DKI
Xi4
=(
1y ) =
y =1 x y =1 x
1y (
y =1 x
1y +
y =z x
1yz +
v =1
1v
y =z
1yz )
% &#
= Xi2 +
v =1
+ IE@AH JDA =IJ JAH
1v
y =z
1yz + (
u=1
B JDA =IJ B H
1u )2
y =z
=> LA
1yz .
(
u=1
A B EJI B=?J HI EI
1u )
2 y =z
1yz .
% &$
1u
u=1
MDE?D = I AGK= I JDA
1yz ,
B % &# -=?D JAH
% &%
x y =z
1h
1yz
@AFA @E C
MDAJDAH
h AGK= I A B y H z H J 1B h = y H h = z 1h EI HA@K @= J E JDA JAH 1h 1y 1z + IE@AH M JDA JAH I E % &% B H MDE?D JDEI D @I . H h = y h = z E % &% JDA HAIK J B K JEF OE C x y =z 1yz >O 1h EI
x x x
1hz +
z =h
6DA HA AGK= I =E E C JAH I
1yh = 2
y =h y =z
B JDA B H
1yz .
x v =y =z
% &&
B % &% =HA
1vyz
DA ?A
% &%
2
y =z
6DA K JEF E?=JE
1yz +
v =y =z
1vyz .
=E E C B=?J H B % &$
% &'
x u=1
1u
CELAI
1u (2
u=1 x y =z
1yz +
v =y =z x
1vyz )
x x
% '
=4
y =z
6DA FH ?A@KHA B H ? A=?D
1yz + 2
v =y =z
1vyz +
u=1
E
1u
v =y =z
1vyz .
E E=H IAA => LA
% ' EI B=
1vyz
>AE C ? K JA@ E
HIJ MEJD
1v
JAH
JDA
MEJD
1z
B
6DA HAIK J EI
>J=E A@ MDA
I MDAHA
1y = @ = O MEJD u = v = y = z 1J
4
y =z
9DA
1yz + 2
v =y =z
1vyz + 3
v =y =z
1vyz +
u=v =y =z
1uvyz .
% '
Xi4 3
=
x
Xi2
+2
y =z
1yz +
v =y =z x
1vyz + 4
y =z
1yz + 2
v =y =z
1vyz +
% '
1vyz +
v =y =z x u=v =y =z x
1uvyz =
x
Xi2 + 6
y =z
1yz + 6
v =y =z
1vyz +
u=v =y =z
1uvyz .
'
AJ KI F &
M FH ?AA@ J >IAHLA 5E ?A
?= ?K =JA
HIJ JD=J
1y = 1i (y )
1y
= @
1 E (Xi4 ) MDE?D M=I IAJ =I JDA > A?JELA x4 = P {1y = 1} = ri HA?= JDA =>>HALE=JE
@A J EB
y=z
% '!
E (1vyz ) =
@ B
B IAGKA ?AI
E (1uvyz ) A CJD k BH x! . (x k )!
JDA F FK =JE
xAA
A JI EI % '"
0A ?A
A ?=
B H
FH @K?JI
B JDA B H
11 ...1j
MDA
jx
x! (x j )!
A JDKI
1 1 x! x! x! 2 3 E (Xi4 ) = 4 (E (Xi2 ) + 6 ri +6 ri + r4 ) = 4 x x (x 2)! (x 3)! (x 4)! i 1 1 1 1 2 3 2 3 E (Xi2 ) + 6( 2 3 )ri + 6( 2 + 3 )ri + % '$ 4 x x x x x x 11 6 4 6 . (1 3 + 2 )ri x x x
1J EI ? A=H BH M JDEI JD=J % '$ ? A ?= FH ?AA@ J LAHCAI J M=H@ = ? IJ= J K >AH ?= ?K =JA % & *O % !$ % '%
1 1 2 2 2 (E (Xi2 ))2 = 4 (xri (1 ri ) + ri x) 4 x x 2 3 1 2 4 (1 ri )2 + ri (1 ri ). = ri + 2 ri x x 4 9DA x % '% JA @I J ri MDE?D EI = ? IJ= J K >AH 0A 1 1 2 2 4 F & =HA I=JEI A@ JE I? ?AH E C 4 (E (Xi )) = @ 4 E (Xi ) x x
AJ KI FH ?AA@ J ID M JD=J % & D @I 1 1 2 2 2 *A?=KIA 4 (E (Xi )) = 4 (xri (1 ri ) + ri x ) % '$ HA@K?AI J x x
?A JDA ?
@E
1 1 1 1 2 3 2 3 2 2 (xri (1 ri ) + ri x ) + 6( 2 3 )ri + 6( 2 + 3 )ri + 4 x x x x x x 6 11 6 4 (1 3 + 2 )ri = x x x 1 2 1 4 4 3 2 3 3 2 ]+ ] + 2 [ri + 11ri [ri ri 6ri + 12ri 6ri + 6ri + 18ri 3 x x 1 3 4 4 . [6ri 6ri ] + ri x
!
% '&
1 4 4A?= JD=J MD=J M=I J >A FH LA@ M=I JDA ? LAHCA ?A J M=H@ AH B 4 E (Xi ) x 1 1 4 >IAHLA JD=J JDA JAH I ri E (Xi2 )2 =J = IFAA@ B ? LAHCA ?A FH F HJE = J x x4 E % '% = @ % '& ?= ?A A=?D JDAH KJ 6DA HAIJ B JDA JAH I JA @ J AH =J 1 A=IJ JDA H=JA B E > JD ANFHAIIE I MDA x BH MDE?D JDA @AIEHA@ HAIK J x B MI 3-,
%#!% EJO ? F
-N=
B K EB H
ALE@A ?A ?AH E C JDA FHE H FH >=>E >IAHLA D MALAH JD=J JDA EI J @EI?KIIA@ IJHA= B = K EB H = A BKJKHA O JDA B B = K EB H
OE C JDA E
B=
EJA = @ K EB H A
IJHA= AJD @I A
JDEI IA?JE
=0
. H JDA A E @
JDAH ANJHA
KIJ ? A=H O JA @ J
B JDA I= FJE K
@EI?KIIAI
E JAHAIJE C ?=IAI
0<< AJD @ B
=0
)BJAH
>J=E E C K EB H
KJFKJ
B JDA ?D
HK A %
! EI FHA?EIA O AJD @ 1
JDA IJH=ECDJ HK A
IE@AH=JE
JDA ? HHA?J E @K?JELA ?=IAI EJ EI =>IKH@ J =I JDA HIJ >IAHLA@ . H JDEI HA=I
1J
JDA
B JDA MI
HK A %
M >A KIA@
6DA CA AH= HK A EI @A
MDAHA
(a , c, x, wx )+ 1 1 [ (do (wx+1 )) (a , c, x, wx )] c
I B JDEI IA?JE I= EJ @ AI J
% ''
FJO IAGKA ?A IE@AH=JE =JJAH EB JDA O =BJAH = ?AHJ=E FHE H ? B F A IE A ?B JDA @EI?KIIE IE@AH=JE I = @ c EI = ?=KJE I B IE F E?EJO A
=FF E?=JE E
HK A IJ=HJI
JDA FHALE KI ?D=FJAH AJD @ a EI JDA E EJE= AJD @ >=IA@ K?D JDA @ACHAA H@AH ID K @ >A =@ KIJA@ =J A=?D A J EI . H HA=I AJD @ =M=O BH B=?J H ?= JDA ANJHA B
B=?J H MDE?D E @E?=JAI D M IJAF 6DA =HCAH c EI JDA EJ ME >A =IIK A@ JD=J AJD @ c *A?=KIA JDA A= I JD=J JDA ? HHA?JE
HK A M K @ D=LA J
? HHA?JE >A B H
K =JA@ B H @ACHAAI
!
MDE?D M K @ HAIK J E HA ? F E?=JA@ ?= ?K =JE I 5E E =H O EJ EI =IIK A@ JD=J 1 do (wx+1 ) = M JDA FHE H FH >=>E EJO B ? IAGKA J O >J=E E C O DA=@I MDA + IE@AH J IIE C = ? E FHA@E?=JA @A = JDA DA=@I AJD @ H = 5KFF IA JDA IEJK=JE JE C JDA HAIK JI J=E I MDE?D 6DA FJE B? K EI @A A@ E EJO E A = =@E? = CK=CA MEJD B=? E JDA J IIAI D=LA >AA B JDA ? HHA?JE A IA?KJELA J IIAI E @K?JELA HA LAH IKFF IA AEJDAH A
KJA K EB H
AJD @ E
=0
A= I JD=J JDA
HK A OEA @I
AJD @
1 a (1 ). c
1B JDA E ? EI CELA >O E C ALE@A ?A HA =E I D EJE CA A KI JDA HAIK JE C HA?KHIELA O ?= ?K =JA@ BH JDA @A B % '' 6DA HAIK J B H = I=
F A IE A
1 a (1 )k . c
6DA FH >=>E EJO JKJE C JDA => LA E FH @K?J B = B H K E EJA@ K >AH E B DA=@I H J=E I EI CELA F K = " CELA +=H =F '# !! = @ B H
k1 k+ a 2 c 1 k. ) k + (1 a c k=1
(1 1 )k
%
6DEI B H
K = ?=
>A ?
F=HA@ J
JD=J B H =
NA@ L= KA
0<<
% !
k+ 2 . k + k=1
1J ME E C JDA ? 6DA JAH >A ID M LAHCA ?A I >A M JD=J = H KJE A ? = AH E LAHCA ?A JAIJ JDA H=JE L= KA >KJ HA JDA B HAIK J JD=J % ? LAHCAI J B % ! >A MHEJJA ME C B H =E I E @EBBAHA J ?
B % ! ?=
1 k 1). 1+ ( 2 +k
2H LE@A@ JD=J B H
% " B
ak > 0
ak < 0 BH
A L= KA
M=H@I = FH @K?J
B JDA
(1 + ak )
% #
k=1
!
LAHCAI J
AH
L= KA EB = @
O EB JDA IAHEAI
k=1
? ? LAHCAI 5E ?A EJ M=I =IIK JDA JAH AH LAHCAI J = A@ JD=J
(ak )
EJ D @I JD=J
% $
>0
E O EB
=I MA IAA MDA
I =HA MHEJJA L= KA EB = @
JDA B H
k ( + 1) < 0 k
0A ?A
k=1
? LAHCAI E A EB
1 k ( 1) 2 +k
% %
k=1
? LAHCAI 0AHA A ?= =FF O JDA H=JE
k 1) +k
% &
JAIJ 1B
k
EI I = AH JD=
lim |
ak+1 |, ak 1
=E I K @A?E@A@
% '
1
E
JDA ?
LAHCA ?A HA
% ' EI AGK= J
k+1 1 +k+1 , k 1 +k
MDE?D HA@K?AI J
%
+k = +k+1
.H =IIK GKAIJE AJ KI JDA => LA B H A@ JDA L= KA B JDA ? M AN= ?A
+1 . 1 +k +1 k = 1 0A ?A
@ JDA H=JE
%
=FFH =?DAI
<
=I D=I >AA
LAHCA ?A
B JDA IAHEAI K @A?E@A@ LAHCA ?A B JDA FH @K?J % 1J EI =IIK B K EB H ALE@A ?A >A? AI AI JHELE=
a > 0 IE a > 0
1 MEJD
A EIIKA >A?
>0
!!
LAHCA ?A EI I
1 EI B=IJAH E
E
% JD=
B % =HA MHEJJA
JDA B H
1+
AJ
k 1 . 1 k 2[a (1 c ) + k ] 2
@E C J % HA=@I
%
y =1
1 6DA B H c
K = % ? HHAIF
% !
a y k+1 + ky . a y k+1 + k + 1
6DEI HA@K?AI J
% "
a y k+1 +y k a y k+1 1 +k + k
)I
.
K
% #
y = @ JDA @A 1 0A ?A JDA FH
E = LEAM JD=J ? EJA IJHA= AH 6DA J=E
k =
AH=J H JA @I J
L= KA MDE?D ID MI JD=J =
A= I BH
B ALE@A ?A
%#"
6DA ?K
K =JELA
A=
IGK=HA AHH H
J JE JDA @A E AIJE B ? ? EJI EJE M B JDA HECDJ ALA A= ?K K =JELA @EHA?J B JDA ?K AIJA@ B JDA
MEJD
=JA %
6DA E@A=
K =JELA AHH H EI J
AHH H
=JAI MEJD F AI
AHH H B H I
Xi E
JM
AIJA@ I=
x=
x + 1 ?=
>A MHEJJA
% $
6DA ANFA?JA@ L= KA
B % $ EI
E [Err, (x, Xi , ri ) + Err, (x, Xi + 1i(x+1) , ri )] = E [Err, (x, Xi , ri )] + E [Err, (x, Xi + 1i(x+1) , ri )].
>IAHLA JD=J JDA ANFA?JA@ L= KA IE I IAF=H=JA O ALA K = JDA CA AH= B H A ?= AIJA@ I= @A FAH=J H ?= >A =FF EA@ J J E @AFA @A J AI JDA JM B A=?D AHH H ANFHAI JDAH >A?=KIA JD KCD JDA AHH HI =HA L=HE=> AI ME C B H IE A B K = B H JDA ?K K =JELA IGK=HA AHH H B H E C BH
E (X + Y ) = E (X ) + E (Y ) @
J HAGKEHA JD=J
= @
A JDA B
1 KF J k
k
2 (k, Xi , ri ) CErr,
=
x=1
% %
6DA
A=
H ANFA?JA@ L= KA % %
B JDA ?K
Qi EI
>O HABAHA ?A J
=
x=1
Err, (x, ri ),
AIJA@ I= I A= F AI BH ?K
% &
EA
B A=
A=
x=1J
x=k
B H JDA FHA@E?=JA
Qi
K =JELA IGK=HA E
IGK=HA AHH H E JAH?D= CA=> O JDA =LAH=CA A= ?K K =JELA IGK=HA AHH H HABAHHA@ J H ?K K =JELA A= K =JELA IGK=HA AHH H IGK=HA
9EJD HAIFA?J J
Qi
O =I JDA
1
7IE C JDA B H %
k 2 Err (x, ri )
=
x=1
i=1 x=1
% ' AGK= I J
Err (x, ri ).
i=1
% '
x=1
MDE?D ME = I >A @A JA@ >O
Q Err, (x,
2 ri ), i
%
!#
>IAHLA JD=J
x=1
=
x=1
%
E(
x=1
MDE?D =J H J A= I JD=J JDEI ANFHAIIE A ?= = = I
FHA@E?=JAI
!$
HK A = @ JE
F E?=JE JKH I
A
HK A BH = B
IJHK?JELA F E J
B LEAM 1J ME B
FH >=>E EJEAI
IA JA ?AI =HA ?
AI I BK ?JE
J IAA
>IAHL=JE
B JDA = CK=CA ?=
B ALE@A ?A B H AN=
=> LA >KJ MEJD JDA L=HE=> A F A >KJ JDA A@ JD=J A=?D K >AH
@A
JE C
J JDA
JDA I= EJA K
B ALE@A ?A IJ=JA
A JI @AI?HE>AI JDA FH FAH B JDA ? HHA?JE ? > JD B IA?KJELA A=?D =E I O JDAH B JDAIA
>AH
=
?A
>KJ E
=I E
6DEI IA IEJELEJO J IAGKA ?AI >E EJO + FH >=>E EJO M=I ID M 6DA JE A B=?J H ME
A B=?J H E
F HJ= J ? 6DEI
B K EB H
HA @AJ=E >A
!%
&
1J IAA FEA?AI ? JM
6E
A= @
FJE K
>J=E E C ALE@A ?A
AJD @ @AFA @I >J=E A@ A > @O JDA @KH=JE B B JE A E MDE?D JDA
I JD=J JDA
B ALE@A ?A =HA
>KJ EI JDEI = F =KIE> A LEAM => KJ FH >=>E EJO M A@CA => KJ JDA M H @ >O =J A C 5D K @ A JI J EB J JDAIA >J=E E C = J
A =HHELAI =J JDA I=
e1
e2
=I >O
e1 &e2
AGK= F IJAHE H FH >=>E EJEAI = A =@ KIJ JDA A JDA E @K?JELA A IJ=HJI MEJD @AJAH K = E E C >AH JDAH = =HCA B E GKEHO . H AN= MAECDJ J F A ALA
AJD @ E JDA B? L= KA
JDA ? KHIA
AJD @
FEHE?= B=?J H E
= =CA J IDEBJ J
=J I B BJA
A J E ?HA=IAI JDA
>IAHLE C BKHJDAH E @ELE@K= I MEJD JDA FH FAHJO EJ M=I >AB HA JDA =@ KIJ E L @EJE LAI = JE
EI DECDAH JD=
A J 0A ?A >A?=KIA = FH ?AII
A B=?J H FH >=>E EJEAI B H = HAIA=H?D FH ?AII @EBBAH >J=E A@ FEA?AMEIA EI E I B M A@CA E B JDA ALE@A ?A IJ=JA AJD @I 6 JA J =?? B=?J @EBBAHA J BH >J=E E C JDA A JDAEH @EJE I
A JI EI JDA I=
MDAJDAH EJ M=I
EJA > @O
B ALE@A ?A HAFHAIA JE C =
>A DA=@I J =FF O MDA @E C IJHK?JELA O MDE?D = ALE@A ?A HA FHA?EIA O ` JD=J K ELAH
EI =IIEC A@ JDA I=
&
+
IE@AH JM
Q1 (1) =
@ Q1 (2) E
MDE?D Qi EI =
5E ?A ? =>E EJO =E I
Q1 (1) =
Q1 (2) ?=
6DA GKAIJE
B MD=J EJ
A= I B H = IA JA ?A J
>IAHL=> A HA
!&
?AFJE
B?
A = IMAH J
JDA GKAIJE
1J
M JD=J JDA =?JK= EIJ ? =O J=? & J >A JDA A JDA JD=J =
A J=E I JD=J K ELAHI= CA AH= E = @E C > @O B B ALE@A ?A 0 MALAH B ? A B ? IJHK? I JDAH M=O IJHK?JELA I B
?AFJE
I = @ JDA ? HHAIF
@E C IJHA=
&
)?JK= EIJ JHKJD HA A?J JDA GKAIJE JD=J >AE C JHKA ?AFJE B? " B ? JDA ? IJHK?JELA IJHK?JELA <S I=O I A @E C 4==JE =E A = @J =@ EJ JD=J ? IJHK?JELA JHKJD EI = JA IA@ BJA HABAHHA@ I B IJHK?JELA ? ?AFJE
A = IMAH EI J ? J ?AFJE EA
A= I D=LE C >AA
FH LA@ MDE?D EI
IJHK?JELA JHKJD B H ?
ME C HA=I
>A FH LA@
EI FH L=> A = @ EJ EI
EI FH L=> A ?=
??KH
JDAH M H@I
?= EJ
> A?JELA IA IA MEJD KJ JDA KIJE ?=JE JD=J IK?D = IEJK=JE JDA HO ? 1B FH ?AH E C JDA ANFHAIIE FH LA@ EJ IAA <S ?=
EI FH L=> A ? =IIE?=
A J J
A= E C
S D=I >AA
S M=I = HA=@O FH
A J A J=E I JD=J EJ EI
S EI FH L=> A >AB HA EJ EI FH LA@ >KJ EI EJ KIJE A@ J I=O JD=J E = IEJK=JE MDAHA S D=I =?JK= O >AA FH LA@ EJ M=I FH L=> A >AB HA EJ M=I FH LA@ 5=OE C JD=J S M=I FH L=> A A= I JD=J = IEJK=JE >J=E A@ MDAHA JDA IJ=JA A J <S EI FH L=> A M=I JHKA 0 MALAH JDA =?JK= EIJ ? ?AFJE B ? IJHK?JELA JHKJD A J=E I JD=J S KIJ >A FH LA@ MDA ALAH <S EI FH L=> A EI JHKA 0A ?A S
I=O JD=J ? K @ BA=JKHA E AJ KI JHKJD EI J D=LA >AA FH L=> A >AB HA EJ M=I FH LA@ MDE?D EI ? A=H O = ?AFJE B LEAM B? IJHK?JELA JHKJD ?AFJE B ? IJHK?JELA @EI?KII MD=J JDA =?JK= EIJ ? B FH >=>E EJEAI A= I JD=J Q1 (1)&Q1 (2) M=> A 1 JDA =? > O EB EJ D=I >AA D=LA >AA @KH=JE @ EI K E JKEJELA JDA =?JK= EIJ ? M FH ?AA@ J JDA F E J JKH
A= I BH
M=> A MDE?D E
Q1 (2) =HA
>IAHL=> A = @
Q1 (1)&Q1 (2)
>IAHL=JE
EI JHKA B =
Q1 (1)
Q1 (2)
2H LE@A@ JD=J =
FH FAHJO
!'
B JE EIJ ?
Q1 (1) =
IJHK?JELA B =BB=EHI E A H@AH B
Q1 (2) ?=
IE
> B
J D=LA >AA
A= E C
>IAHLA@ IAF=H=JA O
*KJ EB
>IAHLAI
Q1 (1)
=> KJ JDA
B JDA K ELAHIA EI KF@=JA@ 1J M=I =HCKA@ => LA JD=J EJ EI H=JE AJD @ MDA ALAH MD=J EJ M=I >AB HA J E JDA IEJK=JE JDA IEJK=JE B JDA KF@=JE C B ALE@A ?A
A Q FH FAHJO Q1 (1) JDA FH >=>E EJO B C Q1 (1) 0A ?A JDA FH >=>E EJO >IAHLA@ B =
& 1 =
=?JK= EIJ JHKJD =?JK= EIJ ? JDA IA IA ?AFJE B ? IJHK?JELA JHKJD = IA JA ?A EI JHKA EB EJ EI FH L AJD @ ?= B B FH LE C EJ MEJD KJ D=LE C J A AII O >KJ >A
S
I
>A JHKA JE
>IAHL=>E EJO
EI JHKA EB EJ EI
Q1 (1)&Q1 (2) EI JHKA EBB Q1 (1) EI >IAHL=> A = @ Q1 (2) EI EB Q1 (1) = @ Q1 (2) =HA > JD >IAHL=> A JDAO ?= J >A A JE A Q1 (1) = @ Q1 (2) ?= >A JE A AII O JHKA E JDA IA
O K @AH JDA ? B JDA JHKJD @EJE JD=J A B JDA JDKI ?= >A A B = K ELAHI= CA AH= E =JE >IAHL=> A A =BJAH = MEJD = JDAH B JDA
>IAHLA@
A= I JDA FH > =
FH >=>E EJO
K JEF OE C JDEI FH >=>E EJO >O JDA FH >=>E EJO =?? K J JDA =FFH FHE=JA ?D= CA E 5E ?A JDA E @K?JELA E @ELE@K= ? ?AFJE
B JDA IA?
AJD @ AJ?
AJD @ ?=
Q
A
@E C IJHA=
B ALE@A ?A E
=?JK= EIJ
IJHK?JELA JHKJD =I MA
=FF E?=JE B JDA ? HHA?JE ?= >A JE JDAH HK A AA@I J J= A F =?A EB JHKJD EI E JAHFHAJA@ A B JDA ? K ?JI
>IAHLA JD=J
? =IIE?= O IE ?A D=LE C J
Q1 (1)&Q1 (2)
"
&!
6DA
H@AH
B?
K ?JI
6DA AGK=JE
P (Q1 (1)&Q1 (2)) = P (Q1 (2)) P (Q1 (1)|Q1 (2)) = P (Q1 (2)&Q1 (1))
HA A?JI JDA E JAHFHAJ=JE =BJAH >IAHLE C B FH >=>E EJEAI MEJD KJ JDA ABBA?J B JDA ? HHA?JE IE ?A JDA FH >=>E EJO BK ?JE
& HK A
P
BH
E A
Q1 (2)
=I IAA H@AH EJ EI
JDA
Qi
@ AI
>IAHLE C
Qj
@ AI E
JDA
=JJAH ?=IA
Qi (x)
JDA FHALE KI ?=IA IE C = ? HHA?JE AE HK A ABBA?JI JDA FH >=>E EJEAI @ KIJ >A JDA I= I
J >A =@@HAIIA@ E
"
*E> E CH=FDO
*A A I AC= 2=K A=IKHA !H@ A@ 9E AO IJHK?JELA ) = OIEI AM ; H . + '&" 2H >=>E EJO > A?JELEJO = @ -LE@A ?A 4 KJ A@CA
*E E CI AO 2 ''# 2H >=>E EJO = @ ! " *EID F - '$% . K @=JE *HE? AH 2 '&% 5JK@EAI # # I B+
?/H=M 0E I FDE?=
4A@K?E C F IIE> A M H @I J
= CK=CA 2DE
!! !## CE?= 5O J=N = M H '!" @= EJEAI = @ GK= JE ?=JE KH = B 5O > E? CE? B = CK=CA 4 KJ A@CA AC= 2=K
A= E C = @
B +DE?=C
2HAII
&
6DA +
JE KK
B 1 @K?JELA
2HAII +DE?=C CE?= . K @=JE I B 2H >=>E EJO 2HAII +DE?=C 1 = =J I A@ 6DA 2H > A ! !" O 7 ELAHIEJO B @ A@EJE HIJ A@E
'
+=H =F 4 '$ JE E
B +DE?=C 0E JE
= 1 IJAH@=
= @ )
-II=OI
L=
,= A
, '&$
1 JKEJE
EIJE?
CE? 1 CE? L
A@I 0= @>
B 2DE
I FDE?=
"
!
,A .E AJJE 5 I 1 I
* '%
= @ 5J=JEIJE?I
9E AO
"
, KLA L H .E
A$
-
FEHEI?DA J AJIE C L=
E @K?JEALA
CE?=I 6E @I?DHEBJ
#
,K B H@
AJJ
'%% - A
$ %
,K .=CE
AJJ
JDAH - EC EJA
=I
4 '%$
@A I 6DA
CE? " # #& & .AIJ= 4 ''" EJO *=OAIE= ' FJE K 1 @K?JELA AJD @I ) 5JK@O E E EJK@A 1 @K?JELA 2H >=>E E? , H@HA?DJ KH = B 2DE I
A= E C = @ ?
. AJ?DAH 2 =JDA
) ?
FDOIE?I 2DE
I FDE?=
FJ JE? ? E?
@EJE
4 5JAH !
0AOJE C ) '!"
KI *A
MAEIJDA HEA 5FHE CAH *AH E " 0E JE = '## . H E?= & ## '$' @= EJO = @ 3K= JE ?=JE #% % IJHK?JELA =FFH =?D J IJ=JA @AI?HEFJE IA = JE?I 1 0E JE = @A I B H = @ ? JA J E GK= JE ?=JE JDA HO )?J= 2DE
I FDE?= .A # 0E JE =
B )FF EA@
"!
&
ABBHAO 4 + '% 4+
A=IKHAI = @ E JACH= I 1
4 +=H =F B
1 @K?JELA
2H >=>E EJO
=?
E =
@ E?D AEJIHA?D K C
!
FO JD )
L ) K= +
CE
=H
= JOFA B JDA +
JDA HO 1
FKJAH 5?EA ?A
CE? 2H ?AA@E CI
B JDA -)+5
FKJAH 5?EA ?A 5FHE CAH 8AH =C #% #&" ! KEFAHI -H A !! 6 '&$ 5 A AIJE =JAI B JDA FJE K E @K?JELA AJD @
J EI
" !% "$ ) JAH =JELAI J IJ= @=H@ B 2DE HIJ H@AH IA = JE?I 1 CE? 8 1 , ,
A> = ? 4AE@A
0 '&! %"
I FDE?=
!"
@AIJ E @K?JELA
I FDO
B 5?EA ?A !&
!#
= @
AMEI
E @K?JELA E
@AIJO 2DE
I FDO
!$
E C K =I
EE =JDA
1 '$' =JE?=
JDA ? JAI
@EJE
CE?= B H
B JDA )?=@A
!%
''
9AECDJ
- -A I 6
4 @ FE "% % !& O ?D ' !# !' AI =H C L )) '$ L ? IJHK?JELA L= $% =JDA =JE?I 6HK@O =JA =JE?D ) 5 '& ) IJ IKHA JDA HEAI ) = I B =JDA =JE?= CE? &
1 IJEJKJ= E I IAHEAI
B 2 '$&
IJHK?JELA
=JDA
=JE?I )
GLEIJ 9E
5J ? D
""
"
=HJE
B 2 '' ]
=JDA
=JE?I
B1
EJO^
A?JKHA
JAI E
FKJAH
5?EA ?A "% 5FHE CAH 8AH =C "$ '% " 2EAJ=HE A '%" 1 @K?JELA E @AIJO = @ =M E A AII 2DE I FDO B
5?EA ?A " '$ '& "! 4==JE =E A 2DE "" I FDO 2 B " CE? + ?AFJE I B JHKJD E E JKEJE EI 0EIJ HO = @
"#
5 OH
I * '&
B >A EAB 1
,0
H A@
AMEI
5?EA ?A !' !%# !%% "% 6H A IJH= ) '%% +D E?A IAGKA ?AI ) +D=FJAH E?I "& NB H@ 7 ELAHIEJO 2HAII ) L= ,= A NB H@ , '&& IJAH@= > A?JELEJO 0=HL=H@ 7 ELAHIEJO 2HAII += + IJHK?JELEI E =JDA =JE?I ) B 1 JKEJE EIJE? =JDA =J
6H A IJH= E JH @K?JE
HJD 0
= @ )
"'
9HECDJ >HE@CA
+ '' )
6HKJD = @
"#