RESEARCH ARTICLE | MAY 08 2019

Machine learning and NDE: Past, present, and future 

Joel B. Harley; Daniel Sparkman
AIP Conf. Proc. 2102, 090001 (2019)
https://doi.org/10.1063/1.5099819


View Export
Online Citation

Articles You May Be Interested In

Using photodiodes and supervised machine learning for automatic classification of weld defects in laser
welding of thin foils copper-to-steel battery tabs
J. Laser Appl. (November 2022)

A supervised learning approach for prediction of x-ray computed tomography data from ultrasonic testing
data
AIP Conf. Proc. (May 2019)

Development of decoupled multi-physics simulation for laser lap welding considering part-to-part gap
J. Laser Appl. (June 2017)

03 October 2024 09:07:14

 0DFKLQH/HDUQLQJDQG1'(3DVW3UHVHQWDQG)XWXUH
-RHO%+DUOH\'DQLHO6SDUNPDQ

University of Florida, Gainesville, FL 32355, USA

Air Force Research Laboratory, Wright-Patterson AFB, OH 45433, USA

MRHOKDUOH\#XIOHGX

$EVWUDFW5HFHQWKLJKSURILOHVXFFHVVHVLQPDFKLQHOHDUQLQJKDYHIRXQGVROXWLRQVWRSUREOHPVWKDWZHUHORQJWKRXJKWWR
EHGHFDGHVDZD\DQGKDVJHQHUDWHGUHQHZHGLQWHUHVWLQDUWLILFLDOLQWHOOLJHQFH $, DQGPDFKLQHOHDUQLQJ 0/ UHVHDUFK)RU
H[DPSOHWKHUHFHQWVXFFHVVDQGUDSLGFRPPHUFLDOL]DWLRQRIGHHSOHDUQLQJKDVFDWDSXOWHGWHFKQLFDODFKLHYHPHQWVLQPDQ\
ILHOGV LQFOXGLQJ FRPSXWHU YLVLRQ VSHHFK UHFRJQLWLRQ JDPHV DQG PDFKLQH WUDQVODWLRQ 7KHVH VXFFHVVHV SUHVHQW QHZ
RSSRUWXQLWLHVIRUDGYDQFLQJQRQGHVWUXFWLYHHYDOXDWLRQ 1'( WHFKQLTXHV7KLVSDSHUUHYLHZVWKHIXQGDPHQWDOFRQFHSWVRI
0/DQGWKHLUXQGHUO\LQJFRQQHFWLRQVWRVWDWLVWLFV:HWKHQGLVFXVVSDVWDSSOLFDWLRQVDQGPHWKRGVRI0/IRU1'(:HDOVR
GHVFULEHWKHVWLOOXQUHVROYHGFKDOOHQJHVIRUWKLVILHOGVXFKDVWKHXQDYDLODELOLW\RIUHOLDEOHWUDLQLQJGDWD:HWKHQGLVFXVV
FXUUHQWUHVHDUFKLQ0/IRU1'(WKDWLVGLUHFWHGWRZDUGVROYLQJWKHVHFKDOOHQJHV)LQDOO\ZHRXWOLQHKRZWKHPRVWUHFHQW
DGYDQFHVLQ0/VXFKDVGHHSOHDUQLQJDQGWUDQVIHUOHDUQLQJKDYHWKHSRWHQWLDOWRUHYROXWLRQL]HKRZZHGHVLJQIXWXUH1'(
VROXWLRQV

,1752'8&7,21
1HZGHYHORSPHQWVLQ$UWLILFLDO,QWHOOLJHQFH $, DQG0DFKLQH/HDUQLQJ 0/ KDYHUHVXOWHGLQPDQ\UHFHQWKLJK

03 October 2024 09:07:14

SURILOHEUHDNWKURXJKVLQPDQ\ILHOGVWKDWKDYHFDSWXUHGQHZVSDSHUKHDGOLQHVDQGHQWHUHGPDLQVWUHDPDZDUHQHVV)RU
H[DPSOHDGYDQFHVLQPHWKRGVIRUFRPSXWHUYLVLRQKDYHOHGWRPHWKRGVIRUDXWRQRPRXVGULYLQJIDFLDOUHFRJQLWLRQ
DQGPHGLFDOLPDJLQJ$GYDQFHVLQVSHHFKUHFRJQLWLRQKDVHQDEOHGWHFKQRORJLHVIRUFHOOSKRQHDVVLVWDQWVDQGKRPH
DXWRPDWLRQ %UHDNWKURXJKV LQ $, IRU JDPHSOD\LQJ KDV UHVXOWHG LQ WKH FRPSXWHU SOD\HU VXFFHVVHV LQ *R DQG
HQWHUWDLQPHQW YLGHR JDPHV 1HZ DSSOLFDWLRQV RI PDFKLQH OHDUQLQJ WHFKQLTXHV KDYH LPSDFWHG DXWRWUDQVODWLRQ
FDSDELOLWLHVIRUZHEVLWHVDQGYLGHRFRQIHUHQFLQJ7KHVHQHDUGDLO\VXFFHVVHVLQWKHQHZVKDYHFUHDWHGDORWRILQWHUHVW
LQ PDFKLQH OHDUQLQJ DQG KRZ $, FDQ LPSDFW RWKHU ILHOGV *RYHUQPHQWV LQGXVWU\ DQG DFDGHPLD DUH QRZ PDNLQJ
VWUDWHJLFLQYHVWPHQWVLQ$,DQG0/7KLV UHQHZHG LQWHUHVWLQ$,0/DQGWKHQHHGIRUTXDQWLWDWLYH1'(VXJJHVWVWKH
TXHVWLRQV³:KDWUROHKDV$,DQG0/KDGZLWKQRQGHVWUXFWLYHHYDOXDWLRQ 1'( "´DQG³:KDWPLJKW0/DQG1'(
ORRNOLNHLQWKHIXWXUH"´$UHFHQWZRUN>@GLVFXVVHVWKHUROHRI0/IRU1'(DQGKLJKOLJKWVXVHVIRUDXWRPDWLF
LQWHUSUHWDWLRQRI1'(VLJQDOV7KLVSDSHUH[WHQGVWKHGLVFXVVLRQRIWKHLQWHUVHFWLRQRI0/DQG1'(DQGLVDUUDQJHG
LQWR VHYHUDO VHFWLRQV )LUVW DQ RYHUYLHZ RI FRQFHSWV IURP PDFKLQH  OHDUQLQJ DUH SUHVHQWHG  7KLV LV  IROORZHG  E\ D 
GHVFULSWLRQRISDVWDQGSUHVHQWDSSOLFDWLRQVRI0/LQ1'()LQDOO\WKHIXWXUHRI0/LQ1'(LVH[SORUHGLQFOXGLQJ
FXUUHQWFKDOOHQJHVDQGVRPHRIWKHQHZGHYHORSPHQWVWKDWPD\KHOSLQRYHUFRPLQJWKHP

0$&+,1(/($51,1*$%5,()29(59,(:
0DFKLQH/HDUQLQJKDVEHHQGHILQHGDV³DXWRPDWHGPHWKRGVIRUGDWDDQDO\VLV´>@RUPHWKRGVIRUDXWRPDWLFSDWWHUQ
UHFRJQLWLRQ DQG SUHGLFWLRQ RI IXWXUH GDWD >@ 7KH ³OHDUQLQJ´ LQ ³PDFKLQH OHDUQLQJ´ PHDQV WKDW WKH PHWKRG
LPSOHPHQWHGRQDFRPSXWHU WKDWPDNHVDGHFLVLRQ LHSURGXFHVVRPHRXWSXW EDVHGRQSUHYLRXVH[SHULHQFH LH
GDWD  *HQHUDOO\ WKH PHWKRGV DQG DOJRULWKPV DUH VWUXFWXUHG VXFK WKDW WKHLU FDSDELOLW\ WR SHUIRUP D VSHFLILF WDVN
LPSURYHVZLWKPRUHGDWD)RUH[DPSOHDPDFKLQHOHDUQLQJPRGHOVKRXOGSURGXFHPRUHDFFXUDWHSUHGLFWLRQVDVWKH
DPRXQWRIWUDLQLQJGDWDLQFUHDVLQJ DVVXPHWKHWUDLQLQJGDWDZHOOUHSUHVHQWVWKHGHVLUHGVFHQDULR 
7KHVH FKDUDFWHULVWLFV DUH DOVR SUHVHQW IRU PDQ\ PRGHOV IURP VWDWLVWLFV  $OVR PDQ\ RI WKH PHWKRGV LQ PDFKLQH 
OHDUQLQJRULJLQDOO\FRPHIURPWKHILHOGRIVWDWLVWLFV2QHYLHZLVWKDWPDFKLQHOHDUQLQJLVDUHSDFNDJLQJRIVWDWLVWLFV
EXWZLWKDIRFXVRQSUHGLFWLRQ0DFKLQHOHDUQLQJDOVRIRFXVHVIDUOHVVRQWKHRU\DQGSURRIVDVPXFKDVLWGRHVRQ
HPSLULFDOSHUIRUPDQFH7KHVXEMHFWRIDUWLILFLDOLQWHOOLJHQFHRIWHQDULVHVLQGLVFXVVLRQVRIPDFKLQHOHDUQLQJ)LJXUH
LOOXVWUDWHVWKHFORVHUHODWLRQVKLSRIWKHILHOGVRIDUWLILFLDOLQWHOOLJHQFHPDFKLQHOHDUQLQJDQGVWDWLVWLFV7KHILHOGRI
DUWLILFLDOLQWHOOLJHQFHLQYROYHVV\VWHPVLPSOHPHQWHGRQDFRPSXWHUWKDWSHUIRUPDQ\WDVNLQDPDQQHUWKDWLVSHUFHLYHG

45th Annual Review of Progress in Quantitative Nondestructive Evaluation, Volume 38

AIP Conf. Proc. 2102, 090001-1–090001-10; https://doi.org/10.1063/1.5099819
Published by AIP Publishing. 978-0-7354-1832-5/$30.00

090001-1
DVLQWHOOLJHQW0DFKLQHOHDUQLQJPHWKRGVDUHDVLJQLILFDQWFRPSRQHQWRIWKHWRROVIRUGHFLVLRQPDNLQJLQ$,V\VWHPV
DQG0/LVDVXEVHWRI$,6WDWLVWLFVVKDUHVPDQ\FRPPRQJRDOVDQGPHWKRGRORJLHVDVPDFKLQHOHDUQLQJDQGDUWLILFLDO
LQWHOOLJHQFH EXW RIWHQ IRFXVHV RQ VWURQJHU VWDWLVWLFDO MXVWLILFDWLRQV IRU XQGHUVWDQGLQJ DQG H[SODLQLQJ GDWD 7KDW LV
PDFKLQHOHDUQLQJDQGDUWLILFLDOLQWHOOLJHQFHPHWKRGVFDQVRPHWLPHVEHPRUHKHXULVWLFGULYHQ



),*85($,0DFKLQH/HDUQLQJDQG6WDWLVWLFV±7KHILHOGVRIDUWLILFLDOLQWHOOLJHQFHPDFKLQHOHDUQLQJDQG
VWDWLVWLFVRYHUODSVLJQLILFDQWO\ZLWK0/EHLQJDVXEVHWRI$,DQGERWKXVLQJVWDWLVWLFVH[WHQVLYHO\
 


6XSHUYLVHGDQG8QVXSHUYLVHG0DFKLQH/HDUQLQJ

03 October 2024 09:07:14

0DFKLQHOHDUQLQJLVGLYLGHGLQWRFDWHJRULHVGHSHQGLQJRQWKHVSHFLILFWDVNRILQWHUHVW7KHWZRSULPDU\FDWHJRULHV
DUHVXSHUYLVHGOHDUQLQJDQGXQVXSHUYLVHGOHDUQLQJ,QVXSHUYLVHGOHDUQLQJDVHWRIWUDLQLQJGDWDLVDYDLODEOHIRUZKLFK
WKHUHLVDVHWRILQSXWVxnDQGRXWSXWVynDQGWKHJRDOLVWRWUDLQDPRGHOWRSUHGLFWWKHFRUUHVSRQGLQJRXWSXWVym IRU
VRPH QHZ VHWRI LQSXWVxm,Q XQVXSHUYLVHGOHDUQLQJWKH GDWDRQO\FRQWDLQVWKHLQSXWVxiDQGWKHJRDO LVWR ILQG
SDWWHUQVRUJURXSLQJV ZLWKLQWKHGDWDWKDWDUHXVHIXO IRULWVXQGHUVWDQGLQJRUH[SODLQLQJ,QWKHMDUJRQRI PDFKLQH
OHDUQLQJWKHLQSXWVDUHRIWHQFDOOHG³IHDWXUHV´7KHIHDWXUHVDUHQRWQHFHVVDULO\WKHUDZGDWDEXWPD\EHGHULYHGIURP
LWDVWKHRXWSXWRIVRPHWUDQVIRUPDWLRQ
Supervised Learning
6XSHUYLVHGOHDUQLQJLVRIWHQGLYLGHGLQWRFDWHJRULHVGHSHQGLQJRQWKHW\SHRIGDWDWKHPRGHOLVJRLQJWRSUHGLFW,I
WKHPRGHOLVWU\LQJWRSUHGLFWDFDWHJRULFDORXWSXWLHPHPEHUVKLSWRDVSHFLILFFODVVWKLVWDVNLVFDOOHGFODVVLILFDWLRQ
>@ 7KLV LV LOOXVWUDWHG LQ )LJXUH  D  LQ ZKLFK WKH GDWD LV VKRZQ DV GLIIHUHQW SRLQWV LQ WKH LQSXW VSDFH DQG WKH
FRUUHVSRQGLQJRXWSXWVDUHFODVVHVIRUWKHFRORUVRIWKHSRLQWV µUHG¶DQGµSXUSOH¶ $PDFKLQHOHDUQLQJFODVVLILHUZLOO
OHDUQWKHOLQHWKDWEHVWVHSDUDWHVWKHWZRJURXSVEDVHGRQNQRZQWUDLQLQJGDWD$OOQHZLQSXWVRUIHDWXUHVDUHWKHQ
DVVLJQHGDFRORUGHSHQGLQJZKLFKVLGHRIWKHOLQHFRQWDLQVWKHSRLQW1RWHWKDWLQSUDFWLFHWKLVOLQHLVRIWHQDK\SHUSODQH
RUDWUDQVIRUPHGK\SHUSODQH LQDKLJKGLPHQVLRQDOVSDFH LHZLWKPRUHWKDQWZRW\SHVRIIHDWXUHV >@
7KHRWKHUW\SHRIVXSHUYLVHGOHDUQLQJLVUHJUHVVLRQZKHUHWKHPRGHOLVWU\LQJWRSUHGLFWDFRQWLQXRXVRXWSXWLH
DUHDO RUVRPHWLPHVFRPSOH[ QXPEHU7KLVLVLOOXVWUDWHGLQ)LJXUH E LQZKLFKWKHWUDLQLQJGDWDLVSORWWHGDVEODFN
SRLQWVZLWKRXWSXWVYVLQSXWV7KHGDUNUHGOLQHSDVVLQJWKURXJKWKHSRLQWVDUHSUHGLFWLRQVIURPDUHJUHVVLRQPRGHO
REWDLQHGIURPWKHWUDLQLQJGDWD7KHOLJKWHUSLQNEDQGVVXUURXQGLQJWKHGDWDUHSUHVHQWDFRQILGHQFHLQWHUYDORQWKRVH
SUHGLFWLRQV 0DQ\ GLIIHUHQW PRGHOV H[LVW IRU UHJUHVVLRQ LQFOXGLQJ OLQHDU PRGHOV NULJLQJ QHXUDO QHWZRUNV NHUQHO
PHWKRGV VXSSRUW YHFWRU UHJUHVVLRQ DQG RWKHUV >@ $JDLQ LQ SUDFWLFH UHJUHVVLRQ RIWHQ WDNHV SODFH LQ D KLJK
GLPHQVLRQDOGLIILFXOWWRYLVXDOL]HVSDFH

090001-2
 D E
),*85(6XSHUYLVHG/HDUQLQJ± D &ODVVLILFDWLRQ E 5HJUHVVLRQ

Unsupervised Learning
8QVXSHUYLVHGOHDUQLQJLQYROYHVDOJRULWKPVIRUDQDO\]LQJGDWDZLWKQRODEHOV QHHGHGIRUFODVVLILFDWLRQ DQGQR
RXWSXWV QHHGHGIRUUHJUHVVLRQ ,QVWHDGWKHJRDOLVWRILQGDQGGHVFULEHVWUXFWXUHLQWKHGDWD7KHUHDUHPDQ\GLIIHUHQW
DSSURDFKHVDQGRQO\DIHZDUHOLVWHGKHUHDQGLOOXVWUDWHGLQ)LJXUH,Q)LJXUHZHLOOXVWUDWHHDFKRIW\SHRIDOJRULWKP
ZLWKWKHVDPHGDWDVHWLQIHDWXUHVSDFH&OXVWHULQJDOJRULWKPVVHSDUDWHWKHGDWDLQWRJURXSVDQGFODVVODEHOVDUHDVVLJQHG
WRHDFKJURXS'HQVLW\HVWLPDWLRQDOJRULWKPVHVWLPDWHWKHMRLQWSUREDELOLW\GHQVLW\IXQFWLRQIRUWKHGDWDWRTXDQWLI\
WKHXQFHUWDLQW\LQLW'LPHQVLRQDOLW\UHGXFWLRQDOJRULWKPVDLPWRILQGWUDQVIRUPDWLRQVRIWKHGDWDWKDWFDQSURMHFWWKHP
LQWRDORZHUGLPHQVLRQDOPRUHHIILFLHQWUHSUHVHQWDWLRQRIWKHGDWD7RSRORJLFDOGDWDDQDO\VLVLVDQRWKHUXQVXSHUYLVHG
OHDUQLQJWHFKQLTXHWKDWFDSWXUHVVWUXFWXUHLQWKHGDWDWRUHSUHVHQWVXEJURXSVWKDWDUH³QHDU´HDFKRWKHU


03 October 2024 09:07:14

),*85(8QVXSHUYLVHG/HDUQLQJ±&OXVWHULQJ'HQVLW\(VWLPDWLRQ'LPHQVLRQDOLW\5HGXFWLRQ7RSRORJLFDO'DWD
$QDO\VLV


3$67$1'35(6(170$&+,1(/($51,1*())2576,11'(
7KHUHKDYHEHHQGHFDGHVRIUHVHDUFKLQVWDWLVWLFDODQGPDFKLQHOHDUQLQJDSSURDFKHVWRVROYHSUREOHPVLQ1'(
SDUWLFXODUO\LQWKHLQWHUSUHWDWLRQRI1'(VLJQDOVIRUGHWHFWLRQDQGFKDUDFWHUL]DWLRQ7KLVVHFWLRQDWWHPSWVWRFDSWXUH
WKH EURDG VWURNHV RI ZLGHO\ XVHG PDFKLQH OHDUQLQJ DOJRULWKPV LQ 1'( UHVHDUFK DW WKH H[SHQVH RI QRW KDYLQJ D
FRPSUHKHQVLYHOLVWLQJRIHYHU\UHOHYDQWZRUN

090001-3
 8QVXSHUYLVHG0HWKRGV
Clustering
&OXVWHULQJLVDQXQVXSHUYLVHGOHDUQLQJWDVNIRUVHSDUDWLQJDVHWRIGDWDLQWRFOXVWHUV7KHPRVWRIWHQXVHGFOXVWHULQJ
DOJRULWKPLVNPHDQVFOXVWHULQJ>@2WKHURSWLRQVLQFOXGHVSHFWUDOFOXVWHULQJ>@KLHUDUFKLFDOFOXVWHULQJ>@DQGWKH
(0DOJRULWKP>@7KHH[DPSOHLQ)LJXUHLOOXVWUDWHVWKHRSHUDWLRQRIWKHNPHDQVDOJRULWKPIRUDSUREOHPZLWKWZR
LQSXWV IRU WZR FOXVWHUV 6WDUWLQJ ZLWK WKH XQODEHOHG GDWD WZR PHDQV DUH UDQGRPO\ LQLWLDOL]HG 7KHQ HDFK SRLQW LV
DVVLJQHGWRRQHRIWKHkGLIIHUHQWFOXVWHUVEDVHGRQWKHGLVWDQFHEHWZHHQWKHSRLQWVDQGHDFKPHDQ$QHZVHWRIk
GLIIHUHQWPHDQVLVWKHQFDOFXODWHGEDVHGRQDOORIWKHSRLQWVWKDWEHORQJWRWKDWFOXVWHU7KLVSURFHVVLVLWHUDWHGXSRQ
WKHODEHODVVLJQPHQWVWHSDQGWKHXSGDWLQJWKHkPHDQV DQGFRQWLQXHVXQWLOWKHODEHODVVLJQPHQWVKDYHFRQYHUJHG
:KLOHXVHGLQ1'(DSSOLFDWLRQVFOXVWHULQJKDVIRXQGSDUWLFXODUO\ZLGHXVHLQWKHDQDO\VLVRIDFRXVWLFHPLVVLRQ
VLJQDOV >@ 6SHFLILFDOO\ FOXVWHULQJ LV XVHG WR VHSDUDWH RXW GLIIHUHQW W\SHV RI DFRXVWLF HPLVVLRQ VLJQDOV
'LIIHUHQWO\ JURXSHG DFRXVWLF HPLVVLRQ VLJQDOV FDQ FRUUHVSRQG WR D GLIIHUHQW IDLOXUH PHFKDQLVP )RU H[DPSOH IRU
FRPSRVLWHPDWHULDOVDFRXVWLFHPLVVLRQJURXSLQJVFDQEHVHSDUDWHGDQGFRUUHODWHGZLWKIDLOXUHVGXHWRPDWUL[FUDFNLQJ
ILEHUEUHDNDJHDQGLQWHUIDFHIDLOXUH>@


   

03 October 2024 09:07:14


),*85(.0HDQV&OXVWHULQJ±&OXVWHULQJLVSHUIRUPHGE\LWHUDWLQJEHWZHHQDVVLJQPHQWVRIODEHOVIRUHDFKGDWD
SRLQWEDVHGRQWKHFORVHVWPHDQDQGHVWLPDWLQJQHZPHDQVIRUHDFKRIWKHQHZO\ODEHOHGFOXVWHUVXQWLOFRQYHUJHQFH

Matrix decomposition methods
0DWUL[ GHFRPSRVLWLRQ PHWKRGV VXFK DV VLQJXODU YDOXH GHFRPSRVLWLRQ LQGHSHQGHQW FRPSRQHQW DQDO\VLV DQG
GLFWLRQDU\OHDUQLQJ DUHXVHGWRILQGHIIHFWLYHUHSUHVHQWDWLRQVRIGDWD7KHVHDOJRULWKPVRIWHQOHDUQWUDQVIRUPDWLRQVRI
WKH GDWD WKDW DUH XVHG IRU VXEVHTXHQW DQDO\VLV VXFK DV YLVXDOL]DWLRQ RU PRUH DFFXUDWH FODVVLILFDWLRQ 2IWHQ WKHVH
WUDQVIRUPDWLRQVWDNHDVLQSXWD'PDWUL[RIWKHGDWDDQGVHSDUDWHWKDWGDWDLQWRDPDWUL[RIFRPSRQHQWV DOVRFDOOHG
DWRPVRUEDVHV DQGDPDWUL[RIFRHIILFLHQWV$QLOOXVWUDWLYHH[DPSOHRIWKHVHPDWULFHVLVVKRZQLQ)LJXUH(DFK
GHFRPSRVLWLRQ WHFKQLTXHV XVHV GLIIHUHQW DVVXPSWLRQV )RU H[DPSOH VLQJXODU YDOXH GHFRPSRVLWLRQ SURGXFHV
RUWKRJRQDO FRPSRQHQW YHFWRUV DQG RUWKRJRQDO FRHIILFLHQW YHFWRUV ,QGHSHQGHQW FRPSRQHQW DQDO\VLV SURGXFHV D
FRPSRQHQWVPDWUL[WKDWLVVWDWLVWLFDOO\LQGHSHQGHQW'LFWLRQDU\OHDUQLQJSURGXFHVDPDWUL[RIFRHIILFLHQWVWKDWLVVSDUVH
,QJXLGHGZDYHVWUXFWXUDOKHDOWKPRQLWRULQJPDWUL[GHFRPSRVLWLRQWHFKQLTXHVKDYHIRXQGZLGHXVHIRUVHSDUDWLQJ
GDPDJH HYHQWV DQG WKHLU YDULDWLRQV RYHU ORQJ SHULRGV WLPH LH RYHU V WR V WR V RI JXLGHG ZDYH
PHDVXUHPHQWV >@$VDUHVXOWWKHVHPDWUL[GHFRPSRVLWLRQWHFKQLTXHVFDQEHXVHGWROHDUQYDOXDEOHLQIRUPDWLRQ
IURPGDWDVHWLQWKHSUHVHQFHRIQRLVHRIQRLVHDQGRWKHUFRQIRXQGLQJIDFWRUVVXFKDVWHPSHUDWXUHYDULDWLRQV


 

),*85(0DWUL['HFRPSRVLWLRQ0HWKRGV±7KH'PDWUL[RIGDWDLVVHSDUDWHGLQWRDPDWUL[RIFRPSRQHQWVDQGD
PDWUL[RIFRHIILFLHQWV


090001-4
 6XSHUYLVHG0HWKRGV
Support Vector Machines
6XSSRUWYHFWRUPDFKLQHV 690V DUHSULPDULO\XVHGIRUFODVVLILFDWLRQEXWFDQEHH[WHQGHGIRUUHJUHVVLRQ7KH
EDVLFLGHDZLWK690VLVWRILQGDK\SHUSODQHWKDWVHSDUDWHVWKHFODVVHV7KLVLVLOOXVWUDWHGLQ)LJXUH)URPWKHPDQ\
SRVVLEOHVHSDUDWRUVWKHRQHWKDWKDVWKHODUJHVWPDUJLQEHWZHHQFODVVHVLVRSWLPDODQGVROYHGIRU>@7KLVFRQGLWLRQ
FDQEHWKHQZHDNHQHGWRDOORZIRUVRPHOHYHORIHUURULQWKHWUDLQLQJGDWD:KHQWKHFODVVHVDUHQRWOLQHDUO\VHSDUDEOH
DNHUQHOWULFNFDQEHXVHG>@WRPDSWKHGDWDLQWRDKLJKHUGLPHQVLRQDOVSDFHZKHUHWKHGDWDFDQEHOLQHDUO\VHSDUDWHG
DWOHDVWDSSUR[LPDWHO\ 


 
),*85(6XSSRUW9HFWRU0DFKLQHV±$OLQHDUGLVFULPLQDWRULVHVWLPDWHGWKDWKDVWKHODUJHVWPDUJLQEHWZHHQ
FODVVHV.HUQHOIXQFWLRQVDOORZPDSSLQJVIRUGDWDWKDWLVQRWOLQHDUO\VHSDUDEOH 

6HYHUDOH[DPSOHVLQWKHOLWHUDWXUHH[LVWIRUDSSOLFDWLRQRI690VWR1'(SUREOHPVLQFOXGLQJXOWUDVRXQG>
@ HGG\ FXUUHQW >@ DQG VRQLF ,5 >@ )RU H[DPSOH LQ >@ GDPDJH ZDV ORFDOL]HG E\ WUDLQLQJ DQ 690

03 October 2024 09:07:14

UHJUHVVLRQPRGHORQVLPXODWHG%VFDQV7KH690SHUIRUPHGDVDQLQYHUVHPRGHOWDNLQJDVLQSXWVDQHZ%VFDQDQG
SURGXFLQJDVRXWSXWWKHORFDWLRQRIWKHVHFRQGKLGGHQGHODPLQDWLRQDVVHHQLQ)LJXUH


D  E  F 

),*85($SSOLFDWLRQRI690VWR,QYHUVLRQRI87%VFDQV±6LPXODWLRQVRIREOLTXHDQJOHLQFLGHQFH87LQ D SURGXFHG
WKH%VFDQVLQ E 7KHVLPXODWLRQVZHUHXVHGWRWUDLQDQ690EDVHGLQYHUVHPRGHOWRSUHGLFWWKHORFDWLRQRIWKHKLGGHQ
GHODPLQDWLRQ7KHDFFXUDF\LVVKRZQLQWKHSUHGLFWHGYVDFWXDOORFDWLRQ LQPP LQ F 

Neural Networks
$QHXUDOQHWZRUNFRQVLVWVRIDQLQSXWOD\HUDQGDQRXWSXWOD\HUFRQQHFWHGE\RQHRUPRUHKLGGHQOD\HUV>@
:KHQWKHUHLVPRUHWKDQRQHKLGGHQOD\HUZHFDOOWKHQHXUDOQHWZRUNDGHHSQHXUDOQHWZRUN(DFKHGJHLQWKH
QHWZRUNFRUUHVSRQGVWRWKHPXOWLSOLFDWLRQRIDVLQJOHYDOXHE\DOHDUQHGZHLJKW7KHFRQJUXHQFHRIHGJHVDWDQRGH
FRUUHVSRQGVWRWKHVXPRIWKHZHLJKWHGYDOXHV7\SLFDOO\HDFKQRGHDOVRKDVDQDVVRFLDWHOHDUQELDVWHUP7KH
ZHLJKWVDQGELDVHVPDNHXSDQDIILQHWUDQVIRUPDWLRQRILQSXWV7KHUHVXOWRIWKHDIILQHWUDQVIRUPLVWKHQSDVVHG
WKURXJKDQRQOLQHDUIXQFWLRQFDOOHGWKHDFWLYDWLRQIXQFWLRQ7KHRXWSXWRIWKHDFWLYDWLRQIRUPVWKHRXWSXWIRUWKDW
QRGHZKLFKLVWKHQSDVVHGRQDVDQLQSXWWRWKHQH[WOD\HURIWKHQHXUDOQHWZRUN)LJXUHLOOXVWUDWHVHDFKRIWKHVH
FRPSRQHQWV7KHZHLJKWVDQGELDVHVIRUHDFKQRGHDUHWKHSDUDPHWHUVRIWKHQHXUDOQHWZRUNWKDWPXVWEHVROYHG
7KHDSSOLFDWLRQRIQHXUDOQHWZRUNVWR1'(KDVDORQJKLVWRU\LQFOXGLQJFODVVLILFDWLRQRI87VLJQDOVIRU
GHWHFWLRQRIFUDFNV>@FRUURVLRQ>@ZHOGGHIHFWV>@DQGRWKHUV>@1HXUDOQHWZRUNVKDYHDOVREHHQ
XVHGIRUORFDOL]DWLRQRIGHIHFWV>@FKDUDFWHUL]DWLRQRIPDWHULDOSURSHUWLHV>@DQGFKDUDFWHUL]DWLRQRI
GDPDJH>@2QHVLJQLILFDQWEHQHILWRIQHXUDOQHWZRUNVLVWKH\DUHDJHQHUDOIXQFWLRQDSSUR[LPDWRU7KDWLVWKH
QHXUDOQHWZRUNUHSUHVHQWVVRPHPDSSLQJIURPLQSXWVWRRXWSXW7KHUHIRUHQHXUDOQHWZRUNVFDQEHXVHGIRU
UHJUHVVLRQRUFODVVLILFDWLRQ)XUWKHUPRUHDGGLQJOD\HUVWRWKHQHXUDOQHWZRUNV LHPDNLQJLWGHHSHU DOORZVLWWR
OHDUQPDSVIRULQFUHDVLQJO\PRUHFRPSOH[GDWDVHWV

090001-5
 


),*85(1HXUDO1HWZRUNV±$QHXUDOQHWZRUNFRQVLVWVRIVHYHUDOOD\HUVFRUUHVSRQGLQJWRDQLQSXWOD\HUDQGDQ
RXWSXWOD\HUFRQQHFWHGE\RQHRUPRUHKLGGHQOD\HUV


7+()8785(2)0$&+,1(/($51,1*,11'(
,QWKLVVHFWLRQZHEULHIO\GLVFXVVVRPHRIWKHFXUUHQWFKDOOHQJHVZLWKXVLQJPDFKLQHOHDUQLQJIRU1'(DSSOLFDWLRQ
:HWKHQGLVFXVVVRPHRIWKHUHFHQWGHYHORSPHQWVLQPDFKLQHOHDUQLQJWKDWDUHOLNHO\WRSOD\DUROHLQDGGUHVVLQJWKHVH
DQGPRYH1'(DVDILHOGIRUZDUG

&KDOOHQJHVZLWK7UDGLWLRQDO0DFKLQH/HDUQLQJ
7KHUHDUHVHYHUDOFKDOOHQJHVWRVXFFHVVIXOO\DSSO\LQJPDFKLQHOHDUQLQJWRUHDOSUREOHPV6RPHRIWKHVHDUH
SDUWLFXODUO\VLJQLILFDQWLQWKHILHOGRI1'(+HUHZHGHVFULEHWKUHHSDUWLFXODUO\VLJQLILFDQWFKDOOHQJHVWKHIHDWXUH

03 October 2024 09:07:14

SUREOHPWKHEODFNER[SUREOHPDQGWKHGDWDSUREOHP
The Feature Challenge
7KHDFFXUDF\RIPDFKLQHOHDUQLQJPRGHOVLVRIWHQKLJKO\GHSHQGHQWWKHFKRVHQGDWDIHDWXUHVZKLFKDUHW\SLFDOO\
GHULYHGIURPWKHUDZGDWDLQDVWHSNQRZQDV³IHDWXUHH[WUDFWLRQ´RU³IHDWXUHHQJLQHHULQJ´)LJXUHLOOXVWUDWHVWKH
IHDWXUHSUREOHPWKURXJKWZRH[DPSOHV7KHILJXUHRQWKHOHIWLVIRUIHDWXUHVWKDWGRQRWKDYHDQ\UHODWLRQVKLSZLWK
WKHRXWSXWDQGLQZKLFKGHYHORSLQJDQDFFXUDWHFODVVLILHUZRXOGEHGLIILFXOW7KLVLVEHFDXVHWKHIHDWXUHVKDYHD
QHJOLJLEOHSK\VLFDOUHODWLRQVKLSWRWKHSUREOHPRILQWHUHVWVXFKDVGHWHFWLQJGDPDJH7KHILJXUHRQWKHULJKWLVXVHV
WZRPXFKPRUHUHDVRQDEOHIHDWXUHVIRUDGGUHVVLQJWKLVSUREOHP:HREVHUYHWKDWWKHWZRFODVVHVDUHOLQHDUO\
VHSDUDEOHDOORZLQJXVWRXVHWUDLQDQDSSURSULDWHFODVVLILHU



),*85(7KH)HDWXUH3UREOHP±)HDWXUHVPD\QRWKDYHDQ\UHODWLRQVKLSZLWKWKHRXWSXW6RPHIHDWXUHVPD\EHD
PRUHHIIHFWLYHUHSUHVHQWDWLRQRIWKHGDWDDQGPRUHXVHIXOIRUFODVVLILFDWLRQ

0DQ\SUREOHPVLQ1'(LQYROYHPHDVXUHPHQWVZLWKDYHU\ODUJHQXPEHURIGLPHQVLRQVDVDWLPHVHULHVDQGRU
LPDJHVLQFOXGLQJXOWUDVRQLFWHVWLQJHGG\FXUUHQWVRQLF,5WKHUPRJUDSK\DQGRWKHUV0DQ\RIWKHFXUUHQW
DSSURDFKHVLQYROYHH[WUDFWLQJDPD[LPXPDPSOLWXGHWLPHRIIOLJKWVSHFWUDOGDWDRURWKHUIHDWXUHVIRUEXLOGLQJ

090001-6
XVHIXOPRGHOV:KLOHWKHVHKDYHEHHQVXFFHVVIXOLQWKHSDVWWKH\DUHQRWLGHDOIRUHYHU\SUREOHP'LIIHUHQWGDPDJH
PHFKDQLVPVRIWHQDIIHFWGDWDLQGLIIHUHQWDQGFRPSOH[ZD\V7KHVHGLIIHUHQFHVGRQRWDOZD\VVLPSO\WUDQVODWHLQWR
FRPPRQGDWDIHDWXUHV
5HFHQWO\GHHSOHDUQLQJ FDVFDGLQJPXOWLSOHPDFKLQHOHDUQLQJPRGHOVFRQQHFWHGLQOD\HUVZLWKWKHRXWSXWVRIWKH
ILUVWPRGHOIHHGLQJDVLQSXWVLQWRWKHQH[WPRGHO KDYHEHHQXVHGLQPDQ\ILHOGVWRDGGUHVVWKLVLVVXH>@$
FRPPRQIRUPRIGHHSOHDUQLQJLVWKURXJKLVDGHHSQHXUDOQHWZRUNZKLFKOLQNVPXOWLSOHKLGGHQOD\HUVEHWZHHQWKH
LQSXWDQGRXWSXWOD\HUV*LYHQHQRXJKOD\HUVDQGHQRXJKGDWDGHHSOHDUQLQJPHWKRGVFDQHIIHFWLYHO\OHDUQPRUH
RSWLPDOIHDWXUHVIURPUDZGDWDLQDQHDUO\PDFKLQHOHDUQLQJOD\HU>@/DWHUOD\HUVWKHQSHUIRUPWKHFODVVLILFDWLRQ
RUUHJUHVVLRQ+HQFHWKLVFDQDGGUHVVWKHIHDWXUHSUREOHP
The Black Box Challenge
0DFKLQHOHDUQLQJPRGHOVDUHRIWHQFRQVLGHUHG³EODFNER[HV´DQGDUHGLIILFXOWWRLQWHUSUHW)RU1'(WKLVPHDQV
WKDWZKHQDVLJQDOLVFODVVLILHGPDFKLQHOHDUQLQJPRGHOVZLOOSURYLGHOLWWOHDGGLWLRQDOLQIRUPDWLRQWRH[SODLQZKDW
SDUWRIWKHVLJQDORUIHDWXUHVZDVXVHGWRPDNHWKDWGHFLVLRQ0RVWPDFKLQHOHDUQLQJPRGHOVDUHQRWEDVHGRQDQ\
SK\VLFVHTXDWLRQVDQGKRZWKHVHPRGHOVEHKDYHFDQEHVLJQLILFDQWO\GLIIHUHQWGHSHQGLQJRQWKHDYDLODEOHGDWD
+HQFHWKHEODFNER[SUREOHPKDVLPSOLFDWLRQVIRUWKHYDOLGDWLRQRIPDFKLQHOHDUQLQJLQ1'(
5HFHQWZRUNLQDUWLILFLDOLQWHOOLJHQFHKDVHPSKDVL]HGWKHXVHRISK\VLFVLQIRUPHGPDFKLQHOHDUQLQJ>@
7KHVHPHWKRGVW\SLFDOO\LQFRUSRUDWHSK\VLFDONQRZOHGJHE\FRQVWUDLQLQJWKHRSWLPL]DWLRQVXVHGWROHDUQHDFK
PRGHO$VDUHVXOWWKHVHPHWKRGVKDYHDJUHDWHULQWHUSUHWDELOLW\DQGH[SODLQDELOLW\,QDGGLWLRQWKHVHPHWKRGV
UHTXLUHOHVVGDWDWKDQDWUDGLWLRQDOPDFKLQHOHDUQLQJPHWKRG1RWHWKRXJKWKHVHHIIRUWVUHPDLQUHODWLYHO\\RXQJ
The Data Challenge
6WDWLVWLFDODQGPDFKLQHOHDUQLQJPRGHOV SDUWLFXODUO\GHHSPRGHOV RIWHQUHTXLUHDODUJHDPRXQWRIWUDLQLQJGDWD
7UDLQLQJDFRPSOH[PRGHOVXFKDVDGHHSQHXUDOQHWZRUNZLWKVPDOODPRXQWRIGDWDFDQOHDGWRRYHUILWWLQJ7KLV
PHDQVWKDWWKHPRGHOZLOOYHU\DFFXUDWHO\UHFRQVWUXFWWKHWUDLQLQJGDWDRUGDWDYHU\VLPLODUWRWKHWUDLQLQJGDWD
+RZHYHUWKHPRGHOZLOOQRWPDNHDFFXUDWHSUHGLFWLRQVIRUQHZPRUHJHQHUDOGDWD7KLVLVDFRPPRQFKDOOHQJHLQ

03 October 2024 09:07:14

1'(DQGRWKHUHQJLQHHULQJGLVFLSOLQHVEHFDXVHZHODFNWKHYDVWGDWDEDVHVWKDWH[LVWIRURWKHUPDFKLQHOHDUQLQJ
WDVNVVXFKDVLPDJHDQGDXGLRSURFHVVLQJ:HRIWHQODFNWKHVHGDWDEDVHVEHFDXVHWKH\DUHH[SHULPHQWDOO\GLIILFXOW
WRREWDLQDQGPDQ\1'(GDWDVHWVDUHQRWGLUHFWO\FRPSDUDEOH
2QHUHFHQWDGYDQFHLQPDFKLQHOHDUQLQJIRUDGGUHVVLQJWKLVFKDOOHQJHLVWUDQVIHUOHDUQLQJ>@7UDQVIHU
OHDUQLQJDOORZVXVWRWUDQVIHUOHDUQLQJIURPRQHNQRZOHGJHOHDUQLQJWDVNLQWRDQRWKHUOHDUQLQJWDVN$VDUHVXOWZH
FDQRIWHQWUDLQPXFKVLPSOHUPRGHOVWKDWDFFRPSOLVKDVSHFLILFWDVN7KHVHVLPSOHUPRGHOVFDQWKHQEHFRPELQHG
LQWRDELJJHUPRGHODQGWKHUHODWLRQVKLSVEHWZHHQWKHPFDQEHOHDUQHG$VDUHVXOWHDFKSUREOHPXVHVOHVVFRPSOH[
PRGHOVDQGWKHUHIRUHUHTXLUHVOHVVGDWD>@,QDGGLWLRQWKHGDWDXVHGWRWUDLQHDFKWDVNGRHVQRWQHFHVVDULO\QHHGWR
EHGLUHFWO\FRPSDUDEOH


&21&/86,21$1')8785(())2576
0DFKLQH OHDUQLQJ UHSUHVHQWV D SRZHUIXO WRRO DQG UHVHDUFK WRSLF WKDW FDQ OHDG WR VLJQLILFDQW LPSURYHPHQWV LQ
QRQGHVWUXFWLYHHYDOXDWLRQDQGUHODWHGILHOGV$VGLVFXVVHGWKHUHDUHVHYHUDOFKDOOHQJHV WKHIHDWXUHSUREOHPWKHGDWD
FKDOOHQJH DQG WKH EODFN ER[ FKDOOHQJH  WKDW KDYH SUHYHQWHG SUHYLRXV PDFKLQH OHDUQLQJ HIIRUWV IURP ILQGLQJ PRUH
ZLGHVSUHDGVXFFHVV7KLVSDSHUKLJKOLJKWWKHVHFKDOOHQJHVKRZWKH\UHODWHWRSULRUPDFKLQHOHDUQLQJHIIRUWVLQ1'7
DQG SURYLGH D SHUVSHFWLYH RQ KRZ WR RYHUFRPH WKLV FKDOOHQJHV LH WKURXJK GHHS OHDUQLQJ WUDQVIHU OHDUQLQJ DQG
SK\VLFVLQIRUPHGPDFKLQHOHDUQLQJ 
:HHQFRXUDJHRXUIROORZ1'(FRPPXQLW\WRJHWPRUHLQYROYHGDQGPRUHDFWLYHZLWKPDFKLQHOHDUQLQJPHWKRGV
+RZHYHUZHFDXWLRQWKDWZHVKRXOGQRWWUHDWPDFKLQHOHDUQLQJDWRROEXWDVDUHVHDUFKSXUVXLW0DFKLQHOHDUQLQJIRU
HQJLQHHUHGV\VWHPVZKHUHGDWDDYDLODELOLW\LVORZDQGGLYHUVLW\LVKLJKUHPDLQVVLJQLILFDQWFKDOOHQJH7RRYHUFRPH
WKLVFKDOOHQJHZHQHHGUHVHDUFKHUVZKRXQGHUVWDQGWKHSK\VLFVDQGHQJLQHHULQJSUREOHPVWRWDNHWKHOHDGLQSXVKLQJ
WKHPDFKLQHOHDUQLQJILHOGIRUZDUG2QO\WKHQFDQZHFUHDWHORQJWHUPPDFKLQHOHDUQLQJVROXWLRQVIRU1'(SUREOHPV

090001-7
 $&.12:/('*(0(176
3RUWLRQVRIWKLVZRUNDUHIXQGHGE\WKH86$LU)RUFHWKURXJKFRQWUDFW)$)6\VWHPV3OXV,QF
XQGHUWKH$LU)RUFH6XPPHU)DFXOW\)HOORZVKLS3URJUDP0DUN*URIISURJUDPPDQDJHU',675,%87,21
67$7(0(17$$SSURYHGIRUSXEOLFUHOHDVHGLVWULEXWLRQLVXQOLPLWHG&DVH1XPEHU$%:

5()(5(1&(6
1. . 0XUSK\ 0DFKLQH /HDUQLQJ $ 3UREDELOLVWLFV 3HUVSHFWLYH The MIT Press &DPEULGJH 0DVVDFKXVHWWV

2. 7+DVWLH57LEVKLUDQLDQG-)ULHGPDQ7KH(OHPHQWVRI6WDWLVWLFDO/HDUQLQJ'DWD0LQLQJ,QIHUHQFHDQG
3UHGLFWLRQQG(G6SULQJHU6FLHQFH%XVLQHVV0HGLD//&
3. 0*56DXVH$*ULERY$58QZLQDQG6+RUQ³3DWWHUQUHFRJQLWLRQ DSSURDFK WR LGHQWLI\ QDWXUDO
FOXVWHUVRIDFRXVWLFHPLVVLRQVLJQDOV´Pattern Recognit. Lett.YROQRSS±-DQ
4. * 'X - /L : . :DQJ & -LDQJ DQG 6 = 6RQJ ³'HWHFWLRQ DQG FKDUDFWHUL]DWLRQ RI VWUHVVFRUURVLRQ
FUDFNLQJRQVWDLQOHVVVWHHOE\HOHFWURFKHPLFDOQRLVHDQGDFRXVWLFHPLVVLRQWHFKQLTXHV´Corros. Sci.YRO
QRSS±6HS
5. 1 *RGLQ 6 +XJXHW 5 *DHUWQHU DQG / 6DOPRQ ³&OXVWHULQJ RI DFRXVWLF HPLVVLRQ VLJQDOV FROOHFWHG GXULQJ
WHQVLOHWHVWVRQXQLGLUHFWLRQDOJODVVSRO\HVWHUFRPSRVLWHXVLQJVXSHUYLVHGDQGXQVXSHUYLVHGFODVVLILHUV´NDT E
Int.YROQRSS±-XQ
6. + 3 5 5H]D $ + 5H]DLH 6 + + 6DGHJKL 0 + 0RUDGL DQG 0 $KPDGL ³$ GHQVLW\EDVHG IX]]\
FOXVWHULQJ WHFKQLTXH IRU QRQGHVWUXFWLYH GHWHFWLRQ RI GHIHFWV LQ PDWHULDOV´ NDT E Int.YROQRSS
±-XQ
7. 5 (O *XHUMRXPD et al. ³1RQGHVWUXFWLYH HYDOXDWLRQ RI GDPDJH DQG IDLOXUH RI ILEUH UHLQIRUFHG SRO\PHU

03 October 2024 09:07:14

FRPSRVLWHV XVLQJ XOWUDVRQLF ZDYHV DQG DFRXVWLF HPLVVLRQ´ Adv. Eng. Mater. YRO  QR  SS ±

8. $ 6LELO 1 *RGLQ 0 5¶0LOL ( 0DLOOHW DQG * )DQWR]]L ³2SWLPL]DWLRQ RI $FRXVWLF (PLVVLRQ 'DWD
&OXVWHULQJE\D*HQHWLF$OJRULWKP0HWKRG´J. Nondestr. Eval.YROQRSS±-XQ
9. & /LX - 'REVRQ DQG 3 &DZOH\ ³(IILFLHQW JHQHUDWLRQ RI UHFHLYHURSHUDWLQJFKDUDFWHULVWLFVIRUWKHHYDOXDWLRQ RI
GDPDJHGHWHFWLRQLQSUDFWLFDOVWUXFWXUDOKHDOWKPRQLWRULQJDSSOLFDWLRQV´Proc. Math. Phys. Eng. Sci.YRO 
QRS0DU
10. -'REVRQDQG3&DZOH\³,QGHSHQGHQW&RPSRQHQW$QDO\VLVIRU,PSURYHG'HIHFW'HWHFWLRQLQ*XLGHG:DYH
0RQLWRULQJ´Proc. IEEEYROQRSS±$XJ
11. - % +DUOH\ & /LX , - 2SSHQKHLP DQG - 0 ) 0RXUD ³0DQDJLQJ &RPSOH[LW\ 8QFHUWDLQW\ DQG
9DULDELOLW\ LQ *XLGHG :DYH 6WUXFWXUDO +HDOWK 0RQLWRULQJ´ SICE Journal of Control, Measurement, and
System IntegrationYROQRSS±
12. &/LX-%+DUOH\0%HUJHV':*UHYHDQG,-2SSHQKHLP ³5REXVW XOWUDVRQLF GDPDJH GHWHFWLRQ
XQGHUFRPSOH[HQYLURQPHQWDOFRQGLWLRQVXVLQJVLQJXODUYDOXHGHFRPSRVLWLRQ´UltrasonicsYROSS±
$SU
13. & =DQJ 0 , )ULVZHOO DQG 0 ,PUHJXQ ³6WUXFWXUDO 'DPDJH 'HWHFWLRQ XVLQJ ,QGHSHQGHQW &RPSRQHQW
$QDO\VLV´Structural Health MonitoringYROQRSS±0DU
14. 9 0RURYDWL DQG 0 7 .D]HPL ³'HWHFWLRQ RI VXGGHQ VWUXFWXUDO GDPDJH XVLQJ EOLQG VRXUFH VHSDUDWLRQ DQG
WLPH±IUHTXHQF\DSSURDFKHV´Smart Mater. Struct.YROQRS0DU
15. 6 0DULQHWWL / )LQHVVR DQG ( 0DUVLOLR ³0DWUL[ IDFWRUL]DWLRQ PHWKRGV $SSOLFDWLRQ WR WKHUPDO 1'7(´
NDT E Int.YROQRSS±'HF
16. % *DR : / :RR DQG % :. /LQJ ³0DFKLQH OHDUQLQJ VRXUFH VHSDUDWLRQ XVLQJ PD[LPXP D
SRVWHULRUL QRQQHJDWLYHPDWUL[IDFWRUL]DWLRQ´IEEE Trans CybernYROQRSS±-XO
17. *0 =KDQJ ' 0 +DUYH\ DQG ' 5 %UDGHQ ³$GYDQFHG DFRXVWLF PLFURLPDJLQJ XVLQJ VSDUVH VLJQDO
UHSUHVHQWDWLRQIRUWKHHYDOXDWLRQRIPLFURHOHFWURQLFSDFNDJHV´IEEE Trans. Adv. Packag.YROQRSS
±0D\
18. 0 -RKQVRQ ³:DYHIRUP EDVHG FOXVWHULQJ DQG FODVVLILFDWLRQ RI $( WUDQVLHQWV LQ FRPSRVLWH ODPLQDWHV
XVLQJ SULQFLSDOFRPSRQHQWDQDO\VLV´NDT E Int.YROQRSS±6HS

090001-8
19. -/ 5RMR$OYDUH] 0 0DUWLQH]5DPRQ - 0XQR]0DUL * &DPSV9DOOV &0 &UX] DQG $5 )LJXHLUDV
9LGDO ³6SDUVH 'HFRQYROXWLRQ 8VLQJ 6XSSRUW 9HFWRU 0DFKLQHV´ EURASIP J. on Adv. In Sig. Proc. YRO
QRSS
20. . /HH DQG 9 (VWLYLOO&DVWUR ³)HDWXUH H[WUDFWLRQ DQG JDWLQJ WHFKQLTXHV IRU XOWUDVRQLF VKDIW VLJQDO
FODVVLILFDWLRQ´Applied Soft ComputingYROQRSS
21. 90DW]0.UHLGODQG56PLG³&ODVVLILFDWLRQRI8OWUDVRXQG6LJQDOV´Int. J. of Mat. and Prod. Tech.YRO
QR
22. . /HH (IIHFWLYH $SSURDFKHV WR ([WUDFW )HDWXUHV DQG &ODVVLI\ (FKRHV LQ /RQJ 8OWUDVRXQG 6LJQDOV IURP
0HWDO 6KDIWV 2008 International Workshop on Education Technology and Training & 2008 International
Workshop on Geoscience and Remote Sensing6KDQJKDLSS
23. . 9LUXSDNVKDSSD DQG ( 2UXNOX 8OWUDVRQLF IODZ GHWHFWLRQ XVLQJ 6XSSRUW 9HFWRU 0DFKLQH FODVVLILFDWLRQ
2015 IEEE IUS7DLSHLSS
24. <XDQ &KHQ +RQJ:HL 0D  *XDQJ0LQJ =KDQJ   $ VXSSRUW YHFWRU PDFKLQH DSSURDFK IRU
FODVVLILFDWLRQ RI ZHOGLQJ GHIHFWV IURP XOWUDVRQLF VLJQDOV 1RQGHVWUXFWLYH 7HVWLQJ DQG (YDOXDWLRQ 

25. ==HQJ-=KRX17DR/)HQJ&=KDQJDQG;+DQ³6XSSRUWYHFWRUPDFKLQHVEDVHGGHIHFWUHFRJQLWLRQ LQ
6RQLF,5XVLQJ'KHDWGLIIXVLRQIHDWXUHV´NDT & E InternationalYROSS
26. 6 &KHQ ) &HUGD - *XR -% +DUOH\ 4 6KL 3 5L]]R - %LHODN -+ *DUUHWW DQG - .RYDFHYLF
³0XOWLUHVRXOWLRQ &ODVVLILFDWLRQ ZLWK 6HPL6XSHUYLVHG /HDUQLQJ IRU ,QGLUHFW %ULGJH 6WUXFWXUDO +HDOWK
0RQLWRULQJ´SS
27. -%+DUOH\<<LQJ-0)0RXUD,-2SSHQKHLP/6REHOPDQDQG-+*DUUHWW³$SSOLFDWLRQRI0HOOLQ
7UDQVIRUP)HDWXUHVIRU5REXVW8OWUDVRQLF*XLGHG:DYH6WUXFWXUDO+HDOWK0RQLWRULQJ´Review of Progress in
Quantitative Nondestructive Evaluation, $,3&RQIHUHQFH3URFHHGLQJVYROQR
28. ' 6SDUNPDQ HWDO  ³$ 'LUHFW ,QYHUVH  0RGHO IRU 8OWUDVRQLF 'HOPDQLQDWLRQ &KDUDFWHUL]DWLRQ LQ 30&V´
Review of Progress in Quantitative Nondestructive Evaluation
29. 0 6DOXFFL * 2OLYHUL ) 9LDQL 5 0LRUHOOL & 5HERXG 3 &DOPRQ $ 0DVVD ³$ OHDUQLQJE\H[DPSOHV

03 October 2024 09:07:14

DSSURDFK IRU QRQGHVWUXFWLYH ORFDOL]DWLRQ DQG FKDUDFWHUL]DWLRQ RI GHIHFWV WKURXJK HGG\ FXUUHQW
PHDVXUHPHQWV´2015 IEEE Int. Sym. Antennas Propag.
30. &'7RGGDQG5(&KDOOLV³4XDQWLWDWLYHFODVVLILFDWLRQRIDGKHVLYHERQGOLQHGLPHQVLRQVXVLQJ/DPEZDYHV
DQG DUWLILFLDO QHXUDO QHWZRUNV´ IEEE Trans. Ultrason. Ferroelectr. Freq. Control YRO  QR  SS ±

31. < /X / <H = 6X / =KRX DQG / &KHQJ ³$UWLILFLDO 1HXUDO 1HWZRUN $11 EDVHG &UDFN
,GHQWLILFDWLRQ LQ$OXPLQXP3ODWHVZLWK/DPE:DYH6LJQDOV´J. Intell. Mater. Syst. Struct.YROQRSS
±-XO 
32. ):0DUJUDYH.5LJDV'$%UDGOH\DQG3%DUURZFOLIIH³7KH XVH RI QHXUDO QHWZRUNV LQ XOWUDVRQLF
IODZGHWHFWLRQ´MeasurementYROQRSS±0DU
33. 6 <XDQ / :DQJ DQG * 3HQJ ³1HXUDO QHWZRUN PHWKRG EDVHG RQ D QHZ GDPDJH VLJQDWXUH IRU VWUXFWXUDO
KHDOWKPRQLWRULQJ´Thin-Walled Struct.YROQRSS±$SU
34. 6 : /LX - + +XDQJ - & 6XQJ DQG & & /HH ³'HWHFWLRQ RI FUDFNV XVLQJ QHXUDO QHWZRUNV DQG
FRPSXWDWLRQDOPHFKDQLFV´Comput. Methods Appl. Mech. Eng.YROQRSS±$SU
35. $ 'H )HQ]D $ 6RUUHQWLQR DQG 3 9LWLHOOR ³$SSOLFDWLRQ RI $UWLILFLDO 1HXUDO 1HWZRUNV DQG 3UREDELOLW\
(OOLSVH PHWKRGV IRU GDPDJH GHWHFWLRQ XVLQJ /DPE ZDYHV´ Compos. Struct. YRO  SS ± 'HF

36. - 5DILHH ) $UYDQL $ +DULIL DQG 0 + 6DGHJKL ³,QWHOOLJHQW FRQGLWLRQ PRQLWRULQJ RI D JHDUER[ XVLQJ
DUWLILFLDOQHXUDOQHWZRUN´Mech. Syst. Signal Process.YROQRSS±0D\
37. : +RX <:HL- *XR<-LQ DQG & =KX ³$XWRPDWLF 'HWHFWLRQRI:HOGLQJ'HIHFWV XVLQJ'HHS
1HXUDO 1HWZRUN´J. Phys. Conf. Ser.YROQRS-DQ
38. 0 )DKDG . .DPDO 7 =DIDU 5 4D\\XP 6 7DULT DQG . .KDQ ³&RUURVLRQ GHWHFWLRQ LQ LQGXVWULDO
SLSHV XVLQJ JXLGHG DFRXVWLFV DQG UDGLDO EDVLV IXQFWLRQ QHXUDO QHWZRUN´ LQ 2017 International Conference
on Robotics and Automation Sciences (ICRAS)SS±
39. 6 6KDUPD DQG $ 'DV ³%DFNFDOFXODWLRQ RI SDYHPHQW OD\HU PRGXOL IURP IDOOLQJ ZHLJKW GHIOHFWRPHWHU GDWD
XVLQJDQDUWLILFLDOQHXUDOQHWZRUN´Can. J. Civ. Eng.YROQRSS±-DQ
40. 6 =KDQJ + :DQJ : :DQJ DQG 6 &KHQ ³'DPDJH 'HWHFWLRQ LQ 6WUXFWXUHV 8VLQJ $UWLILFLDO 1HXUDO
1HWZRUNV´ LQ 2010 International Conference on Artificial Intelligence and Computational Intelligence
YROSS±

090001-9
  $%HUQLHUL/)HUULJQR0/DUDFFDDQG00ROLQDUD³&UDFN6KDSH5HFRQVWUXFWLRQLQ(GG\&XUUHQW7HVWLQJ
8VLQJ0DFKLQH/HDUQLQJ6\VWHPVIRU5HJUHVVLRQ´IEEE Trans. Instrum. Meas.YROQRSS±

 - %HQ $OL 1 )QDLHFK / 6DLGL % &KHEHO0RUHOOR DQG ) )QDLHFK ³$SSOLFDWLRQ RI HPSLULFDO PRGH
GHFRPSRVLWLRQDQGDUWLILFLDOQHXUDOQHWZRUNIRUDXWRPDWLFEHDULQJIDXOWGLDJQRVLVEDVHGRQYLEUDWLRQVLJQDOV´
Appl. Acoust.YROSS±0DU
 $'DUDELDQG;0DOGDJXH³1HXUDOQHWZRUNEDVHGGHIHFWGHWHFWLRQDQGGHSWKHVWLPDWLRQLQ71'(´NDT
E Int.YROQRSS±$SU
 -+RáDDQG.6FKDERZLF]³1HZWHFKQLTXHRIQRQGHVWUXFWLYHDVVHVVPHQWRIFRQFUHWHVWUHQJWKXVLQJDUWLILFLDO
LQWHOOLJHQFH´NDT E Int.YROQRSS±-XQ
 3&.DPLQVNL³7KH$SSUR[LPDWH/RFDWLRQRI'DPDJHWKURXJKWKH$QDO\VLVRI1DWXUDO)UHTXHQFLHVZLWK
$UWLILFLDO1HXUDO1HWZRUNV´Proc Inst Mech Eng Part E J Process Mech EngYROQRSS±
$XJ
 * 7UWQLN ) .DYFLF DQG * 7XUN ³3UHGLFWLRQ RI FRQFUHWH VWUHQJWK XVLQJ XOWUDVRQLF SXOVH YHORFLW\ DQG
DUWLILFLDOQHXUDOQHWZRUNV´UltrasonicsYROQRSS±-DQ
 -+RáDDQG.6FKDERZLF]³$SSOLFDWLRQRIDUWLILFLDOQHXUDOQHWZRUNVWRGHWHUPLQHFRQFUHWHFRPSUHVVLYH
VWUHQJWKEDVHGRQQRQဨGHVWUXFWLYHWHVWV´Journal of Civil Engineering and ManagementYROQRSS
±-DQ
 </H&XQ<%HQJLRDQG*+LQWRQ³'HHSOHDUQLQJ´NatureYROQRSS±0D\
 <%HQJLR³/HDUQLQJ'HHS$UFKLWHFWXUHVIRU$,´Foundations and Trends® in Machine LearningYRO
QRSS±
 0$EDGLet al.³7HQVRU)ORZ$6\VWHPIRU/DUJH6FDOH0DFKLQH/HDUQLQJ´LQOSDIYROSS
±
 $.UL]KHYVN\,6XWVNHYHUDQG*(+LQWRQ³,PDJH1HW&ODVVLILFDWLRQZLWK'HHS&RQYROXWLRQDO1HXUDO
1HWZRUNV´LQAdvances in Neural Information Processing Systems 25)3HUHLUD&-&%XUJHV/%RWWRX
DQG.4:HLQEHUJHU(GV&XUUDQ$VVRFLDWHV,QFSS±

03 October 2024 09:07:14

 $ .DUSDWQH : :DWNLQV - 5HDG DQG 9 .XPDU ³3K\VLFVJXLGHG 1HXUDO 1HWZRUNV 3*11  $Q
$SSOLFDWLRQLQ/DNH7HPSHUDWXUH0RGHOLQJ´arXiv [cs.LG]2FW
 53DROXFFL)*DWWL0,QIDQWLQR&6PHU]LQL$*QH\g]FHEHDQG06WXSD]]LQL³%URDGEDQG*URXQG
0RWLRQVIURP'3K\VLFV%DVHG1XPHULFDO6LPXODWLRQV8VLQJ$UWLILFLDO1HXUDO1HWZRUNV´Bull. Seismol.
Soc. Am.YROQR$SS±
 $.DUSDWQHet al.³7KHRU\*XLGHG'DWD6FLHQFH$1HZ3DUDGLJPIRU6FLHQWLILF'LVFRYHU\IURP'DWD´
IEEE Trans. Knowl. Data Eng.YROQRSS±2FW
 ')LQRO</X90DKDGHYDQDQG$6ULYDVWDYD³'HHS&RQYROXWLRQDO1HXUDO1HWZRUNVIRU(LJHQYDOXH
3UREOHPVLQ0HFKDQLFV´arXiv [physics.comp-ph]-DQ
 0 5DLVVL 3 3HUGLNDULV DQG* ( .DUQLDGDNLV ³3K\VLFV ,QIRUPHG 'HHS /HDUQLQJ 3DUW ,,  'DWDGULYHQ
'LVFRYHU\RI1RQOLQHDU3DUWLDO'LIIHUHQWLDO(TXDWLRQV´arXiv [cs.AI]1RY
 0 5DLVVL 3 3HUGLNDULV DQG* ( .DUQLDGDNLV ³3K\VLFV ,QIRUPHG 'HHS /HDUQLQJ 3DUW ,,  'DWDGULYHQ
'LVFRYHU\RI1RQOLQHDU3DUWLDO'LIIHUHQWLDO(TXDWLRQV´arXiv [cs.AI]1RY
 < %HQJLR ³'HHS OHDUQLQJ RI UHSUHVHQWDWLRQV IRU XQVXSHUYLVHG DQG WUDQVIHU OHDUQLQJ´ LQ Proceedings of
ICML Workshop on Unsupervised and Transfer LearningSS±
 6*KRVK³7UDQVGXFWLYHWUDQVIHUOHDUQLQJXVLQJDXWRHQFRGHUV´,QGLDQ6WDWLVWLFDO,QVWLWXWH.RONDWD
 +&6KLQet al.³'HHS&RQYROXWLRQDO1HXUDO1HWZRUNVIRU&RPSXWHU$LGHG'HWHFWLRQ&11$UFKLWHFWXUHV
'DWDVHW&KDUDFWHULVWLFVDQG7UDQVIHU/HDUQLQJ´IEEE Trans. Med. ImagingYROQRSS±
0D\
 6-3DQDQG4<DQJ³$VXUYH\RQWUDQVIHUOHDUQLQJ´IEEE Trans. Knowl. Data Eng.YROQRSS
±
 *0HVQLOet al.³8QVXSHUYLVHGDQGWUDQVIHUOHDUQLQJFKDOOHQJHDGHHSOHDUQLQJDSSURDFK´LQProceedings
of the 2011 International Conference on Unsupervised and Transfer Learning workshop-Volume 27
SS±



090001-10