Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1109/ICASSP.2017.7952700guideproceedingsArticle/Chapter ViewAbstractPublication PagesConference Proceedingsacm-pubtype
research-article

Multi-view representation learning via gcca for multimodal analysis of Parkinson's disease

Published: 05 March 2017 Publication History

Abstract

Information from different bio-signals such as speech, handwriting, and gait have been used to monitor the state of Parkinson's disease (PD) patients, however, all the multimodal bio-signals may not always be available. We propose a method based on multi-view representation learning via generalized canonical correlation analysis (GCCA) for learning a representation of features extracted from handwriting and gait that can be used as a complement to speech-based features. Three different problems are addressed: classification of PD patients vs. healthy controls, prediction of the neurological state of PD patients according to the UPDRS score, and the prediction of a modified version of the Frenchay dysarthria assessment (m-FDA). According to the results, the proposed approach is suitable to improve the results in the addressed problems, specially in the prediction of the UPDRS, and m-FDA scores.

7. References

[1]
O. Hornykiewicz, “Biochemical aspects of Parkinson's disease,” Neurology, vol. 51, no. 2, pp. S2–S9, 1998.
[2]
C. G. Goetz and et al., “Movement Disorder Society-sponsored revision of the Unified Parkinson's Disease Rating Scale (MDS-UPDRS): Scale presentation and clinimetric testing results,” Movement Disorders, vol. 23, no. 15, pp. 2129–2170, 2008.
[3]
A. Tsanas, M. A. Little, C. Fox, and L. O. Ramig, “Objective automatic assessment of rehabilitative speech treatment in Parkinson's disease,” IEEE Transactions on Neural Systems and Rehabilitation Engineering, vol. 22, no. 1, pp. 181–190, 2014.
[4]
S. Zhao, F. Rudzicz, L. G Carvalho, C. Márquez-Chin, and S. Livingstone, “Automatic detection of expressed emotion in Parkinson's disease,” in 39th International Conference on Acoustic, Speech, and Signal Processing (ICASSP), 2014, pp. 4813–4817.
[5]
B. Schuller, S. Steidl, A. Batliner, S. Hantke, F. Hönig, J. R. Orozco-Arroyave, E. Nöth, Y. Zhang, and F. Weninger, “The INTERSPEECH 2015 computational paralinguistics challenge: Nativeness, Parkinsons & eating condition,” in 16th Annual Conference of the Speech and Communication Association(INTERSPEECH), 2015, pp. 478–482.
[6]
T. Grósz, R. Busa-Fekete, G. Gosztolya, and L. Tóth, “Assessing the degree of nativeness and Parkinsons condition using Gaussian processes and deep rectifier neural networks,” in 16th Annual Conference of the Speech and Communication Association(INTERSPEECH), 2015, pp. 1339–1343.
[7]
J. R. Orozco-Arroyave, J. C. Vásquez-Correa, F. Hönig, J. D. Arias-Londoño, J. F. Vargas-Bonilla, S. Skodda, J. Rusz, and E. Nöth, “Towards an automatic monitoring of the neurological state of the Parkinson's patients from speech,” in 41st International Conference on Acoustic, Speech, and Signal Processing (ICASSP), 2016.
[8]
J. Klucken, J. Barth, P. Kugler, J. Schlachetzki, T. Henze, F. Marxreiter, Z. Kohl, R. Steidl, J. Hornegger, and B. Eskofier, “Unbiased and mobile gait analysis detects motor impairment in Parkinson's disease,” PloS one, vol. 8, no. 2, pp. e56956, 2013.
[9]
eGaIT - embedded Gait analysis using Intelligent Technology, http://www.egait.de/,” 2011.
[10]
F. Parisi, G. Ferrari, M. Giuberti, L. Contin, V. Cimolin, C. Azzaro, G. Albani, and A. Mauro, “Body-sensor-network-based kinematic characterization and comparative outlook of UPDRS scoring in leg agility, sit-to-stand, and gait tasks in Parkinson's disease,” IEEE Journal of Biomedical and Health Informatics, vol. 19, no. 6, pp. 1777–1793, 2015.
[11]
E. J. Smits, A. J. Tolonen, L. Cluitmans, M. van Gils, B. A. Conway, R. C. Zietsma, K. L. Leenders, and N. M. Maurits, “Standardized handwriting to assess bradykinesia’ micrographia and tremor in Parkinson's disease,” PloS one, vol. 9, no. 5, pp. e97614, 2014.
[12]
P. Drotár, J. Mekyska, I. Rektorová, L. Masarová, Z. Smékal, and M. Faundez-Zanuy, “Evaluation of handwriting kinematics and pressure for differential diagnosis of Parkinson's disease,” Artificial intelligence in Medicine, vol. 67, pp. 39–46, 2016.
[13]
S. Bharadwaj, R. Arora, K. Livescu, and M. Hasegawa-Johnson, “Multiview acoustic feature learning using articulatory measurements,” in Intl. Workshop on Stat. Machine Learning for Speech Recognition, 2012.
[14]
P. Rastogi, B. Van Durme, and R. Arora, “Multiview LSA: Representation learning via generalized CCA,” in Human Language Technologies: The 2015 Annual Conference of the North American Chapter of the ACL, 2015, pp. 556–566.
[15]
P Enderby and R. Palmer, FDA-2: Frenchay Dysarthria Assessment, P. Education, 2nd edition, 2008.
[16]
V. Zeißler, J. Adelhardt, A. Batliner, C. Frank, E. Nöth, R. P. Shi, and H. Niemann, “The prosody module,” in SmartKom: foundations of multimodal dialogue systems, pp. 139–152. Springer 2006.
[18]
M. Shin, S. Park, S. Park, S. Seol, and J. Kwon, “Clinical and empirical applications of the Rey-Osterrieth complex figure test,” Nature Protocols, vol. 1, no. 2, pp. 892–899, 2006.
[19]
J. R. Orozco-Arroyave, J. D. Arias-Londoño, J. F. Vargas-Bonilla, M. C. Gonzalez-Rátiva, and E. Nöth, “New Spanish speech corpus database for the analysis of people suffering from Parkinson's disease,” in Language Resources and Evaluation Conference, (LREC), 2014, pp. 342–347.
[20]
J. R. Orozco-Arroyave, F. Hönig, J. D. Arias-Londoño, J. F. Vargas-Bonilla, K. Daqrouq, S. Skodda, J. Rusz, and E. Nöth “Automatic detection of Parkinson's disease in running speech spoken in three different languages,” The Journal of the Acoustical Society of America, vol. 139, no. 1, pp. 481–500, 2016.

Cited By

View all
  • (2023)Knowledge-aware patient representation learning for multiple disease subtypesJournal of Biomedical Informatics10.1016/j.jbi.2023.104292138:COnline publication date: 1-Feb-2023

Index Terms

  1. Multi-view representation learning via gcca for multimodal analysis of Parkinson's disease
            Index terms have been assigned to the content through auto-classification.

            Recommendations

            Comments

            Information & Contributors

            Information

            Published In

            cover image Guide Proceedings
            2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
            Mar 2017
            6527 pages

            Publisher

            IEEE Press

            Publication History

            Published: 05 March 2017

            Qualifiers

            • Research-article

            Contributors

            Other Metrics

            Bibliometrics & Citations

            Bibliometrics

            Article Metrics

            • Downloads (Last 12 months)0
            • Downloads (Last 6 weeks)0
            Reflects downloads up to 04 Feb 2025

            Other Metrics

            Citations

            Cited By

            View all
            • (2023)Knowledge-aware patient representation learning for multiple disease subtypesJournal of Biomedical Informatics10.1016/j.jbi.2023.104292138:COnline publication date: 1-Feb-2023

            View Options

            View options

            Figures

            Tables

            Media

            Share

            Share

            Share this Publication link

            Share on social media