Abstract
Autism spectrum disorder (ASD) diagnostic systems, based on association of multimodal tools such as combination of Electroencephalogram (EEG) and eye-tracking, have emerged as an analytical to provide objective biomarkers. However, the existing feature-redundancy-based systems have lacked in providing knowledge of fusion approaches and robust feature-set. The present paper aims to reduce disorder homogeneity by proposing a multimodal diagnostic system which can incorporate multimodal data. The paper has collected simultaneous-data from three modalities (laptop-performance tool, EEG machine, and Eye-tracker) fused the recorded computational, neural and visual data. The multimodal features are analyzed via proposed multimodal Kernel-based discriminant correlation analysis (MKDCA) fusion approach and classified using state-of-the-art machine-learning classifiers. The proposed framework has considered the distinct cardinality of the feature vectors and fused the group structure among multiple samples after ranking them in increasing order. As per the results, the proposed multimodal system provided fused feature set of 11 influential features out of total 39 features. The SVM classifier has diagnosed ASD with 92% testing accuracy and 0.988 AUC(ROC). The proposed automated fusion-based system has the potential to classify disorder by reducing the disorder heterogeneity and stratifying ASD individuals into homogeneous sub-groups. In future, the correlation of reduced feature set with ASD clinical symptoms accounted by screening scales can provide clinical relevance of proposed model.






Data availability
The EEG data will be made available on email request to author and Professor M.J. Alhaddad (King Abdulaziz University (KAU), Jeddah, Saudi Arabia).
References
Kakkar D (2019) Diagnostic assessment techniques and non-invasive biomarkers for autism spectrum disorder. Int J E-Health Med Commun 10(3):79–95. https://doi.org/10.4018/IJEHMC.2019070105
Mash LE, Reiter MA, Linke AC, Townsend J, Müller RA (2018) Multimodal approaches to functional connectivity in autism spectrum disorders: an integrative perspective. Dev Neurobiol 78(5):456–473. https://doi.org/10.1002/dneu.22570
Jaime M, McMahon CM, Davidson BC, Newell LC, Mundy PC, Henderson HA (2016) Brief report: reduced temporal-central EEG alpha coherence during joint attention perception in adolescents with autism spectrum disorder. J Autism Dev Disord 46(4):1477–1489. https://doi.org/10.1007/s10803-015-2667-3
Wadhera T, Mahmud M (2022) Brain functional network topology in autism spectrum disorder: a novel weighted hierarchical complexity metric for electroencephalogram. IEEE J Biomed Health Inform 27(4):1718–1725. https://doi.org/10.1109/JBHI.2022.3232550
Zhang L, Wade J, Bian D, Fan J, Swanson A, Weitlauf A, Sarkar N (2015). Multimodal fusion for cognitive load measurement in an adaptive virtual reality driving task for autism intervention. In International Conference on UAHCI (pp. 709–720). Springer, Cham. https://doi.org/10.1007/978-3-319-20684-4_68
Alhussein M, Muhammad G, Hossain MS, Amin SU (2018) Cognitive IoT-cloud integration for smart healthcare: case study for epileptic seizure detection and monitoring. Mob Netw Appl 23(6):1624–1635. https://doi.org/10.1007/s11036-018-1113-0
Koelstra S, Muhl C, Soleymani M, Lee JS, Yazdani A, Ebrahimi T, Patras I (2011) Deap: A database for emotion analysis; using physiological signals. IEEE Trans Affect Comput 3(1):18–31. https://doi.org/10.1109/T-AFFC.2011.15
Correa NM, Li YO, Adali T, Calhoun VD (2008) Canonical correlation analysis for feature-based fusion of biomedical imaging modalities and its application to detection of associative networks in schizophrenia. IEEE J Sel Top Signal Process 2(6):998–1007. https://doi.org/10.1109/JSTSP.2008.2008265
Zhao F, Qiao L, Shi F, Yap PT, Shen D (2017) Feature fusion via hierarchical supervised local CCA for diagnosis of autism spectrum disorder. Brain Imaging Behave 11(4):1050–1060. https://doi.org/10.1007/s11682-016-9587-5
Joshi G, Vig R, Singh S (2018) DCA-based unimodal feature-level fusion of orthogonal moments for Indian sign language dataset. IET Comput Vis 12(5):570–577. https://doi.org/10.1049/iet-cvi.2017.0394
Dekhil O, Ali M, El-Nakieb Y, Shalaby A, Soliman A, Switala A, Elmaghraby A (2019) A personalized autism diagnosis cad system using a fusion of structural mri and resting-state functional mri data. Front Psychiatry 10:392. https://doi.org/10.3389/fpsyt.2019.00392
Zhao F, Zhang H, Rekik I, An Z, Shen D (2018) Diagnosis of autism spectrum disorders using multi-level high-order functional networks derived from resting-state functional MRI. Front Hum Neurosci 12:184. https://doi.org/10.3389/fnhum.2018.00184
Kang J, Han X, Song J, Niu Z, Li X (2020) The identification of children with autism spectrum disorder by SVM approach on EEG and eye-tracking data. Comput Biol Med. https://doi.org/10.1016/j.compbiomed.2020.103722
Chuanchao Z (2020) Two-level fusion big data compression and reconstruction framework combining second-generation wavelet and lossless compression. Complex Intell Syst 6:607–620. https://doi.org/10.1007/s40747-020-00158-z
Wadhera T, Mahmud M (2022) Brain functional network topology in autism spectrum disorder: a novel weighted hierarchical complexity metric for electroencephalogram. IEEE J Biomed Health Inform. https://doi.org/10.1109/JBHI.2022.3232550
Wadhera T, Kakkar D (2020) Multiplex temporal measures reflecting neural underpinnings of brain functional connectivity under cognitive load in Autism Spectrum Disorder. Neurol Res 42(4):327–339. https://doi.org/10.1080/01616412.2020.1726586
Kang J, Zhou T, Han J, Li X (2018) EEG-based multi-feature fusion assessment for autism. J Clin Neurosci 56:101–107. https://doi.org/10.1016/j.jocn.2018.06.049
Wadhera T, Kakkar D (2021) Analysis of simultaneous visual and complex neural dynamics during cognitive learning to diagnose ASD. Phys Eng Sci Med 44(4):1081–1094. https://doi.org/10.1007/s13246-021-01045-8
Subah FZ, Deb K, Dhar PK, Koshiba T (2021) A deep learning approach to predict autism spectrum disorder using multisite resting-state fMRI. Appl Sci 11(8):3636. https://doi.org/10.3390/app11083636
Wadhera T, Bedi J, Sharma S (2023) Autism spectrum disorder prediction using bidirectional stacked gated recurrent unit with time-distributor wrapper: an EEG study. Neural Comput Appl 35(13):9803–9818. https://doi.org/10.1007/s00521-023-08218-4
Acknowledgements
I would like to thank the hospital team for allowing to carry the research and for providing the EEG signals. I am also very much thankful to Professor M.J. Alhaddad and his Brain Computer Interface (BCI) Group (King Abdulaziz University (KAU), Jeddah, Saudi Arabia) for providing the EEG signals of ASD children.
Funding
The present work is not supported financially by any funding agency.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The author has not any conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Below is the link to the electronic supplementary material.
Rights and permissions
About this article
Cite this article
Wadhera, T. Multimodal Kernel-based discriminant correlation analysis data-fusion approach: an automated autism spectrum disorder diagnostic system. Phys Eng Sci Med 47, 361–369 (2024). https://doi.org/10.1007/s13246-023-01350-4
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s13246-023-01350-4