Abstract
Several studies investigated the diagnosis of Parkinson’s disease (PD), which utilized machine learning methods such as support vector machine, neural network, Naïve Bayes and K-nearest neighbor. In addition, different ensemble methods were used such as bagging, random forest and boosting. On the other hand, different feature ranking methods have been used to reduce the data dimensionality by selecting the most important features. In this paper, the ensemble methods, random forest, XGBoost and CatBoost were used to find the most important features for predicting PD. The effect of these features with different thresholds was investigated in order to obtain the best performance for predicting PD. The results showed that CatBoost method obtained the best results.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Xie, W., Li, X., Li, C., Zhu, W., Jankovic, J., Le, W.: Proteasome inhibition modeling nigral neuron degeneration in Parkinson’s disease. J. Neurochem. 115(1), 188–199 (2010)
Borah, A., Choudhury, A., Paul, R., Mazumder, M.K., Chetia, S.: Neuroprotective effect of ayurvedic preparations and natural products on Parkinsons disease. Neuroprotect. Nat. Prod. Clin. Aspect. Mod. Act. (2017)
Olalekan, O., Sanya, O.J.: NMDA R/VDR in fish melanocytes; receptor targeted therapeutic model and mechanism in Parkinson’s disease: J. Biomol. Res. Ther. 3(114) (2014)
Pallanti, S., Marras, A.: Transcranial magnetic stimulation treatment for motor symptoms in Parkinson’s disease: a review of two decades of studies. Alzheimers Dis. Parkinsonism 5(191), 2161–2460 (2015)
Ford, B.: Pain in Parkinson’s disease. Clinical Neurosci. 5(2), 63–72 (1998)
Benitez, A., Edens, H., Fishman, J., Moran, K., Asgharnejad, M.: Rotigotine transdermal system: developing continuous dopaminergic delivery to treat Parkinson’s disease and restless legs syndrome. Ann. N. Y. Acad. Sci. 1329(1), 45–66 (2014)
Olanow, C.W., Rascol, O., Hauser, R., Feigin, P.D., Jankovic, J., Lang, A., Tolosa, E., et al.: A double-blind, delayed-start trial of Rasagiline in Parkinson’s disease. New Engl. J. Med. 361(13), 1268–1278 (2009)
El Moudden, I., Ouzir, M., ElBernoussi, S.: Feature selection and extraction for class prediction in dysphonia measures analysis: a case study on Parkinson’s disease speech rehabilitation. Technol. Health Care 25(4), 693–708 (2017)
Patra, A. K., Ray, R., Abdullah, A. A., & Dash, S. R.: Prediction of Parkinson’s disease using Ensemble Machine Learning classification from acoustic analysis. J. Phys Conf. Ser. 1372(1) (2019)
Saeys, Y., Abeel, T., Van de Peer, Y.: Robust feature selection using ensemble feature selection techniques. In: Joint European Conference on Machine Learning and Knowledge Discovery in Databases, pp. 313–325. Springer, Berlin (2008)
Khan, T., Lundgren, L. E., Anderson, D. G., Nowak, I., Dougherty, M., Verikas, A., Aharonson, V.: Assessing Parkinson’s disease severity using speech analysis in non-native speakers. Comput. Speech Lang. 61(101047) (2020)
Li, X., Wang, Y., Basu, S., Kumbier, K., & Yu, B.: A Debiased MDI feature importance measure for random forests. arXiv preprint arXiv 1906 (10845) (2019)
Lai, V., Cai, J.Z., Tan, C.: Many faces of feature importance: comparing built-in and post-hoc feature importance in text classification. arXiv preprint arXiv 1910 (08534) (2019)
Razmjoo, A., Xanthopoulos, P., Zheng, Q.P.: Feature importance ranking for classification in mixed online environments. Ann. Oper. Res. 276(1–2), 315–330 (2019)
Hoyle, B., Rau, M.M., Zitlau, R., Seitz, S., Weller, J.: Feature importance for machine learning redshifts applied to SDSS galaxies. Mon. Not. R. Astron. Soc. 449(2), 1275–1283 (2015)
Elghazel, H., Aussem, A.: Unsupervised feature selection with ensemble learning. Mach. Learn. 98(1–2), 157–180 (2015)
Prakash, J., Kankar, P. K.: Health prediction of hydraulic cooling circuit using deep neural network with ensemble feature ranking technique. Measurement 151(107225) (2020)
Al-Sarem, M., Saeed, F., Alsaeedi, A., Boulila, W., Al-Hadhrami, T.: Ensemble methods for instance-based arabic language authorship attribution. IEEE Access 8, 17331–17345 (2020)
Chen, Z., Jiang, F., Cheng, Y., Gu, X., Liu, W., Peng, J.: XGBoost classifier for DDoS attack detection and analysis in SDN-Based cloud. In: 2018 IEEE International Conference on Big Data and Smart Computing (BigComp), pp. 251–256. Shanghai, China (2018)
Dhaliwal, S., Nahid, A.A., Abbas, R.: Effective intrusion detection system using XGBoost. Information 9(7), 149 (2018)
Prokhorenkova, L., Gusev, G., Vorobev, A., Dorogush, A. V., & Gulin, A.: CatBoost: unbiased boosting with categorical features. In: 32nd Conference on Neural Information Processing Systems, pp. 6638–6648. Montréal, Canada (2018)
Dorogush, A.V., Ershov, V., Gulin, A.: CatBoost: gradient boosting with categorical features support. arXiv preprint arXiv 1810(11363) (2018)
Al-Sarem, M., Boulila, W., Al-Harby, M., Qadir, J., Alsaeedi, A.: Deep learning-based rumor detection on microblogging platforms: a systematic review. IEEE Access 7, 152788–152812 (2019)
Chebbi, I., Boulila, W., Farah, I.R.: Big data: concepts, challenges and applications. In: Computational collective intelligence, pp. 638–647. Springer, Cham (2015)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 The Editor(s) (if applicable) and The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Al-Sarem, M., Saeed, F., Boulila, W., Emara, A.H., Al-Mohaimeed, M., Errais, M. (2021). Feature Selection and Classification Using CatBoost Method for Improving the Performance of Predicting Parkinson’s Disease. In: Saeed, F., Al-Hadhrami, T., Mohammed, F., Mohammed, E. (eds) Advances on Smart and Soft Computing. Advances in Intelligent Systems and Computing, vol 1188. Springer, Singapore. https://doi.org/10.1007/978-981-15-6048-4_17
Download citation
DOI: https://doi.org/10.1007/978-981-15-6048-4_17
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-15-6047-7
Online ISBN: 978-981-15-6048-4
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)