Abstract
Multimodal data allows supervised learning while considering multiple complementary views of a problem, improving final diagnostic performance of trained models. Data modalities that are missing or difficult to obtain in clinical situations can still be incorporated into model training using the learning using privileged information (LUPI) framework. However, noisy or redundant features in the privileged modality space can limit the amount of knowledge transferred to the diagnostic model during the LUPI learning process. We consider the problem of selecting desirable features from both standard features which are available during both model training and testing, and privileged features which are only available during model training. A novel filter feature selection method named NMIFS+ is introduced that considers redundancy between standard and privileged feature spaces. The algorithm is evaluated on two disease classification datasets with privileged modalities. Results demonstrate an improvement in diagnostic performance over comparable filter selection algorithms.
Grant supported by NIDCR R01 DE024450.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Bianchi, J., et al.: Software comparison to analyze bone radiomics from high resolution CBCT scans of mandibular condyles. Dentomaxill. Radiol. 48(6), 20190049 (2019)
Bianchi, J., et al.: Osteoarthritis of the temporomandibular joint can be diagnosed earlier using biomarkers and machine learning. Sci. Rep. 10(1), 1–14 (2020)
Bleiholder, J., Naumann, F.: Data fusion. ACM Comput. Surv. (CSUR) 41(1), 1–41 (2009)
Cevidanes, L.H., et al.: 3d osteoarthritic changes in tmj condylar morphology correlates with specific systemic and local biomarkers of disease. Osteoarth. Cart. 22(10), 1657–1667 (2014)
Chandrashekar, G., Sahin, F.: A survey on feature selection methods. Comput. Electr. Eng. 40(1), 16–28 (2014)
Cheplygina, V., de Bruijne, M., Pluim, J.P.: Not-so-supervised: a survey of semi-supervised, multi-instance, and transfer learning in medical image analysis. Med. Image Anal. 54, 280–296 (2019)
Duan, L., et al.: Incorporating privileged genetic information for fundus image based glaucoma detection. In: Golland, P., Hata, N., Barillot, C., Hornegger, J., Howe, R. (eds.) MICCAI 2014. LNCS, vol. 8674, pp. 204–211. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-10470-6_26
Estévez, P.A., Tesmer, M., Perez, C.A., Zurada, J.M.: Normalized mutual information feature selection. IEEE Trans. Neural Netw. 20(2), 189–201 (2009)
Hinton, G., Vinyals, O., Dean, J.: Distilling the knowledge in a neural network. arXiv preprint arXiv:1503.02531 (2015)
Izmailov, R., Lindqvist, B., Lin, P.: Feature selection in learning using privileged information. In: 2017 IEEE International Conference on Data Mining Workshops (ICDMW), pp. 957–963. IEEE (2017)
Kullback, S.: Information theory and statistics. Courier Corporation (1997)
Lahat, D., Adali, T., Jutten, C.: Multimodal data fusion: an overview of methods, challenges, and prospects. Proc. IEEE 103(9), 1449–1477 (2015)
Li, Y., Meng, F., Shi, J.: Learning using privileged information improves neuroimaging-based cad of Alzheimer’s disease: a comparative study. Med. Biol. Eng. Comput. 57(7), 1605–1616 (2019)
Lichman, M., et al.: Uci machine learning repository (2013)
Ozenne, B., Subtil, F., Maucort-Boulch, D.: The precision-recall curve overcame the optimism of the receiver operating characteristic curve in rare diseases. J. Clin. Epidemiol. 68(8), 855–859 (2015)
Pan, S.J., Yang, Q.: A survey on transfer learning. IEEE Trans. Knowl. Data Eng. 22(10), 1345–1359 (2009)
Pao, Y.H., Park, G.H., Sobajic, D.J.: Learning and generalization characteristics of the random vector functional-link net. Neurocomputing 6(2), 163–180 (1994)
Pechyony, D., Izmailov, R., Vashist, A., Vapnik, V.: SMO-style algorithms for learning using privileged information. In: Dmin. pp. 235–241. Citeseer (2010)
Peng, H., Long, F., Ding, C.: Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy. IEEE Trans. Patt. Anal. Mach. Intell. 27(8), 1226–1238 (2005)
Sakar, C.O., et al.: A comparative analysis of speech signal processing algorithms for Parkinson’s disease classification and the use of the tunable q-factor wavelet transform. Appl. Soft Comput. 74, 255–263 (2019)
Schiffman, E., et al.: Diagnostic criteria for temporomandibular disorders (DC/TMD) for clinical and research applications: recommendations of the international RDC/TMD consortium network and orofacial pain special interest group. J. Oral Facial Pain Head. 28(1), 6 (2014)
Sharmanska, V., Quadrianto, N., Lampert, C.H.: Learning to rank using privileged information. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 825–832 (2013)
Vapnik, V., Vashist, A.: A new learning paradigm: learning using privileged information. Neural Netw. 22(5–6), 544–557 (2009)
Ye, F., Pu, J., Wang, J., Li, Y., Zha, H.: Glioma grading based on 3d multimodal convolutional neural network and privileged learning. In: 2017 IEEE International Conference on Bioinformatics and Biomedicine (BIBM), pp. 759–763. IEEE (2017)
Zhang, P.B., Yang, Z.X.: A new learning paradigm for random vector functional-link network: RVFL+. Neural Netw. 122, 94–105 (2020)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Zhang, W. et al. (2021). Feature Selection for Privileged Modalities in Disease Classification. In: Syeda-Mahmood, T., et al. Multimodal Learning for Clinical Decision Support. ML-CDS 2021. Lecture Notes in Computer Science(), vol 13050. Springer, Cham. https://doi.org/10.1007/978-3-030-89847-2_7
Download citation
DOI: https://doi.org/10.1007/978-3-030-89847-2_7
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-89846-5
Online ISBN: 978-3-030-89847-2
eBook Packages: Computer ScienceComputer Science (R0)
