Abstract
Predicting health risk from electronic health records (EHRs) is increasingly demanded in the medical and health fields. Many studies have pursued prediction accuracy while ignoring the interpretability of their developed models. To encourage lifestyle changes by patients and employees, an appropriate explanation of why the model outputs high risk is as important as accurately predicting the health risk. In this study, we construct 33 predictive models (11 health-checkup items checked after one, two, and three years). We also clarify a problem in the existing Local Interpretable Model-agnostic Explanations (LIME), namely, inconsistency among the health-risk predictions of the three target years. To resolve this problem, we find and exclude an anomalous sample that deteriorate the interpretation, and output a consistent interpretation of the health-risk predictions over the three years. We evaluate proposed method using more than 10,000 medical examination data. Accuracy was improved by 16% at the maximum compared to the baseline that output the risk at year Y + 1,2,3 equaling to that at year Y. Also, proposed LIME called C-LIME improve number of employees whom we can provide consistent lifestyle advice over the years three times compared to LIME. We have released a health-risk prediction and lifestyle recommendation service using proposed method for employees of the Nippon Telegraph and Telephone Group from April of 2019.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Ancona, M.B., Ceolini, E., Öztireli, C., Gross, M.: Towards better understanding of gradient-based attribution methods for deep neural networks. In: ICLR (2018)
Apley, D.W.: Visualizing the effects of predictor variables in black box supervised learning models. arXiv:1612.08468 (2016)
Bastani, O., Pu, Y., Solar-Lezama, A.: Verifiable reinforcement learning via policy extraction. In: NeurIPS (2018)
Chen, M., Hao, Y., Hwang, K., Wang, L., Wang, L.: Disease prediction by machine learning over big data from healthcare communities. IEEE Access 5, 8869–8879 (2017)
Cheng, Y., Wang, F., Zhang, P., Hu, J.: Risk prediction with electronic health records: a deep learning approach. In: Proceedings of the 2016 SIAM International Conference on Data Mining (2016)
Craven, M.W., Shavlik, J.W.: Extracting tree-structured representations of trained networks. In: Proceedings of the 8th International Conference on Neural Information Processing Systems, pp. 24–30 (1995)
Elshawi, R., Al-Mallah, M.H., Sakr, S.: On the interpretability of machine learning-based model for predicting hypertension. BMC Med. Inf. Decis. Making 19 (2019)
Goldstein, A., Kapelner, A., Bleich, J., Pitkin, E.: Peeking inside the black box: visualizing statistical learning with plots of individual conditional expectation (2013)
Goldstein, B.A., Navar, A.M., Pencina, M.J., Ioannidis, J.P.A.: Opportunities and challenges in developing risk prediction models with electronic health records data: a systematic review. J. Am. Med. Inf. Assoc. 24(1), 198–208 (2016)
Hall, P., Gill, N., Schmidt, N.: Proposed guidelines for the responsible use of explainable machine learning (2019)
Hastie, T.J., Tibshirani, R., Friedman, J.H.: The elements of statistical learning (2001)
Huang, Z., Dong, W., Duan, H., Liu, J.: A regularized deep learning approach for clinical risk prediction of acute coronary syndrome using electronic health records. IEEE Trans. Biomed. Eng. 65(5), 956–968 (2018)
Kanegae, H., Suzuki, K., Fukatani, K., Ito, T., Harada, N., Kario, K.: Highly precise risk prediction model for new onset hypertension using artificial intelligence techniques. J. Clin. Hypertension (2019)
Lundberg, S., Lee, S.I.: A unified approach to interpreting model predictions. In: NIPS (2017)
Ma, F., Gao, J., Suo, Q., You, Q., Zhou, J., Zhang, A.: Risk prediction on electronic health records with prior medical knowledge. In: Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 1910–1919 (2018)
Miotto, R., Li, L., Kidd, B.A., Dudley, J.T.: Deep patient: An unsupervised representation to predict the future of patients from the electronic health records. Sci. Rep. 6 (2016)
Nguyen, P., Tran, T., Wickramasinghe, N., Venkatesh, S.: \(\mathtt Deepr\): a convolutional net for medical records. IEEE J. Biomed. Health Inf. 21(1), 22–30 (2017)
Pham, T., Tran, T., Phung, D., Venkatesh, S.: Predicting healthcare trajectories from medical records: a deep learning approach. J. Biomed. Inf. 69, 218–229 (2017)
Rahimian, F., et al.: Predicting the risk of emergency admission with machine learning: development and validation using linked electronic health records. PLOS Medicine 15, e1002695 (2018)
Rajkomar, A., et al.: Scalable and accurate deep learning with electronic health records. NPJ Digit. Med. 1 (2018)
Ribeiro, M.T., Singh, S., Guestrin, C.: “Why should I trust you?”: explaining the predictions of any classifier. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 1135–1144 (2016)
Ribeiro, M.T., Singh, S., Guestrin, C.: Anchors: High-precision model-agnostic explanations. In: AAAI (2018)
Shickel, B., Tighe, P.J., Bihorac, A., Rashidi, P.: Deep EHR: a survey of recent advances in deep learning techniques for electronic health record (EHR) analysis. IEEE J. Biomed. Health Informatics 22(5), 1589–1604 (2018)
Yadav, P., Steinbach, M., Kumar, V., Simon, G.: Mining electronic health records (EHRs): a survey. ACM Comput. Surv. 50(6) (2018)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Ito, T., Ochiai, K., Fukazawa, Y. (2021). C-LIME: A Consistency-Oriented LIME for Time-Series Health-Risk Predictions. In: Uehara, H., Yamaguchi, T., Bai, Q. (eds) Knowledge Management and Acquisition for Intelligent Systems. PKAW 2021. Lecture Notes in Computer Science(), vol 12280. Springer, Cham. https://doi.org/10.1007/978-3-030-69886-7_5
Download citation
DOI: https://doi.org/10.1007/978-3-030-69886-7_5
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-69885-0
Online ISBN: 978-3-030-69886-7
eBook Packages: Computer ScienceComputer Science (R0)