Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3366423.3380253acmconferencesArticle/Chapter ViewAbstractPublication PagesthewebconfConference Proceedingsconference-collections
research-article
Open access

DyCRS: Dynamic Interpretable Postoperative Complication Risk Scoring

Published: 20 April 2020 Publication History

Abstract

Early identification of patients at risk for postoperative complications can facilitate timely workups and treatments and improve health outcomes. Currently, a widely-used surgical risk calculator online web system developed by the American College of Surgeons (ACS) uses patients’ static features, e.g. gender, age, to assess the risk of postoperative complications. However, the most crucial signals that reflect the actual postoperative physical conditions of patients are usually real-time dynamic signals, including the vital signs of patients (e.g., heart rate, blood pressure) collected from postoperative monitoring. In this paper, we develop a dynamic postoperative complication risk scoring framework (DyCRS) to detect the “at-risk” patients in a real-time way based on postoperative sequential vital signs and static features. DyCRS is based on adaptations of the Hidden Markov Model (HMM) that captures hidden states as well as observable states to generate a real-time, probabilistic, complication risk score. Evaluating our model using electronic health record (EHR) on elective Colectomy surgery from a major health system, we show that DyCRS significantly outperforms the state-of-the-art ACS calculator and real-time predictors with 50.16% area under precision-recall curve (AUCPRC) gain on average in terms of detection effectiveness. In terms of earliness, our DyCRS can predict 15hrs55mins earlier on average than clinician’s diagnosis with the recall of 60% and precision of 55%. Furthermore, Our DyCRS can extract interpretable patients’ stages, which are consistent with previous medical postoperative complication studies. We believe that our contributions demonstrate significant promise for developing a more accurate, robust and interpretable postoperative complication risk scoring system, which can benefit more than 50 million annual surgeries in the US by substantially lowering adverse events and healthcare costs.

References

[1]
Ahmed M. Alaa, Scott Hu, and Mihaela van der Schaar. 2017. Learning from Clinical Judgments: Semi-Markov-Modulated Marked Hawkes Processes for Risk Prognosis. In Proceedings of ICML. 60–69.
[2]
Ahmed M Alaa and Mihaela Van Der Schaar. 2018. A hidden absorbing semi-Markov model for informatively censored temporal data: learning and inference. The Journal of Machine Learning Research 19, 1 (2018), 108–169.
[3]
John B Ammori, Shawn J Pelletier, Raymond Lynch, Joshua Cohn, Yasser Ads, Darrell A Campbell, and Michael J Englesbe. 2008. Incremental costs of post–liver transplantation complications. Journal of the American College of Surgeons 206, 1 (2008), 89–95.
[4]
Ofri Ben-Assuli and Rema Padman. 2019. Trajectories of Repeated Hospitalizations and Frequent Readmissions of Chronic Disease Patients: Risk Stratification, Profiling, and Predictions. forthcoming in MIS Quarterly(2019).
[5]
Karl Y Bilimoria, Yaoming Liu, Jennifer L Paruch, Lynn Zhou, 2013. Development and evaluation of the universal ACS NSQIP surgical risk calculator: a decision aid and informed consent tool for patients and surgeons. Journal of the American College of Surgeons 217, 5 (2013), 833–842.
[6]
Jeff A Bilmes 1998. A gentle tutorial of the EM algorithm and its application to parameter estimation for Gaussian mixture and hidden Markov models. International Computer Science Institute 4, 510 (1998), 126.
[7]
Zhengping Che, Sanjay Purushotham, Kyunghyun Cho, David Sontag, and Yan Liu. 2018. Recurrent neural networks for multivariate time series with missing values. Scientific reports 8, 1 (2018), 6085.
[8]
Mark E Cohen, Karl Y Bilimoria, Clifford Y Ko, and Bruce Lee Hall. 2009. Development of an American College of Surgeons National Surgery Quality Improvement Program: morbidity and mortality risk calculator for colorectal surgery. Journal of the American College of Surgeons 208, 6 (2009), 1009–1016.
[9]
Mark E Cohen, Clifford Y Ko, Karl Y Bilimoria, Lynn Zhou, Kristopher Huffman, Xue Wang, Yaoming Liu, Kari Kraemer, Xiangju Meng, Ryan Merkow, 2013. Optimizing ACS NSQIP modeling for evaluation of surgical quality and risk: patient risk adjustment, procedure mix adjustment, shrinkage adjustment, and surgical focus. Journal of the American College of Surgeons 217, 2 (2013), 336–346.
[10]
Amy S Collins. 2008. Preventing health care–associated infections. In Patient safety and quality: an evidence-based handbook for nurses. Agency for Healthcare Research and Quality (US).
[11]
John P Collins. 2019. Measures of Clinical Meaningfulness and Important Differences. Physical therapy (2019).
[12]
Afsaneh Doryab, Anind K Dey, Grace Kao, and Carissa Low. 2019. Modeling Biobehavioral Rhythms with Passive Sensing in the Wild: A Case Study to Predict Readmission Risk after Pancreatic Surgery. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 3, 1 (2019), 1–21.
[13]
Anahita Dua, Sapan S Desai, Bhavin Patel, Gary R Seabrook, Kellie R Brown, Brian Lewis, Peter J Rossi, Michael Malinowski, and Cheong J Lee. 2016. Preventable complications driving rising costs in management of patients with critical limb ischemia. Annals of vascular surgery 33 (2016), 144–148.
[14]
Radwa Elshawi, Mouaz H Al-Mallah, and Sherif Sakr. 2019. On the interpretability of machine learning-based model for predicting hypertension. BMC medical informatics and decision making 19, 1 (2019), 146.
[15]
RS Evans. 2016. Electronic health records: then, now, and in the future. Yearbook of medical informatics 25, S 01 (2016), S48–S61.
[16]
Jonathan F Finks, Kerry L Kole, Panduranga R Yenumula, Wayne J English, Kevin R Krause, Arthur M Carlin, Jeffrey A Genaw, Mousumi Banerjee, John D Birkmeyer, Nancy J Birkmeyer, 2011. Predicting risk for serious complications with bariatric surgery: results from the Michigan Bariatric Surgery Collaborative. Annals of surgery 254, 4 (2011), 633–640.
[17]
Mohamed M Ghoneim and Michael W O’Hara. 2016. Depression and postoperative complications: an overview. BMC surgery 16, 1 (2016), 5.
[18]
Prateek K Gupta, Himani Gupta, Abhishek Sundaram, Manu Kaushik, Xiang Fang, Weldon J Miller, Dennis J Esterbrooks, Claire B Hunter, 2011. Development and validation of a risk calculator for prediction of cardiac risk after surgery. Circulation (2011), CIRCULATIONAHA–110.
[19]
Joyce C Ho, Cheng H Lee, and Joydeeph Ghosh. 2012. Imputation-enhanced prediction of septic shock in ICU patients. In Proceedings of the ACM SIGKDD workshop on health informatics (HI-KDD12). 18.
[20]
Irfan Ahmad Khan, Adnan Akber, and Yinliang Xu. 2019. Sliding Window Regression based Short-Term Load Forecasting of a Multi-Area Power System. arXiv preprint arXiv:1905.08111(2019).
[21]
Daehwan Kim, Ho-Seong Han, Yoo-Seok Yoon, Jai Young Cho, Youngrok Choi, Jae Yool Jang, and Hanlim Choi. 2015. Postoperative white blood cell counts change after pancreatoduodenectomy: Early sign for pancreatic fistula. Korean Journal of Clinical Oncology 11, 2 (2015), 95–100.
[22]
Hilal Maradit Kremers, Sue L Visscher, James P Moriarty, Megan S Reinalda, Walter K Kremers, James M Naessens, and David G Lewallen. 2013. Determinants of direct medical costs in primary and revision total knee arthroplasty. Clinical Orthopaedics and Related Research® 471, 1(2013), 206–214.
[23]
Sunil Kripalani, Cecelia N Theobald, Beth Anctil, and Eduard E Vasilevskis. 2014. Reducing hospital readmission rates: current strategies and future directions. Annual review of medicine 65 (2014), 471–485.
[24]
Gudrun Lamm, Johann Auer, Thomas Weber, Robert Berent, Cheung Ng, and Bernd Eber. 2006. Postoperative white blood cell count predicts atrial fibrillation after cardiac surgery. Journal of cardiothoracic and vascular anesthesia 20, 1(2006), 51–56.
[25]
Geoffrey K Lighthall, Sharmin Markar, and Robert Hsiung. 2009. Abnormal vital signs are associated with an increased risk for critical events in US veteran inpatients. Resuscitation 80, 11 (2009), 1264–1269.
[26]
Zachary C Lipton, David C Kale, Charles Elkan, and Randall Wetzel. 2015. Learning to diagnose with LSTM recurrent neural networks. arXiv preprint arXiv:1511.03677(2015).
[27]
Yu-Ying Liu, Shuang Li, Fuxin Li, Le Song, and James M Rehg. 2015. Efficient learning of continuous-time hidden markov models for disease progression. In Advances in neural information processing systems. 3600–3608.
[28]
Ladan Mozaffari, Ahmad Mozaffari, and Nasser L Azad. 2015. Vehicle speed prediction via a sliding-window time series analysis and an evolutionary least learning machine: A case study on San Francisco urban roads. Engineering science and technology, an international journal 18, 2(2015), 150–162.
[29]
Montha Na Narong, Somchit Thongpiyapoom, Nonglak Thaikul, Silom Jamulitrat, and Nongyao Kasatpibal. 2003. Surgical site infections in patients undergoing major operations in a university hospital: using standardized infection ratio as a benchmarking tool. American Journal of Infection Control 31, 5 (2003), 274–279.
[30]
Fouzia F Ozair, Nayer Jamshed, Amit Sharma, and Praveen Aggarwal. 2015. Ethical issues in electronic health records: A general overview. Perspectives in clinical research 6, 2 (2015), 73.
[31]
Brenden K Petersen, Michael B Mayhew, Kalvin OE Ogbuefi, John D Greene, Vincent X Liu, and Priyadip Ray. 2018. Modeling sepsis progression using hidden Markov models. arXiv preprint arXiv:1801.02736(2018).
[32]
Valentin Popov, Alesha Ellis-Robinson, and Gerald Humphris. 2019. Modelling reassurances of clinicians with hidden Markov models. BMC medical research methodology 19, 1 (2019), 11.
[33]
Michael John Pritchard. 2012. Pre-operative assessment of elective surgical patients.Nursing standard 26, 30 (2012).
[34]
Lawrence R Rabiner. 1989. A tutorial on hidden Markov models and selected applications in speech recognition. Proc. IEEE 77, 2 (1989), 257–286.
[35]
Katarzyna Rutkowska, Maciej Przybyła, and Hanna Misiołek. 2013. Health-care associated infection in the newly-opened intensive care unit. Anaesthesiology intensive therapy 45, 2 (2013), 62–66.
[36]
Takaya Saito and Marc Rehmsmeier. 2015. The precision-recall plot is more informative than the ROC plot when evaluating binary classifiers on imbalanced datasets. PloS one 10, 3 (2015), e0118432.
[37]
Andrew J Schoenfeld, Leah M Ochoa, Julia O Bader, and Philip J Belmont Jr. 2011. Risk factors for immediate postoperative complications and mortality following spine surgery: a study of 3475 patients from the National Surgical Quality Improvement Program. JBJS 93, 17 (2011), 1577–1582.
[38]
Sue Sendelbach and Marjorie Funk. 2013. Alarm fatigue: a patient safety concern. AACN advanced critical care 24, 4 (2013), 378–386.
[39]
Martin Sundermeyer, Ralf Schlüter, and Hermann Ney. 2012. LSTM neural networks for language modeling. In Thirteenth annual conference of the international speech communication association.
[40]
Majid Vafaeipour, Omid Rahbari, Marc A Rosen, Farivar Fazelpour, and Pooyandeh Ansarirad. 2014. Application of sliding window technique for prediction of wind velocity time series. International Journal of Energy and Environmental Engineering 5, 2-3(2014), 105.
[41]
Wen Wang, Rema Padman, and Nirav Shah. 2018. Early Stratification of Patients at Risk for Postoperative Complications after Elective Colectomy. arXiv preprint arXiv:1811.12227(2018).
[42]
Wen Wang, Rema Padman, and Nirav Shah. 2018. Early Stratification of Patients at Risk for Postoperative Complications after Elective Colectomy. ArXiv abs/1811.12227(2018).
[43]
Xiang Wang, David Sontag, and Fei Wang. 2014. Unsupervised learning of disease progression models. In Proceedings of the 20th ACM SIGKDD international conference on Knowledge discovery and data mining. ACM, 85–94.
[44]
Jenna Wiens, Eric Horvitz, and John V Guttag. 2012. Patient risk stratification for hospital-associated c. diff as a time-series classification task. In Advances in Neural Information Processing Systems. 467–475.
[45]
Xuhai Xu, Prerna Chikersal, Afsaneh Doryab, Daniella K Villalba, Janine M Dutcher, Michael J Tumminia, Tim Althoff, Sheldon Cohen, Kasey G Creswell, J David Creswell, 2019. Leveraging Routine Behavior and Contextually-Filtered Features for Depression Detection among College Students. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 3, 3 (2019), 1–33.
[46]
Jinsung Yoon, Ahmed Alaa, Scott Hu, and Mihaela Schaar. 2016. ForecastICU: a prognostic decision support system for timely prediction of intensive care unit admission. In International Conference on Machine Learning. 1680–1689.

Cited By

View all
  • (2022)The Secondary Use of Electronic Health Records for Data Mining: Data Characteristics and ChallengesACM Computing Surveys10.1145/349023455:2(1-40)Online publication date: 18-Jan-2022
  • (2021)Perioperative Risk Assessment in Pancreatic Surgery Using Machine Learning2021 43rd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC)10.1109/EMBC46164.2021.9630897(2211-2214)Online publication date: 1-Nov-2021

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
WWW '20: Proceedings of The Web Conference 2020
April 2020
3143 pages
ISBN:9781450370233
DOI:10.1145/3366423
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 20 April 2020

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Hidden Markov Model
  2. Interpretability
  3. Postoperative complications
  4. Real-time risk score

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Conference

WWW '20
Sponsor:
WWW '20: The Web Conference 2020
April 20 - 24, 2020
Taipei, Taiwan

Acceptance Rates

Overall Acceptance Rate 1,899 of 8,196 submissions, 23%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)136
  • Downloads (Last 6 weeks)26
Reflects downloads up to 05 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2022)The Secondary Use of Electronic Health Records for Data Mining: Data Characteristics and ChallengesACM Computing Surveys10.1145/349023455:2(1-40)Online publication date: 18-Jan-2022
  • (2021)Perioperative Risk Assessment in Pancreatic Surgery Using Machine Learning2021 43rd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC)10.1109/EMBC46164.2021.9630897(2211-2214)Online publication date: 1-Nov-2021

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Login options

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media