research-article

Public Access

Designing Interactive Alerts to Improve Recognition of Critical Events in Medical Emergencies

Authors:

Angela Mastrianni,

Aleksandra Sarcevic,

Zachary Milestone,

Randall S BurdAuthors Info & Claims

DIS '21: Proceedings of the 2021 ACM Designing Interactive Systems Conference

Pages 864 - 878

https://doi.org/10.1145/3461778.3462051

Published: 28 June 2021 Publication History

All formats PDF

Abstract

Vital sign values during medical emergencies can help clinicians recognize and treat patients with life-threatening injuries. Identifying abnormal vital signs, however, is frequently delayed and the values may not be documented at all. In this mixed-methods study, we designed and evaluated a two-phased visual alert approach for a digital checklist in trauma resuscitation that informs users about undocumented vital signs. Using an interrupted time series analysis, we compared documentation in the periods before (two years) and after (four months) the introduction of the alerts. We found that introducing alerts led to an increase in documentation throughout the post-intervention period, with clinicians documenting vital signs earlier. Interviews with users and video review of cases showed that alerts were ineffective when clinicians engaged less with the checklist or set the checklist down to perform another activity. From these findings, we discuss approaches to designing alerts for dynamic team-based settings.

References

[1]

Emily C. Alberto, Michael J. Amberson, Megan Cheng, Ivan Marsic, Arunachalam A. Thenappan, Aleksandra Sarcevic, Karen J. O'Connell, and Randall S. Burd. 2020. Assessment of Nonroutine Events During Intubation After Pediatric Trauma. Journal of Surgical Research. https://doi.org/10.1016/j.jss.2020.09.036

[2]

Mohammed Al-Jaghbeer, Dilhari Dealmeida, Andrew Bilderback, Richard Ambrosino, and John A. Kellum. 2018. Clinical Decision Support for In-Hospital AKI. Journal of the American Society of Nephrology 29, 2: 654–660. https://doi.org/10.1681/ASN.2017070765

[3]

Jessica S. Ancker, Alison Edwards, Sarah Nosal, Diane Hauser, Elizabeth Mauer, Rainu Kaushal, and with the HITEC Investigators. 2017. Effects of workload, work complexity, and repeated alerts on alert fatigue in a clinical decision support system. BMC Medical Informatics and Decision Making 17, 1: 36. https://doi.org/10.1186/s12911-017-0430-8

[4]

ATLS Subcommittee, American College of Surgeons’ Committee on Trauma, and International ATLS working group. 2013. Advanced trauma life support (ATLS®): the ninth edition. The Journal of Trauma and Acute Care Surgery 74, 5: 1363–1366. https://doi.org/10.1097/TA.0b013e31828b82f5

[5]

Renaldo C. Blocker, Ashley Eggman, Robert Zemple, Elise Wu Chi-Tao, and Douglas A. Wiegmann. 2010. Developing an Observational Tool for Reliably Identifying Work System Factors in the Operating Room that Impact Cardiac Surgical Care. Proceedings of the Human Factors and Ergonomics Society Annual Meeting 54, 12: 879–883. https://doi.org/10.1177/154193121005401216

[6]

Tiffani J. Bright, Anthony Wong, Ravi Dhurjati, Erin Bristow, Lori Bastian, Remy R. Coeytaux, Gregory Samsa, Vic Hasselblad, John W. Williams, Michael D. Musty, Liz Wing, Amy S. Kendrick, Gillian D. Sanders, and David Lobach. 2012. Effect of clinical decision-support systems: a systematic review. Annals of Internal Medicine 157, 1: 29–43. https://doi.org/10.7326/0003-4819-157-1-201207030-00450

[7]

Amanda R. Burden, Zyad J. Carr, Gregory W. Staman, Jeffrey J. Littman, and Marc C. Torjman. 2012. Does every code need a “reader?” improvement of rare event management with a cognitive aid “reader” during a simulated emergency: a pilot study. Simulation in Healthcare: Journal of the Society for Simulation in Healthcare 7, 1: 1–9. https://doi.org/10.1097/SIH.0b013e31822c0f20

[8]

Barbara K. Burian, Anna Clebone, Key Dismukes, and Keith J. Ruskin. 2018. More Than a Tick Box: Medical Checklist Development, Design, and Use. Anesthesia & Analgesia 126, 1: 223–232. https://doi.org/10.1213/ANE.0000000000002286

[9]

Miguel Cabral Guerra, Deedee Kommers, Saskia Bakker, Pengcheng An, Carola van Pul, and Peter Andriessen. 2019. Beepless: Using Peripheral Interaction in an Intensive Care Setting. In Proceedings of the 2019 on Designing Interactive Systems Conference, 607–620. https://doi.org/10.1145/3322276.3323696

Digital Library

[10]

Francisco M. Calisto, Alfredo Ferreira, Jacinto C. Nascimento, and Daniel Gonçalves. 2017. Towards Touch-Based Medical Image Diagnosis Annotation. In Proceedings of the 2017 ACM International Conference on Interactive Surfaces and Spaces, 390–395. https://doi.org/10.1145/3132272.3134111

Digital Library

[11]

Francisco Maria Calisto, Carlos Santiago, Nuno Nunes, and Jacinto C. Nascimento. 2021. Introduction of human-centric AI assistant to aid radiologists for multimodal breast image classification. International Journal of Human-Computer Studies 150: 102607. https://doi.org/10.1016/j.ijhcs.2021.102607

[12]

James J. Cimino, Lincoln Farnum, Kelly Cochran, Steve D. Moore, Patricia P. Sengstack, and Jon W. McKeeby. 2010. Interpreting Nurses’ Responses to Clinical Documentation Alerts. AMIA Annual Symposium Proceedings 2010: 116–120.

[13]

Vanessa Cobus, Bastian Ehrhardt, Susanne Boll, and Wilko Heuten. 2018. Vibrotactile Alarm Display for Critical Care. In Proceedings of the 7th ACM International Symposium on Pervasive Displays, 1–7. https://doi.org/10.1145/3205873.3205886

Digital Library

[14]

Carla Coffey, Lee Ann Wurster, Jonathan Groner, Jeffrey Hoffman, Valerie Hendren, Kathy Nuss, Kathy Haley, Julie Gerberick, Beth Malehorn, and Julia Covert. 2015. A Comparison of Paper Documentation to Electronic Documentation for Trauma Resuscitations at a Level I Pediatric Trauma Center. Journal of Emergency Nursing: JEN 41, 1: 52–56. http://dx.doi.org.ezproxy2.library.drexel.edu/10.1016/j.jen.2014.04.010

[15]

A.J.R. De Bie, S. Nan, L.R.E. Vermeulen, P.M.E. Van Gorp, R.A. Bouwman, A.J.G.H. Bindels, and H.H.M. Korsten. 2017. Intelligent dynamic clinical checklists improved checklist compliance in the intensive care unit. British Journal of Anaesthesia 119, 2: 231–238. https://doi.org/10.1093/bja/aex129

[16]

Norman Lance Downing, Joshua Rolnick, Sarah F. Poole, Evan Hall, Alexander J. Wessels, Paul Heidenreich, and Lisa Shieh. 2019. Electronic health record-based clinical decision support alert for severe sepsis: a randomised evaluation. BMJ Quality & Safety 28, 9: 762–768. https://doi.org/10.1136/bmjqs-2018-008765

[17]

Mariam Fathima, David Peiris, Pradnya Naik-Panvelkar, Bandana Saini, and Carol Lyn Armour. 2014. Effectiveness of computerized clinical decision support systems for asthma and chronic obstructive pulmonary disease in primary care: a systematic review. BMC Pulmonary Medicine 14, 1: 189. https://doi.org/10.1186/1471-2466-14-189

[18]

Alexander G. Fiks, Robert W. Grundmeier, Stephanie Mayne, Lihai Song, Kristen Feemster, Dean Karavite, Cayce C. Hughes, James Massey, Ron Keren, Louis M. Bell, Richard Wasserman, and A. Russell Localio. 2013. Effectiveness of Decision Support for Families, Clinicians, or Both on HPV Vaccine Receipt. Pediatrics 131, 6: 1114–1124. https://doi.org/10.1542/peds.2012-3122

[19]

Alexander G. Fiks, Kenya F. Hunter, A. Russell Localio, Robert W. Grundmeier, Tyra Bryant-Stephens, Anthony A. Luberti, Louis M. Bell, and Evaline A. Alessandrini. 2009. Impact of Electronic Health Record-Based Alerts on Influenza Vaccination for Children With Asthma. Pediatrics 124, 1: 159–169. https://doi.org/10.1542/peds.2008-2823

[20]

Eliot Grigg. 2015. Smarter Clinical Checklists: How to Minimize Checklist Fatigue and Maximize Clinician Performance. Anesthesia & Analgesia 121, 2: 570–573. https://doi.org/10.1213/ANE.0000000000000352

[21]

T. Grundgeiger, M. Albert, D. Reinhardt, O. Happel, A. Steinisch, and T. Wurmb. 2016. Real-time tablet-based resuscitation documentation by the team leader: evaluating documentation quality and clinical performance. Scandinavian Journal of Trauma, Resuscitation and Emergency Medicine 24, 1: 51. https://doi.org/10.1186/s13049-016-0242-3

[22]

Tobias Grundgeiger, Stephan Huber, Daniel Reinhardt, Andreas Steinisch, Oliver Happel, and Thomas Wurmb. 2019. Cognitive Aids in Acute Care: Investigating How Cognitive Aids Affect and Support In-hospital Emergency Teams. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, 1–14. https://doi.org/10.1145/3290605.3300884

Digital Library

[23]

Andrew B. Hall, Felix S. Boecker, Joseph M. Shipp, and Dennis Hanseman. 2017. Advanced Trauma Life Support Time Standards. Military Medicine 182, 3–4: e1588–e1590. https://doi.org/10.7205/MILMED-D-16-00172

[24]

Naomi E. Hammond, Amy J. Spooner, Adrian G. Barnett, Amanda Corley, Peter Brown, and John F. Fraser. 2013. The effect of implementing a modified early warning scoring (MEWS) system on the adequacy of vital sign documentation. Australian Critical Care 26, 1: 18–22. https://doi.org/10.1016/j.aucc.2012.05.001

[25]

Anthony D. Harris, Jessina C. McGregor, Eli N. Perencevich, Jon P. Furuno, Jingkun Zhu, Dan E. Peterson, and Joseph Finkelstein. 2006. The Use and Interpretation of Quasi-Experimental Studies in Medical Informatics. Journal of the American Medical Informatics Association: JAMIA 13, 1: 16–23. https://doi.org/10.1197/jamia.M1749

[26]

Mette Heringa, Hidde Siderius, Annemieke Floor-Schreudering, Peter A G M de Smet, and Marcel L Bouvy. 2017. Lower alert rates by clustering of related drug interaction alerts. Journal of the American Medical Informatics Association: JAMIA 24, 1: 54–59. https://doi.org/10.1093/jamia/ocw049

[27]

Jan Horsky, Shobha Phansalkar, Amrita Desai, Douglas Bell, and Blackford Middleton. 2013. Design of decision support interventions for medication prescribing. International Journal of Medical Informatics 82, 6: 492–503. https://doi.org/10.1016/j.ijmedinf.2013.02.003

[28]

Swathi Jagannath, Aleksandra Sarcevic, Victoria Young, and Sage Myers. 2019. Temporal Rhythms and Patterns of Electronic Documentation in Time-Critical Medical Work. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems - CHI ’19, 1–13. https://doi.org/10.1145/3290605.3300564

Digital Library

[29]

Annika Kaltenhauser, Verena Rheinstädter, Andreas Butz, and Dieter P. Wallach. 2020. “You Have to Piece the Puzzle Together”: Implications for Designing Decision Support in Intensive Care. In Proceedings of the 2020 ACM Designing Interactive Systems Conference, 1509–1522. https://doi.org/10.1145/3357236.3395436

Digital Library

[30]

Kensaku Kawamoto, Caitlin A. Houlihan, E. Andrew Balas, and David F. Lobach. 2005. Improving clinical practice using clinical decision support systems: a systematic review of trials to identify features critical to success. BMJ 330, 7494: 765. https://doi.org/10.1136/bmj.38398.500764.8F

[31]

Mohamed Khamis, Florian Alt, and Andreas Bulling. 2018. The past, present, and future of gaze-enabled handheld mobile devices: survey and lessons learned. In Proceedings of the 20th International Conference on Human-Computer Interaction with Mobile Devices and Services, 1–17. https://doi.org/10.1145/3229434.3229452

Digital Library

[32]

Elyse Olshen Kharbanda, Stephen E. Asche, Alan Sinaiko, James D. Nordin, Heidi L. Ekstrom, Patricia Fontaine, Steven P. Dehmer, Nancy E. Sherwood, and Patrick J. O'Connor. 2018. Evaluation of an Electronic Clinical Decision Support Tool for Incident Elevated BP in Adolescents. Academic Pediatrics 18, 1: 43–50. https://doi.org/10.1016/j.acap.2017.07.004

[33]

Rafal Kocielnik and Gary Hsieh. 2017. Send Me a Different Message: Utilizing Cognitive Space to Create Engaging Message Triggers. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing, 2193–2207. https://doi.org/10.1145/2998181.2998324

Digital Library

[34]

Philip J. Kroth, Paul R. Dexter, J. Marc Overhage, Cynthia Knipe, Siu L. Hui, Anne Belsito, and Clement J. McDonald. 2006. A Computerized Decision Support System Improves the Accuracy of Temperature Capture from Nursing Personnel at the Bedside. AMIA Annual Symposium Proceedings 2006: 444–448.

[35]

Leah Kulp, Aleksandra Sarcevic, Megan Cheng, Yinan Zheng, and Randall S. Burd. 2019. Comparing the Effects of Paper and Digital Checklists on Team Performance in Time-Critical Work. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems - CHI ’19, 1–13. https://doi.org/10.1145/3290605.3300777

Digital Library

[36]

Leah Kulp, Aleksandra Sarcevic, Richard Farneth, Omar Ahmed, Dung Mai, Ivan Marsic, and Randall S. Burd. 2017. Exploring Design Opportunities for a Context-Adaptive Medical Checklist Through Technology Probe Approach. In Proceedings of the 2017 Conference on Designing Interactive Systems (DIS ’17), 57–68. https://doi.org/10.1145/3064663.3064715

Digital Library

[37]

Leah Kulp, Aleksandra Sarcevic, Yinan Zheng, Megan Cheng, Emily Alberto, and Randall Burd. 2020. Checklist Design Reconsidered: Understanding Checklist Compliance and Timing of Interactions. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, 1–13. https://doi.org/10.1145/3313831.3376853

Digital Library

[38]

Pei-Yi Kuo, Rajiv Saran, Marissa Argentina, Michael Heung, Jennifer L. Bragg-Gresham, Dinesh Chatoth, Brenda Gillespie, Sarah Krein, Rebecca Wingard, Kai Zheng, and Tiffany C. Veinot. 2019. Development of a Checklist for the Prevention of Intradialytic Hypotension in Hemodialysis Care: Design Considerations Based on Activity Theory. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, 1–14. https://doi.org/10.1145/3290605.3300872

Digital Library

[39]

Katherine E. Law, Emily A. Hildebrand, Hunter J. Hawthorne, M. Susan Hallbeck, Russell J. Branaghan, Sean C. Dowdy, and Renaldo C. Blocker. 2019. A pilot study of non-routine events in gynecological surgery: Type, impact, and effect. Gynecologic Oncology 152, 2: 298–303. https://doi.org/10.1016/j.ygyno.2018.11.035

[40]

JaeHo Lee, Hyewon Han, Minsu Ock, Sang-il Lee, SunGyo Lee, and Min-Woo Jo. 2014. Impact of a clinical decision support system for high-alert medications on the prevention of prescription errors. International Journal of Medical Informatics 83, 12: 929–940. https://doi.org/10.1016/j.ijmedinf.2014.08.006

[41]

Xinyu Li, Yanyi Zhang, Jianyu Zhang, Moliang Zhou, Shuhong Chen, Yue Gu, Yueyang Chen, Ivan Marsic, Richard A. Farneth, and Randall S. Burd. 2017. Progress Estimation and Phase Detection for Sequential Processes. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1, 3: 1–20. https://doi.org/10.1145/3130936

Digital Library

[42]

Ariel Linden. 2015. Conducting Interrupted Time-series Analysis for Single- and Multiple-group Comparisons. The Stata Journal 15, 2: 480–500. https://doi.org/10.1177/1536867X1501500208

[43]

Kathryn S. Lytle, Nancy M. Short, Rachel L. Richesson, and Monica M. Horvath. 2015. Clinical Decision Support for Nurses: A Fall Risk and Prevention Example. CIN: Computers, Informatics, Nursing 33, 12: 530–537. https://doi.org/10.1097/CIN.0000000000000192

[44]

Gabriela Marcu, Anind Dey, and Sara Kiesler. 2014. Designing for Collaborative Reflection. In Proceedings of the 8th International Conference on Pervasive Computing Technologies for Healthcare. https://doi.org/10.4108/icst.pervasivehealth.2014.254987

Digital Library

[45]

Angela Mastrianni, Leah Kulp, Emily Mapelli, and Aleksandra Sarcevic. 2020. Understanding Digital Checklist Use Through Team Communication. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems (CHI EA ’20), 1–8. https://doi.org/10.1145/3334480.3382817

Digital Library

[46]

John D. McGreevey, Colleen P. Mallozzi, Randa M. Perkins, Eric Shelov, and Richard Schreiber. 2020. Reducing Alert Burden in Electronic Health Records: State of the Art Recommendations from Four Health Systems. Applied Clinical Informatics 11, 1: 1–12. https://doi.org/10.1055/s-0039-3402715

[47]

Sara Montagna, Angelo Croatti, Alessandro Ricci, Vanni Agnoletti, Vittorio Albarello, and Emiliano Gamberini. 2020. Real-time tracking and documentation in trauma management. Health Informatics Journal 26, 1: 328–341. https://doi.org/10.1177/1460458219825507

[48]

Annette Moxey, Jane Robertson, David Newby, Isla Hains, Margaret Williamson, and Sallie-Anne Pearson. 2010. Computerized clinical decision support for prescribing: provision does not guarantee uptake. Journal of the American Medical Informatics Association: JAMIA 17, 1: 25–33. https://doi.org/10.1197/jamia.M3170

[49]

Karen C. Nanji, Diane L. Seger, Sarah P. Slight, Mary G. Amato, Patrick E. Beeler, Qoua L. Her, Olivia Dalleur, Tewodros Eguale, Adrian Wong, Elizabeth R. Silvers, Michael Swerdloff, Salman T. Hussain, Nivethietha Maniam, Julie M. Fiskio, Patricia C. Dykes, and David W. Bates. 2018. Medication-related clinical decision support alert overrides in inpatients. Journal of the American Medical Informatics Association 25, 5: 476–481. https://doi.org/10.1093/jamia/ocx115

[50]

Emanuel Rivers, Bryant Nguyen, Suzanne Havstad, Julie Ressler, Alexandria Muzzin, Bernhard Knoblich, Edward Peterson, and Michael Tomlanovich. 2001. Early Goal-Directed Therapy in the Treatment of Severe Sepsis and Septic Shock. New England Journal of Medicine 345, 19: 1368–1377. https://doi.org/10.1056/NEJMoa010307

[51]

Aleksandra Sarcevic, Brett J. Rosen, Leah J. Kulp, Ivan Marsic, and Randall S. Burd. 2016. Design Challenges in Converting a Paper Checklist to Digital Format for Dynamic Medical Settings. International Conference on Pervasive Computing Technologies for Healthcare 2016: 33–40.

[52]

Aleksandra Sarcevic, Zhan Zhang, and Diana S. Kusunoki. 2012. Decision making tasks in time-critical medical settings. In Proceedings of the 17th ACM international conference on Supporting group work - GROUP ’12, 99. https://doi.org/10.1145/2389176.2389191

Digital Library

[53]

Aleksandra Sarcevic, Zhan Zhang, Ivan Marsic, and Randall S Burd. 2017. Checklist as a Memory Externalization Tool during a Critical Care Process. AMIA Annual Symposium Proceedings 2016: 1080–1089.

[54]

Abbey C. Sidebottom, Beverly Collins, Tamara J. Winden, Asha Knutson, and Heather R. Britt. 2012. Reactions of Nurses to the Use of Electronic Health Record Alert Features in an Inpatient Setting. CIN: Computers, Informatics, Nursing 30, 4: 218–226. https://doi.org/10.1097/NCN.0b013e3182343e8f

[55]

Dean F. Sittig, Adam Wright, Jerome A. Osheroff, Blackford Middleton, Jonathan M. Teich, Joan S. Ash, Emily Campbell, and David W. Bates. 2008. Grand challenges in clinical decision support. Journal of Biomedical Informatics 41, 2: 387–392. https://doi.org/10.1016/j.jbi.2007.09.003

Digital Library

[56]

Pamela L. Smithburger, Mitchell S. Buckley, Sharon Bejian, Katie Burenheide, and Sandra L. Kane-Gill. 2011. A critical evaluation of clinical decision support for the detection of drug-drug interactions. Expert Opinion on Drug Safety 10, 6: 871–882. https://doi.org/10.1517/14740338.2011.583916

[57]

Eric A. Sparks, Hania Wehbe-Janek, Rebecca L. Johnson, W. Roy Smythe, and Harry T. Papaconstantinou. 2013. Surgical Safety Checklist Compliance: A Job Done Poorly! Journal of the American College of Surgeons 217, 5: 867-873.e3. https://doi.org/10.1016/j.jamcollsurg.2013.07.393

[58]

StataCorp. 2019. Stata Statistical Software: Release 16. StataCorp LLC, College Station, TX.

[59]

Charat Thongprayoon, Andrew M. Harrison, John C. O'Horo, Ronaldo A. Sevilla Berrios, Brian W. Pickering, and Vitaly Herasevich. 2016. The Effect of an Electronic Checklist on Critical Care Provider Workload, Errors, and Performance. Journal of Intensive Care Medicine 31, 3: 205–212. https://doi.org/10.1177/0885066614558015

[60]

Matthew Tillman, Hania Wehbe-Janek, Bonnie Hodges, W. Roy Smythe, and Harry T. Papaconstantinou. 2013. Surgical care improvement project and surgical site infections: can integration in the surgical safety checklist improve quality performance and clinical outcomes?1. Journal of Surgical Research 184, 1: 150–156. https://doi.org/10.1016/j.jss.2013.03.048

[61]

David W. Tscholl, Mona Weiss, Michaela Kolbe, Sven Staender, Burkhardt Seifert, Daniel Landert, Bastian Grande, Donat R. Spahn, and Christoph B. Noethiger. 2015. An Anesthesia Preinduction Checklist to Improve Information Exchange, Knowledge of Critical Information, Perception of Safety, and Possibly Perception of Teamwork in Anesthesia Teams. Anesthesia & Analgesia 121, 4: 948–956. https://doi.org/10.1213/ANE.0000000000000671

[62]

Simon L Turner, Andrew B Forbes, Amalia Karahalios, Monica Taljaard, and Joanne E McKenzie. 2020. Evaluation of statistical methods used in the analysis of interrupted time series studies: a simulation study. Public and Global Health. https://doi.org/10.1101/2020.10.12.20211706

[63]

Annette L. Valenta, Margaret M. Browning, Timothy E. Weddle, Greer WP Stevenson, Andrew D. Boyd, and Denise M. Hynes. 2010. Physician perceptions of clinical reminders. In Proceedings of the 1st ACM International Health Informatics Symposium (IHI ’10), 710–717. https://doi.org/10.1145/1882992.1883101

Digital Library

[64]

Paul Kengfai Wan, Abylay Satybaldy, Lizhen Huang, Halvor Holtskog, and Mariusz Nowostawski. 2020. Reducing Alert Fatigue by Sharing Low-Level Alerts With Patients and Enhancing Collaborative Decision Making Using Blockchain Technology: Scoping Review and Proposed Framework (MedAlert). Journal of Medical Internet Research 22, 10: e22013. https://doi.org/10.2196/22013

[65]

Rachel B. Webman, Jennifer L. Fritzeen, JaeWon Yang, Grace F. Ye, Paul C. Mullan, Faisal G. Qureshi, Sarah H. Parker, Aleksandra Sarcevic, Ivan Marsic, and Randall S. Burd. 2016. Classification and team response to nonroutine events occurring during pediatric trauma resuscitation. Journal of Trauma and Acute Care Surgery 81, 4: 666–673. https://doi.org/10.1097/TA.0000000000001196

[66]

Adrian Wong, Mary G. Amato, Diane L. Seger, Sarah P. Slight, Patrick E. Beeler, Patricia C. Dykes, Julie M. Fiskio, Elizabeth R. Silvers, E. John Orav, Tewodros Eguale, and David W. Bates. 2017. Evaluation of medication-related clinical decision support alert overrides in the intensive care unit. Journal of Critical Care 39: 156–161. https://doi.org/10.1016/j.jcrc.2017.02.027

[67]

Qian Yang, Aaron Steinfeld, and John Zimmerman. 2019. Unremarkable AI: Fitting Intelligent Decision Support into Critical, Clinical Decision-Making Processes. Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems - CHI ’19: 1–11. https://doi.org/10.1145/3290605.3300468

Digital Library

[68]

Qian Yang, John Zimmerman, Aaron Steinfeld, Lisa Carey, and James F. Antaki. 2016. Investigating the Heart Pump Implant Decision Process: Opportunities for Decision Support Tools to Help. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 4477–4488. Retrieved January 19, 2021 from http://doi.org/10.1145/2858036.2858373

Digital Library

[69]

Zhan Zhang, Aleksandra Sarcevic, Maria Yala, and Randall S. Burd. 2014. Informing Digital Cognitive Aids Design for Emergency Medical Work by Understanding Paper Checklist Use. In Proceedings of the 18th International Conference on Supporting Group Work - GROUP ’14, 204–214. https://doi.org/10.1145/2660398.2660423

Digital Library

Cited By

Bahodi Mvan Berkel NSkov MMerritt T(2024)Show Me What's Wrong: Impact of Explicit Alerts on Novice Supervisors of a Multi-Robot Monitoring SystemProceedings of the Second International Symposium on Trustworthy Autonomous Systems10.1145/3686038.3686069(1-17)Online publication date: 16-Sep-2024
https://dl.acm.org/doi/10.1145/3686038.3686069
Yildirim NZlotnikov SVenkat AChawla GKim JBukowski LKahn JMccann JZimmerman J(2024)Investigating Why Clinicians Deviate from Standards of Care: Liberating Patients from Mechanical Ventilation in the ICUProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3641982(1-15)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3641982
Taylor ATanjim TCao HLee HGrollman DBroadbent EJu WSoh HWilliams T(2024)Towards Collaborative Crash Cart Robots that Support Clinical TeamworkProceedings of the 2024 ACM/IEEE International Conference on Human-Robot Interaction10.1145/3610977.3634967(715-724)Online publication date: 11-Mar-2024
https://dl.acm.org/doi/10.1145/3610977.3634967
Show More Cited By

Recommendations

Transitioning Cognitive Aids into Decision Support Platforms: Requirements and Design Guidelines
Digital cognitive aids have the potential to serve as clinical decision support platforms, triggering alerts about process delays and recommending interventions. In this mixed-methods study, we examined how a digital checklist for pediatric trauma ...
Alerts as Coordination Mechanisms: Implications for Designing Alerts for Multidisciplinary and Shared Decision Making
GROUP

In this study, we explore how clinical decision support features can be designed to aid teams in caring for patients during time-critical medical emergencies. We interviewed 12 clinicians with experience in leading pediatric trauma resuscitations to ...
”Pop-Up Alerts are the Bane of My Existence”: Designing Alerts for Cognitive Aids Used in Time-Critical Medical Settings
CHI EA '22: Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems

Decision support alerts have the potential to assist clinicians in determining appropriate interventions for critically injured patients. The design of these alerts is critical because it can impact their adoption and effectiveness. In this late-...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

DIS '21: Proceedings of the 2021 ACM Designing Interactive Systems Conference

June 2021

2082 pages

ISBN:9781450384766

DOI:10.1145/3461778

Editors:
Wendy Ju
Jacobs Technion-Cornell Institute at Cornell Tech
,
Lora Oehlberg
University of Calgary
,
Sean Follmer
Stanford University
,
Sarah Fox
Carnegie Mellon University
,
Stacey Kuznetsov
Arizona State University

Copyright © 2021 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 June 2021

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

National Institutes of Health
National Science Foundation

Conference

DIS '21

Sponsor:

SIGCHI

DIS '21: Designing Interactive Systems Conference 2021

June 28 - July 2, 2021

Virtual Event, USA

Acceptance Rates

Overall Acceptance Rate 1,158 of 4,684 submissions, 25%

Upcoming Conference

DIS '25

Sponsor:
sigchi

Designing Interactive Systems Conference

July 5 - 9, 2025

Funchal , Portugal

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

9
Total Citations
View Citations
833
Total Downloads

Downloads (Last 12 months)370
Downloads (Last 6 weeks)44

Reflects downloads up to 17 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Bahodi Mvan Berkel NSkov MMerritt T(2024)Show Me What's Wrong: Impact of Explicit Alerts on Novice Supervisors of a Multi-Robot Monitoring SystemProceedings of the Second International Symposium on Trustworthy Autonomous Systems10.1145/3686038.3686069(1-17)Online publication date: 16-Sep-2024
https://dl.acm.org/doi/10.1145/3686038.3686069
Yildirim NZlotnikov SVenkat AChawla GKim JBukowski LKahn JMccann JZimmerman J(2024)Investigating Why Clinicians Deviate from Standards of Care: Liberating Patients from Mechanical Ventilation in the ICUProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3641982(1-15)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3641982
Taylor ATanjim TCao HLee HGrollman DBroadbent EJu WSoh HWilliams T(2024)Towards Collaborative Crash Cart Robots that Support Clinical TeamworkProceedings of the 2024 ACM/IEEE International Conference on Human-Robot Interaction10.1145/3610977.3634967(715-724)Online publication date: 11-Mar-2024
https://dl.acm.org/doi/10.1145/3610977.3634967
Yadav SRawal GJeyaraman M(2023)Decision Fatigue in Emergency Medicine: An Exploration of Its ValidityCureus10.7759/cureus.51267Online publication date: 29-Dec-2023
https://doi.org/10.7759/cureus.51267
Mastrianni ASarcevic AHu AAlmengor LTempel PGao SBurd R(2023)Transitioning Cognitive Aids into Decision Support Platforms: Requirements and Design GuidelinesACM Transactions on Computer-Human Interaction10.1145/358243130:3(1-28)Online publication date: 10-Jun-2023
https://dl.acm.org/doi/10.1145/3582431
Mastrianni A(2023)Supporting Clinical Teams in Decision-Making: Designing and Evaluating Clinical Decision-Support Systems for Time-Critical Medical WorkCompanion Publication of the 2023 ACM Designing Interactive Systems Conference10.1145/3563703.3593064(32-36)Online publication date: 10-Jul-2023
https://dl.acm.org/doi/10.1145/3563703.3593064
Mastrianni ASarcevic ACui HKrentsa MSullivan TZakeri IMarsic IBurd R(2023)Supporting Awareness of Dynamic Data: Approaches to Designing and Capturing Data within Interactive Clinical ChecklistsProceedings of the 2023 ACM Designing Interactive Systems Conference10.1145/3563657.3595979(1293-1308)Online publication date: 10-Jul-2023
https://dl.acm.org/doi/10.1145/3563657.3595979
Mastrianni AAlmengor LSarcevic A(2022)Alerts as Coordination MechanismsProceedings of the ACM on Human-Computer Interaction10.1145/34928286:GROUP(1-14)Online publication date: 14-Jan-2022
https://dl.acm.org/doi/10.1145/3492828
Mastrianni ACui HSarcevic A(2022)”Pop-Up Alerts are the Bane of My Existence”: Designing Alerts for Cognitive Aids Used in Time-Critical Medical SettingsExtended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491101.3519669(1-7)Online publication date: 27-Apr-2022
https://dl.acm.org/doi/10.1145/3491101.3519669

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Figures

Tables

Media

View Table of Conten