research-article

Public Access

Supporting Awareness of Dynamic Data: Approaches to Designing and Capturing Data within Interactive Clinical Checklists

Authors:

Angela Mastrianni,

Aleksandra Sarcevic,

Megan A. Krentsa,

Travis M Sullivan,

Randall S. BurdAuthors Info & Claims

DIS '23: Proceedings of the 2023 ACM Designing Interactive Systems Conference

Pages 1293 - 1308

https://doi.org/10.1145/3563657.3595979

Published: 10 July 2023 Publication History

All formats PDF

Abstract

Automatically integrating data within interactive clinical checklists allows for enhanced dynamic displays, while also providing information needed for checklist adaptation to the context of the medical event. In this mixed-methods study, we used user-centered design sessions with clinicians to design a checklist interface that automatically captures and displays dynamic patient data. We compared the manual and automatic checklist versions during video-guided simulation sessions, evaluating the effects of automatic capture on clinicians’ interactions with dynamic data and their situation awareness. Despite clinicians’ concerns that automatic data capture would affect situation awareness, we found no significant difference in awareness scores. Participants preferred the automatic version, highlighting its improved accuracy and completeness. From our findings, we propose a framework for capturing dynamic data and designing dynamic data interfaces within interactive checklists. We conclude by discussing barriers and design opportunities for supporting awareness of data trends through checklists.

Supplemental Material

PDF File

SAGAT Probes

Download
28.20 KB

References

[1]

Shehnaz Alidina, Sara N. Goldhaber-Fiebert, Alexander A. Hannenberg, David L. Hepner, Sara J. Singer, Bridget A. Neville, James R. Sachetta, Stuart R. Lipsitz, and William R. Berry. 2018. Factors associated with the use of cognitive aids in operating room crises: a cross-sectional study of US hospitals and ambulatory surgical centers. Implementation Science 13, 1: 50. https://doi.org/10.1186/s13012-018-0739-4

[2]

Alexander F. Arriaga, Angela M. Bader, Judith M. Wong, Stuart R. Lipsitz, William R. Berry, John E. Ziewacz, David L. Hepner, Daniel J. Boorman, Charles N. Pozner, Douglas S. Smink, and Atul A. Gawande. 2013. Simulation-based trial of surgical-crisis checklists. The New England Journal of Medicine 368, 3: 246–253. https://doi.org/10.1056/NEJMsa1204720

[3]

ATLS Subcommittee, American College of Surgeons’ Committee on Trauma, and International ATLS working group. 2013. Advanced trauma life support (ATLS®): the ninth edition. The Journal of Trauma and Acute Care Surgery 74, 5: 1363–1366. https://doi.org/10.1097/TA.0b013e31828b82f5

[4]

Magnus Bang, Katarina Solnevik, and Henrik Eriksson. 2015. The Nurse Watch: Design and Evaluation of a Smart Watch Application with Vital Sign Monitoring and Checklist Reminders. AMIA Annual Symposium Proceedings 2015: 314–319.

[5]

Jeffrey C. Bauer, Eileen John, Christopher L. Wood, Debra Plass, and Dale Richardson. 2020. Data Entry Automation Improves Cost, Quality, Performance, and Job Satisfaction in a Hospital Nursing Unit. JONA: The Journal of Nursing Administration 50, 1: 34–39. https://doi.org/10.1097/NNA.0000000000000836

[6]

Sean M. Bloos, Candace D. McNaughton, Joseph R. Coco, Laurie L. Novak, Julie A. Adams, Robert E. Bodenheimer, Jesse M. Ehrenfeld, Jamison R. Heard, Richard A. Paris, Christopher L. Simpson, Deirdre M. Scully, and Daniel Fabbri. 2020. Feasibility Assessment of a Pre-Hospital Automated Sensing Clinical Documentation System. AMIA Annual Symposium Proceedings 2019: 248–257.

[7]

Brandon Buxton, Jefton Knight, and Utkarsh Shrivastava. 2019. Implications of Vital Sign Monitor and Electronic Medical Record Integration on Identification of Patients in Deteriorating Condition. Transactions of the International Conference on Health Information Technology Advancement. Retrieved from https://scholarworks.wmich.edu/ichita_transactions/66

[8]

Kelly Caine. 2016. Local Standards for Sample Size at CHI. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI ’16), 981–992. https://doi.org/10.1145/2858036.2858498

Digital Library

[9]

Yunan Chen. 2010. Documenting transitional information in EMR. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’10), 1787–1796. https://doi.org/10.1145/1753326.1753594

Digital Library

[10]

Ji Cho and Eun-Hee Lee. 2014. Reducing Confusion about Grounded Theory and Qualitative Content Analysis: Similarities and Differences. The Qualitative Report 19, 32: 1–20. https://doi.org/10.46743/2160-3715/2014.1028

[11]

Eun Kyoung Choe, Bongshin Lee, Matthew Kay, Wanda Pratt, and Julie A. Kientz. 2015. SleepTight: low-burden, self-monitoring technology for capturing and reflecting on sleep behaviors. In Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp ’15), 121–132. https://doi.org/10.1145/2750858.2804266

Digital Library

[12]

Luigina Ciolfi, Gabriela Avram, Laura Maye, Nick Dulake, Mark T. Marshall, Dick van Dijk, and Fiona McDermott. 2016. Articulating Co-Design in Museums: Reflections on Two Participatory Processes. In Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing (CSCW ’16), 13–25. https://doi.org/10.1145/2818048.2819967

Digital Library

[13]

Jacob Cohen. 1988. Statistical power analysis for the behavioral sciences. L. Erlbaum Associates, Hillsdale, N.J.

[14]

Mark Colley, Benjamin Eder, Jan Ole Rixen, and Enrico Rukzio. 2021. Effects of Semantic Segmentation Visualization on Trust, Situation Awareness, and Cognitive Load in Highly Automated Vehicles. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, 1–11. https://doi.org/10.1145/3411764.3445351

Digital Library

[15]

Mark Colley, Max Rädler, Jonas Glimmann, and Enrico Rukzio. 2022. Effects of Scene Detection, Scene Prediction, and Maneuver Planning Visualizations on Trust, Situation Awareness, and Cognitive Load in Highly Automated Vehicles. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 6, 2: 49:1-49:21. https://doi.org/10.1145/3534609

Digital Library

[16]

Sunny Consolvo, Predrag Klasnja, David W. McDonald, and James A. Landay. 2014. Designing for Healthy Lifestyles: Design Considerations for Mobile Technologies to Encourage Consumer Health and Wellness. Foundations and Trends in Human-Computer Interaction 6, 3–4: 167–315. https://doi.org/10.1561/1100000040

Digital Library

[17]

Ester Coolen, Jos Draaisma, and Jan Loeffen. 2019. Measuring situation awareness and team effectiveness in pediatric acute care by using the situation global assessment technique. European Journal of Pediatrics 178, 6: 837–850. https://doi.org/10.1007/s00431-019-03358-z

[18]

Aritra Dasgupta, Dustin L. Arendt, Lyndsey R. Franklin, Pak Chung Wong, and Kristin A. Cook. 2018. Human Factors in Streaming Data Analysis: Challenges and Opportunities for Information Visualization. Computer Graphics Forum 37, 1: 254–272. https://doi.org/10.1111/cgf.13264

[19]

Thomas Corey Davis, Jeffrey A. Green, Alexander Colquhoun, Brenda L. Hage, and Chuck Biddle. 2012. Anesthesia recordkeeping: accuracy of recall with computerized and manual entry recordkeeping. Journal of Clinical Monitoring and Computing 26, 3: 163–169. https://doi.org/10.1007/s10877-012-9349-x

[20]

Thomas F. E. Drake-Brockman, Amitava Datta, and Britta S. von Ungern-Sternberg. 2016. Patient monitoring with Google Glass: a pilot study of a novel monitoring technology. Paediatric Anaesthesia 26, 5: 539–546. https://doi.org/10.1111/pan.12879

[21]

Frank A. Drews and Alexa Doig. 2014. Evaluation of a Configural Vital Signs Display for Intensive Care Unit Nurses. Human Factors 56, 3: 569–580. https://doi.org/10.1177/0018720813499367

[22]

Eric Dryver, Jakob Lundager Forberg, Caroline Hård af Segerstad, William D. Dupont, Anders Bergenfelz, and Ulf Ekelund. 2021. Medical crisis checklists in the emergency department: a simulation-based multi-institutional randomised controlled trial. BMJ Quality & Safety 30, 9: 697–705. https://doi.org/10.1136/bmjqs-2020-012740

[23]

Francine Elrose, Andrew Hill, David Liu, Isaac Salisbury, Thien LeCong, Robert G. Loeb, and Penelope Sanderson. 2021. The Use of Head-Worn Displays for Vital Sign Monitoring in Critical and Acute Care: Systematic Review. JMIR mHealth and uHealth 9, 5: e27165. https://doi.org/10.2196/27165

[24]

Mica Endsley. 2000. Direct Measurement of Situation Awareness: Validity and Use of SAGAT. Situation Awareness: Analysis and Measurement.

[25]

Mica R. Endsley. 2017. From Here to Autonomy: Lessons Learned From Human–Automation Research. Human Factors 59, 1: 5–27. https://doi.org/10.1177/0018720816681350

[26]

Mica R. Endsley. 2020. The Divergence of Objective and Subjective Situation Awareness: A Meta-Analysis. Journal of Cognitive Engineering and Decision Making 14, 1: 34–53. https://doi.org/10.1177/1555343419874248

[27]

Mica R. Endsley. 2021. Situation Awareness. In HANDBOOK OF HUMAN FACTORS AND ERGONOMICS. John Wiley & Sons, Ltd, 434–455. https://doi.org/10.1002/9781119636113.ch17

[28]

Mica R. Endsley. 2021. A Systematic Review and Meta-Analysis of Direct Objective Measures of Situation Awareness: A Comparison of SAGAT and SPAM. Human Factors 63, 1: 124–150. https://doi.org/10.1177/0018720819875376

[29]

Vickie K. Fieler, Thomas Jaglowski, and Karen Richards. 2013. Eliminating Errors in Vital Signs Documentation. CIN: Computers, Informatics, Nursing 31, 9: 422–427. https://doi.org/10.1097/01.NCN.0000432125.61526.27

[30]

Geraldine Fitzpatrick and Gunnar Ellingsen. 2013. A Review of 25 Years of CSCW Research in Healthcare: Contributions, Challenges and Future Agendas. Computer Supported Cooperative Work (CSCW) 22, 4: 609–665. https://doi.org/10.1007/s10606-012-9168-0

Digital Library

[31]

Luisa Flohr, Shaylene Beaudry, K Taneille Johnson, Nicholas West, Catherine M Burns, J Mark Ansermino, Guy A Dumont, David Wensley, Peter Skippen, and Matthias Görges. 2018. Clinician-Driven Design of VitalPAD–An Intelligent Monitoring and Communication Device to Improve Patient Safety in the Intensive Care Unit. IEEE Journal of Translational Engineering in Health and Medicine 6: 1–14. https://doi.org/10.1109/JTEHM.2018.2812162

[32]

Sarah D Fouquet, Laura Fitzmaurice, Y Raymond Chan, and Evan M Palmer. 2021. Doctors documenting: an ethnographic and informatics approach to understanding attending physician documentation in the pediatric emergency department. Journal of the American Medical Informatics Association 28, 2: 239–248. https://doi.org/10.1093/jamia/ocaa252

[33]

Barney G. Glaser and Anselm L. Strauss. 2009. The Discovery of Grounded Theory: Strategies for Qualitative Research. Transaction Publishers.

[34]

Matthias Görges, Nicholas C. West, Christian L. Petersen, and J. Mark Ansermino. 2019. Development and Implementation of the Portable Operating Room Tracker App With Vital Signs Streaming Infrastructure: Operational Feasibility Study. JMIR Perioperative Medicine 2, 2: e13559. https://doi.org/10.2196/13559

[35]

Rúben Gouveia, Fábio Pereira, Evangelos Karapanos, Sean A. Munson, and Marc Hassenzahl. 2016. Exploring the design space of glanceable feedback for physical activity trackers. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp ’16), 144–155. https://doi.org/10.1145/2971648.2971754

Digital Library

[36]

Eliot Grigg. 2015. Smarter Clinical Checklists: How to Minimize Checklist Fatigue and Maximize Clinician Performance. Anesthesia & Analgesia 121, 2: 570–573. https://doi.org/10.1213/ANE.0000000000000352

[37]

Tobias Grundgeiger, Stephan Huber, Daniel Reinhardt, Andreas Steinisch, Oliver Happel, and Thomas Wurmb. 2019. Cognitive Aids in Acute Care: Investigating How Cognitive Aids Affect and Support In-hospital Emergency Teams. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI ’19), 1–14. https://doi.org/10.1145/3290605.3300884

Digital Library

[38]

Fahad Gul, Maheen Nazir, Khawar Abbas, Alishba Ashraf Khan, Daniya Shahzad Malick, Hashim Khan, Syed Naqash Haider Kazmi, and Arbab Osama Naseem. 2022. Surgical safety checklist compliance: The clinical audit. Annals of Medicine and Surgery 81: 104397. https://doi.org/10.1016/j.amsu.2022.104397

[39]

Bethany Danae Hallam, this link will open in a new window Link to external site, Courtney C. Kuza, Kimberly Rak, Jessica C. Fleck, Melanie M. Heuston, Debjit Saha, and Jeremy M. Kahn. 2018. Perceptions of rounding checklists in the intensive care unit: a qualitative study. BMJ Quality & Safety 27, 10: 836. http://dx.doi.org /10.1136/bmjqs-2017-007218

[40]

Stephan Huber, Johanna Gramlich, and Tobias Grundgeiger. 2020. From Paper Flight Strips to Digital Strip Systems: Changes and Similarities in Air Traffic Control Work Practices. Proceedings of the ACM on Human-Computer Interaction 4, CSCW1: 1–21. https://doi.org/10.1145/3392833

Digital Library

[41]

Swathi Jagannath, Aleksandra Sarcevic, Victoria Young, and Sage Myers. 2019. Temporal Rhythms and Patterns of Electronic Documentation in Time-Critical Medical Work. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems - CHI ’19, 1–13. https://doi.org/10.1145/3290605.3300564

Digital Library

[42]

Annika Kaltenhauser, Verena Rheinstädter, Andreas Butz, and Dieter P. Wallach. 2020. “You Have to Piece the Puzzle Together”: Implications for Designing Decision Support in Intensive Care. In Proceedings of the 2020 ACM Designing Interactive Systems Conference (DIS ’20), 1509–1522. https://doi.org/10.1145/3357236.3395436

Digital Library

[43]

Deirdre C. Kelleher, Elizabeth A. Carter, Lauren J. Waterhouse, Samantha E. Parsons, Jennifer L. Fritzeen, and Randall S. Burd. 2014. Effect of a checklist on advanced trauma life support task performance during pediatric trauma resuscitation. Academic Emergency Medicine: Official Journal of the Society for Academic Emergency Medicine 21, 10: 1129–1134. https://doi.org/10.1111/acem.12487

[44]

Hyungil Kim, Joseph L. Gabbard, Sujitha Martin, Ashish Tawari, and Teruhisa Misu. 2019. Toward Prediction of Driver Awareness of Automotive Hazards: Driving-Video-Based Simulation Approach. Proceedings of the Human Factors and Ergonomics Society Annual Meeting 63, 1: 2099–2103. https://doi.org/10.1177/1071181319631003

[45]

Simon Kimmel, Vanessa Cobus, and Wilko Heuten. 2021. opticARe - Augmented Reality Mobile Patient Monitoring in Intensive Care Units. In Proceedings of the 27th ACM Symposium on Virtual Reality Software and Technology (VRST ’21), 1–11. https://doi.org/10.1145/3489849.3489852

Digital Library

[46]

Sven H. Koch, Charlene Weir, Dwayne Westenskow, Matthias Gondan, Jim Agutter, Maral Haar, David Liu, Matthias Görges, and Nancy Staggers. 2013. Evaluation of the effect of information integration in displays for ICU nurses on situation awareness and task completion time: A prospective randomized controlled study. International Journal of Medical Informatics 82, 8: 665–675. https://doi.org/10.1016/j.ijmedinf.2012.10.002

[47]

Korpman RA. 1990. Patient care automation: the future is now. The current paper system – can it be made to work?... part 2. Nursing Economic$ 8, 4: 263–267.

[48]

Jeremias Kuge, Tobias Grundgeiger, Paul Schlosser, Penelope Sanderson, and Oliver Happel. 2021. Design and Evaluation of a Head-Worn Display Application for Multi-Patient Monitoring. In Designing Interactive Systems Conference 2021 (DIS ’21), 879–890. https://doi.org/10.1145/3461778.3462011

Digital Library

[49]

Leah Kulp, Aleksandra Sarcevic, Megan Cheng, and Randall S. Burd. 2021. Towards Dynamic Checklists: Understanding Contexts of Use and Deriving Requirements for Context-Driven Adaptation. ACM Transactions on Computer-Human Interaction 28, 2: 1–33. https://doi.org/10.1145/3444947

Digital Library

[50]

Leah Kulp, Aleksandra Sarcevic, Megan Cheng, Yinan Zheng, and Randall S. Burd. 2019. Comparing the Effects of Paper and Digital Checklists on Team Performance in Time-Critical Work. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI ’19), 1–13. https://doi.org/10.1145/3290605.3300777

Digital Library

[51]

Leah Kulp, Aleksandra Sarcevic, Richard Farneth, Omar Ahmed, Dung Mai, Ivan Marsic, and Randall S. Burd. 2017. Exploring Design Opportunities for a Context-Adaptive Medical Checklist Through Technology Probe Approach. In Proceedings of the 2017 Conference on Designing Interactive Systems (DIS ’17), 57–68. https://doi.org/10.1145/3064663.3064715

Digital Library

[52]

Pei-Yi Kuo, Rajiv Saran, Marissa Argentina, Michael Heung, Jennifer L. Bragg-Gresham, Dinesh Chatoth, Brenda Gillespie, Sarah Krein, Rebecca Wingard, Kai Zheng, and Tiffany C. Veinot. 2019. Development of a Checklist for the Prevention of Intradialytic Hypotension in Hemodialysis Care: Design Considerations Based on Activity Theory. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, 1–14. https://doi.org/10.1145/3290605.3300872

Digital Library

[53]

Diana S. Kusunoki, Aleksandra Sarcevic, Zhan Zhang, and Randall S. Burd. 2013. Understanding visual attention of teams in dynamic medical settings through vital signs monitor use. In Proceedings of the 2013 conference on Computer supported cooperative work (CSCW ’13), 527–540. https://doi.org/10.1145/2441776.2441836

Digital Library

[54]

Brenna Li, Noah Crampton, Thomas Yeates, Yu Xia, Xirong Tian, and Khai Truong. 2021. Automating Clinical Documentation with Digital Scribes: Understanding the Impact on Physicians. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, 1–12. https://doi.org/10.1145/3411764.3445172

Digital Library

[55]

Ian Li, Anind Dey, and Jodi Forlizzi. 2010. A stage-based model of personal informatics systems. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’10), 557–566. https://doi.org/10.1145/1753326.1753409

Digital Library

[56]

Ying Ling Lin, Anne-Marie Guerguerian, Jessica Tomasi, Peter Laussen, and Patricia Trbovich. 2017. Usability of data integration and visualization software for multidisciplinary pediatric intensive care: a human factors approach to assessing technology. BMC Medical Informatics and Decision Making 17, 1: 1–19. https://doi.org/10.1186/s12911-017-0520-7

[57]

Mark Linzer, Jill O. Jin, Purva Shah, Martin Stillman, Roger Brown, Sara Poplau, Nancy Nankivil, Kyra Cappelucci, and Christine A. Sinsky. 2022. Trends in Clinician Burnout With Associated Mitigating and Aggravating Factors During the COVID-19 Pandemic. JAMA Health Forum 3, 11: e224163. https://doi.org/10.1001/jamahealthforum.2022.4163

[58]

David Liu, Simon A. Jenkins, Penelope M. Sanderson, Perry Fabian, and W. John Russell. 2010. Monitoring with Head-Mounted Displays in General Anesthesia: A Clinical Evaluation in the Operating Room. Anesthesia & Analgesia 110, 4: 1032–1038. https://doi.org/10.1213/ANE.0b013e3181d3e647

[59]

Angela Mastrianni and Aleksandra Sarcevic. 2023. Near-Live Simulations to the Rescue: Lessons Learned from Using Alternative Simulation Approaches for Evaluating New Technologies. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems, 1–8. https://doi.org/10.1145/3544549.3573850

Digital Library

[60]

Angela Mastrianni, Aleksandra Sarcevic, Lauren Chung, Issa Zakeri, Emily Alberto, Zachary Milestone, Ivan Marsic, and Randall S Burd. 2021. Designing Interactive Alerts to Improve Recognition of Critical Events in Medical Emergencies. In Designing Interactive Systems Conference 2021. Association for Computing Machinery, New York, NY, USA, 864–878. Retrieved June 29, 2021 from http://doi.org/10.1145/3461778.3462051

Digital Library

[61]

Tara Matthews, Devin Blais, Aubrey Shick, Jennifer Mankoff, Jodi Forlizzi, Stacie Rohrbach, and Roberta Klatzky. 2006. Evaluating Glanceable Visuals for Multitasking. UC Berkeley.

[62]

Laurie Lovett Novak, Christopher L. Simpson, Joseph Coco, Candace D. McNaughton, Jesse M. Ehrenfeld, Sean M. Bloos, and Daniel Fabbri. 2020. Understanding the Information Needs and Context of Trauma Handoffs to Design Automated Sensing Clinical Documentation Technologies: Qualitative Mixed-Method Study of Military and Civilian Cases. Journal of Medical Internet Research 22, 9: e17978. https://doi.org/10.2196/17978

[63]

Linda Onnasch, Christopher D. Wickens, Huiyang Li, and Dietrich Manzey. 2014. Human performance consequences of stages and levels of automation: an integrated meta-analysis. Human Factors 56, 3: 476–488. https://doi.org/10.1177/0018720813501549

[64]

Joni Padden. 2019. Documentation Burden and Cognitive Burden: How Much is Too Much Information? CIN: Computers, Informatics, Nursing 37, 2: 60–61. https://doi.org/10.1097/CIN.0000000000000522

[65]

R. Parasuraman, T.B. Sheridan, and C.D. Wickens. 2000. A model for types and levels of human interaction with automation. IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans 30, 3: 286–297. https://doi.org/10.1109/3468.844354

Digital Library

[66]

JaeYeon Park, Soyoung Rhim, Kyungsik Han, and JeongGil Ko. 2021. Disentangling the clinical data chaos: User-centered interface system design for trauma centers. PLOS ONE 16, 5: e0251140. https://doi.org/10.1371/journal.pone.0251140

[67]

Samantha E. Parsons, Elizabeth A. Carter, Lauren J. Waterhouse, Jennifer Fritzeen, Deirdre C. Kelleher, Karen J. O'Connell, Aleksandra Sarcevic, Kelley M. Baker, Erik Nelson, Nicole E. Werner, Deborah A. Boehm-Davis, and Randall S. Burd. 2014. Improving ATLS Performance in Simulated Pediatric Trauma Resuscitation Using a Checklist. Annals of Surgery 259, 4: 807–813. https://doi.org/10.1097/SLA.0000000000000259

[68]

A. Parush, G. Mastoras, A. Bhandari, K. Momtahan, K. Day, B. Weitzman, B. Sohmer, A. Cwinn, S. J. Hamstra, and L. Calder. 2017. Can teamwork and situational awareness (SA) in ED resuscitations be improved with a technological cognitive aid? Design and a pilot study of a team situation display. Journal of Biomedical Informatics 76: 154–161. https://doi.org/10.1016/j.jbi.2017.10.009

Digital Library

[69]

Kathleen H. Pine and Yunan Chen. 2020. Right Information, Right Time, Right Place: Physical Alignment and Misalignment in Healthcare Practice. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1–12. Retrieved August 31, 2021 from http://doi.org/10.1145/3313831.3376818

Digital Library

[70]

Akira-Sebastian Poncette, Lina Katharina Mosch, Lars Stablo, Claudia Spies, Monique Schieler, Steffen Weber-Carstens, Markus A. Feufel, and Felix Balzer. 2022. A Remote Patient-Monitoring System for Intensive Care Medicine: Mixed Methods Human-Centered Design and Usability Evaluation. JMIR Human Factors 9, 1: e30655. https://doi.org/10.2196/30655

[71]

Juan C. Quiroz, Liliana Laranjo, Ahmet Baki Kocaballi, Shlomo Berkovsky, Dana Rezazadegan, and Enrico Coiera. 2019. Challenges of developing a digital scribe to reduce clinical documentation burden. npj Digital Medicine 2, 1: 1–6. https://doi.org/10.1038/s41746-019-0190-1

[72]

Emanuel Rivers, Bryant Nguyen, Suzanne Havstad, Julie Ressler, Alexandria Muzzin, Bernhard Knoblich, Edward Peterson, and Michael Tomlanovich. 2001. Early Goal-Directed Therapy in the Treatment of Severe Sepsis and Septic Shock. New England Journal of Medicine 345, 19: 1368–1377. https://doi.org/10.1056/NEJMoa010307

[73]

Elizabeth B.-N. Sanders and Pieter Jan Stappers. 2008. Co-creation and the new landscapes of design. CoDesign 4, 1: 5–18. https://doi.org/10.1080/15710880701875068

[74]

Aleksandra Sarcevic, Ivan Marsic, Lauren J. Waterhouse, David C. Stockwell, and Randall S. Burd. 2011. Leadership structures in emergency care settings: a study of two trauma centers. International Journal of Medical Informatics 80, 4: 227–238. https://doi.org/10.1016/j.ijmedinf.2011.01.004

[75]

Aleksandra Sarcevic, Zhan Zhang, Ivan Marsic, and Randall S Burd. 2017. Checklist as a Memory Externalization Tool during a Critical Care Process. AMIA Annual Symposium Proceedings 2016: 1080–1089.

[76]

Paul Schlosser, Ben Matthews, Isaac Salisbury, Penelope Sanderson, and Sass Hayes. 2021. Head-Worn Displays for Emergency Medical Services Staff: Properties of Prehospital Work, Use Cases, and Design Considerations. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (CHI ’21), 1–14. https://doi.org/10.1145/3411764.3445614

Digital Library

[77]

Christian M. Schulz, Amanda Burden, Karen L. Posner, Shawn L. Mincer, Randolph Steadman, Klaus J. Wagner, and Karen B. Domino. 2017. Frequency and Type of Situational Awareness Errors Contributing to Death and Brain Damage: A Closed Claims Analysis. Anesthesiology 127, 2: 326–337. https://doi.org/10.1097/ALN.0000000000001661

[78]

Kristina Stojmenova, Nikolas Thomopoulos, and Jaka Sodnik. 2022. Ready2Drive – Interactive Online Video-Based Driving Tasks for Assessment of Driving-Related Skills of Older Drivers. In 14th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, 196–198. https://doi.org/10.1145/3544999.3551345

Digital Library

[79]

Charat Thongprayoon, Andrew M. Harrison, John C. O'Horo, Ronaldo A. Sevilla Berrios, Brian W. Pickering, and Vitaly Herasevich. 2016. The Effect of an Electronic Checklist on Critical Care Provider Workload, Errors, and Performance. Journal of Intensive Care Medicine 31, 3: 205–212. https://doi.org/10.1177/0885066614558015

[80]

Man-Kei Tse, Simon Y. W. Li, Tsz Hin Chiu, Chung Wai Lau, Ka Man Lam, and Chun Pong Benny Cheng. 2020. Comparison of the Effects of Automated and Manual Record Keeping on Anesthetists’ Monitoring Performance: Randomized Controlled Simulation Study. JMIR Human Factors 7, 2: e16036. https://doi.org/10.2196/16036

[81]

Katherine Walker, Michael Ben-Meir, William Dunlop, Rachel Rosler, Adam West, Gabrielle O'Connor, Thomas Chan, Diana Badcock, Mark Putland, Kim Hansen, Carmel Crock, Danny Liew, David Taylor, and Margaret Staples. 2019. Impact of scribes on emergency medicine doctors’ productivity and patient throughput: multicentre randomised trial. BMJ 364: l121. https://doi.org/10.1136/bmj.l121

[82]

Matt Willis and Mohammad Hossein Jarrahi. 2019. Automating Documentation: A Critical Perspective into the Role of Artificial Intelligence in Clinical Documentation. In Information in Contemporary Society, 200–209. https://doi.org/10.1007/978-3-030-15742-5_19

[83]

Paweł WoŹniak, Margareta Lützhöft, Thomas Porathe, Asim Evren Yantac, and Morten Fjeld. 2013. Examining interactive surfaces for maritime operations. In Proceedings of the 2013 ACM international conference on Interactive tabletops and surfaces (ITS ’13), 341–344. https://doi.org/10.1145/2512349.2512395

Digital Library

[84]

Yilun Xing, Sami Park, Kumar Akash, Xingwei Wu, Teruhisa Misu, and Linda Ng Boyle. 2022. Investigating the impact of context and environment on driver's situation awareness. Proceedings of the Human Factors and Ergonomics Society Annual Meeting 66, 1: 335–339. https://doi.org/10.1177/1071181322661317

[85]

Qian Yang, John Zimmerman, Aaron Steinfeld, Lisa Carey, and James F. Antaki. 2016. Investigating the Heart Pump Implant Decision Process: Opportunities for Decision Support Tools to Help. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 4477–4488. Retrieved January 19, 2021 from http://doi.org/10.1145/2858036.2858373

Digital Library

[86]

Minfan Zhang, Daniel Ehrmann, Mjaye Mazwi, Danny Eytan, Marzyeh Ghassemi, and Fanny Chevalier. 2022. Get To The Point! Problem-Based Curated Data Views To Augment Care For Critically Ill Patients. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (CHI ’22), 1–13. https://doi.org/10.1145/3491102.3501887

Digital Library

[87]

Zhan Zhang, Xiao Luo, Richard Harris, Susanna George, and Jack Finkelstein. 2022. Hands-Free Electronic Documentation in Emergency Care Work Through Smart Glasses. In Information for a Better World: Shaping the Global Future (Lecture Notes in Computer Science), 314–331. https://doi.org/10.1007/978-3-030-96960-8_21

Digital Library

[88]

Zhan Zhang, Aleksandra Sarcevic, Maria Yala, and Randall S. Burd. 2014. Informing Digital Cognitive Aids Design for Emergency Medical Work by Understanding Paper Checklist Use. In Proceedings of the 18th International Conference on Supporting Group Work - GROUP ’14, 204–214. https://doi.org/10.1145/2660398.2660423

Digital Library

[89]

Haibei Zhu, Teruhisa Misu, Sujitha Martin, Xingwei Wu, and Kumar Akash. 2021. Improving Driver Situation Awareness Prediction using Human Visual Sensory and Memory Mechanism. In 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 6210–6216. https://doi.org/10.1109/IROS51168.2021.9636112

Digital Library

Cited By

Yildirim NZlotnikov SVenkat AChawla GKim JBukowski LKahn JMccann JZimmerman J(2024)Investigating Why Clinicians Deviate from Standards of Care: Liberating Patients from Mechanical Ventilation in the ICUProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3641982(1-15)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3641982

Index Terms

Supporting Awareness of Dynamic Data: Approaches to Designing and Capturing Data within Interactive Clinical Checklists
1. Applied computing
  1. Life and medical sciences
    1. Health care information systems
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Graphical user interfaces
  2. Interaction design
    1. Interaction design process and methods
      1. Interface design prototyping
      2. User centered design

Index terms have been assigned to the content through auto-classification.

Recommendations

Design challenges in converting a paper checklist to digital format for dynamic medical settings
PervasiveHealth '16: Proceedings of the 10th EAI International Conference on Pervasive Computing Technologies for Healthcare

We describe a mobile digital checklist that we designed and developed for trauma resuscitation---a dynamic, fast-paced medical process of treating severely injured patients. The checklist design was informed by our analysis of user interactions with a ...
Towards Dynamic Checklists: Understanding Contexts of Use and Deriving Requirements for Context-Driven Adaptation

The goal of this in-the-wild study was to understand how different patient, provider, and environment contexts affected the use of a tablet-based checklist in a dynamic medical setting. Fifteen team leaders used the digital checklist in 187 actual trauma ...
Developing a wearable tactile prototype to support situational awareness
W4A '16: Proceedings of the 13th International Web for All Conference

Research towards my dissertation has involved a series of perceptual and accessibility-focused studies concerned with the use of tactile cues for spatial and situational awareness, displayed through head-mounted wearables. These studies were informed by ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

DIS '23: Proceedings of the 2023 ACM Designing Interactive Systems Conference

July 2023

2717 pages

ISBN:9781450398930

DOI:10.1145/3563657

Editors:
Daragh Byrne
Carnegie Mellon University
,
Nikolas Martelaro
Carnegie Mellon University
,
Andy Boucher
Northumbria University
,
David Chatting
Goldsmiths, University of London
,
Sarah Fdili Alaoui
LISN-Université Paris Saclay
,
Sarah Fox
Carnegie Mellon University
,
Iohanna Nicenboim
Delft University of Technology
,
Cayley MacArthur
University of Waterloo

Copyright © 2023 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 10 July 2023

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

Conference

DIS '23

Sponsor:

SIGCHI

DIS '23: Designing Interactive Systems Conference

July 10 - 14, 2023

PA, Pittsburgh, USA

Acceptance Rates

Overall Acceptance Rate 1,158 of 4,684 submissions, 25%

Upcoming Conference

DIS '25

Sponsor:
sigchi

Designing Interactive Systems Conference

July 5 - 9, 2025

Funchal , Portugal

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
307
Total Downloads

Downloads (Last 12 months)202
Downloads (Last 6 weeks)49

Reflects downloads up to 15 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Yildirim NZlotnikov SVenkat AChawla GKim JBukowski LKahn JMccann JZimmerman J(2024)Investigating Why Clinicians Deviate from Standards of Care: Liberating Patients from Mechanical Ventilation in the ICUProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3641982(1-15)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3641982

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Figures

Tables

Media

View Table of Conten