abstract

Understanding Digital Checklist Use Through Team Communication

Authors:

Angela Mastrianni,

Aleksandra SarcevicAuthors Info & Claims

CHI EA '20: Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems

Pages 1 - 8

https://doi.org/10.1145/3334480.3382817

Published: 25 April 2020 Publication History

Abstract

Introducing technology support in a complex, team-based work setting requires a study of teamwork effects on technology use. In this paper, we present our initial analysis of team communications in a trauma resuscitation setting, where we deployed a digital checklist to support trauma team leaders in guiding patient care. By analyzing speech transcripts, checklist interaction logs, and videos of 15 resuscitations, we identified several tensions that arose from the use of a checklist in a team-based process with multi-step tasks. The tensions included incorrect markings of in-progress tasks as completed, failure to mark completed tasks due to missed communications, failure to record planned tasks, and difficulties in recording dynamic values. From these findings, we discuss design implications for checklist design for dynamic, team-based activities.

References

[1]

Aalok V Agarwala, Paul G Firth, Meredith A Albrecht, Lisa Warren, and Guido Musch. 2015. An electronic checklist improves transfer and retention of critical information at intraoperative handoff of care. Anesthesia & Analgesia 120, 1 (2015), 96--104.

[2]

Amanda R Burden, Zyad J Carr, Gregory W Staman, Jeffrey J Littman, and Marc C Torjman. 2012. Does every code need a "reader?" improvement of rare event management with a cognitive aid "reader" during a simulated emergency: A pilot study. Simulation in Healthcare 7, 1 (2012), 1--9.

[3]

Barbara K Burian, Anna Clebone, Key Dismukes, and Keith J Ruskin. 2018. More than a tick box: medical checklist development, design, and use. Anesthesia & Analgesia 126, 1 (2018), 223--232.

[4]

Elizabeth A Carter, Lauren J Waterhouse, Mark L Kovler, Jennifer Fritzeen, and Randall S Burd. 2013. Adherence to ATLS primary and secondary surveys during pediatric trauma resuscitation. Resuscitation 84, 1 (2013), 66--71.

[5]

Ken Catchpole and Stephanie Russ. 2015. The problem with checklists. BMJ Qual Saf 24, 9 (2015), 545--549.

[6]

Mark Fitzgerald, Peter Cameron, Colin Mackenzie, Nathan Farrow, Pamela Scicluna, Robert Gocentas, Adam Bystrzycki, Geraldine Lee, Nick Andrianopoulos, Linas Dziukas, and others. 2011. Trauma resuscitation errors and computer-assisted decision support. Archives of Surgery 146, 2 (2011), 218--225.

[7]

Abigail S Gertner and Bonnie L Webber. 1998. TraumaTIQ: online decision support for trauma management. IEEE Intelligent Systems and Their Applications 13, 1 (1998), 32--39.

Digital Library

[8]

Michael J Gonzales, Joshua M Henry, Aaron W Calhoun, and Laurel D Riek. 2016. Visual task: A collaborative cognitive aid for acute care resuscitation. In Proceedings of the 10th EAI International Conference on Pervasive Computing Technologies for Healthcare. ICST (Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering), 45--52.

[9]

Tobias Grundgeiger, Stephan Huber, Daniel Reinhardt, Andreas Steinisch, Oliver Happel, and Thomas Wurmb. 2019. Cognitive aids in acute care: Investigating how cognitive aids affect and support in-hospital emergency teams. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1--14.

Digital Library

[10]

Swathi Jagannath, Aleksandra Sarcevic, Victoria Young, and Sage Myers. 2019. Temporal Rhythms and Patterns of Electronic Documentation in Time-Critical Medical Work. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, 334.

Digital Library

[11]

Deirdre C Kelleher, Elizabeth A Carter, Lauren J Waterhouse, Samantha E Parsons, Jennifer L Fritzeen, and Randall S Burd. 2014. Effect of a checklist on advanced trauma life support task performance during pediatric trauma resuscitation. Academic Emergency Medicine 21, 10 (2014), 1129--1134.

[12]

Heidi S Kramer and Frank A Drews. 2017. Checking the lists: A systematic review of electronic checklist use in health care. Journal of Biomedical Informatics 71 (2017), S6--S12.

Digital Library

[13]

Leah Kulp, Aleksandra Sarcevic, Megan Cheng, Yinan Zheng, and Randall S Burd. 2019. Comparing the Effects of Paper and Digital Checklists on Team Performance in Time-Critical Work. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, 547.

Digital Library

[14]

Aleksandra Sarcevic and Randall S Burd. 2008. "What's the Story?" Information Needs of Trauma Teams. In AMIA Annual Symposium Proceedings, Vol. 2008. American Medical Informatics Association, 641.

[15]

Aleksandra Sarcevic, Ivan Marsic, and Randall S Burd. 2018. Dashboard design for improved team situation awareness in time-critical medical work: Challenges and lessons learned. In Designing Healthcare That Works. Elsevier, 113--131.

[16]

Aleksandra Sarcevic, Zhan Zhang, Ivan Marsic, and Randall S Burd. 2016. Checklist as a memory externalization tool during a critical care process. In AMIA Annual Symposium Proceedings, Vol. 2016. American Medical Informatics Association, 1080.

[17]

Charat Thongprayoon, Andrew M Harrison, John C O'Horo, Ronaldo A Sevilla Berrios, Brian W Pickering, and Vitaly Herasevich. 2016. The effect of an electronic checklist on critical care provider workload, errors, and performance. Journal of Intensive Care Medicine 31, 3 (2016), 205--212.

[18]

Curtis H Weiss, David DiBardino, Jason Rho, Nina Sung, Brett Collander, and Richard G Wunderink. 2013. A clinical trial comparing physician prompting with an unprompted automated electronic checklist to reduce empirical antibiotic utilization. Critical Care Medicine 41, 11 (2013).

[19]

Sarah Whyte, Lorelei Lingard, Sherry Espin, G Ross Baker, John Bohnen, Beverley A Orser, Diane Doran, Richard Reznick, and Glenn Regehr. 2008. Paradoxical effects of interprofessional briefings on OR team performance. Cognition, Technology & Work 10, 4 (2008), 287--294.

Digital Library

[20]

Leslie Wu, Jesse Cirimele, Kristen Leach, Stuart Card, Larry Chu, T Kyle Harrison, and Scott R Klemmer. 2014. Supporting crisis response with dynamic procedure aids. In Proceedings of the 2014 Conference on Designing interactive systems. ACM, 315--324.

Digital Library

Cited By

Mastrianni ASarcevic AHu AAlmengor LTempel PGao SBurd R(2023)Transitioning Cognitive Aids into Decision Support Platforms: Requirements and Design GuidelinesACM Transactions on Computer-Human Interaction10.1145/358243130:3(1-28)Online publication date: 10-Jun-2023
https://dl.acm.org/doi/10.1145/3582431
Fischer MDennig FSeebacher DKeim DEl-Assady M(2022)Communication Analysis through Visual Analytics: Current Practices, Challenges, and New Frontiers2022 IEEE Visualization in Data Science (VDS)10.1109/VDS57266.2022.00006(6-16)Online publication date: Oct-2022
https://doi.org/10.1109/VDS57266.2022.00006
Mastrianni ASarcevic AChung LZakeri IAlberto EMilestone ZMarsic IBurd R(2021)Designing Interactive Alerts to Improve Recognition of Critical Events in Medical EmergenciesProceedings of the 2021 ACM Designing Interactive Systems Conference10.1145/3461778.3462051(864-878)Online publication date: 28-Jun-2021
https://dl.acm.org/doi/10.1145/3461778.3462051

Index Terms

Understanding Digital Checklist Use Through Team Communication
1. Human-centered computing
  1. Collaborative and social computing
    1. Collaborative and social computing theory, concepts and paradigms
      1. Computer supported cooperative work

Recommendations

Checklist Design Reconsidered: Understanding Checklist Compliance and Timing of Interactions
CHI '20: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems

We examine the association between user interactions with a checklist and task performance in a time-critical medical setting. By comparing 98 logs from a digital checklist for trauma resuscitation with activity logs generated by video review, we ...
Exploring Design Opportunities for a Context-Adaptive Medical Checklist Through Technology Probe Approach
DIS '17: Proceedings of the 2017 Conference on Designing Interactive Systems

This paper explores the workflow and use of an interactive medical checklist for trauma resuscitation--an emerging technology developed for trauma team leaders to support decision making and task coordination among team members. We used a technology ...
Comparing the Effects of Paper and Digital Checklists on Team Performance in Time-Critical Work
CHI '19: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems

This mixed-methods study examines the effects of a tablet-based checklist system on team performance during a dynamic and safety-critical process of trauma resuscitation. We compared team performance from 47 resuscitations that used a paper checklist to ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI EA '20: Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems

April 2020

4474 pages

ISBN:9781450368193

DOI:10.1145/3334480

General Chairs:
Regina Bernhaupt
Eindhoven University of Technology, Netherlands
,
Florian 'Floyd' Mueller
Monash University, Australia
,
David Verweij
Newcastle University, UK
,
Josh Andres
RMIT, Australia
,
Program Chairs:
Joanna McGrenere
University of British Columbia, Canada
,
Andy Cockburn
University of Canterbury, New Zealand
,
Ignacio Avellino
University of Maryland Baltimore County, USA
,
Alix Goguey
Grenoble Alpes University, France
,
Pernille Bjørn
University of Copenhagen, Denmark
,
Shengdong (Shen) Zhao
National University of Singapore, Singapore
,
Briane Paul Samson
Future University Hakodate, Japan & De La Salle University, Philippines
,
Rafal Kocielnik
University of Washington, USA

Copyright © 2020 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 25 April 2020

Check for updates

Author Tags

Qualifiers

Abstract

Funding Sources

National Institutes of Health
Agency for Healthcare Research and Quality

Conference

CHI '20

Sponsor:

SIGCHI

CHI '20: CHI Conference on Human Factors in Computing Systems

April 25 - 30, 2020

HI, Honolulu, USA

Acceptance Rates

Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
233
Total Downloads

Downloads (Last 12 months)18
Downloads (Last 6 weeks)1

Reflects downloads up to 17 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Mastrianni ASarcevic AHu AAlmengor LTempel PGao SBurd R(2023)Transitioning Cognitive Aids into Decision Support Platforms: Requirements and Design GuidelinesACM Transactions on Computer-Human Interaction10.1145/358243130:3(1-28)Online publication date: 10-Jun-2023
https://dl.acm.org/doi/10.1145/3582431
Fischer MDennig FSeebacher DKeim DEl-Assady M(2022)Communication Analysis through Visual Analytics: Current Practices, Challenges, and New Frontiers2022 IEEE Visualization in Data Science (VDS)10.1109/VDS57266.2022.00006(6-16)Online publication date: Oct-2022
https://doi.org/10.1109/VDS57266.2022.00006
Mastrianni ASarcevic AChung LZakeri IAlberto EMilestone ZMarsic IBurd R(2021)Designing Interactive Alerts to Improve Recognition of Critical Events in Medical EmergenciesProceedings of the 2021 ACM Designing Interactive Systems Conference10.1145/3461778.3462051(864-878)Online publication date: 28-Jun-2021
https://dl.acm.org/doi/10.1145/3461778.3462051

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Figures

Tables

Media

View Table of Conten