research-article

HoloCPR: Designing and Evaluating a Mixed Reality Interface for Time-Critical Emergencies

Authors:

Janet G. Johnson,

Danilo Gasques Rodrigues,

Madhuri Gubbala,

Nadir WeibelAuthors Info & Claims

PervasiveHealth '18: Proceedings of the 12th EAI International Conference on Pervasive Computing Technologies for Healthcare

Pages 67 - 76

https://doi.org/10.1145/3240925.3240984

Published: 21 May 2018 Publication History

Abstract

Performing time-critical procedures such as Cardiopulmonary Resuscitation (CPR) usually requires trained individuals on the scene. Even when step by step instructions are available, most bystanders do not attempt resuscitation due to panic or fear of failing, often at the cost of the victim's life. We propose Mixed Reality (MR) as a compelling medium to support time-critical emergencies, and study its use in this context through an iterative user-centered design process. Our research outlines a number of key considerations for the design of time-critical emergency interfaces that led to the creation of HoloCPR, an MR application providing real-time instructions for resuscitation through a combination of visual and spatial cues. HoloCPR's comparative evaluation during a realistic resuscitation scenario indicates how the use of MR can result in decreased reaction time and increased procedural accuracy. With this work, we hope to bootstrap a new wave of MR applications for time-critical emergencies that can be included in first aid kits in the future.

References

[1]

J. Blattgerste, B. Strenge, P. Renner, T. Pfeiffer, and K. Essig. Comparing conventional and augmented reality instructions for manual assembly tasks. In Proc. of the 10th International Conference on Pervasive Technologies Related to Assistive Environments, pages 75--82, 2017.

Digital Library

[2]

T. P. Caudell and D. W. Mizell. Augmented reality: an application of heads-up display technology to manual manufacturing processes. In Proc. HICSS '92, pages 659--669 vol.2, Jan. 1992.

[3]

B. F. Crabtree and W. L. Miller. Doing qualitative research. Sage Publications, 1999.

[4]

S. Feiner, B. Macintyre, and D. Seligmann. Knowledge-based augmented reality. Commun. ACM, 36(7):53--62, July 1993.

Digital Library

[5]

A. Fouse, N. Weibel, E. Hutchins, and J. D. Hollan. Chronoviz: a system for supporting navigation of time-coded data. In Proc. CHI'11, pages 299--304, 2011.

Digital Library

[6]

M. Funk, A. Bächler, L. Bächler, T. Kosch, T. Heidenreich, and A. Schmidt. Working with augmented reality?: A long-term analysis of in-situ instructions at the assembly workplace. In Proc. of the 10th International Conference on Pervasive Technologies Related to Assistive Environments, pages 222--229. ACM, 2017.

Digital Library

[7]

R. Graham, M. A. McCoy, A. M. Schultz, et al. The public experience with cardiac arrest. National Academies Press (US), 2015.

[8]

S. J. Henderson and S. K. Feiner. Augmented reality in the psychomotor phase of a procedural task. In Proc. ISMAR '11, pages 191--200, 2011.

Digital Library

[9]

I. Kovic and I. Lulic. Mobile phone in the chain of survival. Resuscitation, 82(6):776--779, 2011.

[10]

Y. Kwon, S. Lee, J. Jeong, and W. Kim. Heartisense: a novel approach to enable effective basic life support training without an instructor. In Proc. CHI '14, pages 1699--1704, 2014.

Digital Library

[11]

M. P. Larsen, M. S. Eisenberg, R. O. Cummins, and A. P. Hallstrom. Predicting survival from out-of-hospital cardiac arrest: a graphic model. Annals of emergency medicine, 22(11):1652--1658, 1993.

[12]

P. Milgram and F. Kishino. A taxonomy of mixed reality visual displays. IEICE Trans. on Inf. Syst., 77(12):1321--1329, 1994.

[13]

D. Mozaffarian, E. J. Benjamin, et al. Heart disease and stroke statistics---2015 update. Circulation, 2016.

[14]

A. Nielsen, D. Isbye, F. Lippert, and L. Rasmussen. Can mass education and a television campaign change the attitudes towards cardiopulmonary resuscitation in a rural community? SJTREM, 21(1):39, 2013.

[15]

J. Nolan, J. Soar, and H. Eikeland. The chain of survival. Resuscitation, 71(3):270--271, 2006.

[16]

D. A. Norman and S. W. Draper. User Centered System Design; New Perspectives on Human-Computer Interaction. L. Erlbaum Associates Inc., 1986.

Digital Library

[17]

N. Park, Y. Kwon, S. Lee, W. Woo, and J. Jeong. Projected AR-Based Interactive CPR Simulator. In Proc. VAMR '13, pages 83--89, 2013.

[18]

B. Sarupuri, G. A. Lee, and M. Billinghurst. Using augmented reality to assist forklift operation. In Proc. OzCHI '16, pages 16--24, 2016.

Digital Library

[19]

T. Sielhorst, T. Obst, R. Burgkart, R. Riener, and N. Navab. An augmented reality delivery simulator for medical training. In Proc. AMI-ARCS '04, volume 141, pages 11--20, 2004.

[20]

J. E. Swan and J. L. Gabbard. Survey of user-based experimentation in augmented reality. In Proc. 1st Intl. Conf. on VR, pages 1--9, 2005.

[21]

A. Tang, C. Owen, F. Biocca, and W. Mou. Comparative effectiveness of augmented reality in object assembly. In Proc. CHI '03, pages 73--80, 2003.

Digital Library

[22]

J. Tidwell. Designing interfaces: Patterns for effective interaction design. " O'Reilly Media, Inc.", 2010.

Digital Library

[23]

A. E. Uva, M. Gattullo, V. M. Manghisi, D. Spagnulo, G. L. Cascella, and M. Fiorentino. Evaluating the effectiveness of spatial augmented reality in smart manufacturing: a solution for manual working stations. Intl J.Adv. Manufact Tech, pages 1--13, 2017.

[24]

X. Wang, S. Ong, and A. Nee. A comprehensive survey of augmented reality assembly research. Advances in Manufacturing, 4(1):1--22, 2016.

[25]

R. T. Whitaker, C. Crampton, D. E. Breen, M. Tuceryan, and E. Rose. Object calibration for augmented reality. Comput. Graph. Forum, 14(3):15--27, 1 Aug. 1995.

Digital Library

[26]

M. Wissenberg, F. K. Lippert, F. Folke, P. Weeke, C. M. Hansen, E. F. Christensen, H. Jans, P. A. Hansen, T. Lang-Jensen, J. B. Olesen, et al. Association of national initiatives to improve cardiac arrest management with rates of bystander intervention and patient survival after out-of-hospital cardiac arrest. JAMA, 310(13):1377--1384, 2013.

[27]

H.-K. Wu, S. W.-Y. Lee, H.-Y. Chang, and J.-C. Liang. Current status, opportunities and challenges of augmented reality in education. Computers & Education, 62:41--49, 2013.

[28]

M. Yeh and C. D. Wickens. Attention and trust biases in the design of augmented reality displays. Technical report, Illinois Univ. at Urbana-Champaign, Savoy-Aviation Research Lab, 2000.

Cited By

García MRequesens JCano S(2024)User Experience Evaluation Methods in Mixed Reality EnvironmentsSocial Computing and Social Media10.1007/978-3-031-61281-7_12(179-193)Online publication date: 1-Jun-2024
https://doi.org/10.1007/978-3-031-61281-7_12
Javaheri HGruenerbl AMonger EGobbi MKarolus JLukowicz P(2024)RescuAR: A Self-Directed Augmented Reality System for Cardiopulmonary Resuscitation TrainingPervasive Computing Technologies for Healthcare10.1007/978-3-031-59717-6_12(166-185)Online publication date: 4-Jun-2024
https://doi.org/10.1007/978-3-031-59717-6_12
Ohshima TMatsui SYamane MLing YMuroi KSakai C(2023)MR BLS Trainer: A physical mixed reality CPR+AED rescue simulatorSIGGRAPH Asia 2023 XR10.1145/3610549.3614591(1-2)Online publication date: 28-Nov-2023
https://dl.acm.org/doi/10.1145/3610549.3614591
Show More Cited By

Index Terms

HoloCPR: Designing and Evaluating a Mixed Reality Interface for Time-Critical Emergencies
1. Human-centered computing

Recommendations

Adding Force Feedback to Mixed Reality Experiences and Games using Electrical Muscle Stimulation
CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems

We present a mobile system that enhances mixed reality experiences and games with force feedback by means of electrical muscle stimulation (EMS). The benefit of our approach is that it adds physical forces while keeping the users' hands free to interact ...
Exploring Mixed Reality in Specialized Surgical Environments
CHI EA '17: Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems

Recent technology advances in both Virtual Reality and Augmented Reality are creating an opportunity for a paradigm shift in the design of human-computer interaction systems. Delving into the Reality-Virtuality Continuum, we find Mixed Reality - systems ...
HoloLens-based Mixed Reality Experiences for Subjects with Alzheimer's Disease
CHItaly '17: Proceedings of the 12th Biannual Conference on Italian SIGCHI Chapter

HoloLens technology enables mixed reality experiences that integrate holographic objects into the real world in which the mixed reality head-mounted device is used. Since HoloLens' launch in March 2016, some mixed-reality applications of this technology ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

PervasiveHealth '18: Proceedings of the 12th EAI International Conference on Pervasive Computing Technologies for Healthcare

May 2018

413 pages

ISBN:9781450364508

DOI:10.1145/3240925

General Chairs:
Noga Minsky
Mount Sinai Health System
,
Venet Osmani
Fondazione Bruno Kessler

Copyright © 2018 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

EAI: The European Alliance for Innovation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 21 May 2018

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

PervasiveHealth '18

PervasiveHealth '18: 12th EAI International Conference on Pervasive Computing Technologies for Healthcare

May 21 - 24, 2018

NY, New York, USA

Acceptance Rates

Overall Acceptance Rate 55 of 116 submissions, 47%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

16
Total Citations
View Citations
392
Total Downloads

Downloads (Last 12 months)44
Downloads (Last 6 weeks)3

Reflects downloads up to 26 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

García MRequesens JCano S(2024)User Experience Evaluation Methods in Mixed Reality EnvironmentsSocial Computing and Social Media10.1007/978-3-031-61281-7_12(179-193)Online publication date: 1-Jun-2024
https://doi.org/10.1007/978-3-031-61281-7_12
Javaheri HGruenerbl AMonger EGobbi MKarolus JLukowicz P(2024)RescuAR: A Self-Directed Augmented Reality System for Cardiopulmonary Resuscitation TrainingPervasive Computing Technologies for Healthcare10.1007/978-3-031-59717-6_12(166-185)Online publication date: 4-Jun-2024
https://doi.org/10.1007/978-3-031-59717-6_12
Ohshima TMatsui SYamane MLing YMuroi KSakai C(2023)MR BLS Trainer: A physical mixed reality CPR+AED rescue simulatorSIGGRAPH Asia 2023 XR10.1145/3610549.3614591(1-2)Online publication date: 28-Nov-2023
https://dl.acm.org/doi/10.1145/3610549.3614591
Chen CNguyen CHoffswell JHealey JBui TWeibel N(2023)PaperToPlace: Transforming Instruction Documents into Spatialized and Context-Aware Mixed Reality ExperiencesProceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586183.3606832(1-21)Online publication date: 29-Oct-2023
https://dl.acm.org/doi/10.1145/3586183.3606832
Johnson JSharkey TButarbutar IXiong DHuang RSy LWeibel N(2023)UnMapped: Leveraging Experts’ Situated Experiences to Ease Remote Guidance in Collaborative Mixed RealityProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581444(1-20)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581444
Rebol MSteinmaurer AGamillscheg FPietroszek KGütl CRanniger CHood CRutenberg ASikka N(2023)CPR Emergency Assistance Through Mixed Reality CommunicationAugmented Intelligence and Intelligent Tutoring Systems10.1007/978-3-031-32883-1_38(415-429)Online publication date: 22-May-2023
https://doi.org/10.1007/978-3-031-32883-1_38
Rebol MPietroszek KRanniger CHood CRutenberg ASikka NSteinmaurer AGutl C(2022)Work-in-Progress-Volumetric Communication for Remote Assistance Giving Cardiopulmonary Resuscitation2022 8th International Conference of the Immersive Learning Research Network (iLRN)10.23919/iLRN55037.2022.9815989(1-3)Online publication date: 30-May-2022
https://doi.org/10.23919/iLRN55037.2022.9815989
Zhu JLei YShah ASchein GGhaednia HSchwab JHarteveld CMueller S(2022)MuscleRehab: Improving Unsupervised Physical Rehabilitation by Monitoring and Visualizing Muscle EngagementProceedings of the 35th Annual ACM Symposium on User Interface Software and Technology10.1145/3526113.3545705(1-14)Online publication date: 29-Oct-2022
https://dl.acm.org/doi/10.1145/3526113.3545705
Sevcenko NSchopp BDresler TEhlis ANinaus MMoeller KGerjets P(2022)Neural Correlates of Cognitive Load While Playing an Emergency Simulation Game: A Functional Near-Infrared Spectroscopy (fNIRS) StudyIEEE Transactions on Games10.1109/TG.2022.314295414:4(696-705)Online publication date: Dec-2022
https://doi.org/10.1109/TG.2022.3142954
Rebollo CGasch CRemolar IDelgado D(2021)Learning First Aid with a Video GameApplied Sciences10.3390/app11241163311:24(11633)Online publication date: 8-Dec-2021
https://doi.org/10.3390/app112411633
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten