research-article

SimCEC: A Collaborative VR-Based Simulator for Surgical Teamwork Education

Authors:

Paulo V. F. Paiva,

Liliane S. Machado,

Ana Maria G. Valença,

Thiago V. Batista,

Ronei M. MoraesAuthors Info & Claims

Computers in Entertainment (CIE), Volume 16, Issue 2

Article No.: 3, Pages 1 - 26

https://doi.org/10.1145/3177747

Published: 10 April 2018 Publication History

Abstract

Traditionally, the evaluation of surgical procedures in virtual reality (VR) simulators has been restricted to their individual technical aspects disregarding the procedures carried out by teams. However, some decision models have been proposed to support the collaborative training evaluation process of surgical teams in collaborative virtual environments. The main objective of this article is to present a collaborative simulator based on VR, named SimCEC, as a potential solution for education, training, and evaluation in basic surgical routines for teams of undergraduate students. The simulator considers both tasks performed individually and those carried in a collaborative manner. The main contribution of this work is to improve the discussion about VR simulators requirements (design and implementation) to provide team training in relevant topics, such as users’ feedback in real time, collaborative training in networks, interdisciplinary integration of curricula, and continuous evaluation.

References

[1]

L. Kohn, J. Corrigan, and M. Donaldson. 2000. To Err Is Human: Building a Safer Health System. Washington, DC: National Academies Press.

[2]

A. Cuschieri. 2006. Nature of human error: Implications for surgical practice. Annals of Surgery 244, 5, 642--648.

[3]

Y. Donchin, D. Copher, M. Olin, Y. Badihi, M. Biesky, C. L. Sprung, R. Pizov, and S. Cotev. 2003. A look into the nature and causes of human errors in the intensive care unit. BMJ Quality 8 Safety 12, 2, 143--147.

[4]

P. Pucher, A. Darzi, and R. Aggarwal. 2013. Simulation for ward processes of surgical care. American Journal of Surgery 206, 1, 96--102.

[5]

S. Wei and Z. Wen-QI. 2010. Virtual reality technology in modern medicine. In Proceedings of the International Conference on Audio, Language, and Image Processing. 557--561.

[6]

R. L. Lammers, M. Davenport, F. Korley, S. Griswold-Theodorson, M. T. Fitch, A. T. Narang, L. V. Evans, et al. 2008. Teaching and assessing procedural skills using simulation: Metrics and methodology. Academic Emergency Medicine 15, 11, 1079--1087.

[7]

Joint Commission. 2018. Sentinel Event Policy and Procedures. Retrieved February 6, 2018, from https://www.jointcommission.org/sentinel_event_policy_and_procedures/

[8]

G. Burdea and P. Coiffet. 2003. Virtual Reality Technology. John Wiley 8 Sons.

Digital Library

[9]

Roy A. Ruddle. 2013. The effect of translational and rotational body-based information on navigation. In Human Walking in Virtual Environments. Springer, New York, NY, 99--112.

[10]

S. Singhal and M. Zyda. 1999. Networked Virtual Environments: Design and Implementation. Addison-Wesley, New York, NY.

Digital Library

[11]

S. Shirmohammadi and N. Georganas. 2001. An end-to-end communication architecture for collaborative virtual environments. Computer Networks 35, 2, 351--367.

Digital Library

[12]

S. Benford, C. Greenhalgh, T. Rodden, and J. Pycock. 2001. Collaborative virtual environments. Communications of the ACM 44, 7, 79--85.

Digital Library

[13]

R. Moraes and L. Machado. 2012. A new architecture for assessment of multiple users in collaborative medical training environments based on virtual reality. In Proceedings of the 10th International FLINS Conference. 1119--1124.

[14]

R. Moraes and L. Machado. 2011. Assessment of collaborative medical training based on virtual reality using possibilistic networks. In Proceedings of the XI Safety, Health, and Environment World Congress (SHEWC’11). 46--50.

[15]

R. Moraes and L. Machado. 2013. Simultaneous assessment of teams in collaborative virtual environments using fuzzy naive Bayes. In Proceedings of the 2013 Joint IFSA World Congress and NAFIPS Annual Meeting (IFSA/NAFIPS’13). 1343--1348.

[16]

D. Michael and S. Chen. 2005. Serious Games: Games That Educate, Train, and Inform. Thomson.

Digital Library

[17]

S. Undre, N. Sevdalis, A. N. Healy, S. Darzi, and C. A. Vincent. 2006. Teamwork in the operating theatre: Cohesion or confusion? Journal of Evaluation in Clinical Practice 12, 2, 182--189.

[18]

Grigore C. Burdea. 1996. Force and Touch Feedback for Virtual Reality. John Wiley 8 Sons.

Digital Library

[19]

P. Paiva, L. Machado, and T. Costa. 2016. Hemodynamic behavior modeling of a virtual surgical patient based on a fuzzy expert system. Tempus: Actas de saúde Coletiva, 10, 2, 187--203.

[20]

P. V. F. Paiva, L. S. Machado, and A. M. G. Valença. 2013. A virtual environment for training and assessment of surgical teams. In Proceedings of the Symposium on Virtual and Augmented Reality. 17--26.

Digital Library

[21]

D. Parvati, H. LeRoy, and Y. Patricia. 2011. CliniSpace: A multiperson 3D online immersive training environment accessible through a browser. Studies in Health Technologies and Informatics 163, 173--179.

[22]

J. Taekman, N. Segall, E. Hobbs, and M. Wright. 2007. 3DiTeams—Healthcare team training in a virtual environment. In Proceedings of the Anesthesiology Annual Meeting. 107.A2145.

[23]

Catherine Pons Lelardeux, David Panzoli, Michel Galaup, Vincent Minville, Vincent Lubrano, Pierre Lagarrigue, and Jean-Pierre Jessel. 2016. 3D real-time collaborative environment to learn teamwork and non-technical skills in the operating room. In Interactive Collaborative Learning. Advances in Intelligent Systems and Computing, Vol. 544. Springer, 143--157.

[24]

E. Stroulia Chodos and S. King. 2011. MeRiTS: Simulation-based training for healthcare professionals. Studies in Health Technologies and Informatics 163, 125--131.

[25]

P. Paiva, L. Machado, and A. Valença. 2016. Enhancing collaboration on a cloud-based CVE for supporting surgical education. In Proceedings of the XVIII Symposium on Virtual and Augmented Reality.

[26]

P. Paiva, L. Machado, and T. Batista. 2015. A collaborative and immersive VR simulator for education and assessment of surgical teams. In Proceedings of the Symposium on Virtual and Augmented Reality. 176--185.

Digital Library

[27]

M. Graafland, J. Schraagen, and M. Schijven. 2012. Systematic review of serious games for medical education and surgical skills training. British Journal of Surgery 99, 10, 1322--1330.

[28]

Sandrine de Ribaupierre, Bill Kapralos, Faizal Haji, Eleni Stroulia, Adam Dubrowski, and Roy Eagleson. 2014. Healthcare training enhancement through virtual reality and serious games. In Virtual, Augmented Reality and Serious Games for Healthcare 1, M. Ma, L. C. Jain, and P. Anderson (Eds.). Springer, 9--27.

[29]

R. J. Reis, A. V. de Macedo Neto, M. S. Pinho, P. A. Behar, and M. I. Edelweiss. 2010. Virtual reality environments in surgical training—Introducing the pre, trans and postoperative virtual environment (OPVIR). Brazilian Journal of Videoendoscopic Surgery 3, 3, 126--133.

[30]

A. G. Gallagher, E. M. Ritter, H. Champion, G. Higgens, M. P. Fried, G. Moses, C. D. Smith, and R. M. Satava. 2005. Virtual reality simulation for the operating room: Proficiency-based training as a paradigm shift in surgical skills training. Annals of Surgery 241, 2, 364--372.

[31]

R. Satava. 2001. Accomplishments and challenges of surgical simulation. Surgical Endoscopy 15, 3, 232--241.

[32]

L. S. Leach, R. C. Myrtle, F. A. Weaver, and S. Dasu. 2009. Assessing the performance of surgical teams. Health Care Management Review 34, 1, 29--41.

[33]

A. Santos, R. G. S. Gomes, R. M. Moraes, and L. S. Machado. 2010. A fuzzy logic based assessment tool for VR simulated medical environments. In Proceedings of the X Safety, Health and Environment World Congress. http://www.de.ufpb.br/∼labteve/publi/2010_shewc.pdf.

[34]

R. Satava, A. G. Gallagher, and C. A. Pellegrini. 2003. A. surgical competence and surgical proficiency: Definitions, taxonomy, and metrics. Journal of the American College of Surgeons 196, 6, 933--937.

[35]

P. H. Cosman, P. C. Cregan, C. J. Martin, and J. A. Cartmill. 2002. Virtual Reality simulators: Current status in acquisition and assessment of surgical skills. ANZ Journal of Surgery 72, 1, 30--34.

[36]

J. Paige. 2010. Surgical team training: Promoting high reliability with nontechnical skills. Surgical Clinics of North America 90, 3, 569--581.

[37]

R. McDonald, J. Waring, S. Harrison, K. Walshe, and R. Boaden. 2005. Rules and guidelines in clinical practice: A qualitative study in operating theatres of doctors’ and nurses’ views. Quality and Safety in Health Care 14, 4, 290--294.

[38]

A. N. Healey, S. Undre, and C. A. Vincent. 2004. Developing observational measures of performance in surgical teams. Quality and Safety in Health Care 133, Suppl. 1, i33--i40.

[39]

S. Undre, A. Healey, A. Darzi, and C. Vincent. 2007. Observational teamwork assessment in surgery (OTAS): Refinement and application in urological surgery. World Journal of Surgery 31, 7, 1373--1381.

[40]

A. A. Vanderbilt, A. C. Grover, N. J. Pastis, M. Feldman, D. D. Granados, L. K. Murithi, and A. G. Mainous III. 2015. Randomized controlled trials: A systematic review of laparoscopic surgery and simulation-based training. Global Journal of Health Science 7, 2, 310--327.

[41]

T. P. Grantcharov, V. B. Kristiansen, J. Bendix, L. Bardram, J. Rosenberg, and P. Funch-Jensen. 2004. Randomized clinical trial of virtual reality simulation for laparoscopic skills training. British Journal of Surgery 91, 2, 146--150.

[42]

R. Moraes and L. Machado. 2004. Using fuzzy hidden Markov models for online training evaluation and classification in virtual reality simulators. International Journal of General Systems 33, 2--3, 281--288.

[43]

H. Azarnoush, G. Alzhrani, A. Winkler-Schwartz, F. Alotaibi, N. Gelinas-Phaneuf, V. Pazos, N. Choudhury, J. Fares, R. DiRaddo, and R. F. Del Maestro. 2015. Neurosurgical virtual reality simulation metrics to assess psychomotor skills during brain tumor resection. International Journal of Computer Assisted Radiology and Surgery 10, 5, 603--618.

[44]

J. Rosen, M. Solazzo, B. Hannaford, and M. Sinanan. 2001. Objective laparoscopic skills assessments of surgical residents using hidden Markov models based on haptic information and tool/tissue interactions. Studies in Health Technology and Informatics 70, 417--423.

[45]

B. Choi and A. Pak. 2006. Multidisciplinarity, interdisciplinarity and transdisciplinarity in health research, services, education and policy: 1. Definitions, objectives, and evidence of effectiveness. Clinical and Investigative Medicine 29, 6, 351--364.

[46]

L. Machado and R. Moraes. 2007. Multiple assessment for multiple users in virtual reality training environments. In Progress in Pattern Recognition, Image Analysis and Applications. Lecture Notes in Computer Science, Vol. 4756. Springer, 950--956.

Digital Library

[47]

M. Montoya, A. Massey, and N. Lockwood. 2011. 3D collaborative virtual environments: Exploring the link between collaborative behaviors and team performance. Decision Sciences 42, 2, 451--476.

[48]

Catherine Pons Lelardeux, David Panzoli, Michel Galaup, Vincent Minville, Vincent Lubrano, Pierre Lagarrigue, and Jean-Pierre Jessel. 2016. 3D real-time collaborative environment to learn teamwork and non-technical skills in the operating room. In Interactive Collaborative Learning. Advances in Intelligent Systems and Computing, Vol. 544. Springer, 143--157.

[49]

P. Khanal, A. Vankipuram, A. Ashby, M. Vankipuram, A. Gupta, D. Drumm-Gurnee, K. Josey, L. Tinker, and M. Smith. 2014. Collaborative virtual reality based advanced cardiac life support training simulator using virtual reality principles. Journal of Biomedical Informatics 51, 49--59.

Digital Library

[50]

D. Chodos, E. Stroulia, and S. King. 2011. MeRiTS: Simulation-based training for healthcare professionals. Studies in Health Technologies and Informatics 163, 125--131.

[51]

G. Claude, V. Gouranton, R. B. Berthelot, and B. Arnaldi. 2014. #SEVEN, a sensor effector based scenarios model for driving collaborative virtual environment. In Proceedings of the International Conference on Artificial Reality and Telexistence and the Eurographics Symposium on Virtual Environments (ICAT-EGVE’14). 1--4.

Digital Library

[52]

AO Foundation. 2014. AO Surgery Reference. Retrieved February 6, 2018, from https://www2.aofoundation.org/wps/portal/surgery.

[53]

World Health Organization. 2009. Guidelines on Hand Hygiene in Health Care—First Global Patient Safety Challenge: Clean Care Is Safer Care. Retrieved February 6, 2018, from http://apps.who.int/iris/bitstream/10665/44102/1/9789241597906_eng.pdf.

[54]

R. H. Creighton. 2010. Unity 3D Game Development by Example: A Seat-of-Your-Pants Manual for Building Fun, Groovy Little Games Quickly. Packt Publishing Ltd, Birmingham, UK.

Digital Library

[55]

R. V. Binder. 2000. Testing Object-Oriented Systems: Models, Patterns, and Tools. Addison-Wesley Professional.

Digital Library

[56]

Unify Community. 2015. Official Wiki Page of the Unity Game Engine. Retrieved February 6, 2018, from http://wiki.unity3d.com/.

[57]

A. Merién, J. van de Ven, B. W. Mol, S. Houterman, and S. G. Oei. 2010. Multidisciplinary team training in a simulation setting for acute obstetric emergencies: A systematic review. Obstetrics and Gynecology 115, 5, 1021--1031.

[58]

E. Salas, D. Diaz Granados, C. Klein, C. S. Burke, K. C. Stagl, G. F. Goodwin, and S. M. Halpin. 2008. Does team training improve team performance? A meta-analysis. Human Factors 50, 6, 903--933.

[59]

P. Dev, W. Heinrichs, and P. Youngblood. 2011. CliniSpace™: A multiperson 3D online immersive training environment accessible through a browser. Studies in Health Technologies and Informatics 163, 173--179.

[60]

A. Uribe-Quevedo, D. Rojas, and B. Kapralos. 2016. Customization of a low-end haptic device to add rotational DOF for virtual cardiac auscultation training. In Proceedings of the 7th International Conference on Information, Intelligence, Systems, and Applications (IISA’16). 1--6.

[61]

A. Uribe-Quevedo, S. Ortiz, D. Rojas, and B. Kapralos. 2016. Hand tracking as a tool to quantify carpal tunnel syndrome preventive exercises. In Proceedings of the 7th International Conference on Information, Intelligence, Systems, and Applications (IISA’16). 1--5.

[62]

C. Schuwerk and E. Steinbach. 2013. Smooth object state updates in distributed haptic virtual environments. In Proceedings of the 2013 IEE International Symposium on Haptic Audio Visual Environments and Games (HAVE’13). IEEE, Los Alamitos, CA.

[63]

A. El Rhalibi and M. Merabti. 2005. Agents-based modeling for a peer-to-peer MMOG architecture. Computers in Entertainment 3, 2, 3.

Digital Library

[64]

S. Tang, M. Hanneghan, and A. El Rhalibi. 2007. Pedagogy elements, components and structures for serious games authoring environment. In Proceedings of the 5th International Game Design and Technology Workshop (GDTW’07).

[65]

J. Loversidge. 2012. Faculty Perceptions of Preparation of Medical and Nursing Students for Interprofessional Collaboration. Ph.D. Dissertation. Ohio State University.

[66]

N. Falchikov and J. Goldfinch. 2000. Student peer assessment in higher education: A meta-analysis comparing peer and teacher marks. Review of Educational Research 70, 3, 287--322.

[67]

D. Baldwin. 2007. Some historical notes on interdisciplinary and interprofessional education and practice in health care in the USA. Journal of Interprofessional Care 21, Suppl. 1, 23--37.

[68]

A. C. Greiner and E. Knebel (Eds). 2003. Health Professions Education: A Bridge to Quality. National Academies Press, Washington, DC.

[69]

E. Larson. 1999. The impact of physician-nurse interaction on patient care. Holistic Nursing Practice 12, 2, 38--46.

[70]

S. Tuchschmid, M. Bajka, D. Bachofen, G. Szekely, and M. Harders. 2007. Objective surgical performance assessment for virtual hysteroscopy. Studies in Health Technology and Informatics 25, 473--478.

[71]

K. Moorthy, Y. Munz, S. Sarker, and A. Darzi. 2003. Objective assessment of technical skills in surgery. British Medical Journal 327, 7422, 1032--1037.

Cited By

Dey CGrabowski MFrontzkowski YM.P. GUlbrich S(2024)Social virtual reality: systematic review of virtual teamwork with head-mounted displaysJournal of Workplace Learning10.1108/JWL-02-2024-004936:7(569-584)Online publication date: 20-Aug-2024
https://doi.org/10.1108/JWL-02-2024-0049
Ghamandi RHmaiti YNguyen TGhasemaghaei AKattoju RTaranta ELaViola J(2023)What And How Together: A Taxonomy On 30 Years Of Collaborative Human-Centered XR Tasks2023 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)10.1109/ISMAR59233.2023.00047(322-335)Online publication date: 16-Oct-2023
https://doi.org/10.1109/ISMAR59233.2023.00047
Feng SLiu YZhang QHe WZhang XWang SBillinghurst M(2023)Parallel or Cross? Effects of Two Collaborative Modes on Augmented Reality Co-located OperationsInternational Journal of Human–Computer Interaction10.1080/10447318.2023.220257440:15(3896-3907)Online publication date: 4-May-2023
https://doi.org/10.1080/10447318.2023.2202574
Show More Cited By

Index Terms

SimCEC: A Collaborative VR-Based Simulator for Surgical Teamwork Education
1. Applied computing
  1. Life and medical sciences
    1. Health informatics
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Virtual reality

Recommendations

A comparative analysis of offline and online evaluations and discussion of research paper recommender system evaluation
RepSys '13: Proceedings of the International Workshop on Reproducibility and Replication in Recommender Systems Evaluation

Offline evaluations are the most common evaluation method for research paper recommender systems. However, no thorough discussion on the appropriateness of offline evaluations has taken place, despite some voiced criticism. We conducted a study in which ...
Bet based online evaluation system for marketing campaign
ICEME '23: Proceedings of the 2023 14th International Conference on E-business, Management and Economics

Based on the analysis of relevant research results, this paper uses economic returns as the core means to design an online evaluation system that "bets" with betting funds. In marketing activities, merchants or platforms provide consumers with bet funds, ...
Automated labeling and online evaluation for self-paced movement detection BCI
Abstract
Electroencephalogram (EEG)-based brain–computer interfaces (BCIs) allow users to use brain signals to control external instruments, and movement intention detecting BCIs can aid in the rehabilitation of patients who have lost motor ...

Comments

Information & Contributors

Information

Published In

cover image Computers in Entertainment

Computers in Entertainment Volume 16, Issue 2

Special Issue: Deep Learning, Ubiquitous and Toy Computing

April 2018

152 pages

EISSN:1544-3574

DOI:10.1145/3181320

Issue’s Table of Contents

Copyright © 2018 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 10 April 2018

Accepted: 01 October 2017

Revised: 01 August 2017

Received: 01 February 2017

Published in CIE Volume 16, Issue 2

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tag

Online evaluation

Qualifiers

Research-article
Research
Refereed

Funding Sources

CNPq
CAPES

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

12
Total Citations
View Citations
435
Total Downloads

Downloads (Last 12 months)39
Downloads (Last 6 weeks)7

Reflects downloads up to 03 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Dey CGrabowski MFrontzkowski YM.P. GUlbrich S(2024)Social virtual reality: systematic review of virtual teamwork with head-mounted displaysJournal of Workplace Learning10.1108/JWL-02-2024-004936:7(569-584)Online publication date: 20-Aug-2024
https://doi.org/10.1108/JWL-02-2024-0049
Ghamandi RHmaiti YNguyen TGhasemaghaei AKattoju RTaranta ELaViola J(2023)What And How Together: A Taxonomy On 30 Years Of Collaborative Human-Centered XR Tasks2023 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)10.1109/ISMAR59233.2023.00047(322-335)Online publication date: 16-Oct-2023
https://doi.org/10.1109/ISMAR59233.2023.00047
Feng SLiu YZhang QHe WZhang XWang SBillinghurst M(2023)Parallel or Cross? Effects of Two Collaborative Modes on Augmented Reality Co-located OperationsInternational Journal of Human–Computer Interaction10.1080/10447318.2023.220257440:15(3896-3907)Online publication date: 4-May-2023
https://doi.org/10.1080/10447318.2023.2202574
Andrade JMachado LLopes LMoraes R(2022)Virtual simulations for health education: how are user skills assessed?Revista Brasileira de Educação Médica10.1590/1981-5271v46.4-20210389.ing46:4Online publication date: 2022
https://doi.org/10.1590/1981-5271v46.4-20210389.ing
Chheang VSchott DSaalfeld PVradelis LHuber THuettl FLang HPreim BHansen C(2022)Towards Virtual Teaching Hospitals for Advanced Surgical Training2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)10.1109/VRW55335.2022.00089(410-414)Online publication date: Mar-2022
https://doi.org/10.1109/VRW55335.2022.00089
Pires FCosta CDias P(2021)On the Use of Virtual Reality for Medical Imaging VisualizationJournal of Digital Imaging10.1007/s10278-021-00480-zOnline publication date: 29-Jul-2021
https://doi.org/10.1007/s10278-021-00480-z
Hudák MKorečko ŠSobota B(2020)LIRKIS Global Collaborative Virtual Environments: Current State and Utilization PerspectiveOpen Computer Science10.1515/comp-2020-012411:1(99-106)Online publication date: 17-Dec-2020
https://doi.org/10.1515/comp-2020-0124
Fischer RChang KWeller RZachmann G(2020)Volumetric Medical Data Visualization for Collaborative VR EnvironmentsVirtual Reality and Augmented Reality10.1007/978-3-030-62655-6_11(178-191)Online publication date: 25-Nov-2020
https://dl.acm.org/doi/10.1007/978-3-030-62655-6_11
Thevin LMachulla T(2020)Guidelines for Inclusive Avatars and Agents: How Persons with Visual Impairments Detect and Recognize Others and Their ActivitiesComputers Helping People with Special Needs10.1007/978-3-030-58796-3_21(164-175)Online publication date: 9-Sep-2020
https://dl.acm.org/doi/10.1007/978-3-030-58796-3_21
HUDAK MKORECKO SSOBOTA B(2019)Enhancing Team Interaction and Cross-platform Access in Web-based Collaborative Virtual Environments2019 IEEE 15th International Scientific Conference on Informatics10.1109/Informatics47936.2019.9119312(000171-000176)Online publication date: Nov-2019
https://doi.org/10.1109/Informatics47936.2019.9119312
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents