poster

Open access

A Study on the Size of Tangible Organ-shaped Controllers for Exploring Medical Data in VR

Authors:

Anke Verena Reinschluessel,

Thomas Muender,

Verena Nicole Uslar,

Rainer MalakaAuthors Info & Claims

CHI EA '21: Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems

Article No.: 261, Pages 1 - 7

https://doi.org/10.1145/3411763.3451594

Published: 08 May 2021 Publication History

All formats PDF

Abstract

Virtual reality (VR) is, by nature, excellent in showing spatial relationships, e.g. for viewing medical 3D data. In this work, we propose a VR system to view and manipulate medical 3D images of livers in combination with 3D printed liver models as controllers. We investigate whether users benefit from a controller in the shape of a liver and if the size matters by using three different sizes (50 %, 75 %, 100 %). In a user study with 14 surgeons, we focused on presence, workload and qualitative feedback such as preference. While neither size differences nor the VIVE tracker as control resulted in significant differences, most surgeons preferred the 75 % model. Qualitative results indicate that high similarity of physical and virtual objects regarding shape and a focus on good manageability of the physical object is more important than providing an exact replica in size.

Supplemental Material

MP4 File

Supplemental video

Download
31.93 MB

References

[1]

Mahdi Azmandian, Mark Hancock, Hrvoje Benko, Eyal Ofek, and Andrew D. Wilson. 2016. Haptic Retargeting: Dynamic Repurposing of Passive Haptics for Enhanced Virtual Reality Experiences. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI ’16). ACM, New York, NY, USA, 1968–1979. https://doi.org/10.1145/2858036.2858226

Digital Library

[2]

Lonni Besançon, Paul Issartel, Mehdi Ammi, and Tobias Isenberg. 2017. Mouse, Tactile, and Tangible Input for 3D Manipulation. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI ’17). ACM, New York, NY, USA, 4727–4740. https://doi.org/10.1145/3025453.3025863

Digital Library

[3]

Lonni Besançon, Anders Ynnerman, Daniel F. Keefe, Lingyun Yu, and Tobias Isenberg. 2021. The State of the Art of Spatial Interfaces for 3D Visualization. Computer Graphics Forum n/a, n/a (2021). https://doi.org/10.1111/cgf.14189 arXiv:aaaa

[4]

Andy Cockburn and Bruce McKenzie. 2002. Evaluating the Effectiveness of Spatial Memory in 2D and 3D Physical and Virtual Environments. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Minneapolis, Minnesota, USA) (CHI ’02). ACM, New York, NY, USA, 203–210. https://doi.org/10.1145/503376.503413

Digital Library

[5]

Balázs Faludi, Esther I Zoller, Nicolas Gerig, Azhar Zam, Georg Rauter, and Philippe C Cattin. 2019. Direct Visual and Haptic Volume Rendering of Medical Data Sets for an Immersive Exploration in Virtual Reality. In International Conference on Medical Image Computing and Computer-Assisted Intervention. Springer, Springer, Cham, na, 29–37.

Digital Library

[6]

Chihua Fang, Jihyun An, Antonio Bruno, Xiujun Cai, Jia Fan, Jiro Fujimoto, Rita Golfieri, Xishan Hao, Hongchi Jiang, Long R Jiao, 2020. Consensus recommendations of three-dimensional visualization for diagnosis and management of liver diseases. Hepatology International 14, 4 (2020), 437–453.

[7]

Sandra G Hart and Lowell E Staveland. 1988. Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. Advances in psychology 52 (1988), 139–183.

[8]

Ken Hinckley, Randy Pausch, John C. Goble, and Neal F. Kassell. 1994. Passive Real-world Interface Props for Neurosurgical Visualization. In Conference Companion on Human Factors in Computing Systems (Boston, Massachusetts, USA) (CHI ’94). ACM, New York, NY, USA, 232–. https://doi.org/10.1145/259963.260443

Digital Library

[9]

Hiroshi Ishii and Brygg Ullmer. 1997. Tangible Bits: Towards Seamless Interfaces Between People, Bits and Atoms. In Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (Atlanta, Georgia, USA) (CHI ’97). ACM, New York, NY, USA, 234–241. https://doi.org/10.1145/258549.258715

Digital Library

[10]

Robert J.K. Jacob, Audrey Girouard, Leanne M. Hirshfield, Michael S. Horn, Orit Shaer, Erin Treacy Solovey, and Jamie Zigelbaum. 2008. Reality-based Interaction: A Framework for post-WIMP Interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Florence, Italy) (CHI ’08). ACM, New York, NY, USA, 201–210. https://doi.org/10.1145/1357054.1357089

Digital Library

[11]

James H Johnson. 2002. Importance of dissection in learning anatomy: personal dissection versus peer teaching. Clinical Anatomy 15, 1 (2002), 38–44.

[12]

Andrey Krekhov, Katharina Emmerich, Philipp Bergmann, Sebastian Cmentowski, and Jens Krüger. 2017. Self-Transforming Controllers for Virtual Reality First Person Shooters. In Proceedings of the Annual Symposium on Computer-Human Interaction in Play (Amsterdam, The Netherlands) (CHI PLAY ’17). ACM, New York, NY, USA, 517–529. https://doi.org/10.1145/3116595.3116615

Digital Library

[13]

Eun Kwon, Gerard J. Kim, and Sangyoon Lee. 2009. Effects of Sizes and Shapes of Props in Tangible Augmented Reality. In Proceedings of the 2009 8th IEEE International Symposium on Mixed and Augmented Reality(ISMAR ’09). IEEE Computer Society, Washington, DC, USA, 201–202. https://doi.org/10.1109/ISMAR.2009.5336463

Digital Library

[14]

Irene López García and Eva Hornecker. 2021. Scaling Data Physicalization – How Does Size Influence Experience?. In Proceedings of the Fifteenth International Conference on Tangible, Embedded, and Embodied Interaction (Salzburg, Austria) (TEI ’21). Association for Computing Machinery, New York, NY, USA, Article 8, 14 pages. https://doi.org/10.1145/3430524.3440627

Digital Library

[15]

Alessandro Marro, Taha Bandukwala, and Walter Mak. 2016. Three-dimensional printing and medical imaging: a review of the methods and applications. Current problems in diagnostic radiology 45, 1 (2016), 2–9.

[16]

Nicolas Martelli, Carole Serrano, Hèlène van den Brink, Judith Pineau, Patrice Prognon, Isabelle Borget, and Salma El Batti. 2016. Advantages and disadvantages of 3-dimensional printing in surgery: Asystematic review. Surgery 159, 6 (2016), 1485 – 1500.

[17]

Thierry Morineau, Xavier Morandi, Nadège Le Moëllic, Sylma Diabira, Laurent Riffaud, Claire Haegelen, Pierre-Louis Hénaux, and Pierre Jannin. 2009. Decision Making During Preoperative Surgical Planning. Human Factors 51, 1 (2009), 67–77.

[18]

Thomas Muender, Anke V. Reinschluessel, Sean Drewes, Dirk Wenig, Tanja Döring, and Rainer Malaka. 2019. Does It Feel Real?: Using Tangibles with Different Fidelities to Build and Explore Scenes in Virtual Reality. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). ACM, New York, NY, USA, Article 673, 12 pages. https://doi.org/10.1145/3290605.3300903

Digital Library

[19]

A. Reinschluessel, R. Fischer, C. Schumann, V. Uslar, T. Muender, U. Katzky, H. Kißner, V. Kraft, M. Lampe, T. Lück, K. Bock-Müller, H. Nopper, S. Pelzl, D. Wenig, A. Schenk, D. Weyhe, G. Zachmann, and R. Malaka. 2019. Introducing Virtual & 3D-Printed Models for Improved Collaboration in Surgery. In Proceedings of the 18. Annual Meeting of the German Society of Computer- and Robot-Assisted Surgery, Oliver Burgert (Ed.), Vol. 18. Deutsche Gesellschaft für die Computer-und Roboterassistierte Chirurgie e.V., Stuttgart, Germany, 253–258.

[20]

Anke V. Reinschluessel, Thomas Muender, Verena Uslar, Dirk Weyhe, Andrea Schenk, and Rainer Malaka. 2019. Tangible Organs: Introducing 3D Printed Organ Models with VR to Interact with Medical 3D Models. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI EA ’19). ACM, New York, NY, USA, Article LBW1816, 6 pages. https://doi.org/10.1145/3290607.3313029

Digital Library

[21]

B. Reitinger, A. Bornik, R. Beichel, and D. Schmalstieg. 2006. Liver Surgery Planning Using Virtual Reality. IEEE Computer Graphics and Applications 26, 6 (11 2006), 36–47.

[22]

A. Schenk, S. Zidowitz, H. Bourquain, M. Hindennach, C. Hansen, H.K. Hahn, and H.-O. Peitgen. 2008. Clinical relevance of model based computer-assisted diagnosis and therapy, In Medical Imaging 2008: Computer-Aided Diagnosis. Progress in Biomedical Optics and Imaging - Proceedings of SPIE 6915, 691502–1–691502–19. https://doi.org/10.1117/12.780270

[23]

Adalberto L. Simeone, Eduardo Velloso, and Hans Gellersen. 2015. Substitutional Reality: Using the Physical Environment to Design Virtual Reality Experiences. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (Seoul, Republic of Korea) (CHI ’15). ACM, New York, NY, USA, 3307–3316. https://doi.org/10.1145/2702123.2702389

Digital Library

[24]

C Lee Ventola. 2014. Medical applications for 3D printing: current and projected uses. Pharmacy and Therapeutics 39, 10 (2014), 704.

[25]

Colin Ware and Jeff Rose. 1999. Rotating virtual objects with real handles. ACM Transactions on Computer-Human Interaction (TOCHI) 6, 2(1999), 162–180.

Digital Library

[26]

Bob G Witmer and Michael J Singer. 1998. Measuring presence in virtual environments: A presence questionnaire. Presence 7, 3 (1998), 225–240.

Digital Library

[27]

Yingda Xia, Lingxi Xie, Fengze Liu, Zhuotun Zhu, Elliot K Fishman, and Alan L Yuille. 2018. Bridging the gap between 2d and 3d organ segmentation with volumetric fusion net. In International Conference on Medical Image Computing and Computer-Assisted Intervention. Springer, Springer, Cham, na, 445–453.

Digital Library

[28]

Jiawen Yao, Jinzheng Cai, Dong Yang, Daguang Xu, and Junzhou Huang. 2019. Integrating 3D Geometry of Organ for Improving Medical Image Segmentation. In International Conference on Medical Image Computing and Computer-Assisted Intervention. Springer, Springer, Cham, na, 318–326.

Digital Library

Cited By

Perelman GSerrano MDubois E(2024)Exploiting Physical Referent Features as Input for Multidimensional Data Selection in Augmented RealityACM Transactions on Computer-Human Interaction10.1145/364861331:4(1-40)Online publication date: 19-Sep-2024
https://dl.acm.org/doi/10.1145/3648613
Krieger KEgger JKleesiek JGunzer MChen J(2024)Multisensory Extended Reality Applications Offer Benefits for Volumetric Biomedical Image Analysis in Research and MedicineJournal of Imaging Informatics in Medicine10.1007/s10278-024-01094-xOnline publication date: 11-Jun-2024
https://doi.org/10.1007/s10278-024-01094-x
Reinschluessel AMuender TFischer RKraft VUslar VWeyhe DSchenk AZachmann GDöring TMalaka R(2023)Versatile Immersive Virtual and Augmented Tangible OR – Using VR, AR and Tangibles to Support Surgical PracticeExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3583895(1-5)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544549.3583895
Show More Cited By

Recommendations

Versatile Immersive Virtual and Augmented Tangible OR – Using VR, AR and Tangibles to Support Surgical Practice
CHI EA '23: Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems

Immersive technologies such as virtual reality (VR) and augmented reality (AR), in combination with advanced image segmentation and visualization, have considerable potential to improve and support a surgeon’s work. We demonstrate a solution to help ...
Evaluating Soft Organ-Shaped Tangibles for Medical Virtual Reality
CHI EA '22: Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems

Connecting digital information with the physical is one of the essential ideas of tangible user interfaces. The design of the physical representation is important especially for specialised domains like surgery planning, because surgeons rely heavily ...
Tangible Organs: Introducing 3D Printed Organ Models with VR to Interact with Medical 3D Models
CHI EA '19: Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems

Medical images contain important information for diagnosis and preoperative planning in modern medicine. Interacting with these images still happens mostly with a mouse, abstract gestures or handles. In a focus group with five surgeons, we evaluate the ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI EA '21: Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems

May 2021

2965 pages

ISBN:9781450380959

DOI:10.1145/3411763

Editors:
Yoshifumi Kitamura
Tohoku University, Japan
,
Aaron Quigley
University of New South Wales, Australia
,
Katherine Isbister
University of California Santa Cruz, USA
,
Takeo Igarashi
The University of Tokyo, Japan

Copyright © 2021 Owner/Author.

This work is licensed under a Creative Commons Attribution-NonCommercial International 4.0 License.

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 May 2021

Check for updates

Author Tags

Qualifiers

Poster
Research
Refereed limited

Conference

CHI '21

Sponsor:

SIGCHI

CHI '21: CHI Conference on Human Factors in Computing Systems

May 8 - 13, 2021

Yokohama, Japan

Acceptance Rates

Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
641
Total Downloads

Downloads (Last 12 months)197
Downloads (Last 6 weeks)28

Reflects downloads up to 03 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Perelman GSerrano MDubois E(2024)Exploiting Physical Referent Features as Input for Multidimensional Data Selection in Augmented RealityACM Transactions on Computer-Human Interaction10.1145/364861331:4(1-40)Online publication date: 19-Sep-2024
https://dl.acm.org/doi/10.1145/3648613
Krieger KEgger JKleesiek JGunzer MChen J(2024)Multisensory Extended Reality Applications Offer Benefits for Volumetric Biomedical Image Analysis in Research and MedicineJournal of Imaging Informatics in Medicine10.1007/s10278-024-01094-xOnline publication date: 11-Jun-2024
https://doi.org/10.1007/s10278-024-01094-x
Reinschluessel AMuender TFischer RKraft VUslar VWeyhe DSchenk AZachmann GDöring TMalaka R(2023)Versatile Immersive Virtual and Augmented Tangible OR – Using VR, AR and Tangibles to Support Surgical PracticeExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3583895(1-5)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544549.3583895
Yu XQin LChen XWu LZhang B(2023)Research on Optimization of Neural Network Model Deployment for Edge Devices2023 4th International Conference on Computer Engineering and Intelligent Control (ICCEIC)10.1109/ICCEIC60201.2023.10426742(130-134)Online publication date: 20-Oct-2023
https://doi.org/10.1109/ICCEIC60201.2023.10426742
Muender TReinschluessel ASalzmann DLück TSchenk AWeyhe DDöring TMalaka R(2022)Evaluating Soft Organ-Shaped Tangibles for Medical Virtual RealityExtended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491101.3519715(1-8)Online publication date: 27-Apr-2022
https://dl.acm.org/doi/10.1145/3491101.3519715

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents