research-article

Working with Forensic Practitioners to Understand the Opportunities and Challenges for Mixed-Reality Digital Autopsy

Authors:

Vahid Pooryousef,

Maxime Cordeil,

Lonni Besançon,

Christophe Hurter,

Richard BassedAuthors Info & Claims

CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems

April 2023

Article No.: 843, Pages 1 - 15

https://doi.org/10.1145/3544548.3580768

Published: 19 April 2023 Publication History

Abstract

Forensic practitioners analyse intrinsic 3D data daily on 2D screens. We explore novel immersive visualisation techniques that enable digital autopsy through analysis of 3D imagery. We employ a user-centred design process involving four rounds of user feedback: (1) formative interviews eliciting opportunities and requirements for mixed-reality digital autopsies; (2) a larger workshop identifying our prototype’s limitations and further use-cases and interaction ideas; (3+4) two rounds of qualitative user validation of successive prototypes of novel interaction techniques for pathologist sensemaking. Overall, we find MR holds great potential to enable digital autopsy, initially to supplement physical autopsy, but ultimately to replace it. We found that experts were able to use our tool to perform basic virtual autopsy tasks, MR setup promotes exploration and sense making of cause of death, and subject to limitations of current MR technology, the proposed system is a valid option for digital autopsies, according to experts’ feedback.

– Warning: This paper contains sensitive images which are 3D visualisation of deceased people.

Supplementary Material

Supplemental Materials (3544548.3580768-supplemental-materials.zip)

Download
80.02 MB

MP4 File (3544548.3580768-video-figure.mp4)

Video Figure

Download
283.03 MB

MP4 File (3544548.3580768-video-preview.mp4)

Video Preview

Download
44.40 MB

MP4 File (3544548.3580768-talk-video.mp4)

Pre-recorded Video Presentation

Download
161.26 MB

References

[1]

Raffael Affolter, Sebastian Eggert, Till Sieberth, Michael Thali, and Lars Christian Ebert. 2019. Applying augmented reality during a forensic autopsy—Microsoft HoloLens as a DICOM viewer. Journal of Forensic Radiology and Imaging 16 (March 2019), 5–8. https://doi.org/10.1016/j.jofri.2018.11.003 OA available.

[2]

Salsabeel F. M. Alfalah, Jannat F. M. Falah, Tasneem Alfalah, Mutasem Elfalah, Nadia Muhaidat, and Orwa Falah. 2019. A comparative study between a virtual reality heart anatomy system and traditional medical teaching modalities. Virtual Reality 23, 3 (Sept. 2019), 229–234. https://doi.org/10.1007/s10055-018-0359-y OA available.

Digital Library

[3]

M. Baker. 2016. 1,500 scientists lift the lid on reproducibility. Nature 533, 7604 (05 2016), 452–454. https://doi.org/10.1038/533452a

[4]

Andrea Batch, Andrew Cunningham, Maxime Cordeil, Niklas Elmqvist, Tim Dwyer, Bruce H. Thomas, and Kim Marriott. 2020. There Is No Spoon: Evaluating Performance, Space Use, and Presence with Expert Domain Users in Immersive Analytics. IEEE Transactions on Visualization and Computer Graphics 26, 1(2020), 536–546. https://doi.org/10.1109/TVCG.2019.2934803 OA available.

[5]

Andrea Batch, Biswaksen Patnaik, Moses Akazue, and Niklas Elmqvist. 2020. Scents and Sensibility: Evaluating Information Olfactation. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. ACM, Honolulu HI USA, 1–14. https://doi.org/10.1145/3313831.3376733 OA available.

Digital Library

[6]

Lonni Besançon, Mehdi Ammi, and Tobias Isenberg. 2017. Pressure-Based Gain Factor Control for Mobile 3D Interaction Using Locally-Coupled Devices. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI ’17). ACM, New York, NY, USA, 1831–1842. https://doi.org/10.1145/3025453.3025890 OA available.

Digital Library

[7]

Lonni Besançon, Wolfgang Aigner, Magdalena Boucher, Tim Dwyer, and Tobias Isenberg. 2021. 3D Mobile Data Visualization. In Mobile Data Visualization. Chapman and Hall/CRC, New York, 111–150. https://doi.org/10.1201/9781003090823-4 OA available.

[8]

Lonni Besançon, Paul Issartel, Mehdi Ammi, and Tobias Isenberg. 2017. Hybrid Tactile/Tangible Interaction for 3D Data Exploration. IEEE Trans. Vis. Comp. Graph. 23, 1 (Jan. 2017), 881–890. https://doi.org/10.1109/TVCG.2016.2599217 OA available.

Digital Library

[9]

Lonni Besançon, Paul Issartel, Mehdi Ammi, and Tobias Isenberg. 2017. Mouse, Tactile, and Tangible Input for 3D Manipulation. In Proc. CHI. ACM, New York, 4727–4740. https://doi.org/10.1145/3025453.3025863 OA available.

Digital Library

[10]

Lonni Besançon, Anders Ynnerman, Daniel F Keefe, Lingyun Yu, and Tobias Isenberg. 2021. The State of the Art of Spatial Interfaces for 3D Visualization. Computer Graphics Forum 40, 1 (Feb. 2021), 293–326. https://doi.org/10.1111/cgf.14189 OA available.

[11]

Lonni Besançon, Amir Semmo, David Biau, Bruno Frachet, Virginie Pineau, El Hadi Sariali, Marc Soubeyrand, Rabah Taouachi, Tobias Isenberg, and Pierre Dragicevic. 2020. Reducing Affective Responses to Surgical Images and Videos Through Stylization. Computer Graphics Forum 39, 1 (2020), 462–483. https://doi.org/10.1111/cgf.13886 OA available.

[12]

Renaud Blanch, Yves Guiard, and Michel Beaudouin-Lafon. 2004. Semantic Pointing: Improving Target Acquisition with Control-Display Ratio Adaptation. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Vienna, Austria) (CHI ’04). ACM, New York, NY, USA, 519–526. https://doi.org/10.1145/985692.985758 OA available.

Digital Library

[13]

A. Bornik, R. Beichel, E. Kruijff, B. Reitinger, and D. Schmalstieg. 2006. A Hybrid User Interface for Manipulation of Volumetric Medical Data. In Proc. 3DUI. IEEE Computer Society, Los Alamitos, 29–36. https://doi.org/10.1109/VR.2006.8 OA available.

[14]

Christian Boucheny, Georges-Pierre Bonneau, Jacques Droulez, Guillaume Thibault, and Stephane Ploix. 2009. A perceptive evaluation of volume rendering techniques. ACM Transactions on Applied Perception 5, 4 (Jan. 2009), 1–24. https://doi.org/10.1145/1462048.1462054 OA available.

Digital Library

[15]

Jonas Bulliard, Sebastian Eggert, Garyfalia Ampanozi, Raffael Affolter, Dominic Gascho, Till Sieberth, Michael J. Thali, and Lars C. Ebert. 2020. Preliminary testing of an augmented reality headset as a DICOM viewer during autopsy. Forensic Imaging 23(2020), 200417. https://doi.org/10.1016/j.fri.2020.200417 OA available.

[16]

Wolfgang Büschel, Jian Chen, Raimund Dachselt, Steven Drucker, Tim Dwyer, Carsten Görg, Tobias Isenberg, Andreas Kerren, Chris North, and Wolfgang Stuerzlinger. 2018. Interaction for Immersive Analytics. In Immersive Analytics, Kim Marriott, Falk Schreiber, Tim Dwyer, Karsten Klein, Nathalie Henry Riche, Takayuki Itoh, Wolfgang Stuerzlinger, and Bruce H. Thomas (Eds.). Springer, Berlin/Heidelberg, Chapter 4, 95–138. https://doi.org/10.1007/978-3-030-01388-2_4 OA available.

[17]

T. Butkiewicz and C. Ware. 2011. Multi-touch 3D exploratory analysis of ocean flow models. In Proc. OCEANS. IEEE, Los Alamitos, 746–755. https://doi.org/10.23919/OCEANS.2011.6107079 OA available.

[18]

Kelly Caine. 2016. Local Standards for Sample Size at CHI. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI ’16). ACM, New York, NY, USA, 981–992. https://doi.org/10.1145/2858036.2858498 OA available.

Digital Library

[19]

Ruochen Cao, James Walsh, Andrew Cunningham, Mark Kohler, Ross T Smith, and Bruce H Thomas. 2020. Examining Computer–Supported 3D Event Recreation for Enhancing Cognitive Load, Memorability, and Engagement. Multimodal Technologies and Interaction 4, 3 (2020), 37. https://doi.org/10.3390/mti4030037 OA available.

[20]

Ruochen Cao, Lena Zou-Williams, Andrew Cunningham, James Walsh, Mark Kohler, and Bruce H Thornas. 2021. Comparing the Neuro-Physiological Effects of Cinematic Virtual Reality with 2D Monitors. In 2021 IEEE Virtual Reality and 3D User Interfaces (VR). IEEE, IEEE, Lisboa, Portugal, 729–738. https://doi.org/10.1109/VR50410.2021.00100 OA available.

[21]

Andy Cockburn, Pierre Dragicevic, Lonni Besançon, and Carl Gutwin. 2020. Threats of a Replication Crisis in Empirical Computer Science. Commun. ACM 63, 8 (July 2020), 70–79. https://doi.org/10.1145/3360311 OA available.

Digital Library

[22]

T. Collins, D. Pizarro, S. Gasparini, N. Bourdel, P. Chauvet, M. Canis, L. Calvet, and A. Bartoli. 2021. Augmented Reality Guided Laparoscopic Surgery of the Uterus. IEEE Transactions on Medical Imaging 40, 1 (Jan. 2021), 371–380. https://doi.org/10.1109/TMI.2020.3027442 OA available.

[23]

Maxime Cordeil, Benjamin Bach, Andrew Cunningham, Bastian Montoya, Ross T. Smith, Bruce H. Thomas, and Tim Dwyer. 2020. Embodied Axes: Tangible, Actuated Interaction for 3D Augmented Reality Data Spaces. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). ACM, New York, NY, USA, 1–12. https://doi.org/10.1145/3313831.3376613 OA available.

Digital Library

[24]

C. Correa and Kwan-Liu Ma. 2009. The Occlusion Spectrum for Volume Classification and Visualization. IEEE Transactions on Visualization and Computer Graphics 15, 6 (Nov. 2009), 1465–1472. https://doi.org/10.1109/TVCG.2009.189

Digital Library

[25]

Shaozhang Dai, Jim Smiley, Tim Dwyer, Barrett Ens, and Lonni Besancon. 2023. RoboHapalytics: A Robot Assisted Haptic Controller for Immersive Analytics. IEEE Transactions on Visualization and Computer Graphics 29, 1(2023), 451–461. https://doi.org/10.1109/TVCG.2022.3209433 OA available.

[26]

Paul Dourish. 2001. Where the Action is: The Foundations of Embodied Interaction. MIT Press, Cambridge, MA, USA.

[27]

Robert A. Drebin, Loren Carpenter, and Pat Hanrahan. 1988. Volume rendering. ACM SIGGRAPH Computer Graphics 22, 4 (Aug. 1988), 65–74. https://doi.org/10.1145/378456.378484 OA available.

Digital Library

[28]

Lars C. Ebert, Tuan T. Nguyen, Robert Breitbeck, Marcel Braun, Michael J. Thali, and Steffen Ross. 2014. The forensic holodeck: an immersive display for forensic crime scene reconstructions. Forensic Science, Medicine, and Pathology 10, 4 (Dec. 2014), 623–626. https://doi.org/10.1007/s12024-014-9605-0 OA available.

[29]

N. Elmqvist and P. Tsigas. 2008. A Taxonomy of 3D Occlusion Management for Visualization. IEEE Transactions on Visualization and Computer Graphics 14, 5 (Sept 2008), 1095–1109. https://doi.org/10.1109/TVCG.2008.59

Digital Library

[30]

Rickard Englund and Timo Ropinski. 2016. Evaluating the perception of semi-transparent structures in direct volume rendering techniques. In SIGGRAPH ASIA 2016 Symposium on Visualization. ACM, Macau, 1–8. https://doi.org/10.1145/3002151.3002164 OA available.

Digital Library

[31]

Barrett Ens, Benjamin Bach, Maxime Cordeil, Ulrich Engelke, Marcos Serrano, Wesley Willett, Arnaud Prouzeau, Christoph Anthes, Wolfgang Büschel, Cody Dunne, Tim Dwyer, Jens Grubert, Jason H. Haga, Nurit Kirshenbaum, Dylan Kobayashi, Tica Lin, Monsurat Olaosebikan, Fabian Pointecker, David Saffo, Nazmus Saquib, Dieter Schmalstieg, Danielle Albers Szafir, Matt Whitlock, and Yalong Yang. 2021. Grand Challenges in Immersive Analytics. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI ’21). ACM, New York, NY, USA, Article 459, 17 pages. https://doi.org/10.1145/3411764.3446866 OA available.

Digital Library

[32]

Barrett Ens and Pourang Irani. 2017. Spatial Analytic Interfaces: Spatial User Interfaces for In Situ Visual Analytics. IEEE Computer Graphics and Applications 37, 2 (2017), 66–79. https://doi.org/10.1109/MCG.2016.38 OA available.

Digital Library

[33]

J. Ferrer-Torregrosa, J. Torralba, M. A. Jimenez, S. García, and J. M. Barcia. 2015. ARBOOK: Development and Assessment of a Tool Based on Augmented Reality for Anatomy. Journal of Science Education and Technology 24, 1 (Feb. 2015), 119–124. https://doi.org/10.1007/s10956-014-9526-4 OA available.

[34]

Raphael Fuchs, Volkmar Welker, and Joachim Hornegger. 2010. Non-convex polyhedral volume of interest selection. Computerized Medical Imaging and Graphics 34, 2 (2010), 105–113. https://doi.org/10.1016/j.compmedimag.2009.07.002 OA available.

[35]

Rafael Huff, Carlos A. Dietrich, Luciana P. Nedel, Carla M. D. S. Freitas, João L. D. Comba, and Silvia D. Olabarriaga. 2006. Erasing, digging and clipping in volumetric datasets with one or two hands. In Proceedings of the 2006 ACM international conference on Virtual reality continuum and its applications - VRCIA ’06. ACM Press, Hong Kong, China, 271. https://doi.org/10.1145/1128923.1128967 OA available.

Digital Library

[36]

Christophe Hurter, Russ Taylor, Sheelagh Carpendale, and Alexandru Telea. 2014. Color Tunneling: Interactive Exploration and Selection in Volumetric Datasets. In 2014 IEEE Pacific Visualization Symposium. IEEE, Yokohama, 225–232. https://doi.org/10.1109/PacificVis.2014.61 OA available.

Digital Library

[37]

Christophe Hurter, Alexandru Telea, and Ozan Ersoy. 2011. MoleView: An Attribute and Structure-Based Semantic Lens for Large Element-Based Plots. IEEE Transactions on Visualization and Computer Graphics 17, 12 (dec 2011), 2600–2609. https://doi.org/10.1109/TVCG.2011.223 OA available.

Digital Library

[38]

Gunnar E. Höst, Konrad J. Schönborn, Henry Fröcklin, and Lena A. E. Tibell. 2018. What Biological Visualizations Do Science Center Visitors Prefer in an Interactive Touch Table?Education Sciences 8, 4 (Oct. 2018), 166. https://doi.org/10.3390/educsci8040166 OA available.

[39]

Paul Issartel, Lonni Besançon, Tobias Isenberg, and Mehdi Ammi. 2016. A Tangible Volume for Portable 3D Interaction. In 2016 IEEE International Symposium on Mixed and Augmented Reality. IEEE, Merida, Mexico, 5. https://doi.org/10.1109/ISMAR-Adjunct.2016.0079 OA available.

[40]

Paul Issartel, Florimond Guéniat, and Mehdi Ammi. 2014. A Portable Interface for Tangible Exploration of Volumetric Data. In Proc. VRST (Edinburgh, Scotland). ACM, New York, 209–210. https://doi.org/10.1145/2671015.2671130 OA available.

Digital Library

[41]

Gargi Jani and Abraham Johnson. 2022. Virtual reality and its transformation in forensic education and research practices. Journal of Visual Communication in Medicine 45, 1 (2022), 18–25. https://doi.org/10.1080/17453054.2021.1971516

[42]

Thomas Kilgus, Eric Heim, Sven Haase, Sabine Prüfer, Michael Müller, Alexander Seitel, Markus Fangerau, Tamara Wiebe, Justin Iszatt, Heinz-Peter Schlemmer, Joachim Hornegger, Kathrin Yen, and Lena Maier-Hein. 2015. Mobile markerless augmented reality and its application in forensic medicine. International Journal of Computer Assisted Radiology and Surgery 10, 5 (May 2015), 573–586. https://doi.org/10.1007/s11548-014-1106-9 OA available.

[43]

Stephanie Koller, Lars C. Ebert, Rosa Maria Martinez, and Till Sieberth. 2019. Using virtual reality for forensic examinations of injuries. Forensic Science International 295 (Feb. 2019), 30–35. https://doi.org/10.1016/j.forsciint.2018.11.006

[44]

J. Kruger, J. Schneider, and R. Westermann. 2006. ClearView: An Interactive Context Preserving Hotspot Visualization Technique. IEEE Transactions on Visualization and Computer Graphics 12, 5 (Sept 2006), 941–948. https://doi.org/10.1109/TVCG.2006.124 OA available.

Digital Library

[45]

Benjamin Lee, Xiaoyun Hu, Maxime Cordeil, Arnaud Prouzeau, Bernhard Jenny, and Tim Dwyer. 2020. Shared surfaces and spaces: Collaborative data visualisation in a co-located immersive environment. IEEE Transactions on Visualization and Computer Graphics 27, 2(2020), 1171–1181. https://doi.org/10.1109/TVCG.2020.3030450 OA available.

[46]

Jiazhou Liu, Arnaud Prouzeau, Barrett Ens, and Tim Dwyer. 2020. Design and Evaluation of Interactive Small Multiples Data Visualisation in Immersive Spaces. In IEEE Conference on Virtual Reality and 3D User Interfaces (VR)(VR ’20). IEEE, Atlanta, Georgia, USA, 588–597. https://doi.org/10.1109/VR46266.2020.00-23 OA available.

[47]

Jock D. Mackinlay, George G. Robertson, and Stuart K. Card. 1991. The Perspective Wall: Detail and Context Smoothly Integrated. In Proc. CHI (New Orleans, Louisiana, USA) (CHI ’91). ACM, New York, NY, USA, 173–176. https://doi.org/10.1145/108844.108870 OA available.

Digital Library

[48]

Kim Marriott, Falk Schreiber, Tim Dwyer, Karsten Klein, Nathalie Henry Riche, Takayuki Itoh, Wolfgang Stuerzlinger, and Bruce H Thomas. 2018. Immersive Analytics. Vol. 11190. Springer, Berlin, Heidelber, Germany. https://doi.org/10.1007/978-3-030-01388-2

[49]

Paul Marshall, Rowanne Fleck, Amanda Harris, Jochen Rick, Eva Hornecker, Yvonne Rogers, Nicola Yuill, and Nick Sheep Dalton. 2009. Fighting for control: Children’s embodied interactions when using physical and digital representations. In Proc. CHI. ACM, New York, 2149–2152. https://doi.org/10.1145/1518701.1519027 OA available.

Digital Library

[50]

J. Hunter Matthews and John S. Shields. 2021. The Clinical Application of Augmented Reality in Orthopaedics: Where Do We Stand?Current Reviews in Musculoskeletal Medicine 14, 5 (Oct. 2021), 316–319. https://doi.org/10.1007/s12178-021-09713-8

[51]

Nina McCurdy, Julie Lein, Katharine Coles, and Miriah Meyer. 2016. Poemage: Visualizing the Sonic Topology of a Poem. IEEE Transactions on Visualization and Computer Graphics 22, 1(2016), 439–448. https://doi.org/10.1109/TVCG.2015.2467811 OA available.

Digital Library

[52]

Michael J. McGuffin, Liviu Tancau, and Ravin Balakrishnan. 2003. Using Deformations for Browsing Volumetric Data. In Proceedings of the 14th IEEE Visualization 2003 (VIS’03)(VIS ’03). IEEE Computer Society, Washington, DC, USA, 53–. https://doi.org/10.1109/VISUAL.2003.1250400 OA available.

Digital Library

[53]

Rhys Newbury, Kadek Ananta Satriadi, Jesse Bolton, Jiazhou Liu, Maxime Cordeil, Arnaud Prouzeau, and Bernhard Jenny. 2021. Embodied gesture interaction for immersive maps. Cartography and Geographic Information Science 48, 5 (2021), 417–431. https://doi.org/10.1080/15230406.2021.1929492 OA available.

[54]

Izabel C. Olson, Zeina Atrash Leong, Uri Wilensky, and Mike S. Horn. 2011. “It’s just a toolbar!” Using tangibles to help children manage conflict around a multi-touch tabletop. In Proc. TEI. ACM, New York, 29–36. https://doi.org/10.1145/1935701.1935709 OA available.

Digital Library

[55]

Brian J. Park, Stephen J. Hunt, Charles Martin, Gregory J. Nadolski, Bradford J. Wood, and Terence P. Gade. 2020. Augmented and Mixed Reality: Technologies for Enhancing the Future of IR. Journal of Vascular and Interventional Radiology 31, 7 (July 2020), 1074–1082. https://doi.org/10.1016/j.jvir.2019.09.020 OA available.

[56]

Ronald Poelman, Oytun Akman, Stephan Lukosch, and Pieter Jonker. 2012. As if being there: mediated reality for crime scene investigation. In Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work - CSCW ’12. ACM Press, Seattle, Washington, USA, 1267. https://doi.org/10.1145/2145204.2145394

Digital Library

[57]

Vahid Pooryousef, Ross Brown, and Selen Turkay. 2020. Shape Recognition and Selection in Medical Volume Visualisation with Haptic Gloves. In Proceedings of the 31st Australian Conference on Human-Computer-Interaction (Fremantle, WA, Australia) (OZCHI’19). ACM, New York, NY, USA, 433–436. https://doi.org/10.1145/3369457.3369508 OA available.

Digital Library

[58]

Carolin Reichherzer, Andrew Cunningham, Tracey Coleman, Ruochen Cao, Kurt McManus, Dion Sheppard, Mark Kohler, Mark Billinghurst, and Bruce H Thomas. 2021. Bringing the Jury to the Scene of the Crime: Memory and Decision-Making in a Simulated Crime Scene. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI ’21). ACM, New York, NY, USA, Article 709, 12 pages. https://doi.org/10.1145/3411764.3445464

Digital Library

[59]

Jen Rogers, Austin H Patton, Luke Harmon, Alexander Lex, and Miriah Meyer. 2020. Insights from experiments with rigor in an evobio design study. IEEE Transactions on Visualization and Computer Graphics 27, 2(2020), 1106–1116. https://doi.org/10.1109/tvcg.2020.3030405 OA available.

[60]

Bektur Ryskeldiev, Joelle Zimmermann, Mark Billinghurst, Kai Kunze, Jie Li, and Julie Williamson. 2022. Design and User Research in AR/VR/MR. In 2022 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct). IEEE, Singapore, Singapore, 222–222. https://doi.org/10.1109/ISMAR-Adjunct57072.2022.00049

[61]

Kadek Ananta Satriadi, Barrett Ens, Maxime Cordeil, Tobias Czauderna, and Bernhard Jenny. 2020. Maps Around Me: 3D Multiview Layouts in Immersive Spaces. Proc. ACM Hum.-Comput. Interact. 4, ISS, Article 201 (Nov. 2020), 20 pages. https://doi.org/10.1145/3427329 OA available.

Digital Library

[62]

Kadek Ananta Satriadi, Barrett Ens, Maxime Cordeil, Bernhard Jenny, Tobias Czauderna, and Wesley Willett. 2019. Augmented Reality Map Navigation with Freehand Gestures. In 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). IEEE, Osaka, Japan, 593–603. https://doi.org/10.1109/VR.2019.8798340 OA available.

[63]

I Scott MacKenzie and Stan Riddersma. 1994. Effects of output display and control—display gain on human performance in interactive systems. Behaviour & Information Technology 13, 5 (1994), 328–337. https://doi.org/10.1080/01449299408914613

[64]

Mickael Sereno, Stéphane Gosset, Lonni Besançon, and Tobias Isenberg. 2022. Hybrid Touch/Tangible Spatial Selection in Augmented Reality. Computer Graphics Forum 41, 3 (June 2022), 403–415. https://doi.org/10.1111/cgf.14550 OA available.

[65]

Mickael Sereno, Xiyao Wang, Lonni Besançon, Michael J. McGuffin, and Tobias Isenberg. 2022. Collaborative Work in Augmented Reality: A Survey. IEEE Transactions on Visualization and Computer Graphics 28, 6 (June 2022), 2530–2549. https://doi.org/10.1109/TVCG.2020.3032761 OA available.

Digital Library

[66]

Till Sieberth, Akos Dobay, Raffael Affolter, and Lars C. Ebert. 2019. Applying virtual reality in forensics – a virtual scene walkthrough. Forensic Science, Medicine and Pathology 15, 1 (March 2019), 41–47. https://doi.org/10.1007/s12024-018-0058-8

[67]

Jim Smiley, Benjamin Lee, Siddhant Tandon, Maxime Cordeil, Lonni Besançon, Jarrod Knibbe, Bernhard Jenny, and Tim Dwyer. 2021. The MADE-Axis: A Modular Actuated Device to Embody the Axis of a Data Dimension. Proc. ACM Hum.-Comput. Interact. 5, ISS, Article 501 (nov 2021), 23 pages. https://doi.org/10.1145/3488546 OA available.

Digital Library

[68]

Maurício Sousa, Daniel Mendes, Soraia Paulo, Nuno Matela, Joaquim Jorge, and Daniel Simões Lopes. 2017. VRRRRoom: Virtual Reality for Radiologists in the Reading Room. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, Denver Colorado USA, 4057–4062. https://doi.org/10.1145/3025453.3025566 OA available.

Digital Library

[69]

Erik Sundén, Alexander Bock, Daniel Jönsson, Anders Ynnerman, and Timo Ropinski. 2014. Interaction techniques as a communication channel when presenting 3D visualizations. In Proc. 3DVis. IEEE Computer Society, Los Alamitos, 61–65. https://doi.org/10.1109/3DVis.2014.7160102 OA available.

[70]

A Takatsu, N Suzuki, A Hattori, A Shigeta, and S Abe. 2007. High-dimensional medical imaging and virtual reality techniques. Rechtsmedizin 17, 1 (2007), 13–18.

[71]

Rensu P Theart, Ben Loos, and Thomas R Niesler. 2017. Virtual reality assisted microscopy data visualization and colocalization analysis. BMC Bioinformatics 18, 2 (2017), 64:1–64:16. https://doi.org/10.1186/s12859-016-1446-2 OA available.

[72]

Michael Traore, Christophe Hurter, and Alexandru Telea. 2019. Interactive obstruction-free lensing for volumetric data visualization. IEEE Transactions on Visualization and Computer Graphics 25, 1 (Jan. 2019), 1029–1039. https://doi.org/10.1109/TVCG.2018.2864690 OA available.

Digital Library

[73]

Jinming Wang, Zhengdong Li, Wenhu Hu, Yu Shao, Liyang Wang, Rongqi Wu, Kaijun Ma, Donghua Zou, and Yijiu Chen. 2019. Virtual reality and integrated crime scene scanning for immersive and heterogeneous crime scene reconstruction. Forensic Science International 303 (Oct. 2019), 109943. https://doi.org/10.1016/j.forsciint.2019.109943 OA available.

[74]

Xiyao Wang, Lonni Besançon, David Rousseau, Mickael Sereno, Mehdi Ammi, and Tobias Isenberg. 2020. Towards an Understanding of Augmented Reality Extensions for Existing 3D Data Analysis Tools. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). ACM, New York, NY, USA, 1–13. https://doi.org/10.1145/3313831.3376657 OA available.

Digital Library

[75]

Xiyao Wang, Lonni Besançon, Florimond Guéniat, Mickael Sereno, Mehdi Ammi, and Tobias Isenberg. 2019. A Vision of Bringing Immersive Visualization to Scientific Workflows. In CHI 2019 - The ACM CHI Conference on Human Factors in Computing Systems - Workshop on Interaction Design & Prototyping for Immersive Analytics. Glasgow, United Kingdom. https://hal.science/hal-02053969 OA available.

[76]

Michelle Q. Wang Baldonado, Allison Woodruff, and Allan Kuchinsky. 2000. Guidelines for Using Multiple Views in Information Visualization. In Proceedings of the Working Conference on Advanced Visual Interfaces (Palermo, Italy) (AVI ’00). ACM, New York, NY, USA, 110–119. https://doi.org/10.1145/345513.345271 OA available.

Digital Library

[77]

Chatura Wijetunga, Chris O’Donnell, Tiffany Y So, Dinesh Varma, Peter Cameron, Michael Burke, Richard Bassed, Karen Smith, and Ben Beck. 2020. Injury Detection in Traumatic Death: Postmortem Computed Tomography vs. Open Autopsy. Forensic Imaging 20(2020), 100349. https://doi.org/10.1016/j.jofri.2019.100349 OA available.

[78]

Lesley Xie, Alissa N. Antle, and Nima Motamedi. 2008. Are tangibles more fun? Comparing children’s enjoyment and engagement using physical, graphical and tangible user interfaces. In Proc. TEI. ACM, New York, 191–198. https://doi.org/10.1145/1347390.1347433 OA available.

Digital Library

[79]

Anders Ynnerman, Jonas Löwgren, and Lena Tibell. 2018. Exploranation: A New Science Communication Paradigm. IEEE Computer Graphics and Applications 38, 3 (May/June 2018), 13–20. https://doi.org/10.1109/MCG.2018.032421649 OA available.

[80]

Anders Ynnerman, Thomas Rydell, Daniel Antoine, David Hughes, Anders Persson, and Patric Ljung. 2016. Interactive Visualization of 3D Scanned Mummies at Public Venues. Commun. ACM 59, 12 (Dec. 2016), 72–81. https://doi.org/10.1145/2950040 OA available.

Digital Library

Cited By

Ghaemi ZEns BEngelke UJenny B(2023)Drawing Connections: Designing Situated Links for Immersive MapsProceedings of the ACM on Human-Computer Interaction10.1145/36042527:MHCI(1-26)Online publication date: 13-Sep-2023
https://dl.acm.org/doi/10.1145/3604252
Li HYang YJi YPeng WMartin-Gomez AYan WQian LDing HZhao ZWang G(2023)3D Slicer-AR-Bridge: 3D Slicer AR Connection for Medical Image Visualization and Interaction with AR-HMD2023 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)10.1109/ISMAR-Adjunct60411.2023.00086(399-404)Online publication date: 16-Oct-2023
https://doi.org/10.1109/ISMAR-Adjunct60411.2023.00086

Index Terms

Working with Forensic Practitioners to Understand the Opportunities and Challenges for Mixed-Reality Digital Autopsy
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Empirical studies in HCI
    2. Interaction techniques
  2. Visualization
    1. Visualization application domains

Recommendations

Boundary Conditions for the Digital Forensic Use of Electronic Evidence and The Need for Forensic Counter-Analysis
SADFE '11: Proceedings of the 2011 Sixth IEEE International Workshop on Systematic Approaches to Digital Forensic Engineering

Network and Digital Forensics provide information about electronic activity in new, sometimes unprecedented forms. These new forms offer new, powerful tactical tools for investigations of electronic malfeasance when incorporated under traditional legal ...
Read More
Mixed Reality MIDI Keyboard Demonstration
AM '17: Proceedings of the 12th International Audio Mostly Conference on Augmented and Participatory Sound and Music Experiences

The Mixed Reality MIDI Keyboard is a prototype designed to augment virtual reality experiences through the inclusion of a physical interface which aligns the user's senses with the virtual environment. It also serves as a platform on which the uses of ...
Read More
Convergence of digital and traditional forensic disciplines: a first exemplary study for digital dactyloscopy
MM&Sec '11: Proceedings of the thirteenth ACM multimedia workshop on Multimedia and security

Traditional forensic disciplines get increasingly digitized. This allows for new investigations and often provides more details for each trace. Due to this digitalization, digital and digitized forensic disciplines have very similar courses of action ...
Read More

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems

April 2023

14911 pages

ISBN:9781450394215

DOI:10.1145/3544548

Editors:
Albrecht Schmidt
LMU Munich, Germany60028717
,
Kaisa Väänänen
Tampere University, Finland60011170
,
Tesh Goyal
Google Research, USA60006191
,
Per Ola Kristensson
University of Cambridge, UK60031101
,
Anicia Peters
University of Namibia, Namibia60072704
,
Stefanie Mueller
Massachusetts Institute of Technology, USA60022195
,
Julie R. Williamson
University of Glasgow, UK60001490
,
Max L. Wilson
University of Nottingham, UK60015138

Copyright © 2023 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 19 April 2023

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

Knut and Alice Wallenberg Foundation
Victorian Institute of Forensic Medicine

Conference

CHI '23

Sponsor:

SIGCHI

CHI '23: CHI Conference on Human Factors in Computing Systems

April 23 - 28, 2023

Hamburg, Germany

Acceptance Rates

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI PLAY '24

Sponsor:
sigchi

The Annual Symposium on Computer-Human Interaction in Play

October 14 - 17, 2024

Tampere , Finland

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
389
Total Downloads

Downloads (Last 12 months)287
Downloads (Last 6 weeks)35

Other Metrics

View Author Metrics

Citations

Cited By

Ghaemi ZEns BEngelke UJenny B(2023)Drawing Connections: Designing Situated Links for Immersive MapsProceedings of the ACM on Human-Computer Interaction10.1145/36042527:MHCI(1-26)Online publication date: 13-Sep-2023
https://dl.acm.org/doi/10.1145/3604252
Li HYang YJi YPeng WMartin-Gomez AYan WQian LDing HZhao ZWang G(2023)3D Slicer-AR-Bridge: 3D Slicer AR Connection for Medical Image Visualization and Interaction with AR-HMD2023 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)10.1109/ISMAR-Adjunct60411.2023.00086(399-404)Online publication date: 16-Oct-2023
https://doi.org/10.1109/ISMAR-Adjunct60411.2023.00086

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Full Text

View this article in Full Text.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View full text|Download PDF

View Table of Contents