research-article

Open access

Where Should We Put It? Layout and Placement Strategies of Documents in Augmented Reality for Collaborative Sensemaking

Authors:

Hjalmar Widengren,

Raimund DachseltAuthors Info & Claims

CHI '22: Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems

Article No.: 627, Pages 1 - 16

https://doi.org/10.1145/3491102.3501946

Published: 29 April 2022 Publication History

All formats PDF

Abstract

Future offices are likely reshaped by Augmented Reality (AR) extending the display space while maintaining awareness of surroundings, and thus promise to support collaborative tasks such as brainstorming or sensemaking. However, it is unclear how physical surroundings and co-located collaboration influence the spatial organization of virtual content for sensemaking. Therefore, we conducted a study (N=28) to investigate the effect of office environments and work styles during a document classification task using AR with regard to content placement, layout strategies, and sensemaking workflows. Results show that participants require furniture, especially tables and whiteboards, to assist sensemaking and collaboration regardless of room settings, while generous free spaces (e.g., walls) are likely used when available. Moreover, collaborating participants tend to use furniture despite personal layout preferences. We identified different placement and layout strategies, as well as the transitions in-between. Finally, we propose design implications for future immersive sensemaking applications and beyond.

Supplementary Material

Supplemental Materials (3491102.3501946-supplemental-materials.zip)

Download
94.90 MB

MP4 File (3491102.3501946-video-figure.mp4)

Video Figure

Download
207.65 MB

MP4 File (3491102.3501946-video-preview.mp4)

Video Preview

Download
14.39 MB

MP4 File (3491102.3501946-talk-video.mp4)

Talk Video

Download
133.84 MB

References

[1]

Anand Agarawala and Ravin Balakrishnan. 2006. Keepin’ It Real: Pushing the Desktop Metaphor with Physics, Piles and the Pen. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Montréal, Québec, Canada) (CHI ’06). Association for Computing Machinery, New York, NY, USA, 1283–1292. https://doi.org/10.1145/1124772.1124965

Digital Library

[2]

Deborah Ancona. 2012. Framing and Acting in the Unknown. SAGE Publications, Chapter 1, 3–19.

[3]

Christopher Andrews, Alex Endert, and Chris North. 2010. Space to think: large high-resolution displays for sensemaking. In Proceedings of the 28th international conference on Human factors in computing systems (Atlanta, Georgia, USA) (CHI ’10). ACM, New York, NY, USA, 55–64. https://doi.org/10.1145/1753326.1753336

Digital Library

[4]

C. Andrews and C. North. 2013. The Impact of Physical Navigation on Spatial Organization for Sensemaking. IEEE Transactions on Visualization and Computer Graphics 19, 12 (Dec 2013), 2207–2216. https://doi.org/10.1109/TVCG.2013.205

Digital Library

[5]

Verena Biener, Daniel Schneider, Travis Gesslein, Alexander Otte, Bastian Kuth, Per Ola Kristensson, Eyal Ofek, Michel Pahud, and Jens Grubert. 2020. Breaking the Screen: Interaction Across Touchscreen Boundaries in Virtual Reality for Mobile Knowledge Workers. IEEE Transactions on Visualization & Computer Graphics 26, 12 (dec 2020), 3490–3502. https://doi.org/10.1109/TVCG.2020.3023567

[6]

Mark Billinghurst, Maxime Cordeil, Anastasia Bezerianos, and Todd Margolis. 2018. Collaborative Immersive Analytics. Springer International Publishing, Cham, 221–257. https://doi.org/10.1007/978-3-030-01388-2_8

[7]

Ann Blandford. 2013. Semi-structured qualitative studies. Interaction Design Foundation, Aarhus, Denmark. http://www.interactiondesign.org/encyclopedia/semi-structured_qualitative_studies.html

[8]

Lauren Bradel, Alex Endert, Kristen Koch, Christopher Andrews, and Chris North. 2013. Large high resolution displays for co-located collaborative sensemaking: Display usage and territoriality. International Journal of Human-Computer Studies 71, 11 (2013), 1078 – 1088. https://doi.org/10.1016/j.ijhcs.2013.07.004

Digital Library

[9]

Virginia Braun and Victoria Clarke. 2006. Using thematic analysis in psychology. Qualitative Research in Psychology 3, 2 (2006), 77–101. https://doi.org/10.1191/1478088706qp063oa arXiv:https://www.tandfonline.com/doi/pdf/10.1191/1478088706qp063oa

[10]

Nathalie Bressa, Henrik Korsgaard, Aurélien Tabard, Steven Houben, and Jo Vermeulen. 2021. What’s the Situation with Situated Visualization? A Survey and Perspectives on Situatedness. IEEE Transactions on Visualization & Computer Graphics01 (sep 2021), 1–1. https://doi.org/10.1109/TVCG.2021.3114835

Digital Library

[11]

Wolfgang Büschel, Anke Lehmann, and Raimund Dachselt. 2021. MIRIA: A Mixed Reality Toolkit for the In-Situ Visualization and Analysis of Spatio-Temporal Interaction Data. Association for Computing Machinery, New York, NY, USA. https://doi.org/10.1145/3411764.3445651

Digital Library

[12]

Han Joo Chae, Youli Chang, Minji Kim, Gwanmo Park, and Jinwook Seo. 2020. ARphy: Managing Photo Collections Using Physical Objects in AR. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI EA ’20). Association for Computing Machinery, New York, NY, USA, 1–7. https://doi.org/10.1145/3334480.3382885

Digital Library

[13]

Chia-Ming Chang, Chia-Hsien Lee, and Takeo Igarashi. 2021. Spatial Labeling: Leveraging Spatial Layout for Improving Label Quality in Non-Expert Image Annotation. Association for Computing Machinery, New York, NY, USA. https://doi.org/10.1145/3411764.3445165

Digital Library

[14]

Yifei Cheng, Yukang Yan, Xin Yi, Yuanchun Shi, and David Lindlbauer. 2021. SemanticAdapt: Optimization-Based Adaptation of Mixed Reality Layouts Leveraging Virtual-Physical Semantic Connections. In The 34th Annual ACM Symposium on User Interface Software and Technology (Virtual Event, USA) (UIST ’21). Association for Computing Machinery, New York, NY, USA, 282–297. https://doi.org/10.1145/3472749.3474750

Digital Library

[15]

Kody R. Dillman, Terrance Tin Hoi Mok, Anthony Tang, Lora Oehlberg, and Alex Mitchell. 2018. A Visual Interaction Cue Framework from Video Game Environments for Augmented Reality. Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3173574.3173714

Digital Library

[16]

Fiona Draxler, Audrey Labrie, Albrecht Schmidt, and Lewis L. Chuang. 2020. Augmented Reality to Enable Users in Learning Case Grammar from Their Real-World Interactions. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3313831.3376537

Digital Library

[17]

Barrett Ens, Benjamin Bach, Maxime Cordeil, Ulrich Engelke, Marcos Serrano, Wesley Willett, Arnaud Prouzeau, Christoph Anthes, Wolfgang Büschel, Cody Dunne, Tim Dwyer, Jens Grubert, Jason H. Haga, Nurit Kirshenbaum, Dylan Kobayashi, Tica Lin, Monsurat Olaosebikan, Fabian Pointecker, David Saffo, Nazmus Saquib, Dieter Schmalstieg, Danielle Albers Szafir, Matt Whitlock, and Yalong Yang. 2021. Grand Challenges in Immersive Analytics. Association for Computing Machinery, New York, NY, USA. https://doi.org/10.1145/3411764.3446866

Digital Library

[18]

Barrett Ens, Juan David Hincapié-Ramos, and Pourang Irani. 2014. Ethereal Planes: A Design Framework for 2D Information Space in 3D Mixed Reality Environments. In Proceedings of the 2nd ACM Symposium on Spatial User Interaction (Honolulu, Hawaii, USA) (SUI ’14). Association for Computing Machinery, New York, NY, USA, 2–12. https://doi.org/10.1145/2659766.2659769

Digital Library

[19]

Barrett Ens and Pourang Irani. 2017. Spatial Analytic Interfaces: Spatial User Interfaces for In Situ Visual Analytics. IEEE Comput. Graph. Appl. 37, 2 (March 2017), 66–79. https://doi.org/10.1109/MCG.2016.38

Digital Library

[20]

Barrett Ens, Eyal Ofek, Neil Bruce, and Pourang Irani. 2015. Spatial Constancy of Surface-Embedded Layouts across Multiple Environments. In Proceedings of the 3rd ACM Symposium on Spatial User Interaction (Los Angeles, California, USA) (SUI ’15). Association for Computing Machinery, New York, NY, USA, 65–68. https://doi.org/10.1145/2788940.2788954

Digital Library

[21]

Barrett M. Ens, Rory Finnegan, and Pourang P. Irani. 2014. The Personal Cockpit: A Spatial Interface for Effective Task Switching on Head-Worn Displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Toronto, Ontario, Canada) (CHI ’14). Association for Computing Machinery, New York, NY, USA, 3171–3180. https://doi.org/10.1145/2556288.2557058

Digital Library

[22]

Eureka Foong, Darren Gergle, and Elizabeth M. Gerber. 2017. Novice and Expert Sensemaking of Crowdsourced Design Feedback. Proceedings of the ACM on Human-Computer Interaction 1, CSCW, Article 45 (dec 2017), 18 pages. https://doi.org/10.1145/3134680

Digital Library

[23]

Jonas Frich, Midas Nouwens, Kim Halskov, and Peter Dalsgaard. 2021. How Digital Tools Impact Convergent and Divergent Thinking in Design Ideation. Association for Computing Machinery, New York, NY, USA. https://doi.org/10.1145/3411764.3445062

Digital Library

[24]

Alexia Galati, Riley Schoppa, and Aidong Lu. 2021. Exploring the SenseMaking Process through Interactions and fNIRS in Immersive Visualization. IEEE Transactions on Visualization and Computer Graphics 27, 5(2021), 2714–2724. https://doi.org/10.1109/TVCG.2021.3067693

[25]

Z. He, R. Du, and K. Perlin. 2020. CollaboVR: A Reconfigurable Framework for Creative Collaboration in Virtual Reality. In 2020 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). IEEE Computer Society, Los Alamitos, CA, USA, 542–554. https://doi.org/10.1109/ISMAR50242.2020.00082

[26]

Otmar Hilliges, Lucia Terrenghi, Sebastian Boring, David Kim, Hendrik Richter, and Andreas Butz. 2007. Designing for Collaborative Creative Problem Solving. In Proceedings of the 6th ACM SIGCHI Conference on Creativity & Cognition (Washington, DC, USA) (C&C ’07). ACM, New York, NY, USA, 137–146. https://doi.org/10.1145/1254960.1254980

Digital Library

[27]

Gillian C. Hopkinson. 2001. Influence in marketing channels: A sense-making investigation. Psychology & Marketing 18, 5 (2001), 423–444. https://doi.org/10.1002/mar.1015 arXiv:https://onlinelibrary.wiley.com/doi/pdf/10.1002/mar.1015

[28]

Petra Isenberg, Niklas Elmqvist, Jean Scholtz, Daniel Cernea, Kwan-Liu Ma, and Hans Hagen. 2011. Collaborative Visualization: Definition, Challenges, and Research Agenda. Information Visualization 10, 4 (oct 2011), 310–326. https://doi.org/10.1177/1473871611412817

Digital Library

[29]

Yvonne Jansen, Jonas Schjerlund, and Kasper Hornbæk. 2019. Effects of Locomotion and Visual Overview on Spatial Memory When Interacting with Wall Displays. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3290605.3300521

Digital Library

[30]

Mads Møller Jensen, Roman Rädle, Clemens N. Klokmose, and Susanne Bodker. 2018. Remediating a Design Tool: Implications of Digitizing Sticky Notes. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3173574.3173798

Digital Library

[31]

Matthias Kraus, Karsten Klein, Johannes Fuchs, Daniel A. Keim, Falk Schreiber, and Michael Sedlmair. 2021. The Value of Immersive Visualization. IEEE Computer Graphics and Applications 41, 4 (2021), 125–132. https://doi.org/10.1109/MCG.2021.3075258

[32]

Oh-Hyun Kwon, Chris Muelder, Kyungwon Lee, and Kwan-Liu Ma. 2016. A Study of Layout, Rendering, and Interaction Methods for Immersive Graph Visualization. IEEE Transactions on Visualization and Computer Graphics 22, 7(2016), 1802–1815. https://doi.org/10.1109/TVCG.2016.2520921

Digital Library

[33]

B. Lee, X. Hu, M. Cordeil, A. Prouzeau, B. Jenny, and T. Dwyer. 2021. Shared Surfaces and Spaces: Collaborative Data Visualisation in a Co-located Immersive Environment. IEEE Transactions on Visualization & Computer Graphics 27, 02 (feb 2021), 1171–1181. https://doi.org/10.1109/TVCG.2020.3030450

[34]

Joon Hyub Lee, Donghyeok Ma, Haena Cho, and Seok-Hyung Bae. 2021. Post-Post-It: A Spatial Ideation System in VR for Overcoming Limitations of Physical Post-It Notes. Association for Computing Machinery, New York, NY, USA. https://doi.org/10.1145/3411763.3451786

Digital Library

[35]

Zhen Li, Michelle Annett, Ken Hinckley, Karan Singh, and Daniel Wigdor. 2019. HoloDoc: Enabling Mixed Reality Workspaces that Harness Physical and Digital Content. In CHI 2019 Conference on Human Factors in Computing Systems. ACM. https://www.microsoft.com/en-us/research/publication/holodoc-enabling-mixed-reality-workspaces-that-harness-physical-and-digital-content-2/

[36]

Lee Lisle, Xiaoyu Chen, J.K. Edward Gitre, Chris North, and Doug A. Bowman. 2020. Evaluating the Benefits of the Immersive Space to Think. In 2020 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW). 331–337. https://doi.org/10.1109/VRW50115.2020.00073

[37]

Lee Lisle, Kylie Davidson, Edward J.K. Gitre, Chris North, and Doug A. Bowman. 2021. Sensemaking Strategies with Immersive Space to Think. In 2021 IEEE Virtual Reality and 3D User Interfaces (VR). 529–537. https://doi.org/10.1109/VR50410.2021.00077

[38]

Jiazhou Liu, Arnaud Prouzeau, Barrett Ens, and Tim Dwyer. 2020. Design and Evaluation of Interactive Small Multiples Data Visualisation in Immersive Spaces. In 2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). IEEE, 588–597. https://doi.org/10.1109/VR46266.2020.00081

[39]

Feiyu Lu and Doug A. Bowman. 2021. Evaluating the Potential of Glanceable AR Interfaces for Authentic Everyday Uses. In 2021 IEEE Virtual Reality and 3D User Interfaces (VR). IEEE Computer Society, Los Alamitos, CA, USA, 768–777. https://doi.org/10.1109/VR50410.2021.00104

[40]

Weizhou Luo, Anke Lehmann, Yushan Yang, and Raimund Dachselt. 2021. Investigating Document Layout and Placement Strategies for Collaborative Sensemaking in Augmented Reality. Association for Computing Machinery, New York, NY, USA. https://doi.org/10.1145/3411763.3451588

Digital Library

[41]

Tahir Mahmood, Erik Butler, Nicholas Davis, Jian Huang, and Aidong Lu. 2018. Building Multiple Coordinated Spaces for Effective Immersive Analytics through Distributed Cognition. In 2018 International Symposium on Big Data Visual and Immersive Analytics (BDVA). IEEE, 1–11. https://doi.org/10.1109/BDVA.2018.8533893

[42]

Tahir Mahmood, Willis Fulmer, Neelesh Mungoli, Jian Huang, and Aidong Lu. 2019. Improving Information Sharing and Collaborative Analysis for Remote GeoSpatial Visualization Using Mixed Reality. In 2019 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). IEEE, 236–247. https://doi.org/10.1109/ISMAR.2019.00021

[43]

Thomas W. Malone. 1983. How Do People Organize Their Desks? Implications for the Design of Office Information Systems. ACM Transactions on Information Systems (TOIS) 1, 1 (jan 1983), 99–112. https://doi.org/10.1145/357423.357430

Digital Library

[44]

Kim Marriott, Falk Schreiber, Tim Dwyer, Karsten Klein, Nathalie Henry Riche, Takayuki Itoh, Wolfgang Stuerzlinger, and Bruce H Thomas. 2018. Immersive Analytics. Vol. 11190. Springer. https://doi.org/10.1007/978-3-030-01388-2

[45]

Fabrice Matulic, Wolfgang Büschel, Michael Ying Yang, Stephan Ihrke, Anmol Ramraika, Carsten Rother, and Raimund Dachselt. 2016. Smart Ubiquitous Projection: Discovering Surfaces for the Projection of Adaptive Content. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems (San Jose, California, USA) (CHI EA ’16). Association for Computing Machinery, New York, NY, USA, 2592–2600. https://doi.org/10.1145/2851581.2892545

Digital Library

[46]

Jens Müller, Roman Rädle, and Harald Reiterer. 2017. Remote Collaboration With Mixed Reality Displays: How Shared Virtual Landmarks Facilitate Spatial Referencing. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI ’17). Association for Computing Machinery, New York, NY, USA, 6481–6486. https://doi.org/10.1145/3025453.3025717

Digital Library

[47]

Benjamin Nuernberger, Eyal Ofek, Hrvoje Benko, and Andrew D. Wilson. 2016. SnapToReality: Aligning Augmented Reality to the Real World. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI ’16). Association for Computing Machinery, New York, NY, USA, 1233–1244. https://doi.org/10.1145/2858036.2858250

Digital Library

[48]

Leonardo Pavanatto, Chris North, Doug A. Bowman, Carmen Badea, and Richard Stoakley. 2021. Do we still need physical monitors? An evaluation of the usability of AR virtual monitors for productivity work. In 2021 IEEE Virtual Reality and 3D User Interfaces (VR). 759–767. https://doi.org/10.1109/VR50410.2021.00103

[49]

Peter Pirolli and Stuart Card. 2005. The sensemaking process and leverage points for analyst technology as identified through cognitive task analysis. In Proceedings of international conference on intelligence analysis, Vol. 5. McLean, VA, USA, 2–4.

[50]

Iulian Radu, Tugce Joy, Yiran Bowman, Ian Bott, and Bertrand Schneider. 2021. A Survey of Needs and Features for Augmented Reality Collaborations in Collocated Spaces. Proc. ACM Hum.-Comput. Interact. 5, CSCW1, Article 169 (apr 2021), 21 pages. https://doi.org/10.1145/3449243

Digital Library

[51]

Jie Ren, Yueting Weng, Chengchi Zhou, Chun Yu, and Yuanchun Shi. 2020. Understanding Window Management Interactions in AR Headset + Smartphone Interface. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems(Honolulu, HI, USA) (CHI EA ’20). Association for Computing Machinery, New York, NY, USA, 1–8. https://doi.org/10.1145/3334480.3382812

Digital Library

[52]

Kadek Ananta Satriadi, Barrett Ens, Maxime Cordeil, Tobias Czauderna, and Bernhard Jenny. 2020. Maps Around Me: 3D Multiview Layouts in Immersive Spaces. Proc. ACM Hum.-Comput. Interact. 4, ISS, Article 201 (Nov. 2020), 20 pages. https://doi.org/10.1145/3427329

Digital Library

[53]

Mickael Sereno and Tobias Isenberg. 2020. Subjective Views in Co-Located Augmented Reality-Initial Design. In IEEE VIS Posters. IEEE Computer Society.

[54]

Mickael Sereno, Xiyao Wang, Lonni Besancon, Michael J. Mcguffin, and Tobias Isenberg. 2020. Collaborative Work in Augmented Reality: A Survey. IEEE Transactions on Visualization and Computer Graphics (2020), 1–1. https://doi.org/10.1109/TVCG.2020.3032761

Digital Library

[55]

Jae-eun Shin, Hayun Kim, Callum Parker, Hyung-il Kim, Seoyoung Oh, and Woontack Woo. 2019. Is Any Room Really OK? The Effect of Room Size and Furniture on Presence, Narrative Engagement, and Usability During a Space-Adaptive Augmented Reality Game. In 2019 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). IEEE Computer Society, Los Alamitos, CA, USA, 135–144. https://doi.org/10.1109/ISMAR.2019.00-11

[56]

Jae-eun Shin, Boram Yoon, Dooyoung Kim, and Woontack Woo. 2021. A User-Oriented Approach to Space-Adaptive Augmentation: The Effects of Spatial Affordance on Narrative Experience in an Augmented Reality Detective Game. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI ’21). Association for Computing Machinery, New York, NY, USA, Article 722, 13 pages. https://doi.org/10.1145/3411764.3445675

Digital Library

[57]

Maxim Spur, Vincent Tourre, Erwan David, Guillaume Moreau, and Patrick Le Callet. 2020. Exploring Multiple and Coordinated Views for Multilayered Geospatial Data in Virtual Reality. Information 11, 9 (2020). https://doi.org/10.3390/info11090425

[58]

John Stasko, Carsten Görg, and Zhicheng Liu. 2008. Jigsaw: Supporting Investigative Analysis through Interactive Visualization. Information Visualization 7, 2 (apr 2008), 118–132. https://doi.org/10.1145/1466620.1466622

[59]

Hariharan Subramonyam, Steven M. Drucker, and Eytan Adar. 2019. Affinity Lens: Data-Assisted Affinity Diagramming with Augmented Reality. Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3290605.3300628

Digital Library

[60]

Barbara Tversky. 2009. Spatial cognition: Embodied and situated. Cambridge University Press, New York, NY, US, 201–216.

[61]

Barbara Tversky. 2019. Mind in motion: How action shapes thought. Hachette UK.

[62]

Silvio Waisbord. 2018. Truth is What Happens to News. Journalism Studies 19, 13 (2018), 1866–1878. https://doi.org/10.1080/1461670X.2018.1492881 arXiv:https://doi.org/10.1080/1461670X.2018.1492881

[63]

Xiyao Wang, Lonni Besançon, David Rousseau, Mickael Sereno, Mehdi Ammi, and Tobias Isenberg. 2020. Towards an Understanding of Augmented Reality Extensions for Existing 3D Data Analysis Tools. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3313831.3376657

Digital Library

[64]

Karl E. Weick, Kathleen M. Sutcliffe, and David Obstfeld. 2005. Organizing and the Process of Sensemaking. Organization Science 16, 4 (2005), 409–421. https://doi.org/10.1287/orsc.1050.0133 arXiv:https://doi.org/10.1287/orsc.1050.0133

Digital Library

[65]

John Wenskovitch and Chris North. 2021. An Examination of Grouping and Spatial Organization Tasks for High-Dimensional Data Exploration. IEEE Transactions on Visualization and Computer Graphics 27, 2(2021), 1742–1752. https://doi.org/10.1109/TVCG.2020.3028890

[66]

Wesley Willett, Yvonne Jansen, and Pierre Dragicevic. 2017. Embedded Data Representations. IEEE Transactions on Visualization and Computer Graphics 23, 1(2017), 461–470. https://doi.org/10.1109/TVCG.2016.2598608

Digital Library

[67]

Paweł Wozniak, Nitesh Goyal, Przemysław Kucharski, Lars Lischke, Sven Mayer, and Morten Fjeld. 2016. RAMPARTS: Supporting Sensemaking with Spatially-Aware Mobile Interactions. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI ’16). Association for Computing Machinery, New York, NY, USA, 2447–2460. https://doi.org/10.1145/2858036.2858491

Digital Library

[68]

Yongqin Xian, Christoph H. Lampert, Bernt Schiele, and Zeynep Akata. 2020. Zero-Shot Learning – A Comprehensive Evaluation of the Good, the Bad and the Ugly. arxiv:1707.00600 [cs.CV]

[69]

Fumeng Yang, Jing Qian, Johannes Novotny, David Badre, Cullen D. Jackson, and David H. Laidlaw. 2021. A Virtual Reality Memory Palace Variant Aids Knowledge Retrieval from Scholarly Articles. IEEE Transactions on Visualization and Computer Graphics 27, 12(2021), 4359–4373. https://doi.org/10.1109/TVCG.2020.3009003

Digital Library

[70]

Johannes Zagermann, Ulrike Pfeil, Philipp von Bauer, Daniel Fink, and Harald Reiterer. 2020. ”It’s in My Other Hand!” – Studying the Interplay of Interaction Techniques and Multi-Tablet Activities. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3313831.3376540

Digital Library

Cited By

Gründling JWeyers B(2024)Immersive Analytics: The Influence of Flow, Sense of Agency, and Presence on Performance and SatisfactionProceedings of the ACM on Human-Computer Interaction10.1145/36611448:EICS(1-27)Online publication date: 17-Jun-2024
https://dl.acm.org/doi/10.1145/3661144
Shin JKim HPark HWoo W(2024)Investigating the Design of Augmented Narrative Spaces Through Virtual-Real Connections: A Systematic Literature ReviewProceedings of the CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642819(1-18)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642819
Dong KZhang ZChang XChirarattananon PLC R(2024)Dances with Drones: Spatial Matching and Perceived Agency in Improvised Movements with Drone and Human PartnersProceedings of the CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642345(1-16)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642345
Show More Cited By

Index Terms

Where Should We Put It? Layout and Placement Strategies of Documents in Augmented Reality for Collaborative Sensemaking
1. Human-centered computing
  1. Collaborative and social computing
    1. Collaborative and social computing theory, concepts and paradigms
      1. Computer supported cooperative work
  2. Human computer interaction (HCI)
    1. HCI design and evaluation methods
      1. User studies
    2. Interaction paradigms
      1. Collaborative interaction
      2. Mixed / augmented reality

Recommendations

Investigating Document Layout and Placement Strategies for Collaborative Sensemaking in Augmented Reality
CHI EA '21: Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems

Augmented Reality (AR) has the potential to revolutionize our workspaces, since it considerably extends the limits of current displays while keeping users aware of their collaborators and surroundings. Collective activities like brainstorming and ...
Exploring Spatial Organization Strategies for Virtual Content in Mixed Reality Environments
CHI EA '24: Extended Abstracts of the 2024 CHI Conference on Human Factors in Computing Systems
Our future will likely be reshaped by Mixed Reality (MR) offering boundless display space while preserving the context of real-world surroundings. However, to fully leverage the spatial capabilities of MR technology, a better understanding of how and ...
Multimodal augmented reality: the norm rather than the exception
MVAR '16: Proceedings of the 2016 workshop on Multimodal Virtual and Augmented Reality

Augmented reality (AR) is commonly seen as a technology that overlays virtual imagery onto a participant's view of the world. In line with this, most AR research is focused on what we see. In this paper, we challenge this focus on vision and make a case ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '22: Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems

April 2022

10459 pages

ISBN:9781450391573

DOI:10.1145/3491102

Editors:
Simone Barbosa
PUC-Rio, Brazil
,
Cliff Lampe
University of Michigan, USA
,
Caroline Appert
Université Paris-Saclay, France
,
David A. Shamma
Toyota Research Institute, USA
,
Steven Drucker
Microsoft Research, USA
,
Julie Williamson
University of Glasgow, UK
,
Koji Yatani
University of Tokyo, Japan

Copyright © 2022 Owner/Author.

This work is licensed under a Creative Commons Attribution International 4.0 License.

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 April 2022

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

Deutsche Forschungsgemeinschaft

Conference

CHI '22

Sponsor:

SIGCHI

CHI '22: CHI Conference on Human Factors in Computing Systems

April 29 - May 5, 2022

LA, New Orleans, USA

Acceptance Rates

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

23
Total Citations
View Citations
2,247
Total Downloads

Downloads (Last 12 months)881
Downloads (Last 6 weeks)82

Reflects downloads up to 11 Aug 2024

Other Metrics

View Author Metrics

Citations

Cited By

Gründling JWeyers B(2024)Immersive Analytics: The Influence of Flow, Sense of Agency, and Presence on Performance and SatisfactionProceedings of the ACM on Human-Computer Interaction10.1145/36611448:EICS(1-27)Online publication date: 17-Jun-2024
https://dl.acm.org/doi/10.1145/3661144
Shin JKim HPark HWoo W(2024)Investigating the Design of Augmented Narrative Spaces Through Virtual-Real Connections: A Systematic Literature ReviewProceedings of the CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642819(1-18)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642819
Dong KZhang ZChang XChirarattananon PLC R(2024)Dances with Drones: Spatial Matching and Perceived Agency in Improvised Movements with Drone and Human PartnersProceedings of the CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642345(1-16)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642345
Pei SKim DOlwal AZhang YDu R(2024)UI Mobility Control in XR: Switching UI Positionings between Static, Dynamic, and Self EntitiesProceedings of the CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642220(1-12)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642220
Friedl‐Knirsch JPointecker FPfistermüller SStach CAnthes CRoth D(2024)A Systematic Literature Review of User Evaluation in Immersive AnalyticsComputer Graphics Forum10.1111/cgf.1511143:3Online publication date: 10-Jun-2024
https://doi.org/10.1111/cgf.15111
In SLin TNorth CPfister HYang Y(2024)This is the Table I Want! Interactive Data Transformation on Desktop and in Virtual RealityIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.329960230:8(5635-5650)Online publication date: Aug-2024
https://doi.org/10.1109/TVCG.2023.3299602
Han VCho HMaeda KIon ALindlbauer D(2023)BlendMR: A Computational Method to Create Ambient Mixed Reality InterfacesProceedings of the ACM on Human-Computer Interaction10.1145/36264727:ISS(217-241)Online publication date: 1-Nov-2023
https://dl.acm.org/doi/10.1145/3626472
Calepso AFleck PSchmalstieg DSedlmair M(2023)Exploring Augmented Reality for Situated Analytics with Many Movable Physical ReferentsProceedings of the 29th ACM Symposium on Virtual Reality Software and Technology10.1145/3611659.3615700(1-12)Online publication date: 9-Oct-2023
https://dl.acm.org/doi/10.1145/3611659.3615700
Xu XYu AJonker TTodi KLu FQian XEvangelista Belo JWang TLi MMun AWu TShen JZhang TKokhlikyan NWang FSorenson PKim SBenko H(2023)XAIR: A Framework of Explainable AI in Augmented RealityProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581500(1-30)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581500
Luo WYu ZRzayev RSatkowski MGumhold SMcGinity MDachselt R(2023)Pearl: Physical Environment based Augmented Reality Lenses for In-Situ Human Movement AnalysisProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580715(1-15)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580715
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents