poster

Investigating Document Layout and Placement Strategies for Collaborative Sensemaking in Augmented Reality

Authors:

Raimund DachseltAuthors Info & Claims

CHI EA '21: Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems

Article No.: 456, Pages 1 - 7

https://doi.org/10.1145/3411763.3451588

Published: 08 May 2021 Publication History

Abstract

Augmented Reality (AR) has the potential to revolutionize our workspaces, since it considerably extends the limits of current displays while keeping users aware of their collaborators and surroundings. Collective activities like brainstorming and sensemaking often use space for arranging documents and information and thus will likely benefit from AR-enhanced offices. Until now, there has been very little research on how the physical surroundings might affect virtual content placement for collaborative sensemaking. We therefore conducted an initial study with eight participants in which we compared two different room settings for collaborative image categorization regarding content placement, spatiality, and layout. We found that participants tend to utilize the room’s vertical surfaces as well as the room’s furniture, particularly through edges and gaps, for placement and organization. We also identified three different spatial layout patterns (panoramic-strip, semi-cylindrical layout, furniture-based distribution) and observed the usage of temporary storage spaces specifically for collaboration.

Supplemental Material

MP4 File

Supplemental video

Transcript for: Supplemental video

References

[1]

Christopher Andrews and Chris North. 2013. The Impact of Physical Navigation on Spatial Organization for Sensemaking. IEEE Transactions on Visualization and Computer Graphics 19, 12 (Dec 2013), 2207–2216. https://doi.org/10.1109/TVCG.2013.205

Digital Library

[2]

Lauren Bradel, Alex Endert, Kristen Koch, Christopher Andrews, and Chris North. 2013. Large high resolution displays for co-located collaborative sensemaking: Display usage and territoriality. International Journal of Human-Computer Studies 71, 11 (2013), 1078 – 1088. https://doi.org/10.1016/j.ijhcs.2013.07.004

Digital Library

[3]

Han Joo Chae, Youli Chang, Minji Kim, Gwanmo Park, and Jinwook Seo. 2020. ARphy: Managing Photo Collections Using Physical Objects in AR. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI EA ’20). Association for Computing Machinery, New York, NY, USA, 1–7. https://doi.org/10.1145/3334480.3382885

Digital Library

[4]

Barrett Ens and Pourang Irani. 2017. Spatial Analytic Interfaces: Spatial User Interfaces for In Situ Visual Analytics. IEEE Comput. Graph. Appl. 37, 2 (2017), 66–79. https://doi.org/10.1109/MCG.2016.38

Digital Library

[5]

Barrett Ens, Eyal Ofek, Neil Bruce, and Pourang Irani. 2015. Spatial Constancy of Surface-Embedded Layouts across Multiple Environments. In Proceedings of the 3rd ACM Symposium on Spatial User Interaction (Los Angeles, California, USA) (SUI ’15). Association for Computing Machinery, New York, NY, USA, 65–68. https://doi.org/10.1145/2788940.2788954

Digital Library

[6]

Jae eun Shin, Hayun Kim, Callum Parker, Hyung il Kim, Seoyoung Oh, and Woontack Woo. 2019. Is Any Room Really OK? The Effect of Room Size and Furniture on Presence, Narrative Engagement, and Usability During a Space-Adaptive Augmented Reality Game. In 2019 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). IEEE, Beijing, China, 135–144. https://doi.org/10.1109/ISMAR.2019.00-11

[7]

Zhenyi He, Ruofei Du, and Ken Perlin. 2020. CollaboVR: A Reconfigurable Framework for Creative Collaboration in Virtual Reality. In 2020 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). IEEE Computer Society, Los Alamitos, CA, USA, 542–554. https://doi.org/10.1109/ISMAR50242.2020.00082

[8]

Otmar Hilliges, Lucia Terrenghi, Sebastian Boring, David Kim, Hendrik Richter, and Andreas Butz. 2007. Designing for Collaborative Creative Problem Solving. In Proceedings of the 6th ACM SIGCHI Conference on Creativity & Cognition (Washington, DC, USA) (C&C ’07). ACM, New York, NY, USA, 137–146. https://doi.org/10.1145/1254960.1254980

Digital Library

[9]

Petra Isenberg, Danyel Fisher, Sharoda A. Paul, Meredith Ringel Morris, Kori Inkpen, and Mary Czerwinski. 2012. Co-Located Collaborative Visual Analytics around a Tabletop Display. Visualization and Computer Graphics, IEEE Transactions on 18, 5 (May 2012), 689–702. https://doi.org/10.1109/TVCG.2011.287

Digital Library

[10]

Yvonne Jansen, Jonas Schjerlund, and Kasper Hornbæk. 2019. Effects of Locomotion and Visual Overview on Spatial Memory When Interacting with Wall Displays. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3290605.3300521

Digital Library

[11]

Mads Møller Jensen, Roman Rädle, Clemens N. Klokmose, and Susanne Bodker. 2018. Remediating a Design Tool: Implications of Digitizing Sticky Notes. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3173574.3173798

Digital Library

[12]

Lee Lisle, Xiaoyu Chen, J.K. Edward Gitre, Chris North, and Doug A. Bowman. 2020. Evaluating the Benefits of the Immersive Space to Think. In 2020 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW). IEEE, Atlanta, GA, USA, 331–337. https://doi.org/10.1109/VRW50115.2020.00073

[13]

Jiazhou Liu, Arnaud Prouzeau, Barrett Ens, and Tim Dwyer. 2020. Design and Evaluation of Interactive Small Multiples Data Visualisation in Immersive Spaces. In 2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). IEEE, Atlanta, GA, USA, 588–597. https://doi.org/10.1109/VR46266.2020.00081

[14]

Horea Mureşan and Mihai Oltean. 01 Aug. 2018. Fruit recognition from images using deep learning. Acta Universitatis Sapientiae, Informatica 10, 1 (01 Aug. 2018), 26 – 42. https://doi.org/10.2478/ausi-2018-0002

[15]

Benjamin Nuernberger, Eyal Ofek, Hrvoje Benko, and Andrew D. Wilson. 2016. SnapToReality: Aligning Augmented Reality to the Real World. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI ’16). Association for Computing Machinery, New York, NY, USA, 1233–1244. https://doi.org/10.1145/2858036.2858250

Digital Library

[16]

Kadek Ananta Satriadi, Barrett Ens, Maxime Cordeil, Tobias Czauderna, and Bernhard Jenny. 2020. Maps Around Me: 3D Multiview Layouts in Immersive Spaces. Proc. ACM Hum.-Comput. Interact. 4, ISS, Article 201 (Nov. 2020), 20 pages. https://doi.org/10.1145/3427329

Digital Library

[17]

Stacey D. Scott and Sheelagh Carpendale. 2010. Theory of Tabletop Territoriality. In Tabletops-horizontal interactive displays. Springer, London, 357–385. https://doi.org/10.1007/978-1-84996-113-4_15

[18]

John Wenskovitch and Chris North. 2020. An Examination of Grouping and Spatial Organization Tasks for High-Dimensional Data Exploration. IEEE Transactions on Visualization and Computer Graphics 27, 2(2020), 1742 – 1752. https://doi.org/10.1109/TVCG.2020.3028890

[19]

Paweł Wozniak, Nitesh Goyal, Przemysław Kucharski, Lars Lischke, Sven Mayer, and Morten Fjeld. 2016. RAMPARTS: Supporting Sensemaking with Spatially-Aware Mobile Interactions. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI ’16). Association for Computing Machinery, New York, NY, USA, 2447–2460. https://doi.org/10.1145/2858036.2858491

Digital Library

[20]

Fumeng Yang, Jing Qian, Johannes Novotny, David Badre, Cullen Jackson, and David Laidlaw. 2020. A Virtual Reality Memory Palace Variant Aids Knowledge Retrieval from Scholarly Articles. IEEE Transactions on Visualization and Computer Graphics (2020). https://doi.org/10.1109/TVCG.2020.3009003

Digital Library

[21]

Linjie Yang, Ping Luo, Chen Change Loy, and Xiaoou Tang. 2015. A large-scale car dataset for fine-grained categorization and verification. In 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, Boston, MA, USA, 3973–3981. https://doi.org/10.1109/CVPR.2015.7299023

[22]

Johannes Zagermann, Ulrike Pfeil, Philipp von Bauer, Daniel Fink, and Harald Reiterer. 2020. ”It’s in My Other Hand!” – Studying the Interplay of Interaction Techniques and Multi-Tablet Activities. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3313831.3376540

Digital Library

Cited By

Yangfu RZhiqiang LSonghai Z(2024)Survey of visualization methods for multiscene visual cue information in immersive environmentsJournal of Image and Graphics10.11834/jig.22114729:1(1-21)Online publication date: 2024
https://doi.org/10.11834/jig.221147
Luo W(2024)Exploring Spatial Organization Strategies for Virtual Content in Mixed Reality EnvironmentsExtended Abstracts of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613905.3638181(1-6)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3638181
Zhang YEns BSatriadi KYang YGoodwin S(2023)Embodied Provenance for Immersive SensemakingProceedings of the ACM on Human-Computer Interaction10.1145/36264717:ISS(198-216)Online publication date: 1-Nov-2023
https://dl.acm.org/doi/10.1145/3626471
Show More Cited By

Recommendations

Spatiality and Semantics - Towards Understanding Content Placement in Mixed Reality
CHI EA '23: Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems

Mixed Reality (MR) popularizes numerous situated applications where virtual content is spatially integrated into our physical environment. However, we only know little about what properties of an environment influence the way how people place digital ...
Where Should We Put It? Layout and Placement Strategies of Documents in Augmented Reality for Collaborative Sensemaking
CHI '22: Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems

Future offices are likely reshaped by Augmented Reality (AR) extending the display space while maintaining awareness of surroundings, and thus promise to support collaborative tasks such as brainstorming or sensemaking. However, it is unclear how ...
Collaborative Augmented Reality: Multi-user Interaction in Urban Simulation
IVIC '09: Proceedings of the 1st International Visual Informatics Conference on Visual Informatics: Bridging Research and Practice

Augmented reality (AR) environment allows user or multi-user to interact with 2D and 3D data. AR simply can provide a collaborative interactive AR environment for urban simulation, where users can interact naturally and intuitively. AR collaboration ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI EA '21: Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems

May 2021

2965 pages

ISBN:9781450380959

DOI:10.1145/3411763

Editors:
Yoshifumi Kitamura
Tohoku University, Japan
,
Aaron Quigley
University of New South Wales, Australia
,
Katherine Isbister
University of California Santa Cruz, USA
,
Takeo Igarashi
The University of Tokyo, Japan

Copyright © 2021 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 May 2021

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Poster
Research
Refereed limited

Funding Sources

Deutsche Forschungsgemeinschaftgemeinschaft

Conference

CHI '21

Sponsor:

SIGCHI

CHI '21: CHI Conference on Human Factors in Computing Systems

May 8 - 13, 2021

Yokohama, Japan

Acceptance Rates

Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

15
Total Citations
View Citations
543
Total Downloads

Downloads (Last 12 months)132
Downloads (Last 6 weeks)16

Reflects downloads up to 13 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Yangfu RZhiqiang LSonghai Z(2024)Survey of visualization methods for multiscene visual cue information in immersive environmentsJournal of Image and Graphics10.11834/jig.22114729:1(1-21)Online publication date: 2024
https://doi.org/10.11834/jig.221147
Luo W(2024)Exploring Spatial Organization Strategies for Virtual Content in Mixed Reality EnvironmentsExtended Abstracts of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613905.3638181(1-6)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3638181
Zhang YEns BSatriadi KYang YGoodwin S(2023)Embodied Provenance for Immersive SensemakingProceedings of the ACM on Human-Computer Interaction10.1145/36264717:ISS(198-216)Online publication date: 1-Nov-2023
https://dl.acm.org/doi/10.1145/3626471
Ghaemi ZAnanta Satriadi KEngelke UEns BJenny B(2023)Visualization Placement for Outdoor Augmented Data ToursProceedings of the 2023 ACM Symposium on Spatial User Interaction10.1145/3607822.3614518(1-14)Online publication date: 13-Oct-2023
https://dl.acm.org/doi/10.1145/3607822.3614518
Ellenberg MSatkowski MLuo WDachselt R(2023)Spatiality and Semantics - Towards Understanding Content Placement in Mixed RealityExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3585853(1-8)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544549.3585853
Zhang YEns BSatriadi KYang YGoodwin S(2023)Defining Embodied Provenance for Immersive SensemakingExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3585691(1-7)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544549.3585691
Liu JEns BProuzeau ASmiley JNixon IGoodwin SDwyer T(2023)DataDancing: An Exploration of the Design Space For Visualisation View Management for 3D Surfaces and SpacesProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580827(1-17)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580827
Luo WYu ZRzayev RSatkowski MGumhold SMcGinity MDachselt R(2023)Pearl: Physical Environment based Augmented Reality Lenses for In-Situ Human Movement AnalysisProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580715(1-15)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580715
Davidson KLisle LWhitley KBowman DNorth C(2023)Exploring the Evolution of Sensemaking Strategies in Immersive Space to ThinkIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2022.320735729:12(5294-5307)Online publication date: 1-Dec-2023
https://dl.acm.org/doi/10.1109/TVCG.2022.3207357
Davidson KLisle LTahmid IWhitley KNorth CBowman D(2023)Uncovering Best Practices in Immersive Space to Think2023 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)10.1109/ISMAR59233.2023.00126(1094-1103)Online publication date: 16-Oct-2023
https://doi.org/10.1109/ISMAR59233.2023.00126
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents