A Design Space of Multi-Display Spatial Interactions for Visualization Tasks
Article No.: 23, Pages 1 - 13
Abstract
This paper presents a design space of spatial interaction techniques for multi-display visualizations. By analyzing 56 papers on multi-display tools and techniques, we identify the three dimensions and their associated design choices for different types of spatial interactions using multiple displays and devices. This work aims to provide guidance for designing interactive multi-display visualizations that meet different requirements of visual analysis and sensemaking tasks while also inspiring future design ideas. Visualization researchers can create new multi-display visualizations by using combinations of the design choices associated with different visualization tasks. Our design space also allows them to explore areas of spatial interactions that have been underutilized to their full potential or to understand the requirements for new spatial interaction techniques for multi-display visualizations.
References
[1]
Christopher Andrews, Alex Endert, and Chris North. 2010. Space to Think: Large High-Resolution Displays for Sensemaking. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Atlanta, Georgia, USA) (CHI ’10). Association for Computing Machinery, New York, NY, USA, 55–64. https://doi.org/10.1145/1753326.1753336
[2]
Robert Ball, Chris North, and Doug A. Bowman. 2007. Move to Improve: Promoting Physical Navigation to Increase User Performance with Large Displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI ’07). Association for Computing Machinery, New York, NY, USA, 191–200. https://doi.org/10.1145/1240624.1240656
[3]
Lonni Besançon, Anders Ynnerman, Daniel F. Keefe, Lingyun Yu, and Tobias Isenberg. 2021. The State of the Art of Spatial Interfaces for 3D Visualization. Computer Graphics Forum 40, 1 (2021), 293–326. https://doi.org/10.1111/cgf.14189 arXiv:https://onlinelibrary.wiley.com/doi/pdf/10.1111/cgf.14189
[4]
Andrea Bianchi, So-Ryang Ban, and Ian Oakley. 2015. Designing a Physical Aid to Support Active Reading on Tablets. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (Seoul, Republic of Korea) (CHI ’15). Association for Computing Machinery, New York, NY, USA, 699–708. https://doi.org/10.1145/2702123.2702303
[5]
Mark Bilandzic and Marcus Foth. 2012. A Review of Locative Media, Mobile and Embodied Spatial Interaction. Int. J. Hum.-Comput. Stud. 70, 1 (jan 2012), 66–71. https://doi.org/10.1016/j.ijhcs.2011.08.004
[6]
Stefan Bruckner, Tobias Isenberg, Timo Ropinski, and Alexander Wiebel. 2019. A Model of Spatial Directness in Interactive Visualization. IEEE Transactions on Visualization and Computer Graphics 25, 8 (Aug 2019), 2514–2528. https://doi.org/10.1109/TVCG.2018.2848906
[7]
Frederik Brudy, Christian Holz, Roman Rädle, Chi-Jui Wu, Steven Houben, Clemens Nylandsted Klokmose, and Nicolai Marquardt. 2019. Cross-Device Taxonomy: Survey, Opportunities and Challenges of Interactions Spanning Across Multiple Devices. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–28. https://doi.org/10.1145/3290605.3300792
[8]
Wolfgang Büschel, Ricardo Langner, Ulrich von Zadow, Tom Horak, and Raimund Dachselt. 2016. Towards Cross-Surface Content Sharing Between Mobile Devices and Large Displays in the Wild. In CHI 2016 Workshop on Interacting with Multi-Device Ecologies "’in the Wild"’ (San Jose, CA, USA). 5 pages.
[9]
Wolfgang Büschel, Patrick Reipschläger, Ricardo Langner, and Raimund Dachselt. 2017. Investigating the Use of Spatial Interaction for 3D Data Visualization on Mobile Devices. In Proceedings of the 2017 ACM International Conference on Interactive Surfaces and Spaces (Brighton, United Kingdom) (ISS ’17). Association for Computing Machinery, New York, NY, USA, 62–71. https://doi.org/10.1145/3132272.3134125
[10]
Haeyong Chung and Chris North. 2018. SAViL: Cross-Display Visual Links for Sensemaking in Display Ecologies. Personal Ubiquitous Comput. 22, 2 (apr 2018), 409–431. https://doi.org/10.1007/s00779-017-1091-4
[11]
Haeyong Chung, Chris North, Sarang Joshi, and Jian Chen. 2015. Four considerations for supporting visual analysis in display ecologies. In 2015 IEEE Conference on Visual Analytics Science and Technology (VAST). 33–40. https://doi.org/10.1109/VAST.2015.7347628
[12]
Haeyong Chung, Chris North, Jessica Zeitz Self, Sharon Chu, and Francis Quek. 2014. VisPorter: Facilitating Information Sharing for Collaborative Sensemaking on Multiple Displays. Personal Ubiquitous Comput. 18, 5 (jun 2014), 1169–1186. https://doi.org/10.1007/s00779-013-0727-2
[13]
Jacob Cole, Katharine Daly, Jesika Haria, and Prabhav Jain. 2012. ScreenSquared: Improving Media Sharing with Smartphones.
[14]
Barrett Ens, Sarah Goodwin, Arnaud Prouzeau, Fraser Anderson, Florence Y. Wang, Samuel Gratzl, Zac Lucarelli, Brendan Moyle, Jim Smiley, and Tim Dwyer. 2021. Uplift: A Tangible and Immersive Tabletop System for Casual Collaborative Visual Analytics. IEEE Transactions on Visualization and Computer Graphics 27, 2 (Feb 2021), 1193–1203. https://doi.org/10.1109/TVCG.2020.3030334
[15]
Peter Fröhlich, Rainer Simon, Lynne Baillie, Joi Roberts, and Roderick Murray-Smith. 2007. Mobile Spatial Interaction. In CHI ’07 Extended Abstracts on Human Factors in Computing Systems (San Jose, CA, USA) (CHI EA ’07). Association for Computing Machinery, New York, NY, USA, 2841–2844. https://doi.org/10.1145/1240866.1241091
[16]
Johannes Fuchs, Roman Rädle, Dominik Sacha, Fabian Fischer, and Andreas Stoffel. 2014. Collaborative data analysis with smart tangible devices. In Visualization and Data Analysis 2014, Pak Chung Wong, David L. Kao, Ming C. Hao, and Chaomei Chen (Eds.). Vol. 9017. SPIE, 90170C.
[17]
Avik Ghose, Chirabrata Bhaumik, and Tapas Chakravarty. 2013. BlueEye: A System for Proximity Detection Using Bluetooth on Mobile Phones. In Proceedings of the 2013 ACM Conference on Pervasive and Ubiquitous Computing Adjunct Publication (Zurich, Switzerland) (UbiComp ’13 Adjunct). Association for Computing Machinery, New York, NY, USA, 1135–1142. https://doi.org/10.1145/2494091.2499771
[18]
Jens Grubert, Matthias Heinisch, Aaron Quigley, and Dieter Schmalstieg. 2015. MultiFi: Multi Fidelity Interaction with Displays On and Around the Body. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (Seoul, Republic of Korea) (CHI ’15). Association for Computing Machinery, New York, NY, USA, 3933–3942. https://doi.org/10.1145/2702123.2702331
[19]
Tero Hakala, Juha Lehikoinen, and Antti Aaltonen. 2005. Spatial Interactive Visualization on Small Screen. In Proceedings of the 7th International Conference on Human Computer Interaction with Mobile Devices & Services (Salzburg, Austria) (MobileHCI ’05). Association for Computing Machinery, New York, NY, USA, 137–144. https://doi.org/10.1145/1085777.1085800
[20]
Peter Hamilton and Daniel J. Wigdor. 2014. Conductor: Enabling and Understanding Cross-Device Interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Toronto, Ontario, Canada) (CHI ’14). Association for Computing Machinery, New York, NY, USA, 2773–2782. https://doi.org/10.1145/2556288.2557170
[21]
Jeremy Hartmann, Aakar Gupta, and Daniel Vogel. 2020. Extend, Push, Pull: Smartphone Mediated Interaction in Spatial Augmented Reality via Intuitive Mode Switching. In Proceedings of the 2020 ACM Symposium on Spatial User Interaction (Virtual Event, Canada) (SUI ’20). Association for Computing Machinery, New York, NY, USA, Article 2, 10 pages. https://doi.org/10.1145/3385959.3418456
[22]
Khalad Hasan, David Ahlström, and Pourang Irani. 2015. SAMMI: A Spatially-Aware Multi-Mobile Interface for Analytic Map Navigation Tasks. In Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services (Copenhagen, Denmark) (MobileHCI ’15). Association for Computing Machinery, New York, NY, USA, 36–45. https://doi.org/10.1145/2785830.2785850
[23]
Jeffrey Heer and Ben Shneiderman. 2012. Interactive Dynamics for Visual Analysis. Commun. ACM 55, 4 (apr 2012), 45–54. https://doi.org/10.1145/2133806.2133821
[24]
Jeffrey Hightower and Gaetano Borriello. 2001. Location Systems for Ubiquitous Computing. Computer 34, 8 (aug 2001), 57–66. https://doi.org/10.1109/2.940014
[25]
Ken Hinckley. 2003. Synchronous Gestures for Multiple Persons and Computers. In Proceedings of the 16th Annual ACM Symposium on User Interface Software and Technology (Vancouver, Canada) (UIST ’03). Association for Computing Machinery, New York, NY, USA, 149–158. https://doi.org/10.1145/964696.964713
[26]
Leila Homaeian, Nippun Goyal, James R. Wallace, and Stacey D. Scott. 2018. Group vs Individual: Impact of TOUCH and TILT Cross-Device Interactions on Mixed-Focus Collaboration. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3173574.3173647
[27]
Zanzhen Huang, Yaxin Zhu, Xiaofei Mao, Tianxin Su, Xinyi Fu, and Guangzheng Fei. 2020. coisTable: An Individual-and-Spatial-Aware Tabletop System for Co-located Collaboration. In 2019 6th International Conference on Dependable Systems and Their Applications (DSA). 91–99. https://doi.org/10.1109/DSA.2019.00019
[28]
Raphaël James, Anastasia Bezerianos, Olivier Chapuis, Maxime Cordeil, Tim Dwyer, and Arnaud Prouzeau. 2020. Personal+Context navigation: combining AR and shared displays in Network Path-following. arXiv preprint arXiv:2005.10612 (2020).
[29]
Pascal Jansen, Fabian Fischbach, Jan Gugenheimer, Evgeny Stemasov, Julian Frommel, and Enrico Rukzio. 2020. ShARe: Enabling Co-Located Asymmetric Multi-User Interaction for Augmented Reality Head-Mounted Displays. In Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology (Virtual Event, USA) (UIST ’20). Association for Computing Machinery, New York, NY, USA, 459–471. https://doi.org/10.1145/3379337.3415843
[30]
Tero Jokela, Jarno Ojala, Guido Grassel, Petri Piippo, and Thomas Olsson. 2015. A Comparison of Methods to Move Visual Objects Between Personal Mobile Devices in Different Contexts of Use. In Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services (Copenhagen, Denmark) (MobileHCI ’15). Association for Computing Machinery, New York, NY, USA, 172–181. https://doi.org/10.1145/2785830.2785841
[31]
U. Kister, K. Klamka, C. Tominski, and R. Dachselt. 2017. GraSp: Combining Spatially-Aware Mobile Devices and a Display Wall for Graph Visualization and Interaction. Comput. Graph. Forum 36, 3 (jun 2017), 503–514. https://doi.org/10.1111/cgf.13206
[32]
Stefanie Klum, Petra Isenberg, Ricardo Langner, Jean-Daniel Fekete, and Raimund Dachselt. 2012. Stackables: Combining Tangibles for Faceted Browsing. In Proceedings of the International Working Conference on Advanced Visual Interfaces (Capri Island, Italy) (AVI ’12). Association for Computing Machinery, New York, NY, USA, 241–248. https://doi.org/10.1145/2254556.2254600
[33]
Mandy Korzetz, Romina Kühn, Peter Heisig, and Thomas Schlegel. 2016. Natural Collocated Interactions for Merging Results with Mobile Devices. In Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct (Florence, Italy) (MobileHCI ’16). Association for Computing Machinery, New York, NY, USA, 746–752. https://doi.org/10.1145/2957265.2961839
[34]
Andre Kunert, Tim Weissker, Bernd Froehlich, and Alexander Kulik. 2020. Multi-Window 3D Interaction for Collaborative Virtual Reality. IEEE Transactions on Visualization and Computer Graphics 26, 11 (Nov 2020), 3271–3284. https://doi.org/10.1109/TVCG.2019.2914677
[35]
Ricardo Langner, Tom Horak, and Raimund Dachselt. 2016. Towards combining mobile devices for visual data exploration. In Poster Program of the 2016 IEEE Conference on Information Visualization (InfoVis), Vol. 10.
[36]
Ricardo Langner, Tom Horak, and Raimund Dachselt. 2018. VisTiles: Coordinating and Combining Co-located Mobile Devices for Visual Data Exploration. IEEE Transactions on Visualization and Computer Graphics 24, 1 (Jan 2018), 626–636. https://doi.org/10.1109/TVCG.2017.2744019
[37]
Ricardo Langner, Marc Satkowski, Wolfgang Büschel, and Raimund Dachselt. 2021. MARVIS: Combining Mobile Devices and Augmented Reality for Visual Data Analysis. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI ’21). Association for Computing Machinery, New York, NY, USA, Article 468, 17 pages. https://doi.org/10.1145/3411764.3445593
[38]
Ricardo Langner, Ulrich von Zadow, Tom Horak, Annett Mitschick, and Raimund Dachselt. 2016. Content Sharing Between Spatially-Aware Mobile Phones and Large Vertical Displays Supporting Collaborative Work. Springer International Publishing, Cham, 75–96. https://doi.org/10.1007/978-3-319-45853-3_5
[39]
Bongshin Lee, Petra Isenberg, Nathalie Henry Riche, and Sheelagh Carpendale. 2012. Beyond Mouse and Keyboard: Expanding Design Considerations for Information Visualization Interactions. IEEE Transactions on Visualization and Computer Graphics 18, 12 (Dec 2012), 2689–2698. https://doi.org/10.1109/TVCG.2012.204
[40]
Asterios Leonidis, Maria Korozi, Vasilios Kouroumalis, Emmanouil Adamakis, Dimitrios Milathianakis, and Constantine Stephanidis. 2021. Going Beyond Second Screens: Applications for the Multi-Display Intelligent Living Room. In ACM International Conference on Interactive Media Experiences (Virtual Event, USA) (IMX ’21). Association for Computing Machinery, New York, NY, USA, 187–193. https://doi.org/10.1145/3452918.3465486
[41]
Ming Li and Leif Kobbelt. 2012. Dynamic Tiling Display: Building an Interactive Display Surface Using Multiple Mobile Devices. In Proceedings of the 11th International Conference on Mobile and Ubiquitous Multimedia (Ulm, Germany) (MUM ’12). Association for Computing Machinery, New York, NY, USA, Article 24, 4 pages. https://doi.org/10.1145/2406367.2406397
[42]
Alessandro Liberati, Douglas Altman, Jennifer Tetzlaff, Cynthia Mulrow, Peter Gøtzsche, John Ioannidis, Mike Clarke, P.J. Devereaux, Joseph Kleijnen, and David Moher. 2009. The PRISMA Statement for Reporting Systematic Reviews and Meta-Analyses of Studies That Evaluate Health Care Interventions: Explanation and Elaboration. Journal of clinical epidemiology 62 (08 2009), e1–34. https://doi.org/10.1016/j.jclinepi.2009.06.006
[43]
Roman Lissermann, Simon Olberding, Benjamin Petry, Max Mühlhäuser, and Jürgen Steimle. 2012. PaperVideo: Interacting with Videos on Multiple Paper-like Displays. In Proceedings of the 20th ACM International Conference on Multimedia (Nara, Japan) (MM ’12). Association for Computing Machinery, New York, NY, USA, 129–138. https://doi.org/10.1145/2393347.2393372
[44]
Andrés Lucero, Jussi Holopainen, and Tero Jokela. 2011. Pass-Them-around: Collaborative Use of Mobile Phones for Photo Sharing. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Vancouver, BC, Canada) (CHI ’11). Association for Computing Machinery, New York, NY, USA, 1787–1796. https://doi.org/10.1145/1978942.1979201
[45]
Weizhou Luo, Eva Goebel, Patrick Reipschläger, Mats Ole Ellenberg, and Raimund Dachselt. 2021. Exploring and Slicing Volumetric Medical Data in Augmented Reality Using a Spatially-Aware Mobile Device. In 2021 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct). 334–339. https://doi.org/10.1109/ISMAR-Adjunct54149.2021.00076
[46]
Nicolai Marquardt, Till Ballendat, Sebastian Boring, Saul Greenberg, and Ken Hinckley. 2012. Gradual Engagement: Facilitating Information Exchange between Digital Devices as a Function of Proximity. In Proceedings of the 2012 ACM International Conference on Interactive Tabletops and Surfaces (Cambridge, Massachusetts, USA) (ITS ’12). Association for Computing Machinery, New York, NY, USA, 31–40. https://doi.org/10.1145/2396636.2396642
[47]
Nicolai Marquardt, Frederik Brudy, Can Liu, Ben Bengler, and Christian Holz. 2018. SurfaceConstellations: A Modular Hardware Platform for Ad-Hoc Reconfigurable Cross-Device Workspaces. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–14. https://doi.org/10.1145/3173574.3173928
[48]
Nicolai Marquardt, Nathalie Henry Riche, Christian Holz, Hugo Romat, Michel Pahud, Frederik Brudy, David Ledo, Chunjong Park, Molly Jane Nicholas, Teddy Seyed, Eyal Ofek, Bongshin Lee, William A.S. Buxton, and Ken Hinckley. 2021. AirConstellations: In-Air Device Formations for Cross-Device Interaction via Multiple Spatially-Aware Armatures. In The 34th Annual ACM Symposium on User Interface Software and Technology (Virtual Event, USA) (UIST ’21). Association for Computing Machinery, New York, NY, USA, 1252–1268. https://doi.org/10.1145/3472749.3474820
[49]
Nicolai Marquardt, Ken Hinckley, and Saul Greenberg. 2012. Cross-Device Interaction via Micro-Mobility and f-Formations. In Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology (Cambridge, Massachusetts, USA) (UIST ’12). Association for Computing Machinery, New York, NY, USA, 13–22. https://doi.org/10.1145/2380116.2380121
[50]
Meghna Mehta, Ahmed Sabbir Arif, Apurva Gupta, Sean DeLong, Roozbeh Manshaei, Graceline Williams, Manasvi Lalwani, Sanjay Chandrasekharan, and Ali Mazalek. 2016. Active Pathways: Using Active Tangibles and Interactive Tabletops for Collaborative Modeling in Systems Biology. In Proceedings of the 2016 ACM International Conference on Interactive Surfaces and Spaces (Niagara Falls, Ontario, Canada) (ISS ’16). Association for Computing Machinery, New York, NY, USA, 129–138. https://doi.org/10.1145/2992154.2992176
[51]
Till Nagel, Larissa Pschetz, Moritz Stefaner, Matina Halkia, and Boris Müller. 2009. mæve – An Interactive Tabletop Installation for Exploring Background Information in Exhibitions. In Human-Computer Interaction. Ambient, Ubiquitous and Intelligent Interaction, Julie A. Jacko (Ed.). Springer Berlin Heidelberg, Berlin, Heidelberg, 483–491. https://doi.org/10.1007/978-3-642-02580-8_53
[52]
Gary Perelman, Marcos Serrano, Christophe Bortolaso, Celia Picard, Mustapha Derras, and Emmanuel Dubois. 2019. Combining Tablets with Smartphones for Data Analytics. In Human-Computer Interaction – INTERACT 2019: 17th IFIP TC 13 International Conference, Paphos, Cyprus, September 2–6, 2019, Proceedings, Part IV (Paphos, Cyprus). Springer-Verlag, Berlin, Heidelberg, 439–460. https://doi.org/10.1007/978-3-030-29390-1_24
[53]
Tommaso Piazza, Morten Fjeld, Gonzalo Ramos, AsimEvren Yantac, and Shengdong Zhao. 2013. Holy Smartphones and Tablets, Batman! Mobile Interaction’s Dynamic Duo. In Proceedings of the 11th Asia Pacific Conference on Computer Human Interaction (Bangalore, India) (APCHI ’13). Association for Computing Machinery, New York, NY, USA, 63–72. https://doi.org/10.1145/2525194.2525205
[54]
Arnaud Prouzeau, Anastasia Bezerianos, and Olivier Chapuis. 2018. Awareness Techniques to Aid Transitions between Personal and Shared Workspaces in Multi-Display Environments. In Proceedings of the 2018 ACM International Conference on Interactive Surfaces and Spaces (Tokyo, Japan) (ISS ’18). Association for Computing Machinery, New York, NY, USA, 291–304. https://doi.org/10.1145/3279778.3279780
[55]
Jing Qian, Tongyu Zhou, Meredith Young-Ng, Jiaju Ma, Angel Cheung, Xiangyu Li, Ian Gonsher, and Jeff Huang. 2021. Portalware: Exploring Free-Hand AR Drawing with a Dual-Display Smartphone-Wearable Paradigm. In Proceedings of the 2021 ACM Designing Interactive Systems Conference (Virtual Event, USA) (DIS ’21). Association for Computing Machinery, New York, NY, USA, 205–219. https://doi.org/10.1145/3461778.3462098
[56]
Roman Rädle, Hans-Christian Jetter, Nicolai Marquardt, Harald Reiterer, and Yvonne Rogers. 2014. HuddleLamp: Spatially-Aware Mobile Displays for Ad-Hoc Around-the-Table Collaboration. In Proceedings of the Ninth ACM International Conference on Interactive Tabletops and Surfaces (Dresden, Germany) (ITS ’14). Association for Computing Machinery, New York, NY, USA, 45–54. https://doi.org/10.1145/2669485.2669500
[57]
Patrick Reipschläger and Raimund Dachselt. 2019. DesignAR: Immersive 3D-Modeling Combining Augmented Reality with Interactive Displays. In Proceedings of the 2019 ACM International Conference on Interactive Surfaces and Spaces (Daejeon, Republic of Korea) (ISS ’19). Association for Computing Machinery, New York, NY, USA, 29–41. https://doi.org/10.1145/3343055.3359718
[58]
Patrick Reipschläger, Severin Engert, and Raimund Dachselt. 2020. Augmented Displays: Seamlessly Extending Interactive Surfaces With Head-Mounted Augmented Reality. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI EA ’20). Association for Computing Machinery, New York, NY, USA, 1–4. https://doi.org/10.1145/3334480.3383138
[59]
Patrick Reipschlager, Tamara Flemisch, and Raimund Dachselt. 2021. Personal Augmented Reality for Information Visualization on Large Interactive Displays. IEEE Transactions on Visualization and Computer Graphics 27, 2 (Feb 2021), 1182–1192. https://doi.org/10.1109/TVCG.2020.3030460
[60]
Patrick Reipschläger, Burcu Kulahcioglu Ozkan, Aman Shankar Mathur, Stefan Gumhold, Rupak Majumdar, and Raimund Dachselt. 2018. DebugAR: Mixed Dimensional Displays for Immersive Debugging of Distributed Systems. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI EA ’18). Association for Computing Machinery, New York, NY, USA, 1–6. https://doi.org/10.1145/3170427.3188679
[61]
Johan Sanneblad and Lars Erik Holmquist. 2006. Ubiquitous Graphics: Combining Hand-Held and Wall-Size Displays to Interact with Large Images. In Proceedings of the Working Conference on Advanced Visual Interfaces (Venezia, Italy) (AVI ’06). Association for Computing Machinery, New York, NY, USA, 373–377. https://doi.org/10.1145/1133265.1133343
[62]
Marc Satkowski, Weizhou Luo, and Raimund Dachselt. 2021. Towards In-situ Authoring of AR Visualizations with Mobile Devices. In 2021 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct). 324–325. https://doi.org/10.1109/ISMAR-Adjunct54149.2021.00073
[63]
Dominik Schmidt, Julian Seifert, Enrico Rukzio, and Hans Gellersen. 2012. A Cross-Device Interaction Style for Mobiles and Surfaces. In Proceedings of the Designing Interactive Systems Conference (Newcastle Upon Tyne, United Kingdom) (DIS ’12). Association for Computing Machinery, New York, NY, USA, 318–327. https://doi.org/10.1145/2317956.2318005
[64]
Julian Seifert, Adalberto Simeone, Dominik Schmidt, Paul Holleis, Christian Reinartz, Matthias Wagner, Hans Gellersen, and Enrico Rukzio. 2012. MobiSurf: Improving Co-Located Collaboration through Integrating Mobile Devices and Interactive Surfaces. In Proceedings of the 2012 ACM International Conference on Interactive Tabletops and Surfaces (Cambridge, Massachusetts, USA) (ITS ’12). Association for Computing Machinery, New York, NY, USA, 51–60. https://doi.org/10.1145/2396636.2396644
[65]
Marcos Serrano, Barrett Ens, Xing-Dong Yang, and Pourang Irani. 2015. Gluey: Developing a Head-Worn Display Interface to Unify the Interaction Experience in Distributed Display Environments. In Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services (Copenhagen, Denmark) (MobileHCI ’15). Association for Computing Machinery, New York, NY, USA, 161–171. https://doi.org/10.1145/2785830.2785838
[66]
Hannah Snyder. 2019. Literature review as a research methodology: An overview and guidelines. Journal of Business Research 104 (08 2019), 333–339. https://doi.org/10.1016/j.jbusres.2019.07.039
[67]
Hendrik Sollich, Ulrich von Zadow, Tobias Pietzsch, Pavel Tomancak, and Raimund Dachselt. 2016. Exploring Time-Dependent Scientific Data Using Spatially Aware Mobiles and Large Displays. In Proceedings of the 2016 ACM International Conference on Interactive Surfaces and Spaces (Niagara Falls, Ontario, Canada) (ISS ’16). Association for Computing Machinery, New York, NY, USA, 349–354. https://doi.org/10.1145/2992154.2996779
[68]
Martin Spindler, Wolfgang Büschel, and Raimund Dachselt. 2012. Use Your Head: Tangible Windows for 3D Information Spaces in a Tabletop Environment. In Proceedings of the 2012 ACM International Conference on Interactive Tabletops and Surfaces (Cambridge, Massachusetts, USA) (ITS ’12). Association for Computing Machinery, New York, NY, USA, 245–254. https://doi.org/10.1145/2396636.2396674
[69]
Martin Spindler, Sophie Stellmach, and Raimund Dachselt. 2009. PaperLens: Advanced Magic Lens Interaction above the Tabletop. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (Banff, Alberta, Canada) (ITS ’09). Association for Computing Machinery, New York, NY, USA, 69–76. https://doi.org/10.1145/1731903.1731920
[70]
Martin Spindler, Christian Tominski, Heidrun Schumann, and Raimund Dachselt. 2010. Tangible Views for Information Visualization. In ACM International Conference on Interactive Tabletops and Surfaces (Saarbrücken, Germany) (ITS ’10). Association for Computing Machinery, New York, NY, USA, 157–166. https://doi.org/10.1145/1936652.1936684
[71]
Peter Tandler, Thorsten Prante, Christian Müller-Tomfelde, Norbert Streitz, and Ralf Steinmetz. 2001. Connectables: Dynamic Coupling of Displays for the Flexible Creation of Shared Workspaces. In Proceedings of the 14th Annual ACM Symposium on User Interface Software and Technology (Orlando, Florida) (UIST ’01). Association for Computing Machinery, New York, NY, USA, 11–20. https://doi.org/10.1145/502348.502351
[72]
Lucia Terrenghi, Aaron Quigley, and Alan Dix. 2009. A Taxonomy for and Analysis of Multi-Person-Display Ecosystems. Personal Ubiquitous Comput. 13, 8 (nov 2009), 583–598. https://doi.org/10.1007/s00779-009-0244-5
[73]
Christian Tominski, Stefan Gladisch, Ulrike Kister, Raimund Dachselt, and Heidrun Schumann. 2014. A Survey on Interactive Lenses in Visualization. In EuroVis - STARs, R. Borgo, R. Maciejewski, and I. Viola (Eds.). The Eurographics Association. https://doi.org/10.2312/eurovisstar.20141172
[74]
Paweł Wozniak, Nitesh Goyal, Przemysław Kucharski, Lars Lischke, Sven Mayer, and Morten Fjeld. 2016. RAMPARTS: Supporting Sensemaking with Spatially-Aware Mobile Interactions. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI ’16). Association for Computing Machinery, New York, NY, USA, 2447–2460. https://doi.org/10.1145/2858036.2858491
[75]
Paweł Woźniak, Lars Lischke, Benjamin Schmidt, Shengdong Zhao, and Morten Fjeld. 2014. Thaddeus: A Dual Device Interaction Space for Exploring Information Visualisation. In Proceedings of the 8th Nordic Conference on Human-Computer Interaction: Fun, Fast, Foundational (Helsinki, Finland) (NordiCHI ’14). Association for Computing Machinery, New York, NY, USA, 41–50. https://doi.org/10.1145/2639189.2639237
[76]
Ye Yuan, Nathalie Riche, Nicolai Marquardt, Molly Jane Nicholas, Teddy Seyed, Hugo Romat, Bongshin Lee, Michel Pahud, Jonathan Goldstein, Rojin Vishkaie, Christian Holz, and Ken Hinckley. 2022. Understanding Multi-Device Usage Patterns: Physical Device Configurations and Fragmented Workflows. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (New Orleans, LA, USA) (CHI ’22). Association for Computing Machinery, New York, NY, USA, Article 64, 22 pages. https://doi.org/10.1145/3491102.3517702
[77]
Johannes Zagermann, Ulrike Pfeil, Philipp von Bauer, Daniel Fink, and Harald Reiterer. 2020. "It’s in My Other Hand!" – Studying the Interplay of Interaction Techniques and Multi-Tablet Activities. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3313831.3376540
[78]
Kening Zhu, Morten Fjeld, and Ayça Ünlüer. 2018. WristOrigami: Exploring Foldable Design for Multi-Display Smartwatch. In Proceedings of the 2018 Designing Interactive Systems Conference (Hong Kong, China) (DIS ’18). Association for Computing Machinery, New York, NY, USA, 1207–1218. https://doi.org/10.1145/3196709.3196713
Index Terms
- A Design Space of Multi-Display Spatial Interactions for Visualization Tasks
Recommendations
Comparing Tangible and Multi-touch Interaction for Interactive Data Visualization Tasks
TEI '16: Proceedings of the TEI '16: Tenth International Conference on Tangible, Embedded, and Embodied InteractionInteractive visualization plays a key role in the analysis of large datasets. It can help users to explore data, investigate hypotheses and find patterns. The easier and more tangible the interaction, the more likely it is to enhance understanding. This ...
A Design Space for Trust-enabling Interaction Design
MIDI '14: Proceedings of the 2014 Mulitmedia, Interaction, Design and Innovation International Conference on Multimedia, Interaction, Design and InnovationThe purpose of this article is to introduce and assess the expressiveness of a design space for trust-enabling interaction design; or in other words aims to assess the extent to which the design space can explain/describe trust-enabling interactions. It ...
A Design Space of Visualization Tasks
Knowledge about visualization tasks plays an important role in choosing or building suitable visual representations to pursue them. Yet, tasks are a multi-faceted concept and it is thus not surprising that the many existing task taxonomies and models ...
Comments
Information & Contributors
Information
Published In
October 2023
505 pages
ISBN:9798400702815
DOI:10.1145/3607822
Copyright © 2023 Owner/Author.
This work is licensed under a Creative Commons Attribution International 4.0 License.
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 13 October 2023
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Funding Sources
Conference
Acceptance Rates
Overall Acceptance Rate 86 of 279 submissions, 31%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 779Total Downloads
- Downloads (Last 12 months)534
- Downloads (Last 6 weeks)62
Reflects downloads up to 08 Feb 2025
Other Metrics
Citations
View Options
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML FormatLogin options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in