Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

Multitouch Interaction with Parallel Coordinates on Large Vertical Displays

Published: 04 November 2020 Publication History

Abstract

This paper presents a multitouch vocabulary for interacting with parallel coordinates plots on wall-sized displays. The gesture set relies on principles such as two-finger range definition, a functional distinction of background and foreground for applying the Hold-and-Move concept to wall-sized displays as well as fling-based interaction for triggering and controlling long-range movements. Our implementation demonstrates that out-of-reach problems and limitations regarding multitouch technology and display size can be tackled by the coherent integration of our multitouch gestures. Expert reviews indicate that our gesture vocabulary helps to solve typical analysis tasks that require interaction beyond arms' reach, and it also shows how often certain gestures were used.

Supplementary Material

MP4 File (v4issa199.mp4)
Supplemental video

References

[1]
Christopher Andrews, Alex Endert, and Chris North. 2010. Space to think: large high-resolution displays for sensemaking. In Proceedings of the 28th International Conference on Human Factors in Computing Systems, CHI 2010, Atlanta, Georgia, USA, April 10--15, 2010, Elizabeth D. Mynatt, Don Schoner, Geraldine Fitzpatrick, Scott E. Hudson, W. Keith Edwards, and Tom Rodden (Eds.). ACM, 55--64. https://doi.org/10.1145/1753326.1753336
[2]
Christopher Andrews, Alex Endert, Beth Yost, and Chris North. 2011. Information visualization on large, high-resolution displays: Issues, challenges, and opportunities. Information Visualization, Vol. 10, 4 (2011), 341--355. https://doi.org/10.1177/1473871611415997
[3]
Robert Ball and Chris North. 2007. Realizing embodied interaction for visual analytics through large displays. Comput. Graph., Vol. 31, 3 (2007), 380--400. https://doi.org/10.1016/j.cag.2007.01.029
[4]
Robert Ball, Chris North, and Doug A. Bowman. 2007. Move to improve: promoting physical navigation to increase user performance with large displays. In Proceedings of the 2007 Conference on Human Factors in Computing Systems, CHI 2007, San Jose, California, USA, April 28 - May 3, 2007, Mary Beth Rosson and David J. Gilmore (Eds.). ACM, 191--200. https://doi.org/10.1145/1240624.1240656
[5]
Dominikus Baur, Bongshin Lee, and Sheelagh Carpendale. 2012. TouchWave: kinetic multi-touch manipulation for hierarchical stacked graphs. In Interactive Tabletops and Surfaces, ITS'12, Cambridge/Boston, MA, USA, November 11--14, 2012, Orit Shaer, Chia Shen, Meredith Ringel Morris, and Michael S. Horn (Eds.). ACM, 255--264. https://doi.org/10.1145/2396636.2396675
[6]
Anastasia Bezerianos and Petra Isenberg. 2012. Perception of Visual Variables on Tiled Wall-Sized Displays for Information Visualization Applications. IEEE Trans. Vis. Comput. Graph., Vol. 18, 12 (2012), 2516--2525. https://doi.org/10.1109/TVCG.2012.251
[7]
John Brooke. 1996. SUS--A quick and dirty usability scale. Usability evaluation in industry, Vol. 189, 194 (1996), 4--7.
[8]
Thorsten Bü ring, Jens Gerken, and Harald Reiterer. 2006. User Interaction with Scatterplots on Small Screens - A Comparative Evaluation of Geometric-Semantic Zoom and Fisheye Distortion. IEEE Trans. Vis. Comput. Graph., Vol. 12, 5 (2006), 829--836. https://doi.org/10.1109/TVCG.2006.187
[9]
Mohammad Chegini, Shao Lin, Dirk Joachim Lehmann, Keith Andrews, and Tobias Schreck. 2017. Interaction Concepts for Collaborative Visual Analysis of Scatterplots on Large Vertically-Mounted High-Resolution Multi-Touch Displays. In Proceedings of the 10th Forum Media Technology and 3rd All Around Audio Symposium, St. Pö lten, Austria, November 29--30, 2017 (CEUR Workshop Proceedings, Vol. 2009), Wolfgang Aigner, Thomas Moser, Kerstin Blumenstein, Matthias Zeppelzauer, Michael Iber, and Grischa Schmiedl (Eds.). CEUR-WS.org, 90--96. http://ceur-ws.org/Vol-2009/fmt-proceedings-2017-paper13.pdf
[10]
Raimund Dachselt and Robert Buchholz. 2009. Natural throw and tilt interaction between mobile phones and distant displays. In Proceedings of the 27th International Conference on Human Factors in Computing Systems, CHI 2009, Extended Abstracts Volume, Boston, MA, USA, April 4--9, 2009, Dan R. Olsen Jr., Richard B. Arthur, Ken Hinckley, Meredith Ringel Morris, Scott E. Hudson, and Saul Greenberg (Eds.). ACM, 3253--3258. https://doi.org/10.1145/1520340.1520467
[11]
Steven Mark Drucker, Danyel Fisher, Ramik Sadana, Jessica Herron, and m. c. schraefel. 2013. TouchViz: a case study comparing two interfaces for data analytics on tablets. In 2013 ACM SIGCHI Conference on Human Factors in Computing Systems, CHI '13, Paris, France, April 27 - May 2, 2013, Wendy E. Mackay, Stephen A. Brewster, and Susanne Bødker (Eds.). ACM, 2301--2310. https://doi.org/10.1145/2470654.2481318
[12]
Niklas Elmqvist, Pierre Dragicevic, and Jean-Daniel Fekete. 2008. Rolling the Dice: Multidimensional Visual Exploration using Scatterplot Matrix Navigation. IEEE Trans. Vis. Comput. Graph., Vol. 14, 6 (2008), 1539--1148. https://doi.org/10.1109/TVCG.2008.153
[13]
G. W. Furnas. 1986. Generalized Fisheye Views. SIGCHI Bull., Vol. 17, 4 (April 1986), 16--23. https://doi.org/10.1145/22339.22342
[14]
Jé ré mie Gilliot, Gé ry Casiez, and Nicolas Roussel. 2014. Direct and indirect multi-touch interaction on a wall display. In Proceedings of the 26th Conference on l'Interaction Homme-Machine, Villeneuve d'Ascq, France, October 28--31, 2014, Gé ry Casiez, Thomas Pietrzak, Olivier Chapuis, and Sté phane Conversy (Eds.). ACM, 147--152. https://doi.org/10.1145/2670444.2670445
[15]
Faizan Haque, Mathieu Nancel, and Daniel Vogel. 2015. Myopoint: Pointing and Clicking Using Forearm Mounted Electromyography and Inertial Motion Sensors. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, CHI 2015, Seoul, Republic of Korea, April 18--23, 2015, Bo Begole, Jinwoo Kim, Kori Inkpen, and Woontack Woo (Eds.). ACM, 3653--3656. https://doi.org/10.1145/2702123.2702133
[16]
Mathias Heilig, Stephan Huber, Mischa Demarmels, and Harald Reiterer. 2010. ScatterTouch: a multi touch rubber sheet scatter plot visualization for co-located data exploration. In ACM International Conference on Interactive Tabletops and Surfaces, ITS 2010, Saarbrü cken, Germany, November 7--10, 2010, Antonio Krü ger, Johannes Schö ning, Daniel Wigdor, and Michael Haller (Eds.). ACM, 263--264. https://doi.org/10.1145/1936652.1936707
[17]
Julian Heinrich and Daniel Weiskopf. 2013. State of the Art of Parallel Coordinates. In Eurographics 2013 - State of the Art Reports, Girona, Spain, May 6--10, 2013, Mateu Sbert and Lá szló Szirmay-Kalos (Eds.). Eurographics Association, 95--116. https://doi.org/10.2312/conf/EG2013/stars/095--116
[18]
Tom Horak, Sriram Karthik Badam, Niklas Elmqvist, and Raimund Dachselt. 2018. When David Meets Goliath: Combining Smartwatches with a Large Vertical Display for Visual Data Exploration. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, CHI 2018, Montreal, QC, Canada, April 21--26, 2018, Regan L. Mandryk, Mark Hancock, Mark Perry, and Anna L. Cox (Eds.). ACM, 19. https://doi.org/10.1145/3173574.3173593
[19]
Mikkel R. Jakobsen and Kasper Hornbæk. 2015. Is Moving Improving?: Some Effects of Locomotion in Wall-Display Interaction. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, CHI 2015, Seoul, Republic of Korea, April 18--23, 2015, Bo Begole, Jinwoo Kim, Kori Inkpen, and Woontack Woo (Eds.). ACM, 4169--4178. https://doi.org/10.1145/2702123.2702312
[20]
Ulrike Kister, Konstantin Klamka, Christian Tominski, and Raimund Dachselt. 2017. GraSp: Combining Spatially-aware Mobile Devices and a Display Wall for Graph Visualization and Interaction. Comput. Graph. Forum, Vol. 36, 3 (2017), 503--514. https://doi.org/10.1111/cgf.13206
[21]
Robert Kosara. 2011. Indirect multi-touch interaction for brushing in parallel coordinates. In Visualization and Data Analysis 2011, San Francisco Airport, CA, USA, January 24--25, 2011 (SPIE Proceedings, Vol. 7868), Pak Chung Wong, Jinah Park, Ming C. Hao, Chaomei Chen, Katy Bö rner, David L. Kao, and Jonathan C. Roberts (Eds.). SPIE, 786809. https://doi.org/10.1117/12.872645
[22]
Alexander Kulik, Jan Dittrich, and Bernd Froehlich. 2012. The hold-and-move gesture for multi-touch interfaces. In Mobile HCI '12, Proceedings of the 14th international conference on Human-computer interaction with mobile devices and services, San Francsico, CA, USA, September 21--24, 2012, Elizabeth F. Churchill, Sriram Subramanian, Patrick Baudisch, and Kenton O'Hara (Eds.). ACM, 49--58. https://doi.org/10.1145/2371574.2371583
[23]
Ricardo Langner, Ulrike Kister, and Raimund Dachselt. 2019. Multiple Coordinated Views at Large Displays for Multiple Users: Empirical Findings on User Behavior, Movements, and Distances. IEEE Trans. Vis. Comput. Graph., Vol. 25, 1 (2019), 608--618. https://doi.org/10.1109/TVCG.2018.2865235
[24]
Bongshin Lee, Petra Isenberg, Nathalie Henry Riche, and Sheelagh Carpendale. 2012. Beyond Mouse and Keyboard: Expanding Design Considerations for Information Visualization Interactions. IEEE Trans. Vis. Comput. Graph., Vol. 18, 12 (2012), 2689--2698. https://doi.org/10.1109/TVCG.2012.204
[25]
Lars Lischke, Sven Mayer, Jan Hoffmann, Philipp Kratzer, Stephan Roth, Katrin Wolf, and Pawel Wozniak. 2017. Interaction techniques for window management on large high-resolution displays. In Proceedings of the 16th International Conference on Mobile and Ubiquitous Multimedia, MUM 2017, Stuttgart, Germany, November 26 - 29, 2017, Niels Henze, Pawel Wozniak, Kaisa V"a "a n"a nen, Julie Williamson, and Stefan Schneegass (Eds.). ACM, 241--247. https://doi.org/10.1145/3152832.3152852
[26]
Can Liu, Olivier Chapuis, Michel Beaudouin-Lafon, Eric Lecolinet, and Wendy E. Mackay. 2014. Effects of display size and navigation type on a classification task. In CHI Conference on Human Factors in Computing Systems, CHI'14, Toronto, ON, Canada - April 26 - May 01, 2014, Matt Jones, Philippe A. Palanque, Albrecht Schmidt, and Tovi Grossman (Eds.). ACM, 4147--4156. https://doi.org/10.1145/2556288.2557020
[27]
Mingyu Liu, Mathieu Nancel, and Daniel Vogel. 2015. Gunslinger: Subtle Arms-down Mid-air Interaction. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology, UIST 2015, Charlotte, NC, USA, November 8--11, 2015, Celine Latulipe, Bjoern Hartmann, and Tovi Grossman (Eds.). ACM, 63--71. https://doi.org/10.1145/2807442.2807489
[28]
Meredith Ringel Morris, Andreea Danielescu, Steven Mark Drucker, Danyel Fisher, Bongshin Lee, m. c. schraefel, and Jacob O. Wobbrock. 2014. Reducing legacy bias in gesture elicitation studies. Interactions, Vol. 21, 3 (2014), 40--45. https://doi.org/10.1145/2591689
[29]
Mathieu Nancel, Julie Wagner, Emmanuel Pietriga, Olivier Chapuis, and Wendy E. Mackay. 2011. Mid-air pan-and-zoom on wall-sized displays. In Proceedings of the International Conference on Human Factors in Computing Systems, CHI 2011, Vancouver, BC, Canada, May 7--12, 2011, Desney S. Tan, Saleema Amershi, Bo Begole, Wendy A. Kellogg, and Manas Tungare (Eds.). ACM, 177--186. https://doi.org/10.1145/1978942.1978969
[30]
Jakob Nielsen. 1993. Usability engineering .Academic Press.
[31]
PQLabs. [n.d.]. Support Center. https://www.pqlabs.com/support_wall.html. Accessed: 03/2019.
[32]
Arnaud Prouzeau, Anastasia Bezerianos, and Olivier Chapuis. 2017. Evaluating Multi-User Selection for Exploring Graph Topology on Wall-Displays. IEEE Trans. Vis. Comput. Graph., Vol. 23, 8 (2017), 1936--1951. https://doi.org/10.1109/TVCG.2016.2592906
[33]
Renata G. Raidou, Martin Eisemann, Marcel Breeuwer, Elmar Eisemann, and Anna Vilanova. 2016. Orientation-Enhanced Parallel Coordinate Plots. IEEE Trans. Vis. Comput. Graph., Vol. 22, 1 (2016), 589--598. https://doi.org/10.1109/TVCG.2015.2467872
[34]
Fateme Rajabiyazdi, Jagoda Walny, Carrie Mah, John Brosz, and Sheelagh Carpendale. 2015. Understanding Researchers' Use of a Large, High-Resolution Display Across Disciplines. In Proceedings of the 2015 International Conference on Interactive Tabletops & Surfaces, ITS 2015, Funchal, Portugal, November 15--18, 2015, Nuno Jardim Nunes, Enrico Costanza, Patrick Olivier, and Johannes Schö ning (Eds.). ACM, 107--116. https://doi.org/10.1145/2817721.2817735
[35]
Khairi Reda, Andrew E. Johnson, Michael E. Papka, and Jason Leigh. 2015. Effects of Display Size and Resolution on User Behavior and Insight Acquisition in Visual Exploration. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, CHI 2015, Seoul, Republic of Korea, April 18--23, 2015, Bo Begole, Jinwoo Kim, Kori Inkpen, and Woontack Woo (Eds.). ACM, 2759--2768. https://doi.org/10.1145/2702123.2702406
[36]
Patrick Riehmann, Gabriela Molina León, Joshua Reibert, Florian Echtler, and Bernd Froehlich. 2020. Short-Contact Touch-Manipulation of Scatterplot Matrices on Wall Displays. Computer Graphics Forum (2020). https://doi.org/10.1111/cgf.13979
[37]
Patrick Riehmann, Joshua Reibert, Jens Opolka, and Bernd Frö hlich. 2018. Touch the Time: Touch-Centered Interaction Paradigms for Time-Oriented Data. In Eurographics Conference on Visualization, EuroVis 2018, Short Papers, Brno, Czech Republic, 4--8 June 2018, Jimmy Johansson, Filip Sadlo, and Tobias Schreck (Eds.). Eurographics Association, 113--117. https://doi.org/10.2312/eurovisshort.20181088
[38]
Jonathan C. Roberts, Panagiotis D. Ritsos, Sriram Karthik Badam, Dominique Brodbeck, Jessie Kennedy, and Niklas Elmqvist. 2014. Visualization beyond the Desktop-the Next Big Thing. IEEE Computer Graphics and Applications, Vol. 34, 6 (2014), 26--34. https://doi.org/10.1109/MCG.2014.82
[39]
Richard C. Roberts, Robert S. Laramee, Gary A. Smith, Paul Brookes, and Tony D'Cruze. 2019. Smart Brushing for Parallel Coordinates. IEEE Trans. Vis. Comput. Graph., Vol. 25, 3 (2019), 1575--1590. https://doi.org/10.1109/TVCG.2018.2808969
[40]
George G. Robertson, Mary Czerwinski, Patrick Baudisch, Brian Meyers, Daniel C. Robbins, Greg Smith, and Desney S. Tan. 2005. The Large-Display User Experience. IEEE Computer Graphics and Applications, Vol. 25, 4 (2005), 44--51. https://doi.org/10.1109/MCG.2005.88
[41]
V'i t Rusná k, Caroline Appert, Olivier Chapuis, and Emmanuel Pietriga. 2018. Designing Coherent Gesture Sets for Multi-scale Navigation on Tabletops. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, CHI 2018, Montreal, QC, Canada, April 21--26, 2018, Regan L. Mandryk, Mark Hancock, Mark Perry, and Anna L. Cox (Eds.). ACM, 142. https://doi.org/10.1145/3173574.3173716
[42]
Jeffrey M. Rzeszotarski and Aniket Kittur. 2014. Kinetica: naturalistic multi-touch data visualization. In CHI Conference on Human Factors in Computing Systems, CHI'14, Toronto, ON, Canada - April 26 - May 01, 2014, Matt Jones, Philippe A. Palanque, Albrecht Schmidt, and Tovi Grossman (Eds.). ACM, 897--906. https://doi.org/10.1145/2556288.2557231
[43]
Ramik Sadana, Meeshu Agnihotri, and John T. Stasko. 2018. Touching Data: A Discoverability-based Evaluation of a Visualization Interface for Tablet Computers. CoRR, Vol. abs/1806.06084 (2018). arxiv: 1806.06084 http://arxiv.org/abs/1806.06084
[44]
Ramik Sadana and John T. Stasko. 2014. Designing and implementing an interactive scatterplot visualization for a tablet computer. In International Working Conference on Advanced Visual Interfaces, AVI 2014, Como, Italy, May 27--29, 2014, Paolo Paolini and Franca Garzotto (Eds.). ACM, 265--272. https://doi.org/10.1145/2598153.2598163
[45]
Ramik Sadana and John T. Stasko. 2016. Designing Multiple Coordinated Visualizations for Tablets. Comput. Graph. Forum, Vol. 35, 3 (2016), 261--270. https://doi.org/10.1111/cgf.12902
[46]
Arjun Srinivasan, Bongshin Lee, Nathalie Henry Riche, Steven M. Drucker, and Ken Hinckley. 2020. InChorus: Designing Consistent Multimodal Interactions for Data Visualization on Tablet Devices. In CHI '20: CHI Conference on Human Factors in Computing Systems, Honolulu, HI, USA, April 25--30, 2020, Regina Bernhaupt, Florian 'Floyd' Mueller, David Verweij, Josh Andres, Joanna McGrenere, Andy Cockburn, Ignacio Avellino, Alix Goguey, Pernille Bjøn, Shengdong Zhao, Briane Paul Samson, and Rafal Kocielnik (Eds.). ACM, 1--13. https://doi.org/10.1145/3313831.3376782
[47]
Theophanis Tsandilas, Anastasia Bezerianos, and Thibaut Jacob. 2015. SketchSliders: Sketching Widgets for Visual Exploration on Wall Displays. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, CHI 2015, Seoul, Republic of Korea, April 18--23, 2015, Bo Begole, Jinwoo Kim, Kori Inkpen, and Woontack Woo (Eds.). ACM, 3255--3264. https://doi.org/10.1145/2702123.2702129
[48]
Ulrich von Zadow, Wolfgang Bü schel, Ricardo Langner, and Raimund Dachselt. 2014. SleeD: Using a Sleeve Display to Interact with Touch-sensitive Display Walls. In Proceedings of the Ninth ACM International Conference on Interactive Tabletops and Surfaces, ITS 2014, Dresden, Germany, November 16 - 19, 2014, Raimund Dachselt, T. C. Nicholas Graham, Kasper Hornbæk, and Miguel A. Nacenta (Eds.). ACM, 129--138. https://doi.org/10.1145/2669485.2669507
[49]
Bowen Yu and Xiaoru Yuan. 2011. Parallel Coordinates on iPad. In Poster Proceedings of IEEE Pacific Visualization Symposium (PacificVis 2011). IEEE, 21--22.

Cited By

View all
  • (2024)Interactive Visualization on Large High‐Resolution Displays: A SurveyComputer Graphics Forum10.1111/cgf.1500143:6Online publication date: 30-Apr-2024
  • (2024)Dual-Thumb pointing and command selection techniques for tabletsInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2023.103203184(103203)Online publication date: Apr-2024
  • (2022)Research on the Multi-Screen Connection Interaction Method Based on Regular Octagon K-Value Template MatchingSymmetry10.3390/sym1408152814:8(1528)Online publication date: 26-Jul-2022

Recommendations

Comments

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Human-Computer Interaction
Proceedings of the ACM on Human-Computer Interaction  Volume 4, Issue ISS
ISS
November 2020
488 pages
EISSN:2573-0142
DOI:10.1145/3433930
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 04 November 2020
Published in PACMHCI Volume 4, Issue ISS

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. focus + context
  2. large high-resolution displays
  3. multitouch
  4. parallel coordinates plots

Qualifiers

  • Research-article

Funding Sources

  • German Aerospace Center (DLR)

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)28
  • Downloads (Last 6 weeks)2
Reflects downloads up to 16 Oct 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Interactive Visualization on Large High‐Resolution Displays: A SurveyComputer Graphics Forum10.1111/cgf.1500143:6Online publication date: 30-Apr-2024
  • (2024)Dual-Thumb pointing and command selection techniques for tabletsInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2023.103203184(103203)Online publication date: Apr-2024
  • (2022)Research on the Multi-Screen Connection Interaction Method Based on Regular Octagon K-Value Template MatchingSymmetry10.3390/sym1408152814:8(1528)Online publication date: 26-Jul-2022

View Options

Get Access

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media