research-article

Thaddeus: a dual device interaction space for exploring information visualisation

Authors:

Paweł Woźniak,

Benjamin Schmidt,

Shengdong Zhao,

Morten FjeldAuthors Info & Claims

NordiCHI '14: Proceedings of the 8th Nordic Conference on Human-Computer Interaction: Fun, Fast, Foundational

Pages 41 - 50

https://doi.org/10.1145/2639189.2639237

Published: 26 October 2014 Publication History

Abstract

This paper introduces Thaddeus---a mobile phone-tablet system for mobile interaction with information visualisations. Our work is motivated by the roles smartphones and tablets play in everyday interactive spaces as well as anticipated developments in mobile sensing technology. We also aim to meet the social challenges of a data-driven society. We designed and implemented a system that uses mutual spatial awareness as an input mode, producing new interaction patterns for mobile settings. We gathered extensive user insight from two design studies and evaluated the system in a controlled experiment. We used qualitative and quantitative measures in the final evaluation. The results show that the system does not have a significant impact on performance, but users perceive it as pleasurable and easy to use. Thaddeus offers an enhanced user experience when exploring information on the go, and provides insights for future designs of mobile multi-device systems.

Supplementary Material

MP4 File (p41-wozniak.mp4)

Download
28.39 MB

References

[1]

Alt, F., Kubitza, T., Bial, D., et al. Digifieds. Proceedings of MUM '11, ACM Press (2011), 165--174.

Digital Library

[2]

Ballagas, R., Rohs, M., Sheridan, J. G., and Borchers, J. BYOD: Bring Your Own Device. In Proceedings of the Workshop on Ubiquitous Display Environments, Ubicomp, (2004).

[3]

Ballendat, T., Marquardt, N., and Greenberg, S. Proxemic Interaction: Designing for a Proximity and Orientation-Aware Environment. ITS '10 ACM, (2010), 121--130.

Digital Library

[4]

Baudisch, P., Sinclair, M., and Wilson, A. Soap: a pointing device that works in mid-air. Proceedings of UIST '06, (2006), 43--46.

Digital Library

[5]

Bell, G. and Dourish, P. Yesterday's tomorrows: notes on ubiquitous computing's dominant vision. Personal Ubiquitous Comput. 11, 2 (2007), 133--143.

Digital Library

[6]

Butler, A., Izadi, S., and Hodges, S. SideSight: multi-"touch" interaction around small devices. Proceedings of UIST '08, ACM (2008), 201--204.

Digital Library

[7]

Chung, H., North, C., Self, J. Z., Chu, S., and Quek, F. VisPorter: facilitating information sharing for collaborative sensemaking on multiple displays. Personal and Ubiquitous Computing, (2013).

Digital Library

[8]

Churchill, E. F. From data divination to data-aware design. interactions 19, 5 (2012), 10--13.

Digital Library

[9]

Danesh, A., Inkpen, K., Lau, F., Shu, K., and Booth, K. Geney\texttrademark: designing a collaborative activity for the palm\texttrademark handheld computer. Proc. CHI '01, ACM (2001), 388--395.

Digital Library

[10]

Girouard, A., Tarun, A., and Vertegaal, R. DisplayStacks. Proceedings of CHI '12, ACM Press (2012), 2431.

Digital Library

[11]

Harrison, C. and Hudson, S. E. Minput. Proceedings of CHI '10, ACM Press (2010), 1661.

Digital Library

[12]

Hazas, M., Kray, C., Gellersen, H., Agbota, H., Kortuem, G., and Krohn, A. A relative positioning system for co-located mobile devices. Proceedings of MobileHCI '03, ACM (2005), 177--190.

Digital Library

[13]

Hinckley, K., Dixon, M., Sarin, R., Guimbretiere, F., and Balakrishnan, R. Codex: a dual screen tablet computer. Proceedings of CHI '09, ACM (2009), 1933--1942.

Digital Library

[14]

Hinckley, K., Ramos, G., Guimbretiere, F., Baudisch, P., and Smith, M. Stitching: pen gestures that span multiple displays. Proceedings of AVI '04, ACM Press (2004), 23.

Digital Library

[15]

Hwang, S., Ahn, M., and Wohn, K. MagGetz. Proceedings of UIST '13, ACM Press (2013), 411--416.

Digital Library

[16]

Ishii, H. and Ullmer, B. Tangible bits: towards seamless interfaces between people, bits and atoms. Proceedings of CHI '97, ACM (1997), 234--241.

Digital Library

[17]

Lissermann, R., Olberding, S., Petry, B., Mühlhäuser, M., and Steimle, J. PaperVideo: interacting with videos on multiple paper-like displays. Proceedings of MM '12, ACM Press (2012), 129.

Digital Library

[18]

Lucero, A., Holopainen, J., and Jokela, T. Pass-them-around: collaborative use of mobile phones for photo sharing. Proceedings of CHI '11, ACM Press (2011), 1787.

Digital Library

[19]

Lucero, A., Jokela, T., Palin, A., Aaltonen, V., and Nikara, J. EasyGroups: binding mobile devices for collaborative interactions. CHI EA '12, ACM Press (2012), 2189.

Digital Library

[20]

Merrill, D., Sun, E., and Kalanithi, J. Sifteo cubes. CHI EA '12, ACM (2012), 1015--1018.

Digital Library

[21]

Müller-Tomfelde, C., Grossman, T., and Wigdor, D. On, Above, and Beyond: Taking Tabletops to the Third Dimension. In Tabletops - Horizontal Interactive Displays. 2010, 277--299.

[22]

Nielsen, J. and Levy, J. Measuring usability: preference vs. performance. Communications of the ACM 37, 4 (1994), 66--75.

Digital Library

[23]

Peng, C., Shen, G., and Zhang, Y. BeepBeep: A high-accuracy acoustic-based system for ranging and localization using COTS devices. ACM Trans. Embed. Comput. Syst. 11, 1 (2012), 4:1--4:29.

Digital Library

[24]

Raj, B., Kalgaonkar, K., Harrison, C., and Dietz, P. Ultrasonic Doppler Sensing in HCI. Pervasive Computing, IEEE 11 (2012), 2, 24--29.

Digital Library

[25]

Rekimoto, J. Pick-and-drop: a direct manipulation technique for multiple computer environments. Proceedings of UIST '97, ACM (1997), 31--39.

Digital Library

[26]

Sahami Shirazi, A., Moghadam, P., Ketabdar, H., and Schmidt, A. Assessing the vulnerability of magnetic gestural authentication to video-based shoulder surfing attacks. Proceedings of CHI '12, ACM Press (2012), 2045.

Digital Library

[27]

Santosa, S. and Wigdor, D. A field study of multi-device workflows in distributed workspaces. Proceedings of UbiComp '13, ACM Press (2013), 63.

Digital Library

[28]

Schmidt, D., Seifert, J., Rukzio, E., and Gellersen, H. A cross-device interaction style for mobiles and surfaces. Proceedings of DIS '12, ACM Press (2012), 318.

Digital Library

[29]

Schneider, B., Strait, M., Muller, L., Elfenbein, S., Shaer, O., and Shen, C. Phylo-Genie: engaging students in collaborative 'tree-thinking' through tabletop techniques. Proceedings of CHI '12, ACM (2012), 3071--3080.

Digital Library

[30]

Schneider, B., Tobiasz, M., Willis, C., and Shen, C. WALDEN: multi-surface multi-touch simulation of climate change and species loss in thoreau's woods. Proc. ITS '12, ACM (2012), 387--390.

Digital Library

[31]

Schwarz, J., Klionsky, D., Harrison, C., Dietz, P., and Wilson, A. Phone as a pixel. Proceedings of CHI '12, ACM Press (2012), 2235.

Digital Library

[32]

Shaer, O., Mazalek, A., Ullmer, B., and Konkel, M. From Big Data to Insights: Opportunities and Challenges for TEI in Genomics. Proceedings of TEI '13, (2013).

Digital Library

[33]

Spindler, M., Martsch, M., and Dachselt, R. Going beyond the surface: studying multi-layer interaction above the tabletop. Proceedings of CHI '12, ACM (2012), 1277--1286.

Digital Library

[34]

Spindler, M., Tominski, C., Schumann, H., and Dachselt, R. Tangible views for information visualization. ACM ITS 2010, ACM (2010), 157--166.

Digital Library

[35]

Terrenghi, L., Kirk, D., Sellen, A., and Izadi, S. Affordances for manipulation of physical versus digital media on interactive surfaces. Proceedings of CHI '07, ACM Press (2007), 1157.

Digital Library

[36]

Weise, S., Hardy, J., Agarwal, P., Coulton, P., Friday, A., and Chiasson, M. Democratizing ubiquitous computing: a right for locality. Proc. Ubicomp 2012, ACM (2012), 521--530.

Digital Library

[37]

Weiser, M. Some computer science issues in ubiquitous computing. Commun. ACM 36, 7 (1993), 75--84.

Digital Library

[38]

Wu, A., Yim, J.-B., Caspary, E., Mazalek, A., Chandrasekharan, S., and Nersessian, N. J. Kinesthetic pathways: a tabletop visualization to support discovery in systems biology. Proceedings C&C '11, ACM (2011), 21--30.

Digital Library

[39]

Yang, X.-D., Mak, E., McCallum, D., Irani, P., Cao, X., and Izadi, S. LensMouse: augmenting the mouse with an interactive touch display. Proceedings of CHI '10, ACM (2010), 2431--2440.

Digital Library

[40]

Zickuhr, K. Tablet ownership 2013. Tablet, (2013).

Cited By

Xiao YLiu L(2024)User-Defined Interactions for Visual Data Exploration With the Combination of Smartwatch and Large DisplayIEEE Access10.1109/ACCESS.2024.340487612(78657-78679)Online publication date: 2024
https://doi.org/10.1109/ACCESS.2024.3404876
Gryphon KVu VChung H(2023)A Design Space of Multi-Display Spatial Interactions for Visualization TasksProceedings of the 2023 ACM Symposium on Spatial User Interaction10.1145/3607822.3614516(1-13)Online publication date: 13-Oct-2023
https://dl.acm.org/doi/10.1145/3607822.3614516
Beyeler MCheng YHolz C(2023)Cross-Device Shortcuts: Seamless Attention-guided Content Transfer via Opportunistic Deep Links between Apps and DevicesProceedings of the 25th International Conference on Multimodal Interaction10.1145/3577190.3614145(125-134)Online publication date: 9-Oct-2023
https://dl.acm.org/doi/10.1145/3577190.3614145
Show More Cited By

Index Terms

Thaddeus: a dual device interaction space for exploring information visualisation
1. Human-centered computing

Recommendations

Touch & Interact: touch-based interaction with a tourist application
MobileHCI '08: Proceedings of the 10th international conference on Human computer interaction with mobile devices and services

Touch & Interact is an interaction technique which combines mobile phones and public displays. The motivation for the project is to overcome the intrinsic output limitations of mobile phones. Touch & Interact extends the phone output to a public display ...
Touch & interact: touch-based interaction of mobile phones with displays
MobileHCI '08: Proceedings of the 10th international conference on Human computer interaction with mobile devices and services

The limited screen size and resolution of current mobile devices can still be problematic for map, multimedia and browsing applications. In this paper we present Touch & Interact: an interaction technique in which a mobile phone is able to touch a ...
PalmSpace: continuous around-device gestures vs. multitouch for 3D rotation tasks on mobile devices
AVI '12: Proceedings of the International Working Conference on Advanced Visual Interfaces

Rotating 3D objects is a difficult task on mobile devices, because the task requires 3 degrees of freedom and (multi-)touch input only allows for an indirect mapping. We propose a novel style of mobile interaction based on mid-air gestures in proximity ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

NordiCHI '14: Proceedings of the 8th Nordic Conference on Human-Computer Interaction: Fun, Fast, Foundational

October 2014

361 pages

ISBN:9781450325424

DOI:10.1145/2639189

General Chairs:
Virpi Roto,
Jonna Häkkilä,
Program Chairs:
Kaisa Väänänen-Vainio-Mattila,
Oskar Juhlin,
Publications Chairs:
Thomas Olsson,
Ebba Hvannberg

Copyright © 2014 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

In-Cooperation

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 October 2014

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Conference

NordiCHI '14

NordiCHI '14: The 8th Nordic Conference on Human-Computer Interaction

October 26 - 30, 2014

Helsinki, Finland

Acceptance Rates

NordiCHI '14 Paper Acceptance Rate 89 of 361 submissions, 25%;

Overall Acceptance Rate 379 of 1,572 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

23
Total Citations
View Citations
543
Total Downloads

Downloads (Last 12 months)13
Downloads (Last 6 weeks)1

Reflects downloads up to 16 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Xiao YLiu L(2024)User-Defined Interactions for Visual Data Exploration With the Combination of Smartwatch and Large DisplayIEEE Access10.1109/ACCESS.2024.340487612(78657-78679)Online publication date: 2024
https://doi.org/10.1109/ACCESS.2024.3404876
Gryphon KVu VChung H(2023)A Design Space of Multi-Display Spatial Interactions for Visualization TasksProceedings of the 2023 ACM Symposium on Spatial User Interaction10.1145/3607822.3614516(1-13)Online publication date: 13-Oct-2023
https://dl.acm.org/doi/10.1145/3607822.3614516
Beyeler MCheng YHolz C(2023)Cross-Device Shortcuts: Seamless Attention-guided Content Transfer via Opportunistic Deep Links between Apps and DevicesProceedings of the 25th International Conference on Multimodal Interaction10.1145/3577190.3614145(125-134)Online publication date: 9-Oct-2023
https://dl.acm.org/doi/10.1145/3577190.3614145
Marquardt NHenry Riche NHolz CRomat HPahud MBrudy FLedo DPark CNicholas MSeyed TOfek ELee BBuxton WHinckley K(2021)AirConstellations: In-Air Device Formations for Cross-Device Interaction via Multiple Spatially-Aware ArmaturesThe 34th Annual ACM Symposium on User Interface Software and Technology10.1145/3472749.3474820(1252-1268)Online publication date: 10-Oct-2021
https://dl.acm.org/doi/10.1145/3472749.3474820
Langner RSatkowski MBüschel WDachselt RKitamura YQuigley AIsbister KIgarashi TBjørn PDrucker S(2021)MARVIS: Combining Mobile Devices and Augmented Reality for Visual Data AnalysisProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445593(1-17)Online publication date: 6-May-2021
https://dl.acm.org/doi/10.1145/3411764.3445593
Zhu FGrossman TBernhaupt RMueller FVerweij DAndres JMcGrenere JCockburn AAvellino IGoguey ABjørn PZhao SSamson BKocielnik R(2020)BISHARE: Exploring Bidirectional Interactions Between Smartphones and Head-Mounted Augmented RealityProceedings of the 2020 CHI Conference on Human Factors in Computing Systems10.1145/3313831.3376233(1-14)Online publication date: 21-Apr-2020
https://dl.acm.org/doi/10.1145/3313831.3376233
Almeida NTeixeira ASilva SKetsmur M(2019)The AM4I Architecture and Framework for Multimodal Interaction and Its Application to Smart EnvironmentsSensors10.3390/s1911258719:11(2587)Online publication date: 6-Jun-2019
https://doi.org/10.3390/s19112587
Horak TMathisen AKlokmose CDachselt RElmqvist NBrewster SFitzpatrick GCox AKostakos V(2019)VistributeProceedings of the 2019 CHI Conference on Human Factors in Computing Systems10.1145/3290605.3300846(1-13)Online publication date: 2-May-2019
https://dl.acm.org/doi/10.1145/3290605.3300846
Brudy FHolz CRädle RWu CHouben SKlokmose CMarquardt NBrewster SFitzpatrick GCox AKostakos V(2019)Cross-Device TaxonomyProceedings of the 2019 CHI Conference on Human Factors in Computing Systems10.1145/3290605.3300792(1-28)Online publication date: 2-May-2019
https://dl.acm.org/doi/10.1145/3290605.3300792
Perelman GSerrano MBortolaso CPicard CDerras MDubois E(2019)Combining Tablets with Smartphones for Data AnalyticsHuman-Computer Interaction – INTERACT 201910.1007/978-3-030-29390-1_24(439-460)Online publication date: 2-Sep-2019
https://dl.acm.org/doi/10.1007/978-3-030-29390-1_24
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents