research-article

DisplayPointers: seamless cross-device interactions

Author:

Paul StrohmeierAuthors Info & Claims

ACE '15: Proceedings of the 12th International Conference on Advances in Computer Entertainment Technology

Article No.: 4, Pages 1 - 8

https://doi.org/10.1145/2832932.2832958

Published: 16 November 2015 Publication History

Abstract

We present a system for cross-device interactions and interaction scenarios based on touch events between devices. DisplayPointers were designed to explore the affordances of manipulating physical display-objects in multi-device environments. The interactions presented in this paper are an exploration of what a touch between two devices means; a search for a language of physical cross-device interactions. DisplayPointers are implemented by augmenting off-the-shelf devices: our system is fully mobile and can be easily implemented by other researchers and designers.

Supplementary Material

MP4 File (a4-strohmeier.mp4)

Download
36.20 MB

References

[1]

Alissa Antle and Sijie Wang. 2013. Comparing motor-cognitive strategies for spatial problem solving with tangible and multi-touch interfaces. Proceedings of the 7th International Conference on tangible, embedded and embodied interaction: 65--72. http://doi.org/10.1145/2460625.2460635

Digital Library

[2]

Peter Bennett, Stuart Nolan, Ved Uttamchandani, Michael Pages, Kirsten Cater, and Mike Fraser. 2015. Resonant Bits. Proceedings of the Ninth International Conference on Tangible, Embedded, and Embodied Interaction - TEI '14, ACM Press, 49--52. http://doi.org/10.1145/2677199.2680569

Digital Library

[3]

E. A. Bier, M. C. Stone, Ken Pier, William Buxton, and T. D. DeRose. 1993. Toolglass and magic lenses: the see-through interface. Proceedings of the 20th annual conference on Computer graphics and interactive techniques, ACM, 73--80. http://doi.org/10.1145/166117.166126

Digital Library

[4]

Liwei Chan, Stefanie Müller, Anne Roudaut, and Patrick Baudisch. 2012. CapStones and ZebraWidgets. Proceedings of the 2012 ACM annual conference on Human Factors in Computing Systems - CHI '12, 2189. http://doi.org/10.1145/2207676.2208371

Digital Library

[5]

Nicholas Chen, François Guimbretière, and Abigail Sellen. 2013. Graduate student use of a multi-slate reading system. Proc CHI, ACM Press, 1799. http://doi.org/10.1145/2470654.2466237

Digital Library

[6]

A Clark. 1998. Being there: putting brain, body and world back together again. MIT Press.

Digital Library

[7]

Christopher Collins and Sheelagh Carpendale. 2007. VisLink: Revealing relationships amongst visualizations. IEEE Transactions on Visualization and Computer Graphics 13, 6: 1192--1199. http://doi.org/10.1109/TVCG.2007.70521

Digital Library

[8]

Augusto Esteves, Saskia Bakker, Alissa N Antle, Aaron May, Jillian Warren, and Ian Oakley. 2015. The ATB Framework: Quantifying and Classifying Epistemic Strategies in Tangible Problem-Solving Tasks. 13--20. http://doi.org/10.1145/2677199.2680546

Digital Library

[9]

George W. Fitzmaurice. 1993. Situated information spaces and spatially aware palmtop computers. Communications of the ACM 36, 7: 39--49. http://doi.org/10.1145/159544.159566

Digital Library

[10]

Antonio Gomes and Roel Vertegaal. 2014. Paperfold. Proceedings of the extended abstracts of the 32nd annual ACM conference on Human factors in computing systems - CHI EA '14, 535--538. http://doi.org/10.1145/2559206.2574770

Digital Library

[11]

Peter Hamilton and Daniel J. Wigdor. 2014. Conductor. Proceedings of the 32nd annual ACM conference on Human factors in computing systems - CHI '14, ACM Press, 2773--2782. http://doi.org/10.1145/2556288.2557170

Digital Library

[12]

Ken Hinckley, Morgan Dixon, Raman Sarin, Francois Guimbretiere, and Ravin Balakrishnan. 2009. Codex: A Dual Screen Tablet Computer. Design: 1933--1942. http://doi.org/10.1145/1518701.1518996

Digital Library

[13]

Ken Hinckley and Hyunyoung Song. 2011. Sensor Synaesthesia: Touch in Motion, and Motion in Touch. Proceedings of the 2011 annual conference on Human factors in computing systems - CHI '11, ACM Press, 801. http://doi.org/10.1145/1978942.1979059

Digital Library

[14]

Ken Hinckley. 2003. Synchronous gestures for multiple persons and computers. Proceedings of the 16th annual ACM symposium on User interface software and technology - UIST '03, ACM Press, 149--158. http://doi.org/10.1145/964696.964713

Digital Library

[15]

David Holman, Roel Vertegaal, Mark Altosaar, Nikolaus Troje, and Derek Johns. 2005. Paper Windows. Proceedings of the SIGCHI conference on Human factors in computing systems - CHI '05, ACM Press, 591. http://doi.org/10.1145/1054972.1055054

[16]

Mohammadreza Khalilbeigi, Roman Lissermann, Wolfgang Kleine, and Jürgen Steimle. 2012. FoldMe. Proceedings of the Sixth International Conference on Tangible, Embedded and Embodied Interaction - TEI '12, ACM Press, 33. http://doi.org/10.1145/2148131.2148142

[17]

Sang-won Leigh. 2015. THAW: Tangible Interaction with See-Through Augmentation for Smartphones on Computer Screens. Proceedings of the Ninth International Conference on Tangible, Embedded, and Embodied Interaction - TEI '14: 89--96. http://doi.org/10.1145/2677199.2680584

Digital Library

[18]

Ming Li and Leif Kobbelt. 2015. ACTUI: Using Commodity Mobile Devices to Build Active Tangible User Interfaces. MobileHCI: 592--597. http://doi.org/10.1145/2786567.2792895

Digital Library

[19]

Robert Mahony, Tarek Hamel, and Jean Michel Pflimlin. 2008. Nonlinear complementary filters on the special orthogonal group. IEEE Transactions on Automatic Control 53, 5: 1203--1218. http://doi.org/10.1109/TAC.2008.923738

[20]

C. C. Marshall and Sara Bly. 2005. Turning the page on navigation. Proceedings of the 5th ACM/IEEE-CS joint conference on Digital libraries, June, ACM Press, 07--11. http://doi.org/10.1145/1065385.1065438

Digital Library

[21]

Chris North and Ben Shneiderman. 1997. A Taxonomy of Multiple Window Coordinations. 97--18. http://doi.org/10.1.1.29.2424

[22]

William Premerlani and Paul Bizard. 2009. Direction Cosine Matrix IMU: Theory. Dcm: 1--30.

[23]

Roman Rädle, Hans-Christian Jetter, Nicolai Marquardt, Harald Reiterer, and Yvonne Rogers. 2014. HuddleLamp. Proceedings of the Ninth ACM International Conference on Interactive Tabletops and Surfaces - ITS '14, ACM Press, 45--54. http://doi.org/10.1145/2669485.2669500

[24]

Jun Rekimoto. 1995. The Magnifying Glass Approach to Augmented Reality Systems. International Conference on Artificial Reality and Telexistence icat 95, 4: 123--132. http://doi.org/10.1.1.50.5835

[25]

Dominik Schmidt, Fadi Chehimi, Enrico Rukzio, and Hans Gellersen. 2010. PhoneTouch: A technique for direct phone interaction on surfaces. Proc. UIST. http://doi.org/10.1145/1866029.1866034

Digital Library

[26]

Abigail J. Sellen and Richard H. R. Harper. 2002. The Myth of The Paperless Office. Massechussets Institute of Technology. Retrieved February 4, 2015 from http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.91.6538&rep=rep1&type=pdf

Digital Library

[27]

Aneesh P. Tarun, Peng Wang, Audrey Girouard, Paul Strohmeier, Derek Reilly, and Roel Vertegaal. 2013. PaperTab. CHI '13 Extended Abstracts on Human Factors in Computing Systems on - CHI EA '13, 3131. http://doi.org/10.1145/2468356.2479628

[28]

R. Vertegaal and J. S. Shell. 2008. Attentive user interfaces: the surveillance and sousveillance of gaze-aware objects. Social Science Information 47, 3: 275--298. http://doi.org/10.1177/0539018408092574

[29]

Stephen Voida, Matthew Tobiasz, Julie Stromer, Petra Isenberg, and Sheelagh Carpendale. 2009. Getting practical with interactive tabletop displays. Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces - ITS '09, ACM Press, 109. http://doi.org/10.1145/1731903.1731926

Digital Library

[30]

Colin Ware and Marlon Lewis. 1995. The DragMag image magnifier. Conference companion on Human factors in computing systems - CHI '95, ACM Press, 407--408. http://doi.org/10.1145/223355.223749

Digital Library

[31]

Pierre Wellner. 1993. Interacting with paper on the DigitalDesk. Communications of the ACM 36, 7: 87--96. http://doi.org/10.1145/159544.159630

Digital Library

[32]

Matthew Wright and Adrian Freed. 1997. Open Sound Control: A New Protocol for Communicating with Sound Synthesizers. Proc. ICMC 1997, International Computer Music Association, 101--104. Retrieved from http://cnmat.berkeley.edu/publication/open_sound_control_new_protocol_communicating_sound_synthesizers

[33]

Masasuke Yasumoto. 2015. VISTouch: Dynamic Three-Dimensional Connection between Multiple Mobile Devices. 89--92. Retrieved from http://doi.acm.org/10.1145/2735711.2735823

Digital Library

Cited By

Yu MSultana ACernova SWang MBakogeorge ATibu TTarun AMazalek A(2024)"SimSnap" Framework: Designing Interaction Methods for Cross-device Applications"Adjunct Proceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3672539.3686319(1-3)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3672539.3686319
Qie NBryan-Kinns NSong FRebelo FBall RYang YDu LWang W(2023)Framing Seamlessness-Enhancing Future Multimodal Interaction from Physical to Virtual SpacesCompanion Proceedings of the 2023 Conference on Interactive Surfaces and Spaces10.1145/3626485.3626549(79-81)Online publication date: 5-Nov-2023
https://dl.acm.org/doi/10.1145/3626485.3626549
Yang JKong JZhao C(2021)A Smartphone-Based Cursor Position System in Cross-Device Interaction Using Machine Learning TechniquesSensors10.3390/s2105166521:5(1665)Online publication date: 28-Feb-2021
https://doi.org/10.3390/s21051665
Show More Cited By

Index Terms

DisplayPointers: seamless cross-device interactions
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Touch screens
  2. Interaction design
    1. Interaction design process and methods
      1. Interface design prototyping

Recommendations

Investigating Cross-Device Interaction between a Handheld Device and a Large Display
CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems

There is a growing interest in HCI research to explore cross-device interaction, giving rise to an interest in different approaches facilitating interaction between handheld devices and large displays. Contributing to this, we have investigated the use ...
THAW: tangible interaction with see-through augmentation for smartphones on computer screens
UIST '14 Adjunct: Adjunct Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology

In this paper, we present a novel interaction system that allows a collocated large display and small handheld devices to seamlessly work together. The smartphone acts both as a physical interface and as an additional graphics layer for near-surface ...
THAW: Tangible Interaction with See-Through Augmentation for Smartphones on Computer Screens
TEI '15: Proceedings of the Ninth International Conference on Tangible, Embedded, and Embodied Interaction

The huge influx of mobile display devices is transforming computing into multi-device interaction, demanding a fluid mechanism for using multiple devices in synergy. In this paper, we present a novel interaction system that allows a collocated large ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

ACE '15: Proceedings of the 12th International Conference on Advances in Computer Entertainment Technology

November 2015

388 pages

ISBN:9781450338523

DOI:10.1145/2832932

General Chairs:
Adrian David Cheok
Imagineering Institute, Malaysia, United Kingdom
,
Mohd Shah Sunar
Universiti Teknologi Malaysia
,
Ken Neo
Multimedia University, Malaysia
,
Program Chair:
Yoram Chisik
University of Madeira, Portugal

Copyright © 2015 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 16 November 2015

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

ACE 2015

ACE 2015: 12th International Conference on Advances in Computer Entertainment Technology

November 16 - 19, 2015

Iskandar, Malaysia

Acceptance Rates

Overall Acceptance Rate 36 of 90 submissions, 40%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

8
Total Citations
View Citations
241
Total Downloads

Downloads (Last 12 months)7
Downloads (Last 6 weeks)0

Reflects downloads up to 03 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Yu MSultana ACernova SWang MBakogeorge ATibu TTarun AMazalek A(2024)"SimSnap" Framework: Designing Interaction Methods for Cross-device Applications"Adjunct Proceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3672539.3686319(1-3)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3672539.3686319
Qie NBryan-Kinns NSong FRebelo FBall RYang YDu LWang W(2023)Framing Seamlessness-Enhancing Future Multimodal Interaction from Physical to Virtual SpacesCompanion Proceedings of the 2023 Conference on Interactive Surfaces and Spaces10.1145/3626485.3626549(79-81)Online publication date: 5-Nov-2023
https://dl.acm.org/doi/10.1145/3626485.3626549
Yang JKong JZhao C(2021)A Smartphone-Based Cursor Position System in Cross-Device Interaction Using Machine Learning TechniquesSensors10.3390/s2105166521:5(1665)Online publication date: 28-Feb-2021
https://doi.org/10.3390/s21051665
Brudy FHolz CRädle RWu CHouben SKlokmose CMarquardt NBrewster SFitzpatrick GCox AKostakos V(2019)Cross-Device TaxonomyProceedings of the 2019 CHI Conference on Human Factors in Computing Systems10.1145/3290605.3300792(1-28)Online publication date: 2-May-2019
https://dl.acm.org/doi/10.1145/3290605.3300792
Wu DDong JLiu C(2019)Exploratory study of cross-device search tasksInformation Processing and Management: an International Journal10.1016/j.ipm.2019.10207356:6Online publication date: 1-Nov-2019
https://dl.acm.org/doi/10.1016/j.ipm.2019.102073
Blumenstein KKaltenbrunner MSeidl MBreban LThür NAigner WSubramanian SSteimle JDachselt RMartinez Plasencia DGrossman T(2017)Bringing Your Own Device into Multi-device EcologiesProceedings of the 2017 ACM International Conference on Interactive Surfaces and Spaces10.1145/3132272.3132279(306-311)Online publication date: 17-Oct-2017
https://dl.acm.org/doi/10.1145/3132272.3132279
Jensen HOlsen MSkov MKuramoto IAndo HWallner G(2016)PinchPanProceedings of the 13th International Conference on Advances in Computer Entertainment Technology10.1145/3001773.3001789(1-6)Online publication date: 9-Nov-2016
https://dl.acm.org/doi/10.1145/3001773.3001789
Tada KTanaka J(2016)Development of Multiple Device Collaboration System Using Built-in Camera ImageProceedings, Part II, of the 18th International Conference on Human-Computer Interaction. Interaction Platforms and Techniques - Volume 973210.1007/978-3-319-39516-6_40(419-427)Online publication date: 17-Jul-2016
https://dl.acm.org/doi/10.1007/978-3-319-39516-6_40

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten