research-article

A field study on spontaneous gaze-based interaction with a public display using pursuits

Authors:

Mohamed Khamis,

Andreas BullingAuthors Info & Claims

UbiComp/ISWC'15 Adjunct: Adjunct Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2015 ACM International Symposium on Wearable Computers

Pages 863 - 872

https://doi.org/10.1145/2800835.2804335

Published: 07 September 2015 Publication History

Abstract

Smooth pursuit eye movements were recently introduced as a promising technique for calibration-free and thus spontaneous and natural gaze interaction. While pursuits have been evaluated in controlled laboratory studies, the technique has not yet been evaluated with respect to usability in the wild. We report on a field study in which we deployed a game on a public display where participants used pursuits to select fish moving in linear and circular trajectories at different speeds. The study ran for two days in a busy computer lab resulting in a total of 56 interactions. Results from our study show that linear trajectories are statistically faster to select via pursuits than circular trajectories. We also found that pursuits is well perceived by users who find it fast and responsive.

References

[1]

Florian Alt, Stefan Schneegaß, Albrecht Schmidt, Jörg Müller, and Nemanja Memarovic. How to Evaluate Public Displays. In Proc. PerDis '12. ACM, Article 17, 6 pages.

Digital Library

[2]

Harry Brignull and Yvonne Rogers. 2003. Enticing people to interact with large public displays in public spaces. In Proc. INTERACT '03. 17--24.

[3]

Frederik Brudy, David Ledo, Saul Greenberg, and Andreas Butz. Is Anyone Looking? Mitigating Shoulder Surfing on Public Displays Through Awareness and Protection. In Proc. PerDis '14. ACM, 1--6.

Digital Library

[4]

Andreas Bulling, Florian Alt, and Albrecht Schmidt. Increasing the Security of Gaze-based Cued-recall Graphical Passwords Using Saliency Masks. In Proc. CHI '12. ACM, 3011--3020.

Digital Library

[5]

Andreas Bulling, Daniel Roggen, and Gerhard Tröster. 2009. Wearable EOG Goggles: Eye-based Interaction in Everyday Environments. In CHI '09 EA. ACM, 3259--3264.

Digital Library

[6]

Dietlind Helene Cymek, Antje Christine Venjakob, Stefan Ruff, Otto Hans-Martin Lutz, Simon Hofmann, and Matthias Roetting. 2014. Entering PIN codes by smooth pursuit eye movements. Journal of Eye Movement Research 7(4):1 (2014), 1--11.

[7]

Nigel Davies, Sarah Clinch, and Florian Alt. 2014. Pervasive Displays - Understanding the Future of Digital Signage. Morgan and Claypool Publishers.

Digital Library

[8]

Otto Hans-Martin Lutz, Antje Christine Venjakob, and Stefan Ruff. 2015. SMOOVS: Towards calibration-free text entry by gaze using smooth pursuit movements. Journal of Eye Movement Research 8(1):2 (2015), 1--11.

[9]

Päivi Majaranta and Andreas Bulling. 2014. Eye Tracking and Eye-Based Human-Computer Interaction. Springer Publishing, 39--65.

[10]

Paul Marshall, Richard Morris, Yvonne Rogers, Stefan Kreitmayer, and Matt Davies. Rethinking 'Multi-user': An In-the-wild Study of How Groups Approach a Walk-up-and-use Tabletop Interface. In Proc. CHI '11. ACM, 3033--3042.

Digital Library

[11]

Nemanja Memarovic, Ivan Elhart, and Marc Langheinrich. FunSquare: First Experiences with Autopoiesic Content. In Proc. MUM '11. ACM.

Digital Library

[12]

Jörg Müller, Florian Alt, Daniel Michelis, and Albrecht Schmidt. Requirements and Design Space for Interactive Public Displays. In Proc. MM '10. ACM, 1285--1294.

Digital Library

[13]

Jörg Müller, Robert Walter, Gilles Bailly, Michael Nischt, and Florian Alt. Looking Glass: A Field Study on Noticing Interactivity of a Shop Window. In Proc. CHI '12. ACM, 297--306.

Digital Library

[14]

Takashi Nagamatsu, Kaoruko Fukuda, and Michiya Yamamoto. Development of Corneal Reflection-based Gaze Tracking System for Public Use. In Proc. PerDis '14. ACM, Article 194, 2 pages.

Digital Library

[15]

Takashi Nagamatsu, Ryuichi Sugano, Yukina Iwamoto, Junzo Kamahara, and Naoki Tanaka. User-calibration-free Gaze Tracking with Estimation of the Horizontal Angles Between the Visual and the Optical Axes of Both Eyes. In Proc. ETRA '10. ACM, 251--254.

Digital Library

[16]

Ken Pfeuffer, Melodie Vidal, Jayson Turner, Andreas Bulling, and Hans Gellersen. Pursuit Calibration: Making Gaze Calibration Less Tedious and More Flexible. In Proc. UIST'13. ACM, 261--270.

Digital Library

[17]

Linda E. Sibert and Robert J. K. Jacob. Evaluation of Eye Gaze Interaction. In Proc. CHI '00. ACM, 281--288.

Digital Library

[18]

Vytautas Vaitukaitis and Andreas Bulling. Eye Gesture Recognition on Portable Devices. In Proc. PETMEI '12. 711--714.

Digital Library

[19]

Roel Vertegaal. 2003. Attentive user interfaces. Commun. ACM 46, 3 (2003), 30--33.

Digital Library

[20]

Mélodie Vidal, Andreas Bulling, and Hans Gellersen. Detection of smooth pursuits using eye movement shape features. In Proc. ETRA '12. 177--180.

Digital Library

[21]

Mélodie Vidal, Andreas Bulling, and Hans Gellersen. 2013. Pursuits: Spontaneous Interaction with Displays Based on Smooth Pursuit Eye Movement and Moving Targets. In Proc. UbiComp '13. ACM, 439--448.

Digital Library

[22]

Mélodie Vidal, Ken Pfeuffer, Andreas Bulling, and Hans Gellersen. Pursuits: eye-based interaction with moving targets. In Proc. CHI '13. 3147--3150.

Digital Library

[23]

Xuehan Xiong, Qin Cai, Zicheng Liu, and Zhengyou Zhang. 2014. Eye Gaze Tracking Using an RGBD Camera: A Comparison with a RGB Solution. In Proc. PETMEI '14. ACM, 1113--1121.

Digital Library

[24]

Yanxia Zhang, Andreas Bulling, and Hans Gellersen. SideWays: A Gaze Interface for Spontaneous Interaction with Situated Displays. In Proc. CHI '13. ACM, 851--860.

Digital Library

[25]

Yanxia Zhang, Jörg Müller, Ming Ki Chong, Andreas Bulling, and Hans Gellersen. GazeHorizon: Enabling Passers-by to Interact with Public Displays by Gaze. In Proc. UbiComp '14. ACM.

Digital Library

[26]

Zhiwei Zhu and Qiang Ji. 2005. Eye Gaze Tracking Under Natural Head Movements. In Proc. CVPR '05. IEEE Computer Society, 918--923.

Digital Library

Cited By

Murnani SSetiawan NWibirama S(2024)Robust Object Selection in Spontaneous Gaze-Controlled Application Using Exponential Moving Average and Hidden Markov ModelIEEE Transactions on Human-Machine Systems10.1109/THMS.2024.341378154:5(485-498)Online publication date: Oct-2024
https://doi.org/10.1109/THMS.2024.3413781
Nurlatifa HHartanto RAtaka AWibirama S(2024)Optimum Object Selection Methods for Spontaneous Gaze-Based Interaction with Linear and Circular TrajectoriesResults in Engineering10.1016/j.rineng.2024.101769(101769)Online publication date: Jan-2024
https://doi.org/10.1016/j.rineng.2024.101769
Dondi PSapuppo SPorta M(2024)LeyenesInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2023.103204184:COnline publication date: 1-Apr-2024
https://dl.acm.org/doi/10.1016/j.ijhcs.2023.103204
Show More Cited By

Index Terms

A field study on spontaneous gaze-based interaction with a public display using pursuits
1. Human-centered computing

Recommendations

GazeCast: Using Mobile Devices to Allow Gaze-based Interaction on Public Displays
ETRA '23: Proceedings of the 2023 Symposium on Eye Tracking Research and Applications

Gaze is promising for natural and spontaneous interaction with public displays, but current gaze-enabled displays require movement-hindering stationary eye trackers or cumbersome head-mounted eye trackers. We propose and evaluate GazeCast – a novel ...
Pursuits: eye-based interaction with moving targets
CHI EA '13: CHI '13 Extended Abstracts on Human Factors in Computing Systems

Eye-based interaction has commonly been based on estimation of eye gaze direction, to locate objects for interaction. We introduce Pursuits, a novel and very different eye tracking method that instead is based on following the trajectory of eye movement ...
Tackling challenges of interactive public displays using gaze
UbiComp/ISWC'15 Adjunct: Adjunct Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2015 ACM International Symposium on Wearable Computers

Falling hardware prices led to a widespread use of public displays. Common interaction techniques for such displays currently include touch, mid-air, or smartphone-based interaction. While these techniques are well understood from a technical ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

UbiComp/ISWC'15 Adjunct: Adjunct Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2015 ACM International Symposium on Wearable Computers

September 2015

1626 pages

ISBN:9781450335751

DOI:10.1145/2800835

General Chairs:
Kenji Mase
Nagoya University, JP
,
Marc Langheinrich
Università della Svizzera italiana (USI), CH
,
Daniel Gatica-Perez
IDIAP-EPFL, CH
,
Program Chairs:
Hans Gellersen
Lancaster University, UK
,
Tanzeem Choudhury
Cornell University
,
Koji Yatani
Univerisity of Tokyo, JP

Copyright © 2015 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Yahoo! Japan: Yahoo! Japan
SIGMOBILE: ACM Special Interest Group on Mobility of Systems, Users, Data and Computing
FX Palo Alto Laboratory, Inc.: FX Palo Alto Laboratory, Inc.
Google Inc.
ACM: Association for Computing Machinery
Rakuten Institute of Technology: Rakuten Institute of Technology
Microsoft: Microsoft
Bell Labs: Bell Laboratories
SIGCHI: ACM Special Interest Group on Computer-Human Interaction
KDDI
Panasonic: Panasonic Corporation
NTT DoCoMo
Telefónica: Telefónica
ISTC-PC: Intel Science and Technology Center for Pervasive Computing

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 September 2015

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

UbiComp '15

Sponsor:

Yahoo! Japan
SIGMOBILE
FX Palo Alto Laboratory, Inc.
ACM
Rakuten Institute of Technology
Microsoft
Bell Labs
SIGCHI
Panasonic
Telefónica
ISTC-PC

UbiComp '15: The 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing

September 7 - 11, 2015

Osaka, Japan

Acceptance Rates

Overall Acceptance Rate 764 of 2,912 submissions, 26%

Upcoming Conference

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

41
Total Citations
View Citations
381
Total Downloads

Downloads (Last 12 months)18
Downloads (Last 6 weeks)1

Reflects downloads up to 02 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Murnani SSetiawan NWibirama S(2024)Robust Object Selection in Spontaneous Gaze-Controlled Application Using Exponential Moving Average and Hidden Markov ModelIEEE Transactions on Human-Machine Systems10.1109/THMS.2024.341378154:5(485-498)Online publication date: Oct-2024
https://doi.org/10.1109/THMS.2024.3413781
Nurlatifa HHartanto RAtaka AWibirama S(2024)Optimum Object Selection Methods for Spontaneous Gaze-Based Interaction with Linear and Circular TrajectoriesResults in Engineering10.1016/j.rineng.2024.101769(101769)Online publication date: Jan-2024
https://doi.org/10.1016/j.rineng.2024.101769
Dondi PSapuppo SPorta M(2024)LeyenesInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2023.103204184:COnline publication date: 1-Apr-2024
https://dl.acm.org/doi/10.1016/j.ijhcs.2023.103204
Alsakar NAbdrabou YStumpf SKhamis M(2023)Investigating Privacy Perceptions and Subjective Acceptance of Eye Tracking on Handheld Mobile DevicesProceedings of the ACM on Human-Computer Interaction10.1145/35911337:ETRA(1-16)Online publication date: 18-May-2023
https://dl.acm.org/doi/10.1145/3591133
Kagemoto TTakemura K(2023)Event-Based Pupil Tracking Using Bright and Dark Pupil EffectAdjunct Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586182.3616657(1-3)Online publication date: 29-Oct-2023
https://dl.acm.org/doi/10.1145/3586182.3616657
Belkhiria CBoudir AHurter CPeysakhovich V(2022)EOG-Based Human–Computer Interface: 2000–2020 ReviewSensors10.3390/s2213491422:13(4914)Online publication date: 29-Jun-2022
https://doi.org/10.3390/s22134914
Pearson JBailey GRobinson SJones MOwen TZhang CReitmaier TSteer CCarter ASahoo DRaju D(2022)Can’t Touch This: Rethinking Public Technology in a COVID-19 EraProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3501980(1-14)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3501980
Suryakusuma DHarisno Wicaksono AHartanto RWibirama S(2022)Implementing Design Thinking in The Development of Digital Signage User Interface for Public Health Education2022 8th International Conference on Science and Technology (ICST)10.1109/ICST56971.2022.10136306(1-6)Online publication date: 7-Sep-2022
https://doi.org/10.1109/ICST56971.2022.10136306
Hossain TIslam MDelamare WChowdhury FHasan K(2021)Exploring Social Acceptability and Users’ Preferences of Head- and Eye-Based Interaction with Mobile DevicesProceedings of the 20th International Conference on Mobile and Ubiquitous Multimedia10.1145/3490632.3490636(12-23)Online publication date: 5-Dec-2021
https://dl.acm.org/doi/10.1145/3490632.3490636
Wibirama SMurnani SSukowati IFerdiana R(2021)Gaze-Controlled Digital Signage for Public Health Education during Covid-19 Pandemic2021 9th International Conference on Information and Communication Technology (ICoICT)10.1109/ICoICT52021.2021.9527531(7-12)Online publication date: 3-Aug-2021
https://doi.org/10.1109/ICoICT52021.2021.9527531
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten