research-article

Designing a gaze gesture guiding system

Authors:

William Delamare,

Pourang IraniAuthors Info & Claims

MobileHCI '17: Proceedings of the 19th International Conference on Human-Computer Interaction with Mobile Devices and Services

Article No.: 26, Pages 1 - 13

https://doi.org/10.1145/3098279.3098561

Published: 04 September 2017 Publication History

Abstract

We propose the concept of a guiding system specifically designed for semaphoric gaze gestures, i.e. gestures defining a vocabulary to trigger commands via the gaze modality. Our design exploration considers fundamental gaze gesture phases: Exploration, Guidance, and Return. A first experiment reveals that Guidance with dynamic elements moving along 2D paths is efficient and resistant to visual complexity. A second experiment reveals that a Rapid Serial Visual Presentation of command names during Exploration allows for more than 30% faster command retrievals than a standard visual search. To resume the task where the guide was triggered, labels moving from the outward extremity of 2D paths toward the guide center leads to efficient and accurate origin retrieval during the Return phase. We evaluate our resulting Gaze Gesture Guiding system, G3, for interacting with distant objects in an office environment using a head-mounted display. Users report positively on their experience with both semaphoric gaze gestures and G3.

References

[1]

Roland Aigner, Daniel Wigdor, Hrvoje Benko, et al. 2012. Understanding Mid-Air Hand Gestures: A Study of Human Preferences in Usage of Gesture Types for HCI. Retrieved March 18, 2014 from http://131.107.65.14/en-us/um/people/benko/publications/2012/Understanding MidAir Gestures - MSR-TR-2012-111.pdf

[2]

Fraser Anderson and Walter F Bischof. 2013. Learning and performance with gesture guides. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems - CHI '13, 1109--1118.

Digital Library

[3]

Fraser Anderson, Tovi Grossman, Justin Matejka, and George Fitzmaurice. 2013. YouMove: Enhancing Movement Training with an Augmented Reality Mirror. In Proceedings of the 26th annual ACM symposium on User interface software and technology - UIST '13, 311--320.

Digital Library

[4]

Mihai Bâce, Teemu Leppänen, David Gil de Gomez, and Argenis Ramirez Gomez. 2016. ubiGaze: ubiquitous augmented reality messaging using gaze gestures. In SIGGRAPH ASIA 2016 Mobile Graphics and Interactive Applications - SA '16, 1--5.

Digital Library

[5]

Olivier Bau and Wendy E. Mackay. 2008. OctoPocus: A Dynamic Guide for Learning Gesture-Based Command Sets. In Proceedings of the 21st annual ACM symposium on User interface software and technology - UIST '08, 37--46.

Digital Library

[6]

Nikolaus Bee and Elisabeth André. 2008. Writing with your eye: A dwell time free writing system adapted to the nature of human eye gaze. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 5078 LNCS: 111--122.

Digital Library

[7]

Andrew Bragdon, Robert Zeleznik, Brian Williamson, Timothy Miller, and Joseph J. LaViola. 2009. GestureBar: Improving the Approachability of Gesture-based Interfaces. In Proceedings of the 27th international conference on Human factors in computing systems - CHI '09, 2269--2278.

Digital Library

[8]

Marcus Carter, Eduardo Velloso, John Downs, Abigail Sellen, Kenton O'Hara, and Frank Vetere. 2016. PathSync: Multi-User Gestural Interaction with Touchless Rhythmic Path Mimicry. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems - CHI '16, 3415--3427.

Digital Library

[9]

Andrea Colaço, Ahmed Kirmani, Hye Soo Yang, Nan-Wei Gong, Chris Schmandt, and Vivek K. Goyal. 2013. Mime: Compact, Low-Power 3D Gesture Sensing for Interaction with Head-Mounted Displays. In Proceedings of the 26th annual ACM symposium on User interface software and technology - UIST '13, 227--236.

Digital Library

[10]

Dh Cymek, Ac Venjakob, Stefan Ruff, Otto Hans-Martin Lutz, Simon Hofmann, and Matthias Rötting. 2014. Entering PIN Codes by Smooth Pursuit Eye Movements. Journal of Eye Movement Research 7, 4: 1--11.

[11]

Edwin S. Dalmaijer. 2014. Is the low-cost EyeTribe eye tracker any good for research? Peer J PrePrints 4, 606901: 1--35.

[12]

William Delamare, Céline Coutrix, and Laurence Nigay. 2015. Designing guiding systems for gesture-based interaction. In Proceedings of the 7th ACM SIGCHI Symposium on Engineering Interactive Computing Systems - EICS '15, 44--53.

Digital Library

[13]

William Delamare, Thomas Janssoone, Céline Coutrix, and Laurence Nigay. 2016. Designing 3D Gesture Guidance: Visual Feedback and Feedforward Design Options. In Proceedings of the International Working Conference on Advanced Visual Interfaces - AVI '16, 152--159.

Digital Library

[14]

Heiko Drewes and Albrecht Schmidt. 2007. Interacting with the Computer Using Gaze Gestures. In Proc. of the Int. Conf. on Human-computer interaction '07. 475--488.

Digital Library

[15]

Morten Lund Dybdal, Javier San Agustin, and John Paulin Hansen. 2012. Gaze input for mobile devices by dwell and gestures. In Proceedings of the Symposium on Eye Tracking Research and Applications - ETRA '12, 225--228.

Digital Library

[16]

Augusto Esteves, Eduardo Velloso, Andreas Bulling, and Hans Gellersen. 2015. Orbits: Gaze Interaction for Smart Watches using Smooth Pursuit Eye Movements. Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology - UIST '15, 1: 457--466.

Digital Library

[17]

Dustin Freeman, Hrvoje Benko, Meredith Ringel Morris, and Daniel Wigdor. 2009. ShadowGuides: Visualizations for In-Situ Learning of Multi-Touch and Whole-Hand Gestures. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces - ITS '09, 165--172.

Digital Library

[18]

Emilien Ghomi, Stéphane Huot, Olivier Bau, Michel Beaudouin-Lafon, and Wendy E. Mackay. 2013. Arpège: Learning Multitouch Chord Gestures Vocabularies. In Proceedings of the 2013 ACM international conference on Interactive tabletops and surfaces - ITS '13, 209--218.

Digital Library

[19]

John Paulin Hansen, Florian Biermann, Janus Askø Madsen, et al. 2015. A gaze interactive textual smartwatch interface. Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2015 ACM International Symposium on Wearable Computers - UbiComp '15: 839--847.

Digital Library

[20]

John Paulin Hansen, Haakon Lund, Florian Biermann, Emillie Møllenbach, Sebastian Sztuk, and Javier San Agustin. 2016. Wrist-worn pervasive gaze interaction. In Proceedings of the Ninth Biennial ACM Symposium on Eye Tracking Research & Applications - ETRA '16, 57--64.

Digital Library

[21]

Juan David Hincapié-Ramos, Xiang Guo, Paymahn Moghadasian, and Pourang Irani. 2014. Consumed Endurance: A Metric to Quantify Arm Fatigue of Mid-Air Interactions. In Proceedings of the 32nd annual ACM conference on Human factors in computing systems - CHI '14, 1063--1072.

Digital Library

[22]

Aulikki Hyrskykari, Howell Istance, and Stephen Vickers. 2012. Gaze gestures or dwell-based interaction? In Proceedings of the Symposium on Eye Tracking Research and Applications - ETRA '12, 229--232.

Digital Library

[23]

Poika Isokoski. 2000. Text input methods for eye trackers using off-screen targets. Proceedings of the symposium on Eye tracking research applications ETRA 00: 15--21.

Digital Library

[24]

Howell Istance, Aulikki Hyrskykari, Lauri Immonen, Santtu Mansikkamaa, and Stephen Vickers. 2010. Designing Gaze Gestures for Gaming: An Investigation of Performance. In Proceedings of the 2010 Symposium on Eye-Tracking Research and Applications - ETRA '10, 323--330.

Digital Library

[25]

RJK Jacob and Keith S Karn. 2003. Eye tracking in human-computer interaction and usability research: Ready to deliver the promises. In The Mind's Eye: Cognitive and Applied Aspects of Eye Movement Research. 4.

[26]

Robert J K Jacob. 1993. Eye Movement-Based Human-Computer Interaction Techniques: Toward Non-Command Interfaces. Advances in human-computer interaction 4: 151--190.

[27]

James F Juola, Nicklas J Ward, and Timothy McNamara. 1982. Visual Search and Reading of Rapid Serial Presentations of Letter Strings, Words, and Text. Journal of Experimental Psychology: General 111, 2: 208--227.

[28]

Jari Kangas, Deepak Akkil, Jussi Rantala, Poika Isokoski, Päivi Majaranta, and Roope Raisamo. 2014. Gaze gestures and haptic feedback in mobile devices. In Proceedings of the 32nd annual ACM conference on Human factors in computing systems - CHI '14, 435--438.

Digital Library

[29]

Maria Karam and m. c. Schraefel. 2005. A Taxonomy of Gestures in Human Computer Interactions. 1--45.

[30]

G. Kurtenbach, T. P. Moran, and W. Buxton. 1994. Contextual Animation of Gestural Commands. Computer Graphics Forum 13, 5: 305--314.

[31]

Gordon Kurtenbach, Abigail Sellen, and William Buxton. 1993. An Empirical Evaluation of Some Articulatory and Cognitive Aspects of Marking Menus. Human-Computer Interaction 8, 1--23.

Digital Library

[32]

Microsoft. Hololens. Retrieved December 8, 2016 from https://www.microsoft.com/microsoft-hololens/fr-ca

[33]

Emilie Møllenbach, John Paulin Hansen, and Martin Lillholm. 2013. Eye Movements in Gaze Interaction. Journal of Eye Movement Research 6: 1--15.

[34]

Emilie Møllenbach, Martin Lillholm, Alastair Gail, and John Paulin Hansen. 2010. Single gaze gestures. Proceedings of the 2010 Symposium on Eye-Tracking Research & Applications - ETRA '10, 2: 177.

Digital Library

[35]

Gustav Öquist, Anna Sågvall Hein, Jan Ygge, and Mikael Goldstein. 2004. Eye Movement Study of Reading on a Mobile Device Using the Page and RSVP Text Presentation Formats. In Lecture Notes in Computer Science. 108--119.

[36]

Hyung Min Park, Seok Han Lee, and Jong Soo Choi. 2008. Wearable augmented reality system using gaze interaction. Proceedings - 7th IEEE International Symposium on Mixed and Augmented Reality 2008, ISMAR 2008: 175--176.

Digital Library

[37]

J H Park, C H Shea, and D L Wright. 2000. Reduced-frequency concurrent and terminal feedback: a test of the guidance hypothesis. Journal of motor behavior 32, 3: 287--296.

[38]

Nicholas M. Ross and Elio M. Santos. 2014. The relative contributions of internal motor cues and external semantic cues to anticipatory smooth pursuit. Proceedings of the Symposium on Eye Tracking Research and Applications - ETRA '14: 183--186.

Digital Library

[39]

Gustavo Rovelo, Donald Degraen, Davy Vanacken, Kris Luyten, and Karin Coninx. 2015. Gestu-Wan - An Intelligible Mid-Air Gesture Guidance System for Walk-up-and-Use Displays. In Proc. Interact '15, 368--386.

[40]

Quentin Roy, Sylvain Malacria, Yves Guiard, Eric Lecolinet, and James Eagan 2013. Augmented Letters: Mnemonic Gesture-based Shortcuts. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13), 2325--2328.

Digital Library

[41]

D Rozado, T Moreno, J San Agustin, F B Rodriguez, and P Varona. 2015. Controlling a Smartphone Using Gaze Gestures as the Input Mechanism. Human-Computer Interaction 30, 1: 34--63.

Digital Library

[42]

Gary S Rubin and Kathleen Turano. 1992. Reading without saccadic eye movements. Vision Research 32, 5: 895--902.

[43]

Rajinder Sodhi, Hrvoje Benko, and Andrew Wilson. 2012. LightGuide: Projected Visualizations for Hand Movement Guidance. In Proceedings of the 2012 ACM annual conference on Human Factors in Computing Systems - CHI '12, 179--188.

Digital Library

[44]

Oleg Špakov, Poika Isokoski, Jari Kangas, Deepak Akkil, and Päivi Majaranta. 2016. Pursuit Adjuster: An Exploration into the Design Space of Smooth Pursuit - based Widgets. In Proceedings of the Ninth Biennial ACM Symposium on Eye Tracking Research & Applications - ETRA '16, 287--290.

Digital Library

[45]

Radu-Daniel Vatavu, Lisa Anthony, and Jacob O. Wobbrock. 2013. Relative accuracy measures for stroke gestures. Proceedings of the 15th ACM on International conference on multimodal interaction - ICMI '13: 279--286.

Digital Library

[46]

Radu-Daniel Vatavu, Daniel Vogel, Géry Casiez, and Laurent Grisoni. 2011. Estimating the Perceived Difficulty of Pen Gestures. In Proceedings of the 13th IFIP TC 13 international conference on Human-computer interaction - INTERACT'11. Springer-Verlag Berlin, Heidelberg, 89--106.

Digital Library

[47]

Eduardo Velloso, Markus Wirth, Christian Weichel, Augusto Esteves, and Hans Gellersen. 2016. AmbiGaze: Direct Control of Ambient Devices by Gaze. Proceedings of the 2016 ACM Conference on Designing Interactive Systems - DIS '16, July: 812--817.

Digital Library

[48]

Mélodie Vidal, Andreas Bulling, and Hans Gellersen. 2013. Pursuits: Spontaneous interaction with displays based on smooth pursuit eye movement and moving targets. In Proceedings of the 2013 ACM international joint conference on Pervasive and ubiquitous computing - UbiComp '13, 439.

Digital Library

[49]

Jacob O Wobbrock, James Rubinstein, Michael Sawyer, and Andrew T. Duchowski. 2007. Not Typing but Writing: Eye-based Text Entry Using Letter-like Gestures. Proceedings of The Conference on Communications by Gaze Interaction (COGAIN), Figure 1: 61--64.

[50]

Jacob O Wobbrock, Andrew D Wilson, and Yang Li. 2007. Gestures without libraries, toolkits or training: a $1 recognizer for user interface prototypes. In Proceedings of the 20th annual ACM symposium on User interface software and technology - UIST '07, 159.

Digital Library

[51]

Tobii. Retrieved December 8, 2016 from http://tobiigaming.com/product /

Cited By

Delamare WHarada DYang LRen X(2024)Guiding gaze gestures on smartwatchesInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2023.103196183:COnline publication date: 14-Mar-2024
https://dl.acm.org/doi/10.1016/j.ijhcs.2023.103196
Yi-yan WWen CJing-ze TWei-chi HYa-feng NWen-jun YCheng-qi X(2024)Design recommendations of target size and tracking speed under circular and square trajectories for smooth pursuit with Euclidean algorithm in eye-control systemDisplays10.1016/j.displa.2023.10260881(102608)Online publication date: Jan-2024
https://doi.org/10.1016/j.displa.2023.102608
Bature ZAbdullahi SYeamkuan SChiracharit WChamnongthai K(2023)Boosted Gaze Gesture Recognition Using Underlying Head Orientation SequenceIEEE Access10.1109/ACCESS.2023.327028511(43675-43689)Online publication date: 2023
https://doi.org/10.1109/ACCESS.2023.3270285
Show More Cited By

Index Terms

Designing a gaze gesture guiding system
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms

Recommendations

Guiding gaze gestures on smartwatches: Introducing fireworks
Abstract
Smartwatches enable interaction anytime and anywhere, with both digital and augmented physical objects. However, situations with busy hands can prevent user inputs. To address this limitation, we propose Fireworks, an innovative hands-free ...
Highlights
- For guiding few gestures, a system-paced guidance is not necessary.
- Pursuits are more adapted than saccades for Single Straight Gaze Gestures.
- Delay and visual feedforward to activate Fireworks do not impact performances.
- ...
A Method to Recognize Eyeball Movement Gesture using Infrared Distance Sensor Array on Eyewear
iiWAS2021: The 23rd International Conference on Information Integration and Web Intelligence

Sensing technology for eyeball movement (i.e., gaze movement) has enabled various applications, e.g., hands-free input interfaces and provided information that helps us understand human beings in various fields. However, the existing method, which ...
Gaze Speedup: Eye Gaze Assisted Gesture Typing in Virtual Reality
IUI '23: Proceedings of the 28th International Conference on Intelligent User Interfaces

Mid-air text input in augmented or virtual reality (AR/VR) is an open problem. One proposed solution is gesture typing where the user performs a gesture trace over the keyboard. However, this requires the user to move their hands precisely and ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

MobileHCI '17: Proceedings of the 19th International Conference on Human-Computer Interaction with Mobile Devices and Services

September 2017

874 pages

ISBN:9781450350754

DOI:10.1145/3098279

General Chairs:
Matt Jones
Swansea University
,
Manfred Tscheligi
University of Salzburg and AIT
,
Program Chairs:
Yvonne Rogers
University College London
,
Roderick Murray-Smith
University of Glasgow

Copyright © 2017 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 04 September 2017

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Conference

MobileHCI '17

Sponsor:

SIGCHI

MobileHCI '17: 19th International Conference on Human-Computer Interaction with Mobile Devices and Services

September 4 - 7, 2017

Vienna, Austria

Acceptance Rates

MobileHCI '17 Paper Acceptance Rate 45 of 224 submissions, 20%;

Overall Acceptance Rate 202 of 906 submissions, 22%

Upcoming Conference

MOBILEHCI '24

Sponsor:
sigchi

26th International Conference on Mobile Human-Computer Interaction

September 30 - October 3, 2024

Melbourne , VIC , Australia

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

16
Total Citations
View Citations
621
Total Downloads

Downloads (Last 12 months)51
Downloads (Last 6 weeks)3

Reflects downloads up to 27 Jul 2024

Other Metrics

View Author Metrics

Citations

Cited By

Delamare WHarada DYang LRen X(2024)Guiding gaze gestures on smartwatchesInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2023.103196183:COnline publication date: 14-Mar-2024
https://dl.acm.org/doi/10.1016/j.ijhcs.2023.103196
Yi-yan WWen CJing-ze TWei-chi HYa-feng NWen-jun YCheng-qi X(2024)Design recommendations of target size and tracking speed under circular and square trajectories for smooth pursuit with Euclidean algorithm in eye-control systemDisplays10.1016/j.displa.2023.10260881(102608)Online publication date: Jan-2024
https://doi.org/10.1016/j.displa.2023.102608
Bature ZAbdullahi SYeamkuan SChiracharit WChamnongthai K(2023)Boosted Gaze Gesture Recognition Using Underlying Head Orientation SequenceIEEE Access10.1109/ACCESS.2023.327028511(43675-43689)Online publication date: 2023
https://doi.org/10.1109/ACCESS.2023.3270285
Isomoto TYamanaka SShizuki B(2022)Dwell Selection with ML-based Intent Prediction Using Only Gaze DataProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35503016:3(1-21)Online publication date: 7-Sep-2022
https://dl.acm.org/doi/10.1145/3550301
Li JRay SRajanna VHammond T(2022)Evaluating the Performance of Machine Learning Algorithms in Gaze Gesture Recognition SystemsIEEE Access10.1109/ACCESS.2021.313615310(1020-1035)Online publication date: 2022
https://doi.org/10.1109/ACCESS.2021.3136153
Hossain TIslam MDelamare WChowdhury FHasan K(2021)Exploring Social Acceptability and Users’ Preferences of Head- and Eye-Based Interaction with Mobile DevicesProceedings of the 20th International Conference on Mobile and Ubiquitous Multimedia10.1145/3490632.3490636(12-23)Online publication date: 5-Dec-2021
https://dl.acm.org/doi/10.1145/3490632.3490636
Ahn SSantosa SParent MWigdor DGrossman TGiordano MKitamura YQuigley AIsbister KIgarashi TBjørn PDrucker S(2021)StickyPie: A Gaze-Based, Scale-Invariant Marking Menu Optimized for AR/VRProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445297(1-16)Online publication date: 6-May-2021
https://dl.acm.org/doi/10.1145/3411764.3445297
Niu YLi XYang WXue CPeng NJin T(2021)Smooth Pursuit Study on an Eye-Control System for Continuous Variable Adjustment TasksInternational Journal of Human–Computer Interaction10.1080/10447318.2021.201297939:1(23-33)Online publication date: 15-Dec-2021
https://doi.org/10.1080/10447318.2021.2012979
Rothe SBuschek DHußmann H(2019)Guidance in Cinematic Virtual Reality-Taxonomy, Research Status and ChallengesMultimodal Technologies and Interaction10.3390/mti30100193:1(19)Online publication date: 19-Mar-2019
https://doi.org/10.3390/mti3010019
Min CLee EPark SKang S(2019)TigerProceedings of the 21st International Conference on Human-Computer Interaction with Mobile Devices and Services10.1145/3338286.3340117(1-11)Online publication date: 1-Oct-2019
https://dl.acm.org/doi/10.1145/3338286.3340117
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents