research-article

Investigating Privacy Perceptions and Subjective Acceptance of Eye Tracking on Handheld Mobile Devices

Authors:

Yasmeen Abdrabou,

Mohamed KhamisAuthors Info & Claims

Proceedings of the ACM on Human-Computer Interaction, Volume 7, Issue ETRA

Article No.: 164, Pages 1 - 16

https://doi.org/10.1145/3591133

Published: 18 May 2023 Publication History

Abstract

Although eye tracking brings many benefits to users of mobile devices and developers of mobile applications, it poses significant privacy risks to both: the users of mobile devices, and the bystanders that surround users, are within the front-facing camera's field of view. Recent research demonstrates that tracking an individual's gaze reveals personal and sensitive information. This paper presents an investigation of the privacy perceptions and the subjective acceptance of users towards eye tracking on handheld mobile devices. In a four-phase user study (N=17), participants used a smartphone eye tracking app, were interviewed before and after viewing a video showing the amount of sensitive and personal data that could be derived from eye movements, and had their privacy concerns measured. Our findings 1) show factors that influence users' and bystanders' attitudes toward eye tracking on mobile devices such as the algorithms' transparency and the developers' credibility and 2) support designing mechanisms to allow for privacy-aware eye tracking solutions on mobile-devices.

Supplemental Material

MP4 File

Presentation video

Download
117.48 MB

ZIP File

Paper Title: Privacy Perceptions and Subjective Acceptance of Eye Tracking on Handheld Mobile Devices Authors: Noora Alsakar et al.

Download
472.92 KB

References

[1]

Melvin Abraham, Pejman Saeghe, Mark Mcgill, and Mohamed Khamis. 2022. Implications of XR on Privacy, Security and Behaviour: Insights from Experts. In Nordic Human-Computer Interaction Conference (Aarhus, Denmark) (NordiCHI '22). Association for Computing Machinery, New York, NY, USA, Article 30, 12 pages. https://doi.org/10.1145/3546155. 3546691

Digital Library

[2]

APPLE. 2022. https://www.apple.com/.

[3]

Tom Beesley, Daniel Pearson, and Mike Le Pelley. 2019. Chapter 1 - Eye Tracking as a Tool for Examining Cognitive Processes. In Biophysical Measurement in Experimental Social Science Research, Gigi Foster (Ed.). Academic Press, 1--30. https://doi.org/10.1016/B978-0--12--813092--6.00002--2

[4]

Virginia Braun and Victoria Clarke. 2006. Using thematic analysis in psychology. Qualitative research in psychology 3, 2 (2006), 77--101.

[5]

Virginia Braun and Victoria Clarke. 2021. One size fits all? What counts as quality practice in (reflexive) thematic analysis? Qualitative research in psychology 18, 3 (2021), 328--352.

[6]

Tamara Denning, Zakariya Dehlawi, and Tadayoshi Kohno. 2014. In Situ with Bystanders of Augmented Reality Glasses: Perspectives on Recording and Privacy-Mediating Technologies. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Toronto, Ontario, Canada) (CHI '14). Association for Computing Machinery, New York, NY, USA, 2377--2386. https://doi.org/10.1145/2556288.2557352

Digital Library

[7]

Michael D Dodd, John R Hibbing, and Kevin B Smith. 2011. The politics of attention: gaze-cuing effects are moderated by political temperament. Attention, Perception, & Psychophysics 73, 1 (2011), 24--29.

[8]

Andrew T. Duchowski, Krzysztof Krejtz, Izabela Krejtz, Cezary Biele, Anna Niedzielska, Peter Kiefer, Martin Raubal, and Ioannis Giannopoulos. 2018. The Index of Pupillary Activity: Measuring Cognitive Load Vis-à-Vis Task Difficulty with Pupil Oscillation. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI '18). Association for Computing Machinery, New York, NY, USA, 1--13. https://doi.org/ 10.1145/3173574.3173856

Digital Library

[9]

Kerstin Gidlöf, Annika Wallin, Richard Dewhurst, and Kenneth Holmqvist. 2013. Using eye tracking to trace a cognitive process: Gaze behaviour during decision making in a natural environment. Journal of eye movement research 6, 1 (2013).

[10]

Jie Gu, Yunjie Calvin Xu, Heng Xu, Cheng Zhang, and Hong Ling. 2017. Privacy concerns for mobile app download: An elaboration likelihood model perspective. Decision Support Systems 94 (2017), 19--28.

Digital Library

[11]

David Harborth and Alisa Frik. 2021. Evaluating and Redefining Smartphone Permissions with Contextualized Justifications for Mobile Augmented Reality Apps. In SOUPS@ USENIX Security Symposium. 513--534.

[12]

Sabrina Hoppe, Tobias Loetscher, Stephanie A Morey, and Andreas Bulling. 2018. Eye movements during everyday behavior predict personality traits. Frontiers in human neuroscience (2018), 105.

[13]

Roberto Hoyle, Robert Templeman, Denise Anthony, David Crandall, and Apu Kapadia. 2015. Sensitive lifelogs: A privacy analysis of photos from wearable cameras. In Proceedings of the 33rd Annual ACM conference on human factors in computing systems. 1645--1648.

Digital Library

[14]

Michael Xuelin Huang, Jiajia Li, Grace Ngai, Hong Va Leong, and Andreas Bulling. 2019. Moment-to-moment detection of internal thought during video viewing from eye vergence behavior. In Proceedings of the 27th ACM International Conference on Multimedia. 2254--2262.

Digital Library

[15]

Christina Katsini, Yasmeen Abdrabou, George E Raptis, Mohamed Khamis, and Florian Alt. 2020. The role of eye gaze in security and privacy applications: Survey and future HCI research directions. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1--21.

Digital Library

[16]

Christina Katsini, Christos Fidas, George E. Raptis, Marios Belk, George Samaras, and Nikolaos Avouris. 2018. Influences of Human Cognition and Visual Behavior on Password Strength during Picture Password Composition. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI '18). Association for Computing Machinery, New York, NY, USA, 1--14. https://doi.org/10.1145/3173574.3173661

Digital Library

[17]

Mohamed Khamis, Florian Alt, and Andreas Bulling. 2015. A Field Study on Spontaneous Gaze-Based Interaction with a Public Display Using Pursuits. In Adjunct Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2015 ACM International Symposium on Wearable Computers (Osaka, Japan) (UbiComp/ISWC'15 Adjunct). Association for Computing Machinery, New York, NY, USA, 863--872. https://doi.org/10.1145/2800835.2804335

Digital Library

[18]

Mohamed Khamis, Florian Alt, and Andreas Bulling. 2018. The past, present, and future of gaze-enabled handheld mobile devices: Survey and lessons learned. In Proceedings of the 20th International Conference on Human-Computer Interaction with Mobile Devices and Services. 1--17.

Digital Library

[19]

Marion Koelle. 2000. Designing Socially Acceptable Body-worn Cameras. Masterthesis. University of Oldenburg.

[20]

Marion Koelle, Swamy Ananthanarayan, Simon Czupalla, Wilko Heuten, and Susanne Boll. 2018. Your smart glasses' camera bothers me! exploring opt-in and opt-out gestures for privacy mediation. In Proceedings of the 10th Nordic Conference on Human-Computer Interaction. 473--481.

Digital Library

[21]

Marion Koelle, Matthias Kranz, and Andreas Möller. 2015. Don't look at me that way! understanding user attitudes towards data glasses usage. In Proceedings of the 17th international conference on human-computer interaction with mobile devices and services. 362--372.

Digital Library

[22]

Marion Koelle, Thomas Olsson, Robb Mitchell, Julie Williamson, and Susanne Boll. 2019. What is (Un)Acceptable? Thoughts on Social Acceptability in HCI Research. Interactions 26, 3 (apr 2019), 36--40. https://doi.org/10.1145/3319073

Digital Library

[23]

Jacob Leon Kröger, Otto Hans-Martin Lutz, and Florian Müller. 2019. What does your gaze reveal about you? On the privacy implications of eye tracking. In IFIP International Summer School on Privacy and Identity Management. Springer, 226--241.

[24]

Bruno Laeng and Liv Falkenberg. 2007. Women's pupillary responses to sexually significant others during the hormonal cycle. Hormones and behavior 52, 4 (2007), 520--530.

[25]

Päivi Majaranta. 2011. Gaze Interaction and Applications of Eye Tracking: Advances in Assistive Technologies: Advances in Assistive Technologies. IGI Global.

[26]

Päivi Majaranta and Andreas Bulling. 2014. Eye Tracking and Eye-Based Human--Computer Interaction. Springer London, London, 39--65. https://doi.org/10.1007/978--1--4471--6392--3_3

[27]

Päivi Majaranta and Kari-Jouko Räihä. 2007. Text entry by gaze: Utilizing eye-tracking. Text entry systems: Mobility, accessibility, universality (2007), 175--187.

[28]

Naresh K Malhotra, Sung S Kim, and James Agarwal. 2004. Internet users' information privacy concerns (IUIPC): The construct, the scale, and a causal model. Information systems research 15, 4 (2004), 336--355.

[29]

Karola Marky, Sarah Prange, Max Mühlhäuser, and Florian Alt. 2021. Roles Matter! Understanding Differences in the Privacy Mental Models of Smart Home Visitors and Residents. Association for Computing Machinery, New York, NY, USA, 108--122. https://doi.org/10.1145/3490632.3490664

Digital Library

[30]

Sven Mayer, Gierad Laput, and Chris Harrison. 2020. Enhancing mobile voice assistants with worldgaze. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1--10.

Digital Library

[31]

Calkin S Montero, Jason Alexander, Mark T Marshall, and Sriram Subramanian. 2010. Would you do that? Understanding social acceptance of gestural interfaces. In Proceedings of the 12th international conference on Human computer interaction with mobile devices and services. 275--278.

Digital Library

[32]

Omar Namnakani, Yasmeen Abdrabou, Jonathan Grizou, Augusto Esteves, and Mohamed Khamis. 2023. Comparing Dwell time, Pursuits and Gaze Gestures for Gaze Interaction on Handheld Mobile Devices. In Proceedings of the 41st Annual ACM Conference on Human Factors in Computing Systems (Hamburg, Germany) (CHI '23). ACM, New York, NY, USA. https://doi.org/10.1145/3544548.3580871

Digital Library

[33]

Gie-seo Park, Jong-gil Ahn, and Gerard J Kim. 2011. Gaze-directed hands-free interface for mobile interaction. In International Conference on Human-Computer Interaction. Springer, 304--313.

[34]

Alfredo J Perez, Sherali Zeadally, and Scott Griffith. 2017. Bystanders' privacy. IT Professional 19, 3 (2017), 61--65.

Digital Library

[35]

Sören Preibusch. 2014. Eye-tracking. Privacy interfaces for the next ubiquitous modality. In 2014 W3C Workshop on Privacy and User-Centric Controls.

[36]

George E. Raptis, Christos Fidas, and Nikolaos Avouris. 2019. Do Game Designers' Decisions Related to Visual Activities Affect Knowledge Acquisition in Cultural Heritage Games? An Evaluation From a Human Cognitive Processing Perspective. J. Comput. Cult. Herit. 12, 1, Article 4 (feb 2019), 25 pages. https://doi.org/10.1145/3292057

Digital Library

[37]

George E. Raptis, Christina Katsini, Marios Belk, Christos Fidas, George Samaras, and Nikolaos Avouris. 2017. Using Eye Gaze Data and Visual Activities to Infer Human Cognitive Styles: Method and Feasibility Studies. In Proceedings of the 25th Conference on User Modeling, Adaptation and Personalization (Bratislava, Slovakia) (UMAP '17). Association for Computing Machinery, New York, NY, USA, 164--173. https://doi.org/10.1145/3079628.3079690

Digital Library

[38]

D. Rozado, T. Moreno, J. San Agustin, F. B. Rodriguez, and P. Varona. 2015. Controlling a Smartphone Using Gaze Gestures as the Input Mechanism. Human--Computer Interaction 30, 1 (2015), 34--63. https://doi.org/10.1080/07370024. 2013.870385 arXiv:https://doi.org/10.1080/07370024.2013.870385

Digital Library

[39]

Javier San Agustin, John Paulin Hansen, and Martin Tall. 2010. Gaze-Based Interaction with Public Displays Using off-the-Shelf Components. In Proceedings of the 12th ACM International Conference Adjunct Papers on Ubiquitous Computing - Adjunct (Copenhagen, Denmark) (UbiComp '10 Adjunct). Association for Computing Machinery, New York, NY, USA, 377--378. https://doi.org/10.1145/1864431.1864444

Digital Library

[40]

Julian Steil, Inken Hagestedt, Michael Xuelin Huang, and Andreas Bulling. 2019. Privacy-aware eye tracking using differential privacy. In Proceedings of the 11th ACM Symposium on Eye Tracking Research & Applications. 1--9.

Digital Library

[41]

Pauline van der Wel and Henk van Steenbergen. 2018. Pupil dilation as an index of effort in cognitive control tasks: A review. Psychonomic bulletin & review 25, 6 (2018), 2005--2015.

[42]

Yaxing Yao, Justin Reed Basdeo, Oriana Rosata Mcdonough, and Yang Wang. 2019. Privacy Perceptions and Designs of Bystanders in Smart Homes. Proc. ACM Hum.-Comput. Interact. 3, CSCW, Article 59 (nov 2019), 24 pages. https: //doi.org/10.1145/3359161

Digital Library

[43]

Yaxing Yao, Huichuan Xia, Yun Huang, and Yang Wang. 2017. Privacy Mechanisms for Drones: Perceptions of Drone Controllers and Bystanders. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI '17). Association for Computing Machinery, New York, NY, USA, 6777--6788. https: //doi.org/10.1145/3025453.3025907

Digital Library

[44]

Jakub ?evcech and Mária Bieliková. 2014. User's Interest Detection through Eye Tracking for Related Documents Retrieval. In 2014 9th International Workshop on Semantic and Social Media Adaptation and Personalization. 9--13. https://doi.org/10.1109/SMAP.2014.20

Digital Library

Cited By

Abdrabou YOmelina TDietz FKhamis MAlt FHassib M(2024)Where Do You Look When Unlocking Your Phone? : A Field Study of Gaze Behaviour During Smartphone UnlockExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3651094(1-7)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3651094

Index Terms

Investigating Privacy Perceptions and Subjective Acceptance of Eye Tracking on Handheld Mobile Devices
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Empirical studies in HCI
2. Security and privacy
  1. Human and societal aspects of security and privacy

Recommendations

DynamicRead: Exploring Robust Gaze Interaction Methods for Reading on Handheld Mobile Devices under Dynamic Conditions
ETRA

Enabling gaze interaction in real-time on handheld mobile devices has attracted significant attention in recent years. An increasing number of research projects have focused on sophisticated appearance-based deep learning models to enhance the precision ...
Comparing Dwell time, Pursuits and Gaze Gestures for Gaze Interaction on Handheld Mobile Devices
CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems

Gaze is promising for hands-free interaction on mobile devices. However, it is not clear how gaze interaction methods compare to each other in mobile settings. This paper presents the first experiment in a mobile setting that compares three of the most ...
4th international workshop on pervasive eye tracking and mobile eye-based interaction
UbiComp '14 Adjunct: Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct Publication

Previous work on eye tracking and eye-based human-computer interfaces mainly concentrated on making use of the eyes in traditional desktop settings. With the recent growth of interest in smart glass devices and low-cost eye trackers, however, gaze-based ...

Comments

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Human-Computer Interaction

Proceedings of the ACM on Human-Computer Interaction Volume 7, Issue ETRA

ETRA

May 2023

234 pages

EISSN:2573-0142

DOI:10.1145/3597645

Editor:
Jeff Nichols
Apple Inc., United States

Issue’s Table of Contents

Copyright © 2023 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 May 2023

Published in PACMHCI Volume 7, Issue ETRA

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Data Availability

Presentation video https://dl.acm.org/doi/10.1145/3591133#Investigating Privacy Perceptions.mp4

Paper Title: Privacy Perceptions and Subjective Acceptance of Eye Tracking on Handheld Mobile Devices Authors: Noora Alsakar et al. https://dl.acm.org/doi/10.1145/3591133#V7etra164aux.zip

Funding Sources

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
216
Total Downloads

Downloads (Last 12 months)101
Downloads (Last 6 weeks)10

Reflects downloads up to 09 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Abdrabou YOmelina TDietz FKhamis MAlt FHassib M(2024)Where Do You Look When Unlocking Your Phone? : A Field Study of Gaze Behaviour During Smartphone UnlockExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3651094(1-7)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3651094

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents