User-Centered Investigation of Features for Attention Management Systems in an Online Vignette Study
Pages 108 - 121
Abstract
Notifications and interruptions have shown to significantly impede task performance while causing stress. Attention management systems aim at mitigating these negative effects, for example, by delaying interruptions to task boundaries or times of low mental load. However, while the theoretical benefits of such an approach are well-documented, it is quite unclear how holding back information from users is accepted, especially in times of the “always-on-mentality”. Thus, we conducted an online vignette experiment with N=163 participants, who were presented hypothetical private and work-related scenarios where interruptions are delayed by attention management systems. Participants rated how long they would allow particular interruptions to be delayed, as well as which data collection methods a system could use to perform these decisions. Our results show that interruption management is desired by potential users, provided they feel in control. We conclude with recommendations for the design of attention management systems.
References
[1]
Piotr D. Adamczyk and Brian P. Bailey. 2004. If Not Now, when?: The Effects of Interruption at Different Moments Within Task Execution. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Vienna, Austria) (CHI ’04). ACM, New York, NY, USA, 271–278. https://doi.org/10.1145/985692.985727
[2]
Saleema Amershi, Dan Weld, Mihaela Vorvoreanu, Adam Fourney, Besmira Nushi, Penny Collisson, Jina Suh, Shamsi Iqbal, Paul N. Bennett, Kori Inkpen, Jaime Teevan, Ruth Kikin-Gil, and Eric Horvitz. 2019. Guidelines for Human-AI Interaction. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3290605.3300233
[3]
Christoph Anderson, Isabel Hübener, Ann-Kathrin Seipp, Sandra Ohly, Klaus David, and Veljko Pejovic. 2018. A Survey of Attention Management Systems in Ubiquitous Computing Environments. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 2, 2, Article 58 (jul 2018), 27 pages. https://doi.org/10.1145/3214261
[4]
Christiane Atzmüller and Peter M. Steiner. 2010. Experimental Vignette Studies in Survey Research. Methodology 6, 3 (2010), 128–138. https://doi.org/10.1027/1614-2241/a000014 arXiv:https://doi.org/10.1027/1614-2241/a000014
[5]
Thom Baguley, Grace Dunham, and Oonagh Steer. 2022. Statistical modelling of vignette data in psychology. British Journal of Psychology 113, 4 (2022), 1143–1163.
[6]
Brian P. Bailey and Joseph A. Konstan. 2006. On the need for attention-aware systems: Measuring effects of interruption on task performance, error rate, and affective state. Computers in Human Behavior 22, 4 (2006), 685 – 708. https://doi.org/10.1016/j.chb.2005.12.009 Attention aware systems.
[7]
Peter Bogunovich and Dario Salvucci. 2011. The effects of time constraints on user behavior for deferrable interruptions. In Proceedings of the SIGCHI conference on human factors in computing systems. 3123–3126.
[8]
JP Borst and NA Taatgen. 2007. The costs of multitasking in threaded cognition., 133–138 pages.
[9]
Jelmer P Borst, Niels A Taatgen, and Hedderik Van Rijn. 2010. The problem state: a cognitive bottleneck in multitasking.Journal of Experimental Psychology: Learning, memory, and cognition 36, 2 (2010), 363.
[10]
Jelmer P Borst, Niels A Taatgen, and Hedderik van Rijn. 2015. What makes interruptions disruptive? A process-model account of the effects of the problem state bottleneck on task interruption and resumption. In Proceedings of the 33rd annual ACM conference on human factors in computing systems. 2971–2980.
[11]
Caroline Bradbury-Jones, Julie Taylor, and OR Herber. 2014. Vignette development and administration: a framework for protecting research participants. International Journal of Social Research Methodology 17, 4 (2014), 427–440.
[12]
David M Cades, Deborah A Boehm Davis, J Gregory Trafton, and Christopher A Monk. 2007. Does the difficulty of an interruption affect our ability to resume?. In Proceedings of the human factors and ergonomics society annual meeting, Vol. 51. SAGE Publications Sage CA: Los Angeles, CA, 234–238.
[13]
R. H. B. Christensen. 2022. ordinal—Regression Models for Ordinal Data. R package version 2022.11-16. https://CRAN.R-project.org/package=ordinal.
[14]
Jon D Elhai, Jason C Levine, Robert D Dvorak, and Brian J Hall. 2016. Fear of missing out, need for touch, anxiety and depression are related to problematic smartphone use. Computers in Human Behavior 63 (2016), 509–516.
[15]
Spencer C Evans, Michael C Roberts, Jared W Keeley, Jennifer B Blossom, Christina M Amaro, Andrea M Garcia, Cathleen Odar Stough, Kimberly S Canter, Rebeca Robles, and Geoffrey M Reed. 2015. Vignette methodologies for studying clinicians’ decision-making: Validity, utility, and application in ICD-11 field studies. International journal of clinical and health psychology 15, 2 (2015), 160–170.
[16]
Janet Finch. 1987. The vignette technique in survey research. Sociology 21, 1 (1987), 105–114.
[17]
Joel E. Fischer, Chris Greenhalgh, and Steve Benford. 2011. Investigating Episodes of Mobile Phone Activity as Indicators of Opportune Moments to Deliver Notifications. In Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services (Stockholm, Sweden) (MobileHCI ’11). Association for Computing Machinery, New York, NY, USA, 181–190. https://doi.org/10.1145/2037373.2037402
[18]
Helen M Hodgetts and Dylan M Jones. 2006. Interruption of the Tower of London task: support for a goal-activation approach.Journal of Experimental Psychology: General 135, 1 (2006), 103.
[19]
Eric Horvitz. 1999. Principles of Mixed-initiative User Interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Pittsburgh, Pennsylvania, USA) (CHI ’99). ACM, New York, NY, USA, 159–166. https://doi.org/10.1145/302979.303030
[20]
ECMCE Horvitz. 2001. Notification, disruption, and memory: Effects of messaging interruptions on memory and performance. In Human-Computer Interaction: INTERACT, Vol. 1. 263.
[21]
Shamsi T. Iqbal and Brian P. Bailey. 2005. Investigating the Effectiveness of Mental Workload As a Predictor of Opportune Moments for Interruption. In CHI ’05 Extended Abstracts on Human Factors in Computing Systems (Portland, OR, USA) (CHI EA ’05). ACM, New York, NY, USA, 1489–1492. https://doi.org/10.1145/1056808.1056948
[22]
Shamsi T. Iqbal and Eric Horvitz. 2010. Notifications and Awareness: A Field Study of Alert Usage and Preferences. In Proceedings of the 2010 ACM Conference on Computer Supported Cooperative Work (Savannah, Georgia, USA) (CSCW ’10). Association for Computing Machinery, New York, NY, USA, 27–30. https://doi.org/10.1145/1718918.1718926
[23]
Gloria Mark, Daniela Gudith, and Ulrich Klocke. 2008. The cost of interrupted work: more speed and stress. In Proceedings of the SIGCHI conference on Human Factors in Computing Systems. 107–110.
[24]
Anouk Mols and Jason Pridmore. 2021. Always available via WhatsApp: Mapping everyday boundary work practices and privacy negotiations. Mobile Media & Communication 9, 3 (2021), 422–440. https://doi.org/10.1177/2050157920970582 arXiv:https://doi.org/10.1177/2050157920970582
[25]
Alexander Neff and Philipp Wintersberger. 2022. An Experience Sampling Study to Evaluate Why Users Dismiss Smartphone Notifications. In Adjunct Publication of the 24th International Conference on Human-Computer Interaction with Mobile Devices and Services (Vancouver, BC, Canada) (MobileHCI ’22). Association for Computing Machinery, New York, NY, USA, Article 18, 5 pages. https://doi.org/10.1145/3528575.3551446
[26]
Tadashi Okoshi, Julian Ramos, Hiroki Nozaki, Jin Nakazawa, Anind K. Dey, and Hideyuki Tokuda. 2015. Reducing Users’ Perceived Mental Effort Due to Interruptive Notifications in Multi-Device Mobile Environments. In Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing (Osaka, Japan) (UbiComp ’15). Association for Computing Machinery, New York, NY, USA, 475–486. https://doi.org/10.1145/2750858.2807517
[27]
Antti Oulasvirta and Pertti Saariluoma. 2006. Surviving task interruptions: Investigating the implications of long-term working memory theory. International Journal of Human-Computer Studies 64, 10 (Oct. 2006), 941–961. https://doi.org/10.1016/j.ijhcs.2006.04.006
[28]
Martin Pielot and Luz Rello. 2015. The Do Not Disturb Challenge: A Day Without Notifications. In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems (Seoul, Republic of Korea) (CHI EA ’15). Association for Computing Machinery, New York, NY, USA, 1761–1766. https://doi.org/10.1145/2702613.2732704
[29]
Martin Pielot, Amalia Vradi, and Souneil Park. 2018. Dismissed! A Detailed Exploration of How Mobile Phone Users Handle Push Notifications. In Proceedings of the 20th International Conference on Human-Computer Interaction with Mobile Devices and Services (Barcelona, Spain) (MobileHCI ’18). Association for Computing Machinery, New York, NY, USA, Article 3, 11 pages. https://doi.org/10.1145/3229434.3229445
[30]
Benjamin Poppinga, Wilko Heuten, and Susanne Boll. 2014. Sensor-Based Identification of Opportune Moments for Triggering Notifications. IEEE Pervasive Computing 13, 1 (2014), 22–29. https://doi.org/10.1109/MPRV.2014.15
[31]
Claudia Roda and Julie Thomas. 2006. Attention aware systems: Theories, applications, and research agenda. Computers in Human Behavior 22, 4 (2006), 557–587.
[32]
Dario D. Salvucci and Peter Bogunovich. 2010. Multitasking and Monotasking: The Effects of Mental Workload on Deferred Task Interruptions. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Atlanta, Georgia, USA) (CHI ’10). Association for Computing Machinery, New York, NY, USA, 85–88. https://doi.org/10.1145/1753326.1753340
[33]
Dario D Salvucci and Niels A Taatgen. 2008. Threaded cognition: an integrated theory of concurrent multitasking.Psychological review 115, 1 (2008), 101.
[34]
Dario D. Salvucci, Niels A. Taatgen, and Jelmer P. Borst. 2009. Toward a Unified Theory of the Multitasking Continuum: From Concurrent Performance to Task Switching, Interruption, and Resumption. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Boston, MA, USA) (CHI ’09). Association for Computing Machinery, New York, NY, USA, 1819–1828. https://doi.org/10.1145/1518701.1518981
[35]
Christina Schneegass and Fiona Draxler. 2021. Designing Task Resumption Cues for Interruptions in Mobile Learning Scenarios. In Technology-Augmented Perception and Cognition, Evangelos Niforatos and Tilman Dingler (Eds.). Springer International Publishing, Cham, 125–181. https://doi.org/10.1007/978-3-030-30457-7_5 Series Title: Human–Computer Interaction Series.
[36]
Hawal Shamon and Carl Berning. 2019. Attention check items and instructions in online surveys with incentivized and non-incentivized samples: Boon or bane for data quality?, 55–77 pages.
[37]
Cheri Speier, Joseph S Valacich, and Iris Vessey. 1999. The influence of task interruption on individual decision making: An information overload perspective. Decision sciences 30, 2 (1999), 337–360.
[38]
Namrata Srivastava, Rajiv Jain, Jennifer Healey, Zoya Bylinskii, and Tilman Dingler. 2021. Mitigating the Effects of Reading Interruptions by Providing Reviews and Previews. In Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI EA ’21). Association for Computing Machinery, New York, NY, USA, Article 229, 6 pages. https://doi.org/10.1145/3411763.3451610
[39]
Fabio Sticca and Sonja Perren. 2013. Is cyberbullying worse than traditional bullying? Examining the differential roles of medium, publicity, and anonymity for the perceived severity of bullying. Journal of youth and adolescence 42 (2013), 739–750.
[40]
Roel Vertegaal 2003. Attentive user interfaces. Commun. ACM 46, 3 (2003), 30–33.
[41]
Peter Vorderer, Dorothée Hefner, Leonard Reinecke, and Christoph Klimmt. 2017. Permanently online, permanently connected: Living and communicating in a POPC world.
[42]
Mark Weiser. 1991. The Computer for the 21 st Century. Scientific american 265, 3 (1991), 94–105.
[43]
Tom Wilks. 2004. The use of vignettes in qualitative research into social work values. Qualitative social work 3, 1 (2004), 78–87.
[44]
Philipp Wintersberger, Clemens Schartmüller, and Andreas Riener. 2019. Attentive user interfaces to improve multitasking and take-over performance in automated driving: the auto-net of things. International Journal of Mobile Human Computer Interaction (IJMHCI) 11, 3 (2019), 40–58.
[45]
Glenn Wylie and Alan Allport. 2000. Task switching and the measurement of “switch costs”. Psychological research 63, 3 (2000), 212–233.
[46]
Manuela Züger, Christopher Corley, André N. Meyer, Boyang Li, Thomas Fritz, David Shepherd, Vinay Augustine, Patrick Francis, Nicholas Kraft, and Will Snipes. 2017. Reducing Interruptions at Work: A Large-Scale Field Study of FlowLight. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI ’17). Association for Computing Machinery, New York, NY, USA, 61–72. https://doi.org/10.1145/3025453.3025662
[47]
Manuela Züger and Thomas Fritz. 2018. Sensing and Supporting Software Developers’ Focus. In Proceedings of the 26th Conference on Program Comprehension (Gothenburg, Sweden) (ICPC ’18). Association for Computing Machinery, New York, NY, USA, 2–6. https://doi.org/10.1145/3196321.3196323
[48]
Manuela Züger, Sebastian C. Müller, André N. Meyer, and Thomas Fritz. 2018. Sensing Interruptibility in the Office: A Field Study on the Use of Biometric and Computer Interaction Sensors. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–14. https://doi.org/10.1145/3173574.3174165
Index Terms
- User-Centered Investigation of Features for Attention Management Systems in an Online Vignette Study
Recommendations
MuM'23 Workshop on Interruptions and Attention Management
MUM '23: Proceedings of the 22nd International Conference on Mobile and Ubiquitous MultimediaAttention management systems seek to minimize disruption by intelligently timing interruptions and helping users navigate multiple tasks and activities. While there is a solid theoretical basis and rich history in HCI research for attention management, ...
Not Merely Deemed as Distraction: Investigating Smartphone Users’ Motivations for Notification-Interaction
CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing SystemsNotifications are commonly considered a distraction when they arrive during a task, and consequently, prior research has consistently sought effective ways of deferring their arrival until task transitions. However, many smartphone users still interact ...
Too tense for candy crush: affect influences user engagement with proactively suggested content
MobileHCI '17: Proceedings of the 19th International Conference on Human-Computer Interaction with Mobile Devices and ServicesPush notifications are increasingly being used to engage users with app content. In the present research, we propose that users' current affect (i.e., how they are feeling) should be a critical---yet underexplored---factor in user engagement. ...
Comments
Information & Contributors
Information
Published In
December 2023
607 pages
Copyright © 2023 Owner/Author.
This work is licensed under a Creative Commons Attribution-NoDerivatives International 4.0 License.
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 03 December 2023
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Funding Sources
- Austrian Science Fund (FWF)
Conference
MUM '23
MUM '23: International Conference on Mobile and Ubiquitous Multimedia
December 3 - 6, 2023
Vienna, Austria
Acceptance Rates
Overall Acceptance Rate 190 of 465 submissions, 41%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 164Total Downloads
- Downloads (Last 12 months)164
- Downloads (Last 6 weeks)27
Reflects downloads up to 12 Sep 2024
Other Metrics
Citations
View Options
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML FormatGet Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in