Work in Progress

Voicing Suggestions and Enabling Reflection: Results of an Expert Discussion on Proactive Assistants for Time Management

Authors:

Jovan Jeromela,

Owen ConlanAuthors Info & Claims

CUI '23: Proceedings of the 5th International Conference on Conversational User Interfaces

Article No.: 48, Pages 1 - 6

https://doi.org/10.1145/3571884.3604317

Published: 19 July 2023 Publication History

Abstract

While voice-controllable Intelligent Personal Assistants (IPAs) have become widespread in recent years, they remain primarily reactive with rather constrained calendaring capabilities. Anticipating more adaptive and complex assistants in the future, we organised a multidisciplinary expert discussion investigating potential use cases, interaction principles, and user modelling challenges within proactive IPAs for time management. This paper presents the identified themes and deliberations on enticing self-reflection, longitudinal task assistance, interaction modality, dialogue design, perception of the system, usage willingness, onboarding, and explainability. These findings outline a framework of advanced IPAs for time management.

References

[1]

Andreas Balaskas, Stephen M Schueller, Anna L Cox, and Gavin Doherty. 2022. Understanding users’ perspectives on mobile apps for anxiety management. Frontiers in Digital Health (2022), 178.

[2]

Pauline M. Berry, Thierry Donneau-Golencer, Khang Duong, Melinda Gervasio, Bart Peintner, and Neil Yorke-Smith. 2017. Evaluating intelligent knowledge systems: experiences with a user-adaptive assistant agent. Knowledge and Information Systems 52, 2 (2017), 379–409. https://doi.org/10.1007/s10115-016-1011-3

Digital Library

[3]

Judith Borghouts, Elizabeth Eikey, Gloria Mark, Cinthia De Leon, Stephen M Schueller, Margaret Schneider, Nicole Stadnick, Kai Zheng, Dana Mukamel, Dara H Sorkin, 2021. Barriers to and facilitators of user engagement with digital mental health interventions: systematic review. Journal of medical Internet research 23, 3 (2021), e24387.

[4]

Virginia Braun and Victoria Clarke. 2006. Using thematic analysis in psychology. Qualitative Research in Psychology 3, 2 (2006), 77–101. https://doi.org/10.1191/1478088706qp063oa

[5]

Leigh Clark, Philip Doyle, Diego Garaialde, Emer Gilmartin, Stephan Schlögl, Jens Edlund, Matthew Aylett, João Cabral, Cosmin Munteanu, Justin Edwards, and Benjamin R Cowan. 2019. The State of Speech in HCI: Trends, Themes and Challenges. Interacting with Computers 31, 4 (2019), 349–371. https://doi.org/10.1093/iwc/iwz016

[6]

Benjamin R. Cowan, Nadia Pantidi, David Coyle, Kellie Morrissey, Peter Clarke, Sara Al-Shehri, David Earley, and Natasha Bandeira. 2017. "What can i help you with?": infrequent users’ experiences of intelligent personal assistants., Article 43 pages. https://doi.org/10.1145/3098279.3098539

Digital Library

[7]

Justin Cranshaw, Emad Elwany, Todd Newman, Rafal Kocielnik, Bowen Yu, Sandeep Soni, Jaime Teevan, and Andrés Monroy-Hernández. 2017. Calendar.Help: Designing a Workflow-Based Scheduling Agent with Humans in the Loop. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI ’17). Association for Computing Machinery, New York, NY, USA, 2382–2393. https://doi.org/10.1145/3025453.3025780

Digital Library

[8]

Allan de Barcelos Silva, Marcio Miguel Gomes, Cristiano André da Costa, Rodrigo da Rosa Righi, Jorge Luis Victoria Barbosa, Gustavo Pessin, Geert De Doncker, and Gustavo Federizzi. 2020. Intelligent personal assistants: A systematic literature review. Expert Systems with Applications 147 (2020), 113193. https://doi.org/10.1016/j.eswa.2020.113193

Digital Library

[9]

Eduardo Islas-Cota, J. Octavio Gutierrez-Garcia, Christian O. Acosta, and Luis-Felipe Rodríguez. 2022. A systematic review of intelligent assistants. Future Generation Computer Systems 128 (2022), 45–62. https://doi.org/10.1016/j.future.2021.09.035

Digital Library

[10]

Pranut Jain, Rosta Farzan, and Adam J. Lee. 2022. Laila is in a Meeting: Design and Evaluation of a Contextual Auto-Response Messaging Agent. In Designing Interactive Systems Conference (Virtual Event, Australia) (DIS ’22). Association for Computing Machinery, New York, NY, USA, 1457–1471. https://doi.org/10.1145/3532106.3533493

Digital Library

[11]

Jovan Jeromela. 2022. Scrutability of Intelligent Personal Assistants. In Proceedings of the 30th ACM Conference on User Modeling, Adaptation and Personalization (Barcelona, Spain) (UMAP ’22). Association for Computing Machinery, New York, NY, USA, 335–340. https://doi.org/10.1145/3503252.3534355

Digital Library

[12]

Judy Kay. 1998. A scrutable user modelling shell for user-adapted interaction. Doctoral dissertation. Basser Department of Computer Science, Faculty of Science, University of Sydney.

[13]

Judy Kay and Bob Kummerfeld. 2013. Creating Personalized Systems That People Can Scrutinize and Control: Drivers, Principles and Experience. ACM Trans. Interact. Intell. Syst. 2, 4, Article 24 (jan 2013), 42 pages. https://doi.org/10.1145/2395123.2395129

Digital Library

[14]

Ewa Luger and Abigail Sellen. 2016. "Like Having a Really Bad PA": The Gulf between User Expectation and Experience of Conversational Agents., 5286–5297 pages. https://doi.org/10.1145/2858036.2858288

Digital Library

[15]

Michal Luria, Rebecca Zheng, Bennett Huffman, Shuangni Huang, John Zimmerman, and Jodi Forlizzi. 2020. Social Boundaries for Personal Agents in the Interpersonal Space of the Home. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3313831.3376311

Digital Library

[16]

Christian Meurisch, Maria-Dorina Ionescu, Benedikt Schmidt, and Max Mühlhäuser. 2017. Reference model of next-generation digital personal assistant: integrating proactive behavior. In Proceedings of the 2017 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2017 ACM International Symposium on Wearable Computers. 149–152.

Digital Library

[17]

Roger K. Moore. 2017. Is Spoken Language All-or-Nothing? Implications for Future Speech-Based Human-Machine Interaction. Springer Singapore, Singapore, 281–291. https://doi.org/10.1007/978-981-10-2585-3_22

[18]

Roger K. Moore and Mauro Nicolao. 2017. Toward a Needs-Based Architecture for ‘Intelligent’ Communicative Agents: Speaking with Intention. Frontiers in Robotics and AI 4 (2017). https://doi.org/10.3389/frobt.2017.00066

[19]

Christine Murad and Cosmin Munteanu. 2019. "I Don’t Know What You’re Talking about, HALexa": The Case for Voice User Interface Guidelines. In Proceedings of the 1st International Conference on Conversational User Interfaces (Dublin, Ireland) (CUI ’19). Association for Computing Machinery, New York, NY, USA, Article 9, 3 pages. https://doi.org/10.1145/3342775.3342795

Digital Library

[20]

Martin Porcheron, Joel E. Fischer, Stuart Reeves, and Sarah Sharples. 2018. Voice Interfaces in Everyday Life. Association for Computing Machinery, Paper 640. https://doi.org/10.1145/3173574.3174214

Digital Library

[21]

Yu Sun, Nicholas Jing Yuan, Yingzi Wang, Xing Xie, Kieran McDonald, and Rui Zhang. 2016. Contextual Intent Tracking for Personal Assistants., 273–282 pages. https://doi.org/10.1145/2939672.2939676

Digital Library

[22]

Yu Sun, Nicholas Jing Yuan, Xing Xie, Kieran McDonald, and Rui Zhang. 2017. Collaborative Intent Prediction with Real-Time Contextual Data. ACM Trans. Inf. Syst. 35, 4 (2017), Article 30. https://doi.org/10.1145/3041659

Digital Library

[23]

Carlos Toxtli, Andrés Monroy-Hernández, and Justin Cranshaw. 2018. Understanding Chatbot-Mediated Task Management. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–6. https://doi.org/10.1145/3173574.3173632

Digital Library

[24]

Sruthi Viswanathan, Fabien Guillot, Minsuk Chang, Antonietta Maria Grasso, and Jean-Michel Renders. 2022. Addressing Hiccups in Conversations with Recommender Systems. In Designing Interactive Systems Conference (Virtual Event, Australia) (DIS ’22). Association for Computing Machinery, New York, NY, USA, 1243–1259. https://doi.org/10.1145/3532106.3533491

Digital Library

[25]

Sarah Theres Völkel, Daniel Buschek, Malin Eiband, Benjamin R. Cowan, and Heinrich Hussmann. 2021. Eliciting and Analysing Users’ Envisioned Dialogues with Perfect Voice Assistants. Association for Computing Machinery, Article 254. https://doi.org/10.1145/3411764.3445536

Digital Library

[26]

Brian Whitworth. 2005. Polite Computing. Behaviour & Information Technology 24, 5 (2005), 353–363. https://doi.org/10.1080/01449290512331333700 arXiv:https://doi.org/10.1080/01449290512331333700

[27]

Jun Xiao, Richard Catrambone, and John T Stasko. 2003. Be Quiet? Evaluating Proactive and Reactive User Interface Assistants. Technical Report. Georgia Institute of Technology.

[28]

Neil Yorke-Smith, Shahin Saadati, Karen L Myers, and David N Morley. 2012. The design of a proactive personal agent for task management. International Journal on Artificial Intelligence Tools 21, 01 (2012), 30. https://doi.org/10.1142/S0218213012500042

[29]

Nima Zargham, Leon Reicherts, Michael Bonfert, Sarah Theres Voelkel, Johannes Schoening, Rainer Malaka, and Yvonne Rogers. 2022. Understanding Circumstances for Desirable Proactive Behaviour of Voice Assistants: The Proactivity Dilemma. In Proceedings of the 4th Conference on Conversational User Interfaces (Glasgow, United Kingdom) (CUI ’22). Association for Computing Machinery, New York, NY, USA, Article 3, 14 pages. https://doi.org/10.1145/3543829.3543834

Digital Library

Cited By

Mathis LBubeck CPeissner M(2024)When to Approach the User: Investigating Suitable Context Factors for Proactive Voice Assistance in Automated CarsProceedings of Mensch und Computer 202410.1145/3670653.3670672(299-309)Online publication date: 1-Sep-2024
https://dl.acm.org/doi/10.1145/3670653.3670672
Jeromela JConlan OBoratto LGena CMarras MGermanakos PPopescus E(2024)Devising Scrutable User Models for Time Management AssistantsAdjunct Proceedings of the 32nd ACM Conference on User Modeling, Adaptation and Personalization10.1145/3631700.3665182(250-255)Online publication date: 27-Jun-2024
https://dl.acm.org/doi/10.1145/3631700.3665182
Jeromela JConlan O(2023)Onboarding Stages and Scrutable Interaction: How Experts Envisioned Explainability in Proactive Time Management AssistantsProceedings of the 11th International Conference on Human-Agent Interaction10.1145/3623809.3623851(306-315)Online publication date: 4-Dec-2023
https://dl.acm.org/doi/10.1145/3623809.3623851

Index Terms

Voicing Suggestions and Enabling Reflection: Results of an Expert Discussion on Proactive Assistants for Time Management
1. Human-centered computing

Recommendations

Onboarding Stages and Scrutable Interaction: How Experts Envisioned Explainability in Proactive Time Management Assistants
HAI '23: Proceedings of the 11th International Conference on Human-Agent Interaction

Intelligent Personal Assistants (IPAs) have become increasingly ubiquitous, yet they remain primarily reactive, non-personalised, and inscrutable. Moreover, concerns regarding user control, data stewardship, and communication design persist in the ...
Eliciting and Analysing Users’ Envisioned Dialogues with Perfect Voice Assistants
CHI '21: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems

We present a dialogue elicitation study to assess how users envision conversations with a perfect voice assistant (VA). In an online survey, N=205 participants were prompted with everyday scenarios, and wrote the lines of both user and VA in dialogues ...
Tickling Proactivity: Exploring the Use of Humor in Proactive Voice Assistants
MUM '23: Proceedings of the 22nd International Conference on Mobile and Ubiquitous Multimedia

With rapid advances in artificial intelligence and natural language processing, voice assistants are evolving into advanced digital personal assistants capable of complex tasks. As they become more proficient at understanding people’s behaviors, ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CUI '23: Proceedings of the 5th International Conference on Conversational User Interfaces

July 2023

504 pages

ISBN:9798400700149

DOI:10.1145/3571884

Editors:
Minha Lee
Eindhoven University of Technology, Netherlands
,
Cosmin Munteanu
University of Waterloo, Canada
,
Martin Porcheron
Bold Insight, UK
,
Johanne Trippas
RMIT University, Australia
,
Sarah Theres Völkel
Google, Germany

Copyright © 2023 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 19 July 2023

Check for updates

Author Tags

Qualifiers

Work in progress
Research
Refereed limited

Funding Sources

Science Foundation Ireland

Conference

CUI '23

Sponsor:

SIGCHI

CUI '23: ACM conference on Conversational User Interfaces

July 19 - 21, 2023

Eindhoven, Netherlands

Acceptance Rates

Overall Acceptance Rate 34 of 100 submissions, 34%

Upcoming Conference

CUI '25

Sponsor:
sigchi

ACM Conversational User Interfaces 2025

July 7 - 9, 2025

Waterloo , ON , Canada

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
125
Total Downloads

Downloads (Last 12 months)55
Downloads (Last 6 weeks)4

Reflects downloads up to 01 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Mathis LBubeck CPeissner M(2024)When to Approach the User: Investigating Suitable Context Factors for Proactive Voice Assistance in Automated CarsProceedings of Mensch und Computer 202410.1145/3670653.3670672(299-309)Online publication date: 1-Sep-2024
https://dl.acm.org/doi/10.1145/3670653.3670672
Jeromela JConlan OBoratto LGena CMarras MGermanakos PPopescus E(2024)Devising Scrutable User Models for Time Management AssistantsAdjunct Proceedings of the 32nd ACM Conference on User Modeling, Adaptation and Personalization10.1145/3631700.3665182(250-255)Online publication date: 27-Jun-2024
https://dl.acm.org/doi/10.1145/3631700.3665182
Jeromela JConlan O(2023)Onboarding Stages and Scrutable Interaction: How Experts Envisioned Explainability in Proactive Time Management AssistantsProceedings of the 11th International Conference on Human-Agent Interaction10.1145/3623809.3623851(306-315)Online publication date: 4-Dec-2023
https://dl.acm.org/doi/10.1145/3623809.3623851

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Figures

Tables

Media

View Table of Conten