research-article

Hello There! Is Now a Good Time to Talk?: Opportune Moments for Proactive Interactions with Smart Speakers

Authors:

Cheul Young Park,

Uichin LeeAuthors Info & Claims

Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, Volume 4, Issue 3

Article No.: 74, Pages 1 - 28

https://doi.org/10.1145/3411810

Published: 04 September 2020 Publication History

Abstract

Increasing number of researchers and designers are envisioning a wide range of novel proactive conversational services for smart speakers such as context-aware reminders and restocking household items. When initiating conversational interactions proactively, smart speakers need to consider users' contexts to minimize disruption. In this work, we aim to broaden our understanding of opportune moments for proactive conversational interactions in domestic contexts. Toward this goal, we built a voice-based experience sampling device and conducted a one-week field study with 40 participants living in university dormitories. From 3,572 in-situ user experience reports, we proposed 19 activity categories to investigate contextual factors related to interruptibility. Our data analysis results show that the key determinants for opportune moments are closely related to both personal contextual factors such as busyness, mood, and resource conflicts for dual-tasking, and the other contextual factors associated with the everyday routines at home, including user mobility and social presence. Based on these findings, we discuss the need for designing context-aware proactive conversation management features that dynamically control conversational interactions based on users' contexts and routines.

References

[1]

Yomna Abdelrahman, Eduardo Velloso, Tilman Dingler, Albrecht Schmidt, and Frank Vetere. 2017. Cognitive Heat: Exploring the Usage of Thermal Imaging to Unobtrusively Estimate Cognitive Load. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 1, 3, Article 33 (sep 2017), 20 pages. https://doi.org/10.1145/3130898

Digital Library

[2]

Piotr D. Adamczyk and Brian P. Bailey. 2004. If Not Now, when?: The Effects of Interruption at Different Moments Within Task Execution. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Vienna, Austria) (CHI '04). ACM, New York, NY, USA, 271--278. https://doi.org/10.1145/985692.985727

[3]

Amazon. 2020. Alexa Skills. https://www.amazon.com/alexa-skills/b/?node=13727921011&ref_=topnav_storetab_a2s

[4]

Amazon. 2020. Alexa Voice Shopping. https://www.amazon.com/alexa-voice-shopping/b?node=14552177011

[5]

Saleema Amershi, Dan Weld, Mihaela Vorvoreanu, Adam Fourney, Besmira Nushi, Penny Collisson, Jina Suh, Shamsi Iqbal, Paul N. Bennett, Kori Inkpen, Jaime Teevan, Ruth Kikin-Gil, and Eric Horvitz. 2019. Guidelines for Human-AI Interaction. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI '19). ACM, New York, NY, USA, Article 3, 13 pages. https://doi.org/10.1145/3290605.3300233

Digital Library

[6]

Noah Apthorpe, Arunesh Mathur, Pardis Emami-Naeini, Marshini Chetty, and Nick Feamster. 2019. You, Me, and IoT: How Internet-Connected Home Devices Affect Interpersonal Relationships. In Conference Companion Publication of the 2019 on Computer Supported Cooperative Work and Social Computing (Austin, TX, USA) (CSCW '19). ACM, New York, NY, USA, 142--145. https://doi.org/10.1145/3311957.3359489

Digital Library

[7]

Till Ballendat, Nicolai Marquardt, and Saul Greenberg. 2010. Proxemic Interaction: Designing for a Proximity and Orientation-Aware Environment. In ACM International Conference on Interactive Tabletops and Surfaces (Saarbrücken, Germany) (ITS '10). Association for Computing Machinery, New York, NY, USA, 121--130. https://doi.org/10.1145/1936652.1936676

Digital Library

[8]

Erin Beneteau, Olivia K. Richards, Mingrui Zhang, Julie A. Kientz, Jason Yip, and Alexis Hiniker. 2019. Communication Breakdowns Between Families and Alexa. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI '19). ACM, New York, NY, USA, Article 243, 13 pages. https://doi.org/10.1145/3290605.3300473

Digital Library

[9]

Frank Bentley, Chris Luvogt, Max Silverman, Rushani Wirasinghe, Brooke White, and Danielle Lottridge. 2018. Understanding the Long-Term Use of Smart Speaker Assistants. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 2, 3, Article 91 (Sept. 2018), 24 pages. https://doi.org/10.1145/3264901

Digital Library

[10]

Matthias Braunhofer, Francesco Ricci, Béatrice Lamche, and Wolfgang Wörndl. 2015. A Context-Aware Model for Proactive Recommender Systems in the Tourism Domain. In Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct (Copenhagen, Denmark) (MobileHCI '15). ACM, New York, NY, USA, 1070--1075. https://doi.org/10.1145/2786567.2794332

Digital Library

[11]

Ana Paula Chaves and Marco Aurélio Gerosa. 2019. How should my chatbot interact? A survey on human-chatbot interaction design. CoRR abs/1904.02743 (2019). arXiv:1904.02743

[12]

Marshini Chetty, Ja-Young Sung, and Rebecca E. Grinter. 2007. How Smart Homes Learn: The Evolution of the Networked Home and Household. In Proceedings of the 9th International Conference on Ubiquitous Computing (Innsbruck, Austria) (UbiComp '07). Springer-Verlag, Berlin, Heidelberg, 127--144.

[13]

Ji Young Cho and Eun-Hee Lee. 2014. Reducing Confusion about Grounded Theory and Qualitative Content Analysis: Similarities and Differences. The Qualitative Report 19, 32 (2014), 1--20.

[14]

Woohyeok Choi, Sangkeun Park, Duyeon Kim, Youn-kyung Lim, and Uichin Lee. 2019. Multi-Stage Receptivity Model for Mobile Just-In-Time Health Intervention. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 3, 2, Article 39 (June 2019), 26 pages. https://doi.org/10.1145/3328910

Digital Library

[15]

Andy Crabtree and Tom Rodden. 2004. Domestic routines and design for the home. Computer Supported Cooperative Work (CSCW) 13, 2 (2004), 191--220. https://doi.org/10.1023/B:COSU.0000045712.26840.a4

Digital Library

[16]

Scott Davidoff, Min Kyung Lee, Charles Yiu, John Zimmerman, and Anind K. Dey. 2006. Principles of Smart Home Control. In Proceedings of the 8th International Conference on Ubiquitous Computing (Orange County, CA) (UbiComp'06). Springer-Verlag, Berlin, Heidelberg, 19--34.

[17]

James Fogarty, Andrew J. Ko, Htet Htet Aung, Elspeth Golden, Karen P. Tang, and Scott E. Hudson. 2005. Examining Task Engagement in Sensor-based Statistical Models of Human Interruptibility. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Portland, Oregon, USA) (CHI '05). ACM, New York, NY, USA, 331--340. https://doi.org/10.1145/1054972.1055018

[18]

Google. 2020. Google Assistant: Google Developers. https://developers.google.com/assistant

[19]

Edward Twitchell Hall. 1966. The hidden dimension. Vol. 609. Garden City, NY: Doubleday.

[20]

Javier Hernandez, Daniel McDuff, Christian Infante, Pattie Maes, Karen Quigley, and Rosalind Picard. 2016. Wearable ESM: Differences in the Experience Sampling Method Across Wearable Devices. In Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services (Florence, Italy) (MobileHCI '16). ACM, New York, NY, USA, 195--205. https://doi.org/10.1145/2935334.2935340

Digital Library

[21]

Joyce Ho and Stephen S. Intille. 2005. Using Context-aware Computing to Reduce the Perceived Burden of Interruptions from Mobile Devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Portland, Oregon, USA) (CHI '05). ACM, New York, NY, USA, 909--918. https://doi.org/10.1145/1054972.1055100

[22]

Karen Hovsepian, Mustafa al'Absi, Emre Ertin, Thomas Kamarck, Motohiro Nakajima, and Santosh Kumar. 2015. cStress: Towards a Gold Standard for Continuous Stress Assessment in the Mobile Environment. In Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing (Osaka, Japan) (UbiComp '15). ACM, New York, NY, USA, 493--504. https://doi.org/10.1145/2750858.2807526

Digital Library

[23]

Shamsi T. Iqbal and Brian P. Bailey. 2005. Investigating the Effectiveness of Mental Workload As a Predictor of Opportune Moments for Interruption. In CHI '05 Extended Abstracts on Human Factors in Computing Systems (Portland, OR, USA) (CHI EA '05). ACM, New York, NY, USA, 1489--1492. https://doi.org/10.1145/1056808.1056948

[24]

Shamsi T. Iqbal and Brian P. Bailey. 2008. Effects of Intelligent Notification Management on Users and Their Tasks. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Florence, Italy) (CHI '08). ACM, New York, NY, USA, 93--102. https://doi.org/10.1145/1357054.1357070

[25]

Tomoko Kamimura, Rina Ishiwata, and Takenobu Inoue. 2012. Medication Reminder Device for the Elderly Patients With Mild Cognitive Impairment. American Journal of Alzheimer's Disease & Other Dementiasr 27, 4 (2012), 238--242. https://doi.org/10.1177/1533317512450066

[26]

Auk Kim, Woohyeok Choi, Jungmi Park, Kyeyoon Kim, and Uichin Lee. 2018. Interrupting Drivers for Interactions: Predicting Opportune Moments for In-vehicle Proactive Auditory-verbal Tasks. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 2, 4, Article 175 (Dec. 2018), 28 pages. https://doi.org/10.1145/3287053

Digital Library

[27]

Auk Kim, Jung-Mi Park, and Uichin Lee. 2020. Interruptibility for In-Vehicle Multitasking: Influence of Voice Task Demands and Adaptive Behaviors. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 4, 1, Article 14 (March 2020), 22 pages. https://doi.org/10.1145/3381009

Digital Library

[28]

Jaejeung Kim, Joonyoung Park, Hyunsoo Lee, Minsam Ko, and Uichin Lee. 2019. LocknType: Lockout Task Intervention for Discouraging Smartphone App Use. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI '19). Association for Computing Machinery, New York, NY, USA, 1--12. https://doi.org/10.1145/3290605.3300927

Digital Library

[29]

SeungJun Kim, Jaemin Chun, and Anind K. Dey. 2015. Sensors Know When to Interrupt You in the Car: Detecting Driver Interruptibility Through Monitoring of Peripheral Interactions. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (Seoul, Republic of Korea) (CHI '15). ACM, New York, NY, USA, 487--496. https://doi.org/10.1145/2702123.2702409

[30]

Rafal Kocielnik, Daniel Avrahami, Jennifer Marlow, Di Lu, and Gary Hsieh. 2018. Designing for Workplace Reflection: A Chat and Voice-Based Conversational Agent. In Proceedings of the 2018 Designing Interactive Systems Conference (Hong Kong, China) (DIS '18). ACM, New York, NY, USA, 881--894. https://doi.org/10.1145/3196709.3196784

Digital Library

[31]

Gierad Laput, Karan Ahuja, Mayank Goel, and Chris Harrison. 2018. Ubicoustics: Plug-and-Play Acoustic Activity Recognition. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology (Berlin, Germany) (UIST '18). ACM, New York, NY, USA, 213--224. https://doi.org/10.1145/3242587.3242609

Digital Library

[32]

Josephine Lau, Benjamin Zimmerman, and Florian Schaub. 2018. Alexa, Are You Listening? Privacy Perceptions, Concerns and Privacy-Seeking Behaviors with Smart Speakers. Proc. ACM Hum.-Comput. Interact. 2, CSCW, Article 102 (Nov. 2018), 31 pages. https://doi.org/10.1145/3274371

Digital Library

[33]

Bokyung Lee, Sindy Wu, Maria Jose Reyes, and Daniel Saakes. 2019. The Effects of Interruption Timings on Autonomous Height-Adjustable Desks That Respond to Task Changes. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI '19). ACM, New York, NY, USA, Article 328, 10 pages. https://doi.org/10.1145/3290605.3300558

Digital Library

[34]

Jemin Lee, Uichin Lee, and Hyungshin Kim. 2019. PASS: Reducing Redundant Interactions between a Smartphone and a Smartwatch for Energy Saving. IEEE Transactions on Mobile Computing (2019), 1--1.

[35]

Uichin Lee, Kyungsik Han, Hyunsung Cho, Kyong-Mee Chung, Hwajung Hong, Sung-Ju Lee, Youngtae Noh, Sooyoung Park, and John M Carroll. 2019. Intelligent positive computing with mobile, wearable, and IoT devices: Literature review and research directions. Ad Hoc Networks 83 (2019), 8--24.

[36]

Irene Lopatovska and Harriet Williams. 2018. Personification of the Amazon Alexa: BFF or a Mindless Companion. In Proceedings of the 2018 Conference on Human Information Interaction & Retrieval (New Brunswick, NJ, USA) (CHIIR '18). Association for Computing Machinery, New York, NY, USA, 265--268. https://doi.org/10.1145/3176349.3176868

Digital Library

[37]

Gloria Mark, Shamsi Iqbal, Mary Czerwinski, and Paul Johns. 2015. Focused, Aroused, but So Distractible: Temporal Perspectives on Multitasking and Communications. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing (Vancouver, BC, Canada) (CSCW '15). ACM, New York, NY, USA, 903--916. https://doi.org/10.1145/2675133.2675221

Digital Library

[38]

Abhinav Mehrotra, Mirco Musolesi, Robert Hendley, and Veljko Pejovic. 2015. Designing Content-driven Intelligent Notification Mechanisms for Mobile Applications. In Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing (Osaka, Japan) (UbiComp '15). ACM, New York, NY, USA, 813--824. https://doi.org/10.1145/2750858.2807544

Digital Library

[39]

Abhinav Mehrotra, Mirco Musolesi, Robert Hendley, and Veljko Pejovic. 2015. Designing Content-Driven Intelligent Notification Mechanisms for Mobile Applications. In Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing (Osaka, Japan) (UbiComp '15). Association for Computing Machinery, New York, NY, USA, 813--824. https://doi.org/10.1145/2750858.2807544

Digital Library

[40]

Abhinav Mehrotra, Veljko Pejovic, Jo Vermeulen, Robert Hendley, and Mirco Musolesi. 2016. My Phone and Me: Understanding People's Receptivity to Mobile Notifications. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI '16). Association for Computing Machinery, New York, NY, USA, 1021--1032. https://doi.org/10.1145/2858036.2858566

Digital Library

[41]

Sarah Mennicken, Jo Vermeulen, and Elaine M. Huang. 2014. From Today's Augmented Houses to Tomorrow's Smart Homes: New Directions for Home Automation Research. In Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing (Seattle, Washington) (UbiComp '14). Association for Computing Machinery, New York, NY, USA, 105--115. https://doi.org/10.1145/2632048.2636076

[42]

Alex Mihailidis and Geoffrey R Fernie. 2002. Context-aware assistive devices for older adults with dementia. Gerontechnology 2, 2 (2002), 173--188.

[43]

Chunjong Park, Junsung Lim, Juho Kim, Sung-Ju Lee, and Dongman Lee. 2017. Don'T Bother Me. I'm Socializing!: A Breakpoint-Based Smartphone Notification System. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing (Portland, Oregon, USA) (CSCW '17). ACM, New York, NY, USA, 541--554. https://doi.org/10.1145/2998181.2998189

Digital Library

[44]

Daehee Park, Wan C. Yoon, and Uichin Lee. 2020. Cognitive States Matter: Design Guidelines for Driving Situation Awareness in Smart Vehicles. Sensors 10 (2020), 2978.

[45]

Joonyoung Park, Jin Yong Sim, Jaejeung Kim, Mun Yong Yi, and Uichin Lee. 2018. Interaction Restraint: Enforcing Adaptive Cognitive Tasks to Restrain Problematic User Interaction. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI EA '18). Association for Computing Machinery, New York, NY, USA, 1--6. https://doi.org/10.1145/3170427.3188613

Digital Library

[46]

Veljko Pejovic and Mirco Musolesi. 2014. InterruptMe: Designing Intelligent Prompting Mechanisms for Pervasive Applications. In Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing (Seattle, Washington) (UbiComp '14). ACM, New York, NY, USA, 897--908. https://doi.org/10.1145/2632048.2632062

Digital Library

[47]

Martin Pielot, Bruno Cardoso, Kleomenis Katevas, Joan Serrà, Aleksandar Matic, and Nuria Oliver. 2017. Beyond Interruptibility: Predicting Opportune Moments to Engage Mobile Phone Users. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 1, 3, Article 91 (Sept. 2017), 25 pages. https://doi.org/10.1145/3130956

Digital Library

[48]

Martin Porcheron, Joel E. Fischer, Stuart Reeves, and Sarah Sharples. 2018. Voice Interfaces in Everyday Life. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI '18). ACM, New York, NY, USA, Article 640, 12 pages. https://doi.org/10.1145/3173574.3174214

Digital Library

[49]

Amanda Purington, Jessie G. Taft, Shruti Sannon, Natalya N. Bazarova, and Samuel Hardman Taylor. 2017. "Alexa is My New BFF": Social Roles, User Satisfaction, and Personification of the Amazon Echo. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI EA '17). Association for Computing Machinery, New York, NY, USA, 2853--2859. https://doi.org/10.1145/3027063.3053246

Digital Library

[50]

Jingyan Qin, Zhibo Chen, Wenhao Zhang, Daisong Guan, Zhun Wu, and Min Zhao. 2019. Research on Active Interaction Design for Smart Speakers Agent of Home Service Robot. In International Conference on Human-Computer Interaction. Springer, 253--263.

[51]

Tom Rodden and Steve Benford. 2003. The Evolution of Buildings and Implications for the Design of Ubiquitous Domestic Environments. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Ft. Lauderdale, Florida, USA) (CHI '03). ACM, New York, NY, USA, 9--16. https://doi.org/10.1145/642611.642615

Digital Library

[52]

Ben F. Rubin and Ry Crist. 2019. What Amazon's Alexa will tell us in 2019. https://www.cnet.com/news/what-amazon-alexa-will-tell-us-in-2019/

[53]

Dario D. Salvucci, Niels A. Taatgen, and Jelmer P. Borst. 2009. Toward a Unified Theory of the Multitasking Continuum: From Concurrent Performance to Task Switching, Interruption, and Resumption. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Boston, MA, USA) (CHI '09). ACM, New York, NY, USA, 1819--1828. https://doi.org/10.1145/1518701.1518981

[54]

Alex Sciuto, Arnita Saini, Jodi Forlizzi, and Jason I. Hong. 2018. "Hey Alexa, What's Up?": A Mixed-Methods Studies of In-Home Conversational Agent Usage. In Proceedings of the 2018 Designing Interactive Systems Conference (Hong Kong, China) (DIS '18). ACM, New York, NY, USA, 857--868. https://doi.org/10.1145/3196709.3196772

Digital Library

[55]

Rob Semmens, Nikolas Martelaro, Pushyami Kaveti, Simon Stent, and Wendy Ju. 2019. Is Now A Good Time?: An Empirical Study of Vehicle-Driver Communication Timing. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI '19). ACM, New York, NY, USA, Article 637, 12 pages. https://doi.org/10.1145/3290605.3300867

Digital Library

[56]

Daniel P Siewiorek, Asim Smailagic, Junichi Furukawa, Andreas Krause, Neema Moraveji, Kathryn Reiger, Jeremy Shaffer, and Fei Lung Wong. 2003. SenSay: A Context-Aware Mobile Phone. In Seventh IEEE International Symposium on Wearable Computers, Vol. 3. 248--249. https://doi.org/10.1109/ISWC.2003.1241422

[57]

Timothy Sohn, Kevin A. Li, Gunny Lee, Ian Smith, James Scott, and William G. Griswold. 2005. Place-Its: A Study of Location-based Reminders on Mobile Phones. In Proceedings of the 7th International Conference on Ubiquitous Computing (Tokyo, Japan) (UbiComp'05). Springer-Verlag, Berlin, Heidelberg, 232--250. https://doi.org/10.1007/11551201_14

[58]

Madiha Tabassum, Tomasz Kosiundefinedski, and Heather Richter Lipford. 2019. "I Don't Own the Data": End User Perceptions of Smart Home Device Data Practices and Risks. In Proceedings of the Fifteenth USENIX Conference on Usable Privacy and Security (Santa Clara, CA, USA) (SOUPS'19). USENIX Association, USA, 435--450.

[59]

TechRepublic. 2019. Google Home: Cheat sheet. https://www.techrepublic.com/article/google-home-the-smart-persons-guide/

[60]

G. H. (Henri) ter Hofte. 2007. Xensible Interruptions from Your Mobile Phone. In Proceedings of the 9th International Conference on Human Computer Interaction with Mobile Devices and Services (Singapore) (MobileHCI '07). ACM, New York, NY, USA, 178--181. https://doi.org/10.1145/1377999.1378003

Digital Library

[61]

Peter Tolmie, James Pycock, Tim Diggins, Allan MacLean, and Alain Karsenty. 2002. Unremarkable Computing. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Minneapolis, Minnesota, USA) (CHI '02). ACM, New York, NY, USA, 399--406. https://doi.org/10.1145/503376.503448

Digital Library

[62]

Liam D. Turner, Stuart M. Allen, and Roger M. Whitaker. 2015. Interruptibility Prediction for Ubiquitous Systems: Conventions and New Directions from a Growing Field. In Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing (Osaka, Japan) (UbiComp '15). ACM, New York, NY, USA, 801--812. https://doi.org/10.1145/2750858.2807514

[63]

Michel Vacher, Benjamin Lecouteux, Pedro Chahuara, François Portet, Brigitte Meillon, and Nicolas Bonnefond. 2014. The Sweet-Home speech and multimodal corpus for home automation interaction. In The 9th edition of the Language Resources and Evaluation Conference (LREC). Reykjavik, Iceland, 4499--4506.

[64]

Niels van Berkel, Jorge Goncalves, Simo Hosio, Zhanna Sarsenbayeva, Eduardo Velloso, and Vassilis Kostakos. 2020. Overcoming compliance bias in self-report studies: A cross-study analysis. International Journal of Human-Computer Studies (2020), 1--12. https://doi.org/10.1016/j.ijhcs.2019.10.003

[65]

Voicebot.ai. 2019. LifePod is Taking Reservations for 'Proactive' Voice Assistant and Smart Speaker for the Elderly. https://voicebot.ai/2019/06/27/lifepod-is-taking-reservations-for-proactive-voice-assistant-and-smart-speaker-for-the-elderly/

[66]

Voicebot.ai. 2019. Smart speaker Consumer Adoption report. https://voicebot.ai/wp-content/uploads/2019/03/smart_speaker_consumer_adoption_report_2019.pdf

[67]

Christopher D. Wickens. 2008. Multiple Resources and Mental Workload. Human Factors 50, 3 (2008), 449--455.

[68]

Alex C. Williams, Harmanpreet Kaur, Gloria Mark, Anne Loomis Thompson, Shamsi T. Iqbal, and Jaime Teevan. 2018. Supporting Workplace Detachment and Reattachment with Conversational Intelligence. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI '18). ACM, New York, NY, USA, Article 88, 13 pages. https://doi.org/10.1145/3173574.3173662

Digital Library

[69]

Jong-bum Woo and Youn-kyung Lim. 2015. User Experience in Do-it-yourself-style Smart Homes. In Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing (Osaka, Japan) (UbiComp '15). ACM, New York, NY, USA, 779--790. https://doi.org/10.1145/2750858.2806063

[70]

Fengpeng Yuan, Xianyi Gao, and Janne Lindqvist. 2017. How Busy Are You?: Predicting the Interruptibility Intensity of Mobile Users. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI '17). ACM, New York, NY, USA, 5346--5360. https://doi.org/10.1145/3025453.3025946

Digital Library

Cited By

Bérubé CLehmann VMaritsch MKraus MFeuerriegel SWortmann FZüger TStettler CFleisch EKocaballi AKowatsch T(2024)Effectiveness and User Perception of an In-Vehicle Voice Warning for Hypoglycemia: Development and Feasibility TrialJMIR Human Factors10.2196/4282311(e42823)Online publication date: 9-Jan-2024
https://doi.org/10.2196/42823
Lee YWu MChang CChang XChang Y(2024)Investigating User-perceived Impacts of Contextual Factors on Opportune MomentsProceedings of the ACM on Human-Computer Interaction10.1145/36765148:MHCI(1-28)Online publication date: 24-Sep-2024
https://dl.acm.org/doi/10.1145/3676514
Ito MTsubouchi KNishio NShimosaka MTaya ASezaki KNishiyama YKostakos VKay JHoang T(2024)Investigating Acceptable Voice-based Notification Timings through Earable Devices: A Preliminary Field StudyCompanion of the 2024 on ACM International Joint Conference on Pervasive and Ubiquitous Computing10.1145/3675094.3677579(30-34)Online publication date: 5-Oct-2024
https://dl.acm.org/doi/10.1145/3675094.3677579
Show More Cited By

Index Terms

Hello There! Is Now a Good Time to Talk?: Opportune Moments for Proactive Interactions with Smart Speakers
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interactive systems and tools
      1. User interface management systems
  2. Ubiquitous and mobile computing

Recommendations

Understanding User Perceptions of Proactive Smart Speakers

Voice assistants, such as Amazon's Alexa and Google Home, increasingly find their way into consumer homes. Their functionality, however, is currently limited to being passive answer machines rather than proactively engaging users in conversations. ...
Poster: Toward Context-aware Proactive Conversation for Smart Speakers
UbiComp/ISWC '21 Adjunct: Adjunct Proceedings of the 2021 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2021 ACM International Symposium on Wearable Computers

Despite the increasing popularity of novel conversational services for smart speakers, the current ones have supported limited proactive interactions. In this work, we focus to understand opportune moments for proactive conversational interactions in ...
Interrupting for Microlearning: Understanding Perceptions and Interruptibility of Proactive Conversational Microlearning Services
CHI '24: Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems

Significant investment of time and effort for language learning has prompted a growing interest in microlearning. While microlearning requires frequent participation in 3-to-10-minute learning sessions, the recent widespread of smart speakers in homes ...

Comments

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies

Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies Volume 4, Issue 3

September 2020

1061 pages

EISSN:2474-9567

DOI:10.1145/3422862

Issue’s Table of Contents

Copyright © 2020 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 04 September 2020

Published in IMWUT Volume 4, Issue 3

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Funding Sources

National Research Foundation of Korea

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

51
Total Citations
View Citations
1,392
Total Downloads

Downloads (Last 12 months)294
Downloads (Last 6 weeks)28

Reflects downloads up to 15 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Bérubé CLehmann VMaritsch MKraus MFeuerriegel SWortmann FZüger TStettler CFleisch EKocaballi AKowatsch T(2024)Effectiveness and User Perception of an In-Vehicle Voice Warning for Hypoglycemia: Development and Feasibility TrialJMIR Human Factors10.2196/4282311(e42823)Online publication date: 9-Jan-2024
https://doi.org/10.2196/42823
Lee YWu MChang CChang XChang Y(2024)Investigating User-perceived Impacts of Contextual Factors on Opportune MomentsProceedings of the ACM on Human-Computer Interaction10.1145/36765148:MHCI(1-28)Online publication date: 24-Sep-2024
https://dl.acm.org/doi/10.1145/3676514
Ito MTsubouchi KNishio NShimosaka MTaya ASezaki KNishiyama YKostakos VKay JHoang T(2024)Investigating Acceptable Voice-based Notification Timings through Earable Devices: A Preliminary Field StudyCompanion of the 2024 on ACM International Joint Conference on Pervasive and Ubiquitous Computing10.1145/3675094.3677579(30-34)Online publication date: 5-Oct-2024
https://dl.acm.org/doi/10.1145/3675094.3677579
Mathis LBubeck CPeissner M(2024)When to Approach the User: Investigating Suitable Context Factors for Proactive Voice Assistance in Automated CarsProceedings of Mensch und Computer 202410.1145/3670653.3670672(299-309)Online publication date: 1-Sep-2024
https://dl.acm.org/doi/10.1145/3670653.3670672
Ahire SOthman SRohs M(2024)Dual-Mode Interventions: Giving Agency to Knowledge Workers in Proactive Health InterventionsProceedings of the 6th ACM Conference on Conversational User Interfaces10.1145/3640794.3665578(1-7)Online publication date: 8-Jul-2024
https://dl.acm.org/doi/10.1145/3640794.3665578
Ahire SSimon BRohs M(2024)WorkFit: Designing Proactive Voice Assistance for the Health and Well-Being of Knowledge WorkersProceedings of the 6th ACM Conference on Conversational User Interfaces10.1145/3640794.3665561(1-14)Online publication date: 8-Jul-2024
https://dl.acm.org/doi/10.1145/3640794.3665561
Edwards JDoyle PBranigan HCowan B(2024)Comparing Perceptions of Static and Adaptive Proactive Speech AgentsProceedings of the 6th ACM Conference on Conversational User Interfaces10.1145/3640794.3665548(1-12)Online publication date: 8-Jul-2024
https://dl.acm.org/doi/10.1145/3640794.3665548
Lim JKoh YKim ALee U(2024)Exploring Context-Aware Mental Health Self-Tracking Using Multimodal Smart Speakers in Home EnvironmentsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642846(1-18)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642846
Kim MLee JKoh YLee CLee UKim A(2024)Interrupting for Microlearning: Understanding Perceptions and Interruptibility of Proactive Conversational Microlearning ServicesProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642778(1-21)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642778
Lee JYoon SLee KJeong ECho JPark WYim DHwang I(2024)Open Sesame? Open Salami! Personalizing Vocabulary Assessment-Intervention for Children via Pervasive Profiling and Bespoke Storybook GenerationProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642580(1-32)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642580
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents