research-article

Open access

WorkFit: Designing Proactive Voice Assistance for the Health and Well-Being of Knowledge Workers

Authors:

Shashank Ahire,

Benjamin Simon,

Michael RohsAuthors Info & Claims

CUI '24: Proceedings of the 6th ACM Conference on Conversational User Interfaces

Article No.: 5, Pages 1 - 14

https://doi.org/10.1145/3640794.3665561

Published: 08 July 2024 Publication History

All formats PDF

Abstract

Prior research has designed and evaluated Voice Assistance (VA) for different settings such as the home, school, and public spaces. Office environments have been relatively understudied, leaving a gap in understanding the essential factors for designing a VA specifically for work settings. In this study, we developed the WorkFit VA specific for the office environment, focusing on the health and well-being of knowledge workers. WorkFit was designed to monitor knowledge workers for sedentary behavior, inconsistent hydration, and stress, and to deliver proactive voice interventions followed by a health recommendation to mitigate those issues. We evaluated WorkFit in a field study with 15 knowledge workers for 5 working days. In the study, we determined challenges and opportunities for voice interactions in work settings. We identified contextual factors for identifying inopportune moments for voice interactions in an office setting. We found that 92% of knowledge workers accepted WorkFit’s hydration interventions while 79% of them engaged in walking breaks. Moreover, breathing exercises recommended by WorkFit significantly stabilized the heart rate of knowledge workers during stress. Based on our findings, we propose five design recommendations for the development of VA customized to office settings.

Supplemental Material

MP4 File

Demo video of WorkFit

Download
70.02 MB

References

[1]

Shashank Ahire. 2023. Designing a Smart Speaker for Emergent Users: Human Plus AI Response(IndiaHCI ’22). Association for Computing Machinery, New York, NY, USA, 67–72. https://doi.org/10.1145/3570211.3570217

Digital Library

[2]

Shashank Ahire, Michael Rohs, and Simon Benjamin. 2022. Ubiquitous Work Assistant: Synchronizing a Stationary and a Wearable Conversational Agent to Assist Knowledge Work. In 2022 Symposium on Human-Computer Interaction for Work (Durham, NH, USA) (CHIWORK 2022). Association for Computing Machinery, New York, NY, USA, Article 3, 9 pages. https://doi.org/10.1145/3533406.3533420

Digital Library

[3]

David Benyon. 1993. Adaptive systems: A solution to usability problems. User Modelling and User-Adapted Interaction 3, 1 (1993), 65–87. https://doi.org/10.1007/bf01099425

[4]

Ananya Bhattacharjee, Joseph Jay Williams, Jonah Meyerhoff, Harsh Kumar, Alex Mariakakis, and Rachel Kornfield. 2023. Investigating the Role of Context in the Delivery of Text Messages for Supporting Psychological Wellbeing. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (Hamburg, Germany) (CHI ’23). Association for Computing Machinery, New York, NY, USA, Article 494, 19 pages. https://doi.org/10.1145/3544548.3580774

Digital Library

[5]

Timothy W. Bickmore, Rebecca A. Silliman, Kerrie Nelson, Debbie M. Cheng, Michael Winter, Lori Henault, and Michael K. Paasche-Orlow. 2013. A Randomized Controlled Trial of an Automated Exercise Coach for Older Adults. Journal of the American Geriatrics Society 61, 10 (2013), 1676–1683. https://doi.org/10.1111/jgs.12449 arXiv:https://agsjournals.onlinelibrary.wiley.com/doi/pdf/10.1111/jgs.12449

[6]

Scott A. Cambo, Daniel Avrahami, and Matthew L. Lee. 2017. BreakSense: Combining Physiological and Location Sensing to Promote Mobility during Work-Breaks. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI ’17). Association for Computing Machinery, New York, NY, USA, 3595–3607. https://doi.org/10.1145/3025453.3026021

Digital Library

[7]

Narae Cha, Auk Kim, Cheul Young Park, Soowon Kang, Mingyu Park, Jae-Gil Lee, Sangsu Lee, and Uichin Lee. 2020. Hello There! Is Now a Good Time to Talk? Opportune Moments for Proactive Interactions with Smart Speakers. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 4, 3, Article 74 (sep 2020), 28 pages. https://doi.org/10.1145/3411810

Digital Library

[8]

Narae Cha, Auk Kim, Cheul Young Park, Soowon Kang, Mingyu Park, Jae-Gil Lee, Sangsu Lee, and Uichin Lee. 2020. Hello There! Is Now a Good Time to Talk? Opportune Moments for Proactive Interactions with Smart Speakers. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 4, 3, Article 74 (sep 2020), 28 pages. https://doi.org/10.1145/3411810

Digital Library

[9]

Don Samitha Elvitigala, Philipp M. Scholl, Hussel Suriyaarachchi, Vipula Dissanayake, and Suranga Nanayakkara. 2021. StressShoe: A DIY Toolkit for Just-in-Time Personalised Stress Interventions for Office Workers Performing Sedentary Tasks. In Proceedings of the 23rd International Conference on Mobile Human-Computer Interaction (Toulouse ; Virtual, France) (MobileHCI ’21). Association for Computing Machinery, New York, NY, USA, Article 38, 14 pages. https://doi.org/10.1145/3447526.3472023

Digital Library

[10]

Kathleen Kara Fitzpatrick, Alison Darcy, and Molly Vierhile. 2017. Delivering Cognitive Behavior Therapy to Young Adults With Symptoms of Depression and Anxiety Using a Fully Automated Conversational Agent (Woebot): A Randomized Controlled Trial. JMIR Ment Health 4, 2 (06 Jun 2017), e19. https://doi.org/10.2196/mental.7785

[11]

Healthline. 2021. How Much Water Should You Drink Per Day. https://www.healthline.com/nutrition/how-much-water-should-you-drink-per-day Accessed on January 19, 2023.

[12]

Junhan Kim, Yoojung Kim, Byungjoon Kim, Sukyung Yun, Minjoon Kim, and Joongseek Lee. 2018. Can a Machine Tend to Teenagers’ Emotional Needs? A Study with Conversational Agents. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI EA ’18). Association for Computing Machinery, New York, NY, USA, 1–6. https://doi.org/10.1145/3170427.3188548

Digital Library

[13]

Everlyne Kimani, Kael Rowan, Daniel McDuff, Mary Czerwinski, and Gloria Mark. 2019. A Conversational Agent in Support of Productivity and Wellbeing at Work. In 2019 8th International Conference on Affective Computing and Intelligent Interaction (ACII). 1–7. https://doi.org/10.1109/ACII.2019.8925488

[14]

Rafal Kocielnik, Daniel Avrahami, Jennifer Marlow, Di Lu, and Gary Hsieh. 2018. Designing for Workplace Reflection: A Chat and Voice-Based Conversational Agent. In Proceedings of the 2018 Designing Interactive Systems Conference (Hong Kong, China) (DIS ’18). Association for Computing Machinery, New York, NY, USA, 881–894. https://doi.org/10.1145/3196709.3196784

Digital Library

[15]

Kathryn M. Kolasa, Carolyn J. Lackey, and Ann C. Grandjean. 2009. Hydration and Health Promotion. Nutrition Today 44, 5 (Sep 2009), 190–201. https://doi.org/10.1097/nt.0b013e3181b9c970

[16]

Masahiro Komori, Yasuhiro Fujimoto, Jing Xu, Ken Tasaka, Hironori Yanagihara, and Koichi Fujita. 2019. Experimental Study on Estimation of Opportune Moments for Proactive Voice Information Service Based on Activity Transition for People Living Alone. In Human-Computer Interaction. Perspectives on Design. HCII 2019(Lecture Notes in Computer Science, Vol. 11566), M. Kurosu (Ed.). Springer, Cham. https://doi.org/10.1007/978-3-030-22646-6_39

Digital Library

[17]

J. Lazar, J.H. Feng, and H. Hochheiser. 2010. Research Methods in Human-Computer Interaction. Wiley. https://books.google.de/books?id=H_r6prUFpc4C

[18]

Minha Lee, Sander Ackermans, Nena van As, Hanwen Chang, Enzo Lucas, and Wijnand IJsselsteijn. 2019. Caring for Vincent: A Chatbot for Self-Compassion. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3290605.3300932

Digital Library

[19]

Hao Liu, Jun Hu, and Matthias Rauterberg. 2010. IHeartrate: A Heart Rate Controlled in-Flight Music Recommendation System. In Proceedings of the 7th International Conference on Methods and Techniques in Behavioral Research (Eindhoven, The Netherlands) (MB ’10). Association for Computing Machinery, New York, NY, USA, Article 26, 4 pages. https://doi.org/10.1145/1931344.1931370

Digital Library

[20]

SA Manandhar and T Pramanik. 2019. Immediate Effect of Slow Deep Breathing Exercise on Blood Pressure and Reaction Time. Mymensingh medical journal : MMJ 28, 4 (October 2019), 925—929. http://europepmc.org/abstract/MED/31599262

[21]

Natalie A. Masento, Mark Golightly, David T. Field, Laurie T. Butler, and Carien M. van Reekum. 2014. Effects of hydration status on cognitive performance and mood | British Journal of Nutrition | Cambridge Core. Cambridge Core (Jan 2014). https://doi.org/10.1017/S0007114513004455

[22]

Oussama Metatla, Alison Oldfield, Taimur Ahmed, Antonis Vafeas, and Sunny Miglani. 2019. Voice User Interfaces in Schools: Co-designing for Inclusion with Visually-Impaired and Sighted Pupils. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–15. https://doi.org/10.1145/3290605.3300608

Digital Library

[23]

Christine Murad, Cosmin Munteanu, Leigh Clark, and Benjamin R. Cowan. 2018. Design Guidelines for Hands-Free Speech Interaction. In Proceedings of the 20th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct (Barcelona, Spain) (MobileHCI ’18). Association for Computing Machinery, New York, NY, USA, 269–276. https://doi.org/10.1145/3236112.3236149

Digital Library

[24]

Jakob Nielsen. 2024. 10 Usability Heuristics for User Interface Design. https://www.nngroup.com/articles/ten-usability-heuristics/

[25]

Yechiam Ostchega, Kathryn S. Porter, Jeffery Hughes, Charles F. Dillon, and Tatiana Nwankwo. 2011. Resting Pulse Rate Reference Data for Children, Adolescents, and Adults; United States, 1999-2008. (August 24 2011). https://stacks.cdc.gov/view/cdc/12363

[26]

Pablo Paredes, Ran Gilad-Bachrach, Mary Czerwinski, Asta Roseway, Kael Rowan, and Javier Hernandez. 2014. PopTherapy: Coping with Stress through Pop-Culture. In Proceedings of the 8th International Conference on Pervasive Computing Technologies for Healthcare (Oldenburg, Germany) (PervasiveHealth ’14). ICST (Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering), Brussels, BEL, 109–117. https://doi.org/10.4108/icst.pervasivehealth.2014.255070

Digital Library

[27]

D. Parry, R.S. Oeppen, H. Gass, and P.A. Brennan. 2017. Impact of hydration and nutrition on personal performance in the clinical workplace. British Journal of Oral and Maxillofacial Surgery 55, 10 (Dec 2017), 995–998. https://doi.org/10.1016/j.bjoms.2017.10.017

[28]

Sharon Parry and Leon Straker. 2013. The contribution of office work to sedentary behaviour associated risk. BMC Public Health 13, 1 (2013). https://doi.org/10.1186/1471-2458-13-296

[29]

Jennifer Pearson, Simon Robinson, Thomas Reitmaier, Matt Jones, Shashank Ahire, Anirudha Joshi, Deepak Sahoo, Nimish Maravi, and Bhakti Bhikne. 2019. StreetWise: Smart Speakers vs Human Help in Public Slum Settings. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3290605.3300326

Digital Library

[30]

Charlie Pinder, Jo Vermeulen, Benjamin R. Cowan, and Russell Beale. 2018. Digital Behaviour Change Interventions to Break and Form Habits. ACM Trans. Comput.-Hum. Interact. 25, 3, Article 15 (jun 2018), 66 pages. https://doi.org/10.1145/3196830

Digital Library

[31]

Leon Reicherts, Nima Zargham, Michael Bonfert, Yvonne Rogers, and Rainer Malaka. 2021. May I Interrupt? Diverging Opinions on Proactive Smart Speakers. In CUI 2021 - 3rd Conference on Conversational User Interfaces (Bilbao (online), Spain) (CUI ’21). Association for Computing Machinery, New York, NY, USA, Article 34, 10 pages. https://doi.org/10.1145/3469595.3469629

Digital Library

[32]

Simon Robinson, Jennifer Pearson, Shashank Ahire, Rini Ahirwar, Bhakti Bhikne, Nimish Maravi, and Matt Jones. 2018. Revisiting “Hole in the Wall” Computing: Private Smart Speakers and Public Slum Settings. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (, Montreal QC, Canada, ) (CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–11. https://doi.org/10.1145/3173574.3174072

Digital Library

[33]

Anna Rudnicka, Dave Cook, Marta E. Cecchinato, Sandy J. J. Gould, Joseph W. Newbold, and Anna L. Cox. 2022. The End of the Active Work Break? Remote Work, Sedentariness and the Role of Technology in Creating Active Break-Taking Norms. In 2022 Symposium on Human-Computer Interaction for Work (Durham, NH, USA) (CHIWORK 2022). Association for Computing Machinery, New York, NY, USA, Article 1, 13 pages. https://doi.org/10.1145/3533406.3533409

Digital Library

[34]

Samiksha Sanjiv Sathe, Tejal Rajandekar, Kirti Thodge, Amol Bhawane, and Utkarsh Thatere. 2020. Immediate Effect of Buteyko Breathing and Bhramari Pranayama on Blood Pressure, Heart Rate and Oxygen Saturation in Hypertensive Patients: A Comparative Study. Indian Journal of Forensic Medicine & Toxicology (2020).

[35]

Steven Sauter, Lawrence Murphy, Michael Colligan, Naomi Swanson, Jr. Joseph Hurrell, Jr. Frederick Scharf, Raymond Sinclair, Paula Grubb, Linda Goldenhar, Toni Alterman, Janet Johnston, Anne Hamilton, and Julie Tisdale. 2014. STRESS...At Work. The National Institute for Occupational Safety and Health (NIOSH) (Jun 2014). https://doi.org/10.26616/NIOSHPUB99101

[36]

Korok Sengupta, Sayan Sarcar, Alisha Pradhan, Roisin McNaney, Sergio Sayago, Debaleena Chattopadhyay, and Anirudha Joshi. 2020. Challenges and Opportunities of Leveraging Intelligent Conversational Assistant to Improve the Well-Being of Older Adults. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI EA ’20). Association for Computing Machinery, New York, NY, USA, 1–4. https://doi.org/10.1145/3334480.3381057

Digital Library

[37]

Anil Shankar, Sushil J. Louis, Sergiu Dascalu, Linda J. Hayes, and Ramona Houmanfar. 2007. User-Context for Adaptive User Interfaces. In Proceedings of the 12th International Conference on Intelligent User Interfaces (Honolulu, Hawaii, USA) (IUI ’07). Association for Computing Machinery, New York, NY, USA, 321–324. https://doi.org/10.1145/1216295.1216357

Digital Library

[38]

Ben Shneiderman. 1997. Designing the User Interface: Strategies for Effective Human-Computer Interaction (3rd ed.). Addison-Wesley Longman Publishing Co., Inc., USA.

Digital Library

[39]

Sarah Silcox. 2015. Why hydration is a workplace issue. https://www.personneltoday.com/hr/hydration-workplace-issue/

[40]

WHO Team. 2020. WHO guidelines on physical activity and sedentary behaviour. https://www.who.int/publications-detail-redirect/9789240015128

[41]

Vincent W.-S. Tseng, Matthew L. Lee, Laurent Denoue, and Daniel Avrahami. 2019. Overcoming Distractions during Transitions from Break to Work Using a Conversational Website-Blocking System. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3290605.3300697

Digital Library

[42]

Liam D. Turner, Stuart M. Allen, and Roger M. Whitaker. 2015. Interruptibility Prediction for Ubiquitous Systems: Conventions and New Directions from a Growing Field. In Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing (Osaka, Japan) (UbiComp ’15). Association for Computing Machinery, New York, NY, USA, 801–812. https://doi.org/10.1145/2750858.2807514

Digital Library

[43]

Alice Watson, Timothy Bickmore, Abby Cange, Ambar Kulshreshtha, and Joseph Kvedar. 2012. An Internet-Based Virtual Coach to Promote Physical Activity Adherence in Overweight Adults: Randomized Controlled Trial. J Med Internet Res 14, 1 (26 Jan 2012), e1. https://doi.org/10.2196/jmir.1629

[44]

Jing Wei, Tilman Dingler, and Vassilis Kostakos. 2022. Understanding User Perceptions of Proactive Smart Speakers. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 5, 4, Article 185 (dec 2022), 28 pages. https://doi.org/10.1145/3494965

Digital Library

[45]

Jing Wei, Benjamin Tag, Johanne R Trippas, Tilman Dingler, and Vassilis Kostakos. 2022. What Could Possibly Go Wrong When Interacting with Proactive Smart Speakers? A Case Study Using an ESM Application. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (New Orleans, LA, USA) (CHI ’22). Association for Computing Machinery, New York, NY, USA, Article 276, 15 pages. https://doi.org/10.1145/3491102.3517432

Digital Library

[46]

Tong Wu, Nikolas Martelaro, Simon Stent, Jorge Ortiz, and Wendy Ju. 2021. Learning When Agents Can Talk to Drivers Using the INAGT Dataset and Multisensor Fusion. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 5, 3, Article 133 (sep 2021), 28 pages. https://doi.org/10.1145/3478125

Digital Library

[47]

Mengru Xue, Rong-Hao Liang, Jun Hu, Bin Yu, and Loe Feijs. 2022. Understanding How Group Workers Reflect on Organizational Stress with a Shared, Anonymous Heart Rate Variability Data Visualization. In Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems (New Orleans, LA, USA) (CHI EA ’22). Association for Computing Machinery, New York, NY, USA, Article 27, 7 pages. https://doi.org/10.1145/3491101.3503576

Digital Library

[48]

Nima Zargham, Leon Reicherts, Michael Bonfert, Sarah Theres Voelkel, Johannes Schoening, Rainer Malaka, and Yvonne Rogers. 2022. Understanding Circumstances for Desirable Proactive Behaviour of Voice Assistants: The Proactivity Dilemma. In Proceedings of the 4th Conference on Conversational User Interfaces (Glasgow, United Kingdom) (CUI ’22). Association for Computing Machinery, New York, NY, USA, Article 3, 14 pages. https://doi.org/10.1145/3543829.3543834

Digital Library

Cited By

Ahire SOthman SRohs M(2024)Dual-Mode Interventions: Giving Agency to Knowledge Workers in Proactive Health InterventionsProceedings of the 6th ACM Conference on Conversational User Interfaces10.1145/3640794.3665578(1-7)Online publication date: 8-Jul-2024
https://dl.acm.org/doi/10.1145/3640794.3665578

Index Terms

WorkFit: Designing Proactive Voice Assistance for the Health and Well-Being of Knowledge Workers
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Sound-based input / output

Recommendations

Dual-Mode Interventions: Giving Agency to Knowledge Workers in Proactive Health Interventions
CUI '24: Proceedings of the 6th ACM Conference on Conversational User Interfaces

In the domain of health and well-being, proactive voice interventions have demonstrated their efficacy. However, users often encounter privacy concerns and social embarrassment due to the lack of control over these proactive interventions, especially in ...
Transforming knowledge workers into innovation workers to improve corporate productivity

This paper deals with the productivity improvement of knowledge work. The productivity of knowledge work is improved through innovations with knowledge creation. The author points out that knowledge is created through the knowledge worker's mental ...
Work-Life Imbalance, Health and Wellbeing of Older Workers: A Meta-analysis
Cross-Cultural Design. Applications in Arts, Learning, Well-being, and Social Development
Abstract
This paper aims to provide a meta-analytic examination of the relationship between work-life imbalance and health and wellbeing of older workers. Five hundred forty-four records were extracted from the databases. It was found that the overall odds ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CUI '24: Proceedings of the 6th ACM Conference on Conversational User Interfaces

July 2024

616 pages

ISBN:9798400705113

DOI:10.1145/3640794

Copyright © 2024 Owner/Author.

This work is licensed under a Creative Commons Attribution-NonCommercial International 4.0 License.

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 July 2024

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

CUI '24

Sponsor:

SIGCHI

CUI '24: ACM Conversational User Interfaces 2024

July 8 - 10, 2024

Luxembourg, Luxembourg

Acceptance Rates

Overall Acceptance Rate 34 of 100 submissions, 34%

Upcoming Conference

CUI '25

Sponsor:
sigchi

ACM Conversational User Interfaces 2025

July 7 - 9, 2025

Waterloo , ON , Canada

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
342
Total Downloads

Downloads (Last 12 months)342
Downloads (Last 6 weeks)72

Reflects downloads up to 30 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Ahire SOthman SRohs M(2024)Dual-Mode Interventions: Giving Agency to Knowledge Workers in Proactive Health InterventionsProceedings of the 6th ACM Conference on Conversational User Interfaces10.1145/3640794.3665578(1-7)Online publication date: 8-Jul-2024
https://dl.acm.org/doi/10.1145/3640794.3665578

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Figures

Tables

Media

View Table of Conten