research-article

Open access

Teacher, Trainer, Counsel, Spy: How Generative AI can Bridge or Widen the Gaps in Worker-Centric Digital Phenotyping of Wellbeing

Authors:

Vedant Das Swain,

Koustuv SahaAuthors Info & Claims

CHIWORK '24: Proceedings of the 3rd Annual Meeting of the Symposium on Human-Computer Interaction for Work

Article No.: 3, Pages 1 - 13

https://doi.org/10.1145/3663384.3663401

Published: 25 June 2024 Publication History

All formats PDF

Abstract

The increasing integration of computing technologies in the workplace has also seen the conceptualization and development of data-driven and algorithmic tools that aim to improve workers’ wellbeing and performance. However, both research and practice have revealed several gaps in the effectiveness and deployment of these tools. Meanwhile, the recent advances in generative AI have highlighted the tremendous capabilities of large language models (LLMs) in processing large volumes of data in producing human-interactive natural language content. This paper explores the opportunities for LLMs in facilitating worker-centered design for Wellbeing Assessment Tools (WATs). In particular, we map features of LLMs against known challenges of WAT. We highlight how the LLMs can bridge or even widen the gaps in worker-centeric WAT. This paper aims to inspire new research directions focused on empowering workers and anticipating harms in integrating LLMs with workplace technologies.

References

[1]

2014. Systematic review of the Hawthorne effect: new concepts are needed to study research participation effects. Journal of clinical epidemiology 67, 3 (2014), 267–277.

[2]

Gregory D Abowd, Anind K Dey, Peter J Brown, Nigel Davies, Mark Smith, and Pete Steggles. 1999. Towards a better understanding of context and context-awareness. In International Symposium on Handheld and Ubiquitous Computing.

[3]

Josh Achiam, Steven Adler, Sandhini Agarwal, Lama Ahmad, Ilge Akkaya, Florencia Leoni Aleman, Diogo Almeida, Janko Altenschmidt, Sam Altman, Shyamal Anadkat, 2023. Gpt-4 technical report. arXiv preprint arXiv:2303.08774 (2023).

[4]

Daniel A Adler, Caitlin A Stamatis, Jonah Meyerhoff, David C Mohr, Fei Wang, Gabriel J Aranovich, Srijan Sen, and Tanzeem Choudhury. 2024. Measuring algorithmic bias to analyze the reliability of AI tools that predict depression risk using smartphone sensed-behavioral data. npj Mental Health Research 3, 1 (2024), 17.

[5]

Daniel A Adler, Emily Tseng, Khatiya C Moon, John Q Young, John M Kane, Emanuel Moss, David C Mohr, and Tanzeem Choudhury. 2022. Burnout and the Quantified Workplace: Tensions around Personal Sensing Interventions for Stress in Resident Physicians. (2022).

[6]

William Agnew, A Stevie Bergman, Jennifer Chien, Mark Díaz, Seliem El-Sayed, Jaylen Pittman, Shakir Mohamed, and Kevin R McKee. 2024. The illusion of artificial inclusion. arXiv preprint arXiv:2401.08572 (2024).

[7]

Ifeoma Ajunwa, Kate Crawford, and Jason Schultz. 2017. Limitless worker surveillance. Calif. L. Rev. 105 (2017), 735.

[8]

Rohan Anil, Andrew M Dai, Orhan Firat, Melvin Johnson, Dmitry Lepikhin, Alexandre Passos, Siamak Shakeri, Emanuel Taropa, Paige Bailey, Zhifeng Chen, 2023. Palm 2 technical report. arXiv preprint arXiv:2305.10403 (2023).

[9]

Anne Archambault and Jonathan Grudin. 2012. A longitudinal study of facebook, linkedin, & twitter use. In Proceedings of the SIGCHI conference on human factors in computing systems. 2741–2750.

Digital Library

[10]

Karim Assi, Lakmal Meegahapola, William Droz, Peter Kun, Amalia De Götzen, Miriam Bidoglia, Sally Stares, George Gaskell, Altangerel Chagnaa, Amarsanaa Ganbold, 2023. Complex daily activities, country-level diversity, and smartphone sensing: A study in denmark, italy, mongolia, paraguay, and uk. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems.

Digital Library

[11]

Noel F Ayoub, Yu-Jin Lee, David Grimm, and Vasu Divi. 2023. Head-to-Head Comparison of ChatGPT Versus Google Search for Medical Knowledge Acquisition. Otolaryngology–Head and Neck Surgery (2023).

[12]

Katherine Baicker, David Cutler, and Zirui Song. 2010. Workplace wellness programs can generate savings. Health affairs 29, 2 (2010), 304–311.

[13]

Solon Barocas and Helen Nissenbaum. 2014. Big data’s end run around anonymity and consent. Privacy, big data, and the public good: Frameworks for engagement 1 (2014), 44–75.

[14]

Ananya Bhattacharjee, Joseph Jay Williams, Jonah Meyerhoff, Harsh Kumar, Alex Mariakakis, and Rachel Kornfield. 2023. Investigating the Role of Context in the Delivery of Text Messages for Supporting Psychological Wellbeing. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems.

Digital Library

[15]

Mehrab Bin Morshed, Javier Hernandez, Daniel McDuff, Jina Suh, Esther Howe, 2022. Advancing the Understanding and Measurement of Workplace Stress in Remote Information Workers from Passive Sensors and Behavioral Data. In 2022 10th International Conference on Affective Computing and Intelligent Interaction (ACII). IEEE.

[16]

Mehrab Bin Morshed, Koustuv Saha, Richard Li, Sidney K. D’Mello, Munmun De Choudhury, Gregory D Abowd, and Thomas Plötz. 2019. Prediction of Mood Instability with Passive Sensing. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 3, 3 (2019).

Digital Library

[17]

L Ebony Boulware, Lisa A Cooper, Lloyd E Ratner, Thomas A LaVeist, and Neil R Powe. 2016. Race and trust in the health care system. Public health reports (2016).

[18]

Karen L Boyd and Nazanin Andalibi. 2023. Automated emotion recognition in the workplace: How proposed technologies reveal potential futures of work. Proceedings of the ACM on Human-Computer Interaction 7, CSCW1 (2023), 1–37.

Digital Library

[19]

Aras Bozkurt. 2023. Generative artificial intelligence (AI) powered conversational educational agents: The inevitable paradigm shift. Asian Journal of Distance Education 18, 1 (2023).

[20]

Erik Brynjolfsson, Danielle Li, and Lindsey R Raymond. 2023. Generative AI at work. Technical Report. National Bureau of Economic Research.

[21]

Matt Burgess. 2023. ChatGPT Has a Big Privacy Problem. https://www.wired.com/story/italy-ban-chatgpt-privacy-gdpr/. Accessed: 2024-02-14.

[22]

Matt Burgess. 2023. Privacy in the age of generative AI. https://stackoverflow.blog/2023/10/23/privacy-in-the-age-of-generative-ai/. Accessed: 2024-02-14.

[23]

Dan Calacci. 2022. Organizing in the End of Employment: Information Sharing, Data Stewardship, and Digital Workerism. In 2022 Symposium on Human-Computer Interaction for Work. 1–9.

Digital Library

[24]

Dan Calacci and Alex Pentland. 2022. Bargaining with the Black-Box: Designing and Deploying Worker-Centric Tools to Audit Algorithmic Management. Proceedings of the ACM on Human-Computer Interaction 6, CSCW2 (2022), 1–24.

Digital Library

[25]

Long Chen, Oleg Sinavski, Jan Hünermann, Alice Karnsund, Andrew James Willmott, Danny Birch, Daniel Maund, and Jamie Shotton. 2023. Driving with llms: Fusing object-level vector modality for explainable autonomous driving. arXiv preprint arXiv:2310.01957 (2023).

[26]

Eun Kyoung Choe, Bongshin Lee, Haining Zhu, Nathalie Henry Riche, and Dominikus Baur. 2017. Understanding self-reflection: how people reflect on personal data through visual data exploration. In Proceedings of the 11th EAI International Conference on Pervasive Computing Technologies for Healthcare.

Digital Library

[27]

Akshat Choube, Vedant Das Swain, and Varun Mishra. 2024. SeSaMe: A Framework to Simulate Self-Reported Ground Truth for Mental Health Sensing Studies. arXiv preprint arXiv:2403.17219 (2024).

[28]

Shreya Chowdhary, Anna Kawakami, Mary L Gray, Jina Suh, Alexandra Olteanu, and Koustuv Saha. 2023. Can Workers Meaningfully Consent to Workplace Wellbeing Technologies?. In Proceedings of the 2023 ACM Conference on Fairness, Accountability, and Transparency. 569–582.

Digital Library

[29]

Chia-Fang Chung, Nanna Gorm, Irina A Shklovski, and Sean Munson. 2017. Finding the right fit: understanding health tracking in workplace wellness programs. In Proceedings of the 2017 CHI conference on human factors in computing systems. ACM, 4875–4886.

Digital Library

[30]

Marios Constantinides and Daniele Quercia. 2022. Good Intentions, Bad Inventions: How Employees Judge Pervasive Technologies in the Workplace. IEEE Pervasive Computing 22, 1 (2022), 69–76.

Digital Library

[31]

Victor P Cornet and Richard J Holden. 2018. Systematic review of smartphone-based passive sensing for health and wellbeing. Journal of biomedical informatics 77 (2018), 120–132.

[32]

Shanley Corvite, Kat Roemmich, Tillie Rosenberg, and Nazanin Andalibi. 2022. Data Subjects’ Perspectives on Emotion Artificial Intelligence Use in the Workplace: A Relational Ethics Lens. Proceedings of the ACM on Human-Computer Interaction (2022).

[33]

Corentin Curchod, Gerardo Patriotta, Laurie Cohen, and Nicolas Neysen. 2020. Working for an algorithm: Power asymmetries and agency in online work settings. Administrative Science Quarterly 65, 3 (2020), 644–676.

[34]

Vedant Das Swain, Victor Chen, Shrija Mishra, Stephen M Mattingly, Gregory D Abowd, and Munmun De Choudhury. 2022. Semantic Gap in Predicting Mental Wellbeing through Passive Sensing. In CHI Conference on Human Factors in Computing Systems. 1–16.

Digital Library

[35]

Vedant Das Swain, Lan Gao, Abhirup Mondal, Gregory D Abowd, and Munmun De Choudhury. 2024. Sensible and Sensitive AI for Worker Wellbeing: Factors that Inform Adoption and Resistance for Information Workers. In Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems.

Digital Library

[36]

Vedant Das Swain, Lan Gao, William A Wood, Srikruthi C Matli, Gregory D Abowd, and Munmun De Choudhury. 2023. Algorithmic Power or Punishment: Information Worker Perspectives on Passive Sensing Enabled AI Phenotyping of Performance and Wellbeing. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1–17.

Digital Library

[37]

Vedant Das Swain, Javier Hernandez, Brian Houck, Koustuv Saha, Jina Suh, Ahad Chaudhry, Tenny Cho, Wendy Guo, Shamsi T Iqbal, and Mary Czerwinski. 2023. Focused Time Saves Nine: Evaluating Computer-Assisted Protected Time for Hybrid Information Work. Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (2023).

Digital Library

[38]

Vedant Das Swain, Manikanta D Reddy, Kari Anne Nies, Louis Tay, Munmun De Choudhury, and Gregory D Abowd. 2019. Birds of a Feather Clock Together: A Study of Person-Organization Fit Through Latent Activity Routines. Proceedings of the ACM on Human-Computer Interaction 3, CSCW (2019), 1–30.

Digital Library

[39]

Vedant Das Swain, Koustuv Saha, Gregory D Abowd, and Munmun De Choudhury. 2020. Social media and ubiquitous technologies for remote worker wellbeing and productivity in a post-pandemic world. In 2020 IEEE Second International Conference on Cognitive Machine Intelligence (CogMI). IEEE, 121–130.

[40]

Vedant Das Swain, Koustuv Saha, Hemang Rajvanshy, Anusha Sirigiri, Julie M. Gregg, Suwen Lin, Gonzalo J. Martinez, Stephen M. Mattingly, Shayan Mirjafari, Raghu Mulukutla, and et al.2019. A Multisensor Person-Centered Approach to Understand the Role of Daily Activities in Job Performance with Organizational Personas. Proc. ACM IMWUT (2019).

[41]

Vedant Das Swain, Koustuv Saha, Manikanta D Reddy, Hemang Rajvanshy, Gregory D Abowd, and Munmun De Choudhury. 2020. Modeling Organizational Culture with Workplace Experiences Shared on Glassdoor. In CHI.

[42]

Vedant Das Swain, Shane Williams, Adam Fourney, and Shamsi T Iqbal. 2022. Two Birds with One Phone: The Role of Mobile Use in the Daily Practices of Remote Information Work. In 2022 Symposium on Human-Computer Interaction for Work. 1–8.

[43]

Anind K Dey, Gregory D Abowd, and Daniel Salber. 2001. A conceptual framework and a toolkit for supporting the rapid prototyping of context-aware applications. Human–Computer Interaction 16, 2-4 (2001), 97–166.

[44]

Upol Ehsan, Koustuv Saha, Munmun De Choudhury, and Mark O Riedl. 2023. Charting the sociotechnical gap in explainable ai: A framework to address the gap in xai. Proceedings of the ACM on Human-Computer Interaction 7, CSCW1 (2023), 1–32.

Digital Library

[45]

Mehmet Firat and Saniye Kuleli. 2023. What if GPT4 became autonomous: The Auto-GPT project and use cases. Journal of Emerging Computer Technologies 3, 1 (2023), 1–6.

[46]

Akshay Goel, Almog Gueta, Omry Gilon, Chang Liu, Sofia Erell, Lan Huong Nguyen, Xiaohong Hao, Bolous Jaber, Shashir Reddy, Rupesh Kartha, 2023. Llms accelerate annotation for medical information extraction. In Machine Learning for Health (ML4H). PMLR, 82–100.

[47]

Erving Goffman 1959. The presentation of self in everyday life. (1959).

[48]

Tanya Goyal, Junyi Jessy Li, and Greg Durrett. 2022. News summarization and evaluation in the era of gpt-3. arXiv preprint arXiv:2209.12356 (2022).

[49]

Gabriel Grill and Nazanin Andalibi. 2022. Attitudes and Folk Theories of Data Subjects on Transparency and Accuracy in Emotion Recognition. Proceedings of the ACM on Human-Computer Interaction 6, CSCW1 (2022), 1–35.

Digital Library

[50]

Jonathan Gruber and Brigitte C Madrian. 2002. Health insurance, labor supply, and job mobility: A critical review of the literature. (2002).

[51]

Maanak Gupta, CharanKumar Akiri, Kshitiz Aryal, Eli Parker, and Lopamudra Praharaj. 2023. From chatgpt to threatgpt: Impact of generative ai in cybersecurity and privacy. IEEE Access (2023).

[52]

Andrea L Guzman. 2020. Ontological boundaries between humans and computers and the implications for human-machine communication. Human-Machine Communication 1 (2020), 37–54.

[53]

Perttu Hämäläinen, Mikke Tavast, and Anton Kunnari. 2023. Evaluating large language models in generating synthetic hci research data: a case study. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems.

Digital Library

[54]

Lucas D Introna. 2000. Workplace surveillance, privacy and distributive justice. Acm Sigcas Computers and Society 30, 4 (2000), 33–39.

Digital Library

[55]

Mingyu Jin, Qinkai Yu, Chong Zhang, Dong Shu, Suiyuan Zhu, Mengnan Du, Yongfeng Zhang, and Yanda Meng. 2024. Health-LLM: Personalized Retrieval-Augmented Disease Prediction Model. arXiv preprint arXiv:2402.00746 (2024).

[56]

Matthew Jörke, Yasaman S Sefidgar, Talie Massachi, Jina Suh, and Gonzalo Ramos. 2023. Pearl: A Technology Probe for Machine-Assisted Reflection on Personal Data. In Proceedings of the 28th International Conference on Intelligent User Interfaces. 902–918.

Digital Library

[57]

Harmanpreet Kaur, Daniel McDuff, Alex C Williams, Jaime Teevan, and Shamsi T Iqbal. 2022. “I Didn’t Know I Looked Angry”: Characterizing Observed Emotion and Reported Affect at Work. In CHI Conference on Human Factors in Computing Systems. 1–18.

Digital Library

[58]

Harmanpreet Kaur, Alex C Williams, Daniel McDuff, Mary Czerwinski, Jaime Teevan, and Shamsi T Iqbal. 2020. Optimizing for happiness and productivity: Modeling opportune moments for transitions and breaks at work. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1–15.

Digital Library

[59]

Anna Kawakami, Shreya Chowdhary, Shamsi T Iqbal, Q Vera Liao, Alexandra Olteanu, Jina Suh, and Koustuv Saha. 2023. Sensing Wellbeing in the Workplace, Why and For Whom? Envisioning Impacts with Organizational Stakeholders. Proceedings of the ACM on Human-Computer Interaction (CSCW) (2023).

Digital Library

[60]

Ronald C Kessler, Catherine Barber, Howard G Birnbaum, Richard G Frank, Paul E Greenberg, Robert M Rose, Gregory E Simon, and Philip Wang. 1999. Depression In The Workplace: Effects On Short-Term Disability: Could treating workers’ depression help employers to save money on disability? These results are encouraging.Health affairs 18, 5 (1999), 163–171.

[61]

Yubin Kim, Xuhai Xu, Daniel McDuff, Cynthia Breazeal, and Hae Won Park. 2024. Health-LLM: Large Language Models for Health Prediction via Wearable Sensor Data. arXiv preprint arXiv:2401.06866 (2024).

[62]

Jan Kocoń, Igor Cichecki, Oliwier Kaszyca, Mateusz Kochanek, Dominika Szydło, Joanna Baran, Julita Bielaniewicz, Marcin Gruza, Arkadiusz Janz, Kamil Kanclerz, 2023. ChatGPT: Jack of all trades, master of none. Information Fusion (2023), 101861.

[63]

Seyma Kucukozer-Cavdar, Tugba Taskaya-Temizel, Abhinav Mehrotra, Mirco Musolesi, and Peter Tino. 2021. Designing Robust Models for Behaviour Prediction Using Sparse Data from Mobile Sensing: A Case Study of Office Workers’ Availability for Well-being Interventions. ACM Transactions on Computing for Healthcare 2, 4 (2021), 1–33.

Digital Library

[64]

Hao-Ping Lee, Yu-Ju Yang, Thomas Serban von Davier, Jodi Forlizzi, and Sauvik Das. 2023. Deepfakes, Phrenology, Surveillance, and More! A Taxonomy of AI Privacy Risks. arXiv preprint arXiv:2310.07879 (2023).

[65]

Patrick Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni, Vladimir Karpukhin, Naman Goyal, Heinrich Küttler, Mike Lewis, Wen-tau Yih, Tim Rocktäschel, 2020. Retrieval-augmented generation for knowledge-intensive nlp tasks. Advances in Neural Information Processing Systems 33 (2020), 9459–9474.

[66]

Jinyang Li, Binyuan Hui, Ge Qu, Binhua Li, Jiaxi Yang, Bowen Li, Bailin Wang, Bowen Qin, Rongyu Cao, Ruiying Geng, 2023. Can llm already serve as a database interface? a big bench for large-scale database grounded text-to-sqls. arXiv preprint arXiv:2305.03111 (2023).

[67]

Blerina Lika, Kostas Kolomvatsos, and Stathes Hadjiefthymiades. 2014. Facing the cold start problem in recommender systems. Expert systems with applications 41, 4 (2014), 2065–2073.

[68]

Yiheng Liu, Tianle Han, Siyuan Ma, Jiayue Zhang, Yuanyuan Yang, Jiaming Tian, Hao He, Antong Li, Mengshen He, Zhengliang Liu, 2023. Summary of chatgpt-related research and perspective towards the future of large language models. Meta-Radiology (2023), 100017.

[69]

Michele Loi. 2019. The digital phenotype: A philosophical and ethical exploration. Philosophy & Technology 32, 1 (2019), 155–171.

[70]

Ewa Luger, Stuart Moran, and Tom Rodden. 2013. Consent for all: revealing the hidden complexity of terms and conditions. In Proceedings of the SIGCHI conference on Human factors in computing systems. 2687–2696.

Digital Library

[71]

Pingchuan Ma, Rui Ding, Shuai Wang, Shi Han, and Dongmei Zhang. 2023. InsightPilot: An LLM-Empowered Automated Data Exploration System. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing: System Demonstrations. 346–352.

[72]

Xiaoyue Ma and Yudi Huo. 2023. Are users willing to embrace ChatGPT? Exploring the factors on the acceptance of chatbots from the perspective of AIDUA framework. Technology in Society 75 (2023), 102362.

[73]

Lewis Maddison. 2023. Samsung workers made a major error by using ChatGPT. techradar pro, available at: www. techradar. com/news/samsung-workers-leaked-company-secrets-by-using-chatgpt (accessed 29 May 2023) (2023).

[74]

Peter Mantello, Manh-Tung Ho, Minh-Hoang Nguyen, and Quan-Hoang Vuong. 2021. Bosses without a heart: socio-demographic and cross-cultural determinants of attitude toward Emotional AI in the workplace. AI & society (2021).

[75]

Gloria Mark, Shamsi Iqbal, Mary Czerwinski, and Paul Johns. 2014. Capturing the mood: facebook and face-to-face encounters in the workplace. In Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing. ACM, 1082–1094.

Digital Library

[76]

Gloria Mark, Shamsi T Iqbal, Mary Czerwinski, Paul Johns, Akane Sano, and Yuliya Lutchyn. 2016. Email duration, batching and self-interruption: Patterns of email use on productivity and stress. In Proceedings of the 2016 CHI conference on human factors in computing systems. 1717–1728.

Digital Library

[77]

Gonzalo J Martinez, Stephen M Mattingly, Jessica Young, Louis Faust, Anind K Dey, Andrew T Campbell, Munmun De Choudhury, Shayan Mirjafari, Subigya Nepal, Pablo Robles-Granda, 2020. Improved Sleep Detection Through The Fusion of Phone Agent and Wearable Data Streams. In WristSense 2020.

[78]

Ivan Martinez. 2023. PrivateGPT. https://github.com/imartinez/privateGPT. Accessed: 2024-02-14.

[79]

Stephen M. Mattingly, Julie M. Gregg, Pino Audia, Ayse Elvan Bayraktaroglu, Andrew T. Campbell, Nitesh V. Chawla, Vedant Das Swain, Munmun De Choudhury, Sidney K. D’Mello, Anind K. Dey, and et al.2019. The Tesserae Project: Large-Scale, Longitudinal, In Situ, Multimodal Sensing of Information Workers. In CHI Ext. Abstracts.

[80]

Michael F McTear. 2002. Spoken dialogue technology: enabling the conversational user interface. ACM Computing Surveys (CSUR) 34, 1 (2002), 90–169.

Digital Library

[81]

Shayan Mirjafari, Kizito Masaba, Ted Grover, Weichen Wang, Pino Audia, Andrew T Campbell, Nitesh V Chawla, Vedant Das Swain, Munmun De Choudhury, Anind K Dey, 2019. Differentiating Higher and Lower Job Performers in the Workplace Using Mobile Sensing. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 3, 2 (2019), 37.

Digital Library

[82]

David C Mohr, Ken R Weingardt, Madhu Reddy, and Stephen M Schueller. 2017. Three problems with current digital mental health research... and three things we can do about them. Psychiatric services 68, 5 (2017), 427–429.

[83]

Timothy Monk, Daniel Buysse, Charles Reynolds Iii, Sarah Berga, David Jarrett, Amy Begley, and David Kupfer. 1997. Circadian rhythms in human performance and mood under constant conditions. Journal of sleep research (1997).

[84]

Hussein Mozannar, Gagan Bansal, Adam Fourney, and Eric Horvitz. 2022. Reading between the lines: Modeling user behavior and costs in AI-assisted programming. arXiv preprint arXiv:2210.14306 (2022).

[85]

Karel Mundnich, Brandon M Booth, Michelle l’Hommedieu, Tiantian Feng, Benjamin Girault, Justin L’hommedieu, Mackenzie Wildman, Sophia Skaaden, Amrutha Nadarajan, Jennifer L Villatte, 2020. TILES-2018, a longitudinal physiologic and behavioral data set of hospital workers. Scientific Data 7, 1 (2020), 354.

[86]

Sujay Nagaraj, Sarah Goodday, Thomas Hartvigsen, Adrien Boch, Kopal Garg, Sindhu Gowda, Luca Foschini, Marzyeh Ghassemi, Stephen Friend, and Anna Goldenberg. 2023. Dissecting the heterogeneity of “in the wild” stress from multimodal sensor data. NPJ Digital Medicine 6, 1 (2023), 237.

[87]

Subigya Nepal, Gonzalo J Martinez, Arvind Pillai, Koustuv Saha, Shayan Mirjafari, Vedant Das Swain, Xuhai Xu, Pino G Audia, Munmun De Choudhury, Anind K Dey, 2022. A survey of passive sensing in the workplace. arXiv preprint arXiv:2201.03074 (2022).

[88]

Breffni M Noone, Michael S Lin, and Amit Sharma. 2024. Firm performance during a crisis: Effects of adhocracy culture, incremental product innovation, and firm size. Journal of Hospitality & Tourism Research 48, 1 (2024), 153–183.

[89]

Jonathan A Obar and Anne Oeldorf-Hirsch. 2020. The biggest lie on the internet: Ignoring the privacy policies and terms of service policies of social networking services. Information, Communication & Society 23, 1 (2020), 128–147.

[90]

Ogbole O Ogancha. 2019. Power Asymmetry and the Quest for Inclusiveness in the Workplace. American Economic Review 57 (2019), 62.

[91]

Daniel Olguín Olguín and Alex Sandy Pentland. 2008. Social sensors for automatic data collection. AMCIS 2008 Proceedings (2008), 171.

[92]

Jukka-Pekka Onnela and Scott L Rauch. 2016. Harnessing smartphone-based digital phenotyping to enhance behavioral and mental health. Neuropsychopharmacology 41, 7 (2016), 1691–1696.

[93]

OpenAI. 2023. GPT-4 Technical Report. (2023). arxiv:2303.08774 [cs.CL]

[94]

Long Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida, Carroll Wainwright, Pamela Mishkin, Chong Zhang, Sandhini Agarwal, Katarina Slama, Alex Ray, 2022. Training language models to follow instructions with human feedback. Advances in Neural Information Processing Systems 35 (2022), 27730–27744.

[95]

Christopher O’Neill. 2017. Taylorism, the European science of work, and the quantified self at work. Science, Technology, & Human Values (2017).

[96]

Hyanghee Park, Daehwan Ahn, Kartik Hosanagar, and Joonhwan Lee. 2021. Human-AI Interaction in Human Resource Management: Understanding Why Employees Resist Algorithmic Evaluation at Workplaces and How to Mitigate Burdens. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1–15.

Digital Library

[97]

Hyanghee Park, Daehwan Ahn, Kartik Hosanagar, and Joonhwan Lee. 2022. Designing Fair AI in Human Resource Management: Understanding Tensions Surrounding Algorithmic Evaluation and Envisioning Stakeholder-Centered Solutions. In CHI Conference on Human Factors in Computing Systems. 1–22.

[98]

Joon Sung Park, Joseph O’Brien, Carrie Jun Cai, Meredith Ringel Morris, Percy Liang, and Michael S Bernstein. 2023. Generative agents: Interactive simulacra of human behavior. In Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology. 1–22.

Digital Library

[99]

Samuel A Prieto, Eyob T Mengiste, and Borja García de Soto. 2023. Investigating the use of ChatGPT for the scheduling of construction projects. Buildings 13, 4 (2023), 857.

[100]

Abhilasha Ravichander, Alan W Black, Shomir Wilson, Thomas Norton, and Norman Sadeh. 2019. Question answering for privacy policies: Combining computational and legal perspectives. arXiv preprint arXiv:1911.00841 (2019).

[101]

Bradley Rey, Bongshin Lee, Eun Kyoung Choe, and Pourang Irani. 2023. Investigating In-Situ Personal Health Data Queries on Smartwatches. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (2023).

[102]

Toran Bruce Richards. 2023. Auto-GPT: An experimental open-source attempt to make GPT-4 fully autonomous.

[103]

Pablo Robles-Granda, Suwen Lin, Xian Wu, Gonzalo J Martinez, Stephen M Mattingly, Edward Moskal, Aaron Striegel, Nitesh V Chawla, Sidney D’Mello, Julie Gregg, 2021. Jointly predicting job performance, personality, cognitive ability, affect, and well-being. IEEE Computational Intelligence Magazine (2021).

[104]

Kat Roemmich and Nazanin Andalibi. 2021. Data subjects’ conceptualizations of and attitudes toward automatic emotion recognition-enabled wellbeing interventions on social media. Proceedings of the ACM on Human-Computer Interaction 5, CSCW2 (2021), 1–34.

Digital Library

[105]

Alex Rosenblat, Tamara Kneese, and Danah Boyd. 2014. Workplace surveillance. Open Society Foundations’ Future of Work Commissioned Research Papers (2014).

[106]

Norman Sadeh, Alessandro Acquisti, Travis D Breaux, Lorrie Faith Cranor, Aleecia M McDonald, Joel R Reidenberg, Noah A Smith, Fei Liu, N Cameron Russell, Florian Schaub, 2013. The usable privacy policy project. In Technical report, Technical Report, CMU-ISR-13-119. Carnegie Mellon University.

[107]

Norman Sadeh, Jason Hong, Lorrie Cranor, Ian Fette, Patrick Kelley, Madhu Prabaker, and Jinghai Rao. 2009. Understanding and capturing people’s privacy policies in a mobile social networking application. Personal and ubiquitous computing 13 (2009), 401–412.

[108]

Koustuv Saha 2019. Social Media as a Passive Sensor in Longitudinal Studies of Human Behavior and Wellbeing. In CHI Ext. Abstracts. ACM.

[109]

Koustuv Saha, Ted Grover, Stephen M Mattingly, Vedant Das Swain, Pranshu Gupta, Gonzalo J Martinez, Pablo Robles-Granda, Gloria Mark, Aaron Striegel, and Munmun De Choudhury. 2021. Person-Centered Predictions of Psychological Constructs with Social Media Contextualized by Multimodal Sensing. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 5, 1 (2021), 1–32.

Digital Library

[110]

Koustuv Saha, Pranshu Gupta, Gloria Mark, Emre Kiciman, and Munmun De Choudhury. 2024. Observer Effect in Social Media Use. In Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems.

Digital Library

[111]

Koustuv Saha and Shamsi T Iqbal. 2023. Focus Time for Wellbeing and Work Engagement of Information Workers. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems Extended Abstracts.

Digital Library

[112]

Koustuv Saha, Manikanta D Reddy, Vedant das Swain, Julie M Gregg, Ted Grover, Suwen Lin, Gonzalo J Martinez, Stephen M Mattingly, Shayan Mirjafari, Raghu Mulukutla, 2019. Imputing missing social media data stream in multisensor studies of human behavior. In 2019 8th International Conference on Affective Computing and Intelligent Interaction (ACII). IEEE, 178–184.

[113]

Koustuv Saha, Manikanta D Reddy, Stephen M Mattingly, Edward Moskal, Anusha Sirigiri, and Munmun De Choudhury. 2019. LibRA : On LinkedIn based Role Ambiguity and Its Relationship with Wellbeing and Job Performance. Proc. ACM Hum.-Comput. Interact.CSCW (2019).

Digital Library

[114]

Koustuv Saha, Asra Yousuf, Louis Hickman, Pranshu Gupta, Louis Tay, and Munmun De Choudhury. 2021. A Social Media Study on Demographic Differences in Perceived Job Satisfaction. Proceedings of the ACM on Human-Computer Ineraction (CSCW) (2021).

Digital Library

[115]

Florian Schaule, Jan Ole Johanssen, Bernd Bruegge, and Vivian Loftness. 2018. Employing consumer wearables to detect office workers’ cognitive load for interruption management. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 2, 1 (2018), 1–20.

Digital Library

[116]

N Sadat Shami, Jiang Yang, Laura Panc, Casey Dugan, Tristan Ratchford, Jamie C Rasmussen, Yannick M Assogba, Tal Steier, Todd Soule, Stela Lupushor, 2014. Understanding employee social media chatter with enterprise social pulse. In Proc. CSCW.

Digital Library

[117]

Mike Sharples. 2022. Automated essay writing: An AIED opinion. International journal of artificial intelligence in education 32, 4 (2022), 1119–1126.

[118]

Richard Snow. 2013. I invented the modern age: The rise of Henry Ford. Simon and Schuster.

[119]

Daniel J Solove. 2012. Introduction: Privacy self-management and the consent dilemma. Harv. L. Rev. 126 (2012), 1880.

[120]

Luke Stark. 2018. Algorithmic psychometrics and the scalable subject. Social Studies of Science 48, 2 (2018), 204–231.

[121]

Jina Suh, Javier Hernandez, Koustuv Saha, Kathy Dixon, Mehrab Bin Morshed, Esther Howe, Anna Kawakami, and Mary Czerwinski. 2023. Towards successful deployment of wellbeing sensing technologies: Identifying misalignments across contextual boundaries. In 2023 11th International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW). IEEE, 1–8.

[122]

Jim Thatcher, David O’Sullivan, and Dillon Mahmoudi. 2016. Data colonialism through accumulation by dispossession: New metaphors for daily data. Environment and Planning D: Society and Space 34, 6 (2016), 990–1006.

[123]

Anja Thieme, Danielle Belgrave, and Gavin Doherty. 2020. Machine learning in mental health: A systematic review of the HCI literature to support the development of effective and implementable ML systems. ACM Transactions on Computer-Human Interaction (TOCHI) 27, 5 (2020), 1–53.

Digital Library

[124]

Hugo Touvron, Thibaut Lavril, Gautier Izacard, Xavier Martinet, Marie-Anne Lachaux, Timothée Lacroix, Baptiste Rozière, Naman Goyal, Eric Hambro, Faisal Azhar, 2023. Llama: Open and efficient foundation language models. arXiv preprint arXiv:2302.13971 (2023).

[125]

Thea F Van de Mortel 2008. Faking it: social desirability response bias in self-report research. Australian Journal of Advanced Nursing, The 25, 4 (2008), 40.

[126]

Qiaosi Wang, Michael Madaio, Shaun Kane, Shivani Kapania, Michael Terry, and Lauren Wilcox. 2023. Designing responsible ai: Adaptations of ux practice to meet responsible ai challenges. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1–16.

Digital Library

[127]

Qiaosi Wang, Koustuv Saha, Eric Gregori, David Joyner, and Ashok K Goel. 2021. Mutual Theory of Mind in Human-AI Interaction: How Language Reflects What Students Perceive About a Virtual Teaching Assistant. In Proc. CHI.

Digital Library

[128]

Rui Wang, Min SH Aung, Saeed Abdullah, Rachel Brian, Andrew T Campbell, Tanzeem Choudhury, Marta Hauser, John Kane, Michael Merrill, Emily A Scherer, 2016. CrossCheck: Toward passive sensing and detection of mental health changes in people with schizophrenia. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing.

Digital Library

[129]

Chenfei Wu, Shengming Yin, Weizhen Qi, Xiaodong Wang, Zecheng Tang, and Nan Duan. 2023. Visual chatgpt: Talking, drawing and editing with visual foundation models. arXiv preprint arXiv:2303.04671 (2023).

[130]

Angie Zhang, Alexander Boltz, Chun Wei Wang, and Min Kyung Lee. 2022. Algorithmic management reimagined for workers and by workers: Centering worker well-being in gig work. In CHI Conference on Human Factors in Computing Systems.

Digital Library

[131]

Han Zhang, Vedant Das Swain, Leijie Wang, Nan Gao, Yilun Sheng, Xuhai Xu, Flora D Salim, Koustuv Saha, Anind K Dey, and Jennifer Mankoff. 2024. Illuminating the Unseen: A Framework for Designing and Mitigating Context-induced Harms in Behavioral Sensing. arXiv preprint arXiv:2404.14665 (2024).

[132]

Ou Zheng, Mohamed Abdel-Aty, Dongdong Wang, Zijin Wang, and Shengxuan Ding. 2023. ChatGPT is on the horizon: Could a large language model be all we need for Intelligent Transportation?arXiv preprint arXiv:2303.05382 (2023).

[133]

Kathryn Zickuhr. 2021. Workplace Surveillance Is Becoming the New Normal for US Workers. Washington Center for Equitable Growth. https://equitablegrowth. org/research-paper/workplace-surveillance-is-becomingthe-new-normal-for-us-workers/. Institute for Research on Labor and Employment University of California, Berkeley 2521 (2021), 94720–5555.

[134]

Manuela Züger, Sebastian C Müller, André N Meyer, and Thomas Fritz. 2018. Sensing interruptibility in the office: A field study on the use of biometric and computer interaction sensors. In Proceedings of the 2018 CHI conference on human factors in computing systems. 1–14.

Digital Library

Cited By

Ferrara E(2024)Large Language Models for Wearable Sensor-Based Human Activity Recognition, Health Monitoring, and Behavioral Modeling: A Survey of Early Trends, Datasets, and ChallengesSensors10.3390/s2415504524:15(5045)Online publication date: 4-Aug-2024
https://doi.org/10.3390/s24155045
Reali GFemminella M(2024)Artificial Intelligence to Reshape the Healthcare EcosystemFuture Internet10.3390/fi1609034316:9(343)Online publication date: 20-Sep-2024
https://doi.org/10.3390/fi16090343

Index Terms

Teacher, Trainer, Counsel, Spy: How Generative AI can Bridge or Widen the Gaps in Worker-Centric Digital Phenotyping of Wellbeing
1. Applied computing
  1. Law, social and behavioral sciences
    1. Psychology
2. Human-centered computing
  1. Collaborative and social computing
    1. Collaborative and social computing theory, concepts and paradigms
      1. Social media
    2. Empirical studies in collaborative and social computing

Recommendations

Algorithmic Power or Punishment: Information Worker Perspectives on Passive Sensing Enabled AI Phenotyping of Performance and Wellbeing
CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems

We are witnessing an emergence in Passive Sensing enabled AI (PSAI) to provide dynamic insights for performance and wellbeing of information workers. Hybrid work paradigms have simultaneously created new opportunities for PSAI, but have also fostered ...
Designing for Wellbeing: Worker-Generated Ideas on Adapting Algorithmic Management in the Hospitality Industry
DIS '23: Proceedings of the 2023 ACM Designing Interactive Systems Conference

Labor shortages have shaped many industries over the past several years, with hospitality experiencing one of the largest rates of attrition. Workers are leaving their jobs for a variety of reasons, ranging from burnout and work intensification to a ...
Can Workers Meaningfully Consent to Workplace Wellbeing Technologies?
FAccT '23: Proceedings of the 2023 ACM Conference on Fairness, Accountability, and Transparency

Sensing technologies deployed in the workplace can unobtrusively collect detailed data about individual activities and group interactions that are otherwise difficult to capture. A hopeful application of these technologies is that they can help ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

CHIWORK '24: Proceedings of the 3rd Annual Meeting of the Symposium on Human-Computer Interaction for Work

June 2024

297 pages

ISBN:9798400710179

DOI:10.1145/3663384

Copyright © 2024 Owner/Author.

This work is licensed under a Creative Commons Attribution International 4.0 License.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 25 June 2024

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

CHIWORK 2024

CHIWORK 2024: Annual Symposium on Human-Computer Interaction for Work

June 25 - 27, 2024

Newcastle upon Tyne, United Kingdom

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
353
Total Downloads

Downloads (Last 12 months)353
Downloads (Last 6 weeks)138

Reflects downloads up to 09 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Ferrara E(2024)Large Language Models for Wearable Sensor-Based Human Activity Recognition, Health Monitoring, and Behavioral Modeling: A Survey of Early Trends, Datasets, and ChallengesSensors10.3390/s2415504524:15(5045)Online publication date: 4-Aug-2024
https://doi.org/10.3390/s24155045
Reali GFemminella M(2024)Artificial Intelligence to Reshape the Healthcare EcosystemFuture Internet10.3390/fi1609034316:9(343)Online publication date: 20-Sep-2024
https://doi.org/10.3390/fi16090343

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents