short-paper

Hey, Siri®! Ok, Google®! Does Talking to Voice Assistants Enhance Emotional Aspects of Mobile Phone User Experience?

Authors:

Clarissa Sabrina Arlinghaus,

Frank OllermannAuthors Info & Claims

MuC '22: Proceedings of Mensch und Computer 2022

Pages 382 - 388

https://doi.org/10.1145/3543758.3547544

Published: 15 September 2022 Publication History

Abstract

This German online study (N = 665) examines the influence of voice control usage on emotional aspects of mobile phone user experience. Frequent use of voice control is associated with both positive and, with limitations, also negative emotions towards the mobile phone. The study only partially confirms Herzberg’s two-factor theory when transferred to user experience. A more frequent use of voice control primarily affects positive emotions, but the combination of both emotion types can make a difference.

Supplementary Material

Figure 1 and Figure 2 are the figures from our paper. Figure 1 shows the amount of positive and negative emotion for different frequencies of voice control use. The only statistically significant pairwise comparison is between "often"' and "never"' with a difference of - 0.53 between the two mean values. Figure 2 visualizes the discriminant analysis. It shows the distribution of group means in a coordinate system with the two discriminant functions as the axes. The group means can be seen to be spread further apart on the axis of function 1 than on the axis of function 2. On the axis of function 1 the group means of "often'' and "never'' are furthest apart. (figures.zip)

Download
682.89 KB

The madness presentation is a short presentation consisting of three slides without description. The madness presentation is used to introduce the paper in less than a minute at the conference. (madness_presentation.pdf)

Download
746.22 KB

MP4 File (video_presentation.mp4)

Video presentation

Download
66.68 MB

References

[1]

Clarissa S. Arlinghaus and Frank Ollermann. 2021. Constant Companion. How Frequent Phone Use and Interpersonal Communication Are Related to User’s Emotional Appraisal. In MuC ’21: Mensch und Computer 2021. ACM, New York, NY, USA, 469–477. https://doi.org/10.1145/3473856.3474013

Digital Library

[2]

Matthew P. Aylett, Benjamin R. Cowan, and Leigh Clark. 2019. Siri, Echo and performance: You have to suffer darling. In CHI EA ’19: Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems, Stephen Brewster, Geraldine Fitzpatrick, Anna Cox, and Vassilis Kostakos (Eds.). Association for Computing Machinery, New York, NY, USA, 1–10. https://doi.org/10.1145/3290607.3310422

Digital Library

[3]

Achim Berg. 2019. Kinder und Jugendliche in der digitalen Welt. Bitkom. Retrieved April 5, 2022 from https://www.bitkom.org/sites/default/files/2019-05/bitkom_pk-charts_kinder_und_jugendliche_2019.pdf

[4]

Chaya Bijani, Brent-Kaan White, and Mark Vilrokx. 2013. Giving voice to enterprise mobile applications. In MobileHCI ’13: Proceedings of the 15th International Conference on Human-Computer Interaction with Mobile Devices and Services, Michael Rohs, Albrecht Schmidt, Daniel Ashbrook, and Enrico Rukzio (Eds.). Association for Computing Machinery, New York, NY, USA, 428–433. https://doi.org/10.1145/2493190.2494086

Digital Library

[5]

Chongyang Chen, Kem Z. K. Zhang, Sesia J. Zhao, Matthew K. O. Lee, and Tianjia Cong. 2016. The impact of mere exposure effect on smartphone addiction. In Proceedings of the 49th Annual Hawaii International Conference on System Sciences. 5-8 January 2016. Kauai, Hawaii, Tung X. Bui and Ralph H. Sprague, Jr. (Eds.). IEEE Society, Los Alamitos, CA, 1507–1514. https://doi.org/10.1109/HICSS.2016.190

Digital Library

[6]

Kevin Christian, Bill Kules, Ben Shneiderman, and Adel Youssef. 2000. A comparison of voice controlled and mouse controlled web browsing. In Assets ’00: Proceedings of the fourth international ACM conference on Assistive technologies, Marilyn Tremaine, Elliot Cole, and Elizabeth Mynatt (Eds.). Association for Computing Machinery, New York, NY, USA, 72–79. https://doi.org/10.1145/354324.354345

Digital Library

[7]

Leigh Clark, Phillip Doyle, Diego Garaialde, Emer Gilmartin, Stephan Schlögl, Jens Edlund, Matthew Aylett, João Cabral, Cosmin Munteanu, and Benjamin Cowan. 2019. The state of speech in HCI: Trends, themes and challenges. Interacting with Computers 31, 4 (2019), 349–371. https://doi.org/10.1093/iwc/iwz016

[8]

Akiba A. Cohen and Dafna Lemish. 2003. Real time and recall measures of mobile phone use: Some methodological concerns and empirical application. New Media & Society 5, 2 (2003), 167–183. https://doi.org/10.1177%2F1461444803005002002

[9]

Daxiang Dai, Qun Liu, and Hongying Meng. 2016. Can your smartphone detect your emotion?. In 12th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery. ICNC-FSKD 2016, Maozhen Li, Ning Xiong, Zhao Tong, Jiayi Du, Chubo Liu, Kenli Li, and Lipo Wang (Eds.). Institute of Electrical and Electronics Engineers, Piscataway, NJ, USA, 1704–1709. https://doi.org/10.1109/FSKD.2016.7603434

[10]

Marina Dobrota, Ana Nikodijević, and Dobrivoje Mihailović. 2012. Influence of the customer experience on satisfaction with mobile phones. Journal of Engineering Management and Competitiveness 2, 2(2012), 69–75. https://doi.org/10.5937/jemc1202069D

[11]

Daniel Dupré, Anna Tcherkassof, and Michel Dubios. 2015. Emotions triggered by innovative products. A multi-componential approach of emotions for user experience tools. In ACII ’15: Proceedings of the 2015 International Conference on Affective Computing and Intelligent Interaction (ACII). IEEE Computer Society, Washington, DC, USA, 772–777. https://doi.org/10.1109/ACII.2015.7344657

Digital Library

[12]

Nicholas Epley, Adam Waytz, and John T. Cacioppo. 2007. On seeing human: A three-Factor theory of anthropomorphism. Psychological Review 114, 4 (2007), 864–886. https://doi.org/10.1037/0033-295X.114.4.864

[13]

Ido Guy. 2018. The characteristics of voice search: Comparing spoken with typed-in mobile web search queries. ACM Transactions on Information Systems 36, 3 (2018), 1–28. https://doi.org/10.1145/3182163

Digital Library

[14]

Marian Harbach, Alexander De Luca, Nathan Malkin, and Serge Egelman. 2016. Keep on lockin’ in the free world: A multi-national comparison of smartphone locking. In CHI ’16: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, Jofish Kaye, Allison Druin, Cliff Lampe, Dan Morris, and Juan Pablo Hourcade (Eds.). Association for Computing Machinery, New York, NY, USA, 4823–4827. https://doi.org/10.1145/2858036.2858273

Digital Library

[15]

Marc Hassenzahl. 2004. The Thing and I: Understanding the Relationship Between User and Product. In Funology. From Usability to Enjoyment, Mark A. Blythe, Kees Overbeeke, Andrew F. Monk, and Peter C. Wright (Eds.). Kluwer Academic Publishers, Dordrecht, 31–42. https://doi.org/10.1007/1-4020-2967-5_4

[16]

Marc Hassenzahl, Sarah Diefenbach, and Anja Göritz. 2010. Needs, affect, and interactive products – facets of user experience. Interacting with Computers 22, 5 (2010), 353–362. https://doi.org/10.1016/j.intcom.2010.04.002

Digital Library

[17]

Alisha C. Holland and Elizabeth A. Kensinger. 2010. Emotion and autobiographical memory. Physics of Life Reviews 7, 1 (2010), 88–131. https://doi.org/10.1016/j.plrev.2010.01.006

[18]

Scott Huffmann. 2014. OMG! Mobile voice survey reveals teens love to talk. Google. Retrieved April 5, 2022 from https://blog.google/products/search/omg-mobile-voice-survey-reveals-teens/

[19]

Imo Inyang, Geza Benke, Joseph Morrissey, Ray McKenzie, and Michael Abramson. 2009. How well do adolescents recall use of mobile telephones? Results of a validation study. BMC Medical Research Methodology 9 (2009), 36. https://doi.org/10.1186/1471-2288-9-36

[20]

Sari Kujala and Talya Miron-Shatz. 2013. Emotions, experiences and usability in real-life mobile phone use. In CHI ’13: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Susanne Bødker, Stephen Brewster, Patrick Baudisch, Michel Beaudin-Lafon, and Wendy E. Mackay (Eds.). Association for Computing Machinery, New York, NY, USA, 1061––1070. https://doi.org/10.1145/2470654.2466135

Digital Library

[21]

Dicle Berfin Köse. 2020. Rolling or scrolling? The effect of content type on habitual use of Facebook. In PACIS 2020 Proceedings, Doug Vogel, Kathy Ning Shen, Pan Shan Ling, Carol Hsu, James Y. L. Thong, Sean Xin Xu, Marco De Marco, and Moez Limayem (Eds.). Association for Information Systems, Atlanta, GA, 1–13.

[22]

Kiljae Lee, Kyung Young Lee, and Lorn Sheehan. 2020. Hey Alexa! A magic spell of social glue?: Sharing a smart voice assistant speaker and its impact on users’ perception of group harmony. Information Systems Frontiers 22 (2020), 563–583. https://doi.org/10.1007/s10796-019-09975-1

[23]

Sascha Mahlke and Michael Minge. 2008. Consideration of multiple components of emotions in human-technology interaction. In Affect and Emotion in Human-Computer-Interaction: From Theory to Applications, Christian Peter and Russell Beale (Eds.). Springer, Berlin. https://doi.org/10.1007/978-3-540-85099-1_5

Digital Library

[24]

Graeme McLean and Kofi Osei-Frimpong. 2019. Hey Alexa...examine the variables influencing the use of artificial intelligent in-home voice assistants. Computers in Human Behavior 99 (2019), 28–37. https://doi.org/10.1016/J.CHB.2019.05.009

Digital Library

[25]

Rishabh Mehrotra, Ahmed Hassan Awadallah, Ahmed El Kholy, and Imed Zitouni. 2017. Hey Cortana! Exploring the use cases of a desktop based digital assistant. In CAIR ’17: First International Workshop on Conversational Approaches to Information Retrieval at SIGIR 2017, Hideo Joho, Lawrence Cavedon, Jaime Arguello, Milad Shokouhi, and Filip Radlinski (Eds.). Association for Computing Machinery, New York, NY, USA, 1–5.

[26]

Michael Minge and Laura Riedel. 2013. meCUE – Ein modularer Fragebogen zur Erfassung des Nutzererlebens. In Mensch & Computer 2013 – Tagungsband. 13. Fachübergreifende Konferenz für interaktive und kooperative Medien. Interaktive Vielfalt, Susanne Boll, Susanne Maaß, and Rainer Malaka (Eds.). Oldenbourg, München, 89–98.

[27]

Michael Minge, Manfred Thüring, and Ingmar Wagner. 2016. Developing and validating an english version of the meCUE questionnaire for measuring user experience. Proceedings of the Human Factors and Ergonomics Society 2016 Annual Meeting 60, 1 (2016), 2063–2067. https://doi.org/10.1177/1541931213601468

[28]

Sara Moussawi. 2018. User experience with personal intelligent agents: A sensory, physical, functional and cognitive affordances view. In SIGMIS-CPR ’18: Proceedings of the 2018 ACM SIGMIS Conference on Computers and People Research, Rajiv Kishore, Daniel Beimborn, Rajendra K. Bandi, Benoit Aubert, Deborah Compeau, and Monideepa Tarafdar (Eds.). Association for Computing Machinery, New York, NY, USA, 86–92. https://doi.org/10.1145/3209626.3209709

Digital Library

[29]

Sara Moussawi, Marios Koufaris, and Raquel Benbunan-Fich. 2021. How perceptions of intelligence and anthropomorphism affect adoption of personal intelligent agents. Electronic Markets 31(2021), 343–364. https://doi.org/10.1007/s12525-020-00411-w

[30]

Rainer Müller, Ralf Müller-Polyzou, Leenhard Hörauf, Attique Bashir, Martin Karkowski, Denise Vesper, and Steffen Gärtner. 2018. Intuitive Bedienung laserbasierter Montageassistenz. ZWF Zeitschrift für Wirtschaftlichen Fabrikbetrieb 113, 6(2018), 363–368. https://doi.org/10.3139/104.111922

[31]

Teresa K. Naab and Anna Schnauber. 2016. Habitual initiation of media use and a response frequency measure for its examination. Media Psychology 19, 1 (2016), 126–155. https://doi.org/10.1080/15213269.2014.951055

[32]

Bjorn Nansen, Frank Vetere, Toni Robertson, John Downs, Margot Brereton, and Jeannette Durick. 2014. Reciprocal habituation: A study of older people and the Kinect. ACM Transactions on Computer-Human Interaction 21, 3(2014), 1–20. https://doi.org/10.1145/2617573

Digital Library

[33]

Roger C. Parslow, Sarah J. Hepworth, and Patricia A. McKinney. 2003. Recall of past use of mobile phone handsets. Radiation Protection Dosimetry 106, 3 (2003), 223–240. https://doi.org/10.1093/oxfordjournals.rpd.a006354

[34]

Alisha Pradhan, Kanika Mehta, and Leah Findlater. 2018. “Accessiblity came by accident”: Use of voice-controlled intelligent personal assistants by people with disabilities. In CHI ’18: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, Regan Mandryk, Mark Hancock, Mark Perry, and Anna Cox (Eds.). Association for Computing Machinery, New York, NY, USA, paper 459, pp. 1–13. https://doi.org/10.1145/3173574.3174033

Digital Library

[35]

Amanda Purington, Jessie G. Taft, Shruti Sannon, Natalya N. Bazarova, and Samuel Hardman Taylor. 2017. “Alexa is my new BFF”: Social roles, user satisfaction, and personification of the Amazon Echo. In CHI EA ’17: Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems, Gloria Mark, Susan Fussel, Cliff Lampe, M.C. Schraefel, Juan Pablo Hourcade, Caroline Appert, and Daniel Wigdor (Eds.). Association for Computing Machinery, New York, NY, USA, 2853–2859. https://doi.org/10.1145/3027063.3053246

Digital Library

[36]

Eeva Raita and Antti Oulasvirta. 2014. Mixed feelings? The relationship between perceived usability and user experience in the wild. In NordiCHI ’14: Proceedings of the 8th Nordic Conference on Human-Computer Interaction: Fun, Fast, Foundational, Virpi Roto, Jonna Häkkilä, Kaisa Väänänen-Vainio-Mattila, Oskar Juhlin, Thomas Olsson, and Ebba Hvannberg (Eds.). ACM, New York, NY, 1–10. https://doi.org/10.1145/2639189.2639207

Digital Library

[37]

Diana Rieger, Lena Frischlich, Tim Wulf, Gary Bente, and Julia Kneer. 2015. Eating ghosts: The underlying mechanism of mood repair via interactive and noninteractive media. Psychology of Popular Media Culture 4, 2 (2015), 138–154. https://doi.org/10.1037/ppm0000018

[38]

Bernd Rohrmann. 1978. Empirische Studien zur Entwicklung von Antwortskalen für die sozialwissenschaftliche Forschung. Zeitschrift für Sozialpsychologie 9 (1978), 222–245.

[39]

Thomas E. Ruggiero. 2000. Uses and gratifications theory in the 21st century. Mass Communication & Society 3, 1 (2000), 3–37. https://doi.org/10.1207/S15327825MCS0301_02

[40]

Christine Rzepka. 2019. Examining the use of voice assistants: A value-focused thinking approach. In AMICIS 2019 Proceedings, Guillermo Rodríguez-Abitia, Carlos Ferran, Martin Santana, and Ramiro Montealegre (Eds.). Association for Information Systems, Atlanta, GA, USA, 1666–1676.

[41]

Florence Samkanage-Zeeb, Gabriele Berg, and Maria Blettner. 2004. Validation of self-reported cellular phone use. Journal of Exposure Analysis and Environmental Epidemiology 14, 3(2004), 245–248. https://doi.org/10.1038/sj.jea.7500321

[42]

Zhanna Sarsenbayeva, Gabriele Marini, Niels van Berkel, Chu Luo, Weiwei Jiang, Kangning Yang, Greg Wadley, Tilman Dingler, Vassilis Kostakos, and Jorge Goncalves. 2020. Does Smartphone Use Drive Our Emotions or Vice Versa? A Causal Analysis. In CHI ’20: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 1–15. https://doi.org/10.1145/3313831.3376163

Digital Library

[43]

Sergio Sayago and Josep Blat. 2020. Reimagining communication with conversational user interfaces. In Reimaging Communication: Mediation, Michael Filimowicz and Veronika Tzankova (Eds.). Routledge, New York, NY, USA, 287–302. https://doi.org/10.4324/9781351015431-18

[44]

Shunsuke Suzuki, Victoria Bellotti, Nick Yee, Bonnie E. John, Yusuke Nakao, Toshiyuki Asahi, and Shin’ichi Fukuzumi. 2011. Variation in importance of time-on-task with familiarity with mobile phone models. In CHI ’11: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Desney Tan, Geraldine Fitzpatrick, Carl Gutwin, Bo Begole, and Wendy A. Kellogg (Eds.). Association for Computing Machinery, New York, NY, USA, 2551–2554. https://doi.org/10.1145/1978942.1979314

Digital Library

[45]

George Terzopoulos and Maya Satratzemi. 2019. Voice assistants and artificial intelligence in education. In BCI ’19: Proceedings of the 9th Balkan Conference on Informatics, George Eleftherakis, Milena Lazarova, Adelina Aleksieva-Petrova, and Antoniya Tasheva (Eds.). Association for Computing Machinery, New York, NY, USA, article 34, pp. 1–6. https://doi.org/10.1145/3351556.3351588

Digital Library

[46]

Subrata Tikadar and Samit Bhattacharya. 2019. A novel method to build and validate an affective state prediction model from touch-typing. In Human-Computer Interaction – INTERACT 2019. 17th IFIP TC 13 International Conference. Paphos, Cyprus, September 2–6, 2019. Proceedings, Part IV, David Lamas, Fernando Loizides, Lennart Nacke, Helen Petrie, Marco Winckler, and Panayiotis Zaphiris (Eds.). Springer Nature Switzerland AG, Cham, CH, 99–119. https://doi.org/10.1007/978-3-030-29390-1_6

Digital Library

[47]

Viswanath Venkatesh, James Y. L. Thong, and Xin Xu. 2012. Consumer acceptance and use of technology: Extending the unified theory of acceptance and use of technology. MIS Quarterly 36, 1 (2012), 157–178. https://doi.org/10.2307/41410412

[48]

Robert Boleslaw Zajonc. 1968. Attitudinal effects of mere exposure. Journal of Personality and Social Psychology 9, 2 (1968), 1–27. https://doi.org/10.1037/h0025848

[49]

Jennifer Zamora. 2017. I’m sorry, Dave, I’m afraid I can’t do that: chatbot perception and expectations. In HAI ‘17: Proceedings of the 5th International Conference on Human Agent Interaction, Britta Wrede, Yukie Nagai, Takanori Komatsu, Marc Hanheide, and Lorenzo Natale (Eds.). ACM, New York, NY, 253–260. https://doi.org/10.1145/3125739.3125766

Digital Library

[50]

Dolf Zillmann. 1988. Mood management through communication choices. American Behavioral Scientist 31, 3 (1988), 327–340. https://doi.org/10.1177/000276488031003005

Cited By

Schäfer AFreyer M(2024)"Is There Anything Else...?" Role-Play Exploration To Use Response Times As A Relationship-Building Effect With Voice AssistantsProceedings of Mensch und Computer 202410.1145/3670653.3677500(474-478)Online publication date: 1-Sep-2024
https://dl.acm.org/doi/10.1145/3670653.3677500
Cheng A(2023)Utilizing Different Voice Value to Understand Voice Assistant Users’ EnjoymentHCI International 2023 Posters10.1007/978-3-031-35989-7_70(553-560)Online publication date: 9-Jul-2023
https://doi.org/10.1007/978-3-031-35989-7_70

Recommendations

Constant Companion: How Frequent Phone Use and Interpersonal Communication Are Related to Users’ Emotional Appraisal
MuC '21: Proceedings of Mensch und Computer 2021

Emotional appraisal is a core aspect of user experience. This study examines whether frequency of mobile phone use can have an impact on emotional aspects of mobile phone user experience. It also comments on the role of interpersonal communication for ...
Emotions, experiences and usability in real-life mobile phone use
CHI '13: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Positive emotional experiences with an interactive product are assumed to lead to good user experience and, ultimately, to product success. However, the path from emotional experiences to product evaluation may not be direct, as emotions fluctuate over ...
Emotional user experience

Emotional experience has become an important topic in human-technology interaction research and design. Nevertheless, such research and design often lacks a proper explanatory basis and methodologically robust operationalisation. In this article, a ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

MuC '22: Proceedings of Mensch und Computer 2022

September 2022

624 pages

ISBN:9781450396905

DOI:10.1145/3543758

Copyright © 2022 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 15 September 2022

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper
Research
Refereed limited

Conference

MuC '22

MuC '22: Mensch und Computer 2022

September 4 - 7, 2022

Darmstadt, Germany

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
156
Total Downloads

Downloads (Last 12 months)35
Downloads (Last 6 weeks)3

Reflects downloads up to 12 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Schäfer AFreyer M(2024)"Is There Anything Else...?" Role-Play Exploration To Use Response Times As A Relationship-Building Effect With Voice AssistantsProceedings of Mensch und Computer 202410.1145/3670653.3677500(474-478)Online publication date: 1-Sep-2024
https://dl.acm.org/doi/10.1145/3670653.3677500
Cheng A(2023)Utilizing Different Voice Value to Understand Voice Assistant Users’ EnjoymentHCI International 2023 Posters10.1007/978-3-031-35989-7_70(553-560)Online publication date: 9-Jul-2023
https://doi.org/10.1007/978-3-031-35989-7_70

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents