"Please Be Nice": Robot Responses to User Bullying - Measuring Performance Across Aggression Levels
Authors: 
Yiming Luo, Shihao Liu, Di Wu, Hao Wang, Yushan PanAuthors Info & Claims
Yiming Luo, Shihao Liu, Di Wu, Hao Wang, Yushan PanAuthors Info & ClaimsArticle No.: 582, Pages 1 - 15
Abstract
As robots become integral to public services, addressing harmful user behaviors like bullying is crucial. Existing research often overlooks the gradual nature of human bullying. This study fills this gap by exploring how robots can counter bullying through optimized responses. Using a simulated human-robot interaction study, we manipulated robot response behaviors and styles across escalating bullying severity. Results show that empathetic verbal responses promptly reduce users’ bullying tendencies by eliciting remorse and redirecting attention to social awareness. However, users’ underlying dispositions may override these reflexive reactions, emphasizing the need for a holistic understanding. In conclusion, a comprehensive approach is essential, involving immediate reaction optimization, emotional state assessment, and ongoing behavioral adjustment through empathetic dialogue. By implementing such strategies, we can transform human-robot relationships from potential bullying situations to harmonious interactions. This study provides an empirical foundation for response protocols that discourage bullying and enhance mutual understanding.
Supplemental Material
MP4 File - Video Preview
Video Preview
- Download
- 6.12 MB
- Download
- 21.04 MB
- Transcript
References
[1]
Ghada M. Abaido. 2020. Cyberbullying on social media platforms among university students in the United Arab Emirates. International Journal of Adolescence and Youth 25, 1 (2020), 407–420.
[2]
João Tiago Almeida, Iolanda Leite, and Elmira Yadollahi. 2023. Would You Help Me? Linking Robot’s Perspective-Taking to Human Prosocial Behavior. In Proceedings of the 2023 ACM/IEEE International Conference on Human-Robot Interaction (Stockholm, Sweden) (HRI ’23). Association for Computing Machinery, New York, NY, USA, 388–397. https://doi.org/10.1145/3568162.3577000
[3]
Sabine A. M. Veldkamp amd Dorret I. Boomsma, Eveline L. de Zeeuw, Catharina E. M. van Beijsterveldt, Meike Bartels, Conor V. Dolan, and Elsje van Bergen. 2019. Genetic and Environmental Influences on Different Forms of Bullying Perpetration, Bullying Victimization, and Their Co-occurrence. Behavior Genetics 49 (2019), 432–443.
[4]
Margaret Arnd-Caddigan. 2015. Sherry Turkle: Alone Together: Why We Expect More from Technology and Less from Each Other: Basic Books, New York, 2011, 348 pp, ISBN 978-0465031467 (pbk).
[5]
Christoph Bartneck and Merel Keijsers. 2020. The morality of abusing a robot. De Gruyter 11 (2020), 271–283. Issue 1.
[6]
Daniel Belanche, Luis V Casaló, Carlos Flavián, and Jeroen Schepers. 2020. Service robot implementation: a theoretical framework and research agenda. The Service Industries Journal 40, 3-4 (2020), 203–225.
[7]
Andrea Botero, Sampsa Hyysalo, Cindy Kohtala, and Jack Whalen. 2020. Getting Participatory Design Done: From Methods and Choices to Translation Work across Constituent Domains. International Journal of Design 14 (2020), 17–34.
[8]
Elizabeth Broadbent. 2017. Interactions with robots: The truths we reveal about ourselves. Annual review of psychology 68 (2017), 627–652.
[9]
Dražen Brščić, Hiroyuki Kidokoro, Yoshitaka Suehiro, and Takayuki Kanda. 2015. Escaping from Children’s Abuse of Social Robots. In Proceedings of the Tenth Annual ACM/IEEE International Conference on Human-Robot Interaction (Portland, Oregon, USA) (HRI ’15). Association for Computing Machinery, New York, NY, USA, 59–66. https://doi.org/10.1145/2696454.2696468
[10]
Oscar Hengxuan Chi, Christina G. Chi, Dogan Gursoy, and Robin Nunkoo. 2023. Customers’ acceptance of artificially intelligent service robots: The influence of trust and culture. International Journal of Information Management 70 (2023), 102623.
[11]
Oscar Hengxuan Chi, Shizhen Jia, Yafang Li, and Dogan Gursoy. 2021. Developing a formative scale to measure consumers’ trust toward interaction with artificially intelligent (AI) social robots in service delivery. Computers in Human Behavior 118 (2021), 106700.
[12]
Hyojin Chin, Lebogang Wame Molefi, and Mun Yong Yi. 2020. Empathy Is All You Need: How a Conversational Agent Should Respond to Verbal Abuse. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–13.
[13]
Hyojin Chin and Mun Yong Yi. 2019. Should an Agent Be Ignoring It? A Study of Verbal Abuse Types and Conversational Agents’ Response Styles. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI EA ’19). Association for Computing Machinery, New York, NY, USA, 1–6. https://doi.org/10.1145/3290607.3312826
[14]
Sujung Cho and Jeoung Min Lee. 2018. Explaining physical, verbal, and social bullying among bullies, victims of bullying, and bully-victims: Assessing the integrated approach between social control and lifestyles-routine activities theories. Children and Youth Services Review 91 (2018), 372–382.
[15]
Youngjoon Choi, Miju Choi, Munhyang (Moon) Oh, and Seongseop (Sam) Kim. 2020. Service robots in hotels: understanding the service quality perceptions of human-robot interaction. Journal of Hospitality Marketing & Management 29, 6 (2020), 613–635.
[16]
Joe Connolly. 2020. Preventing Robot Abuse through Emotional Robot Responses. In Companion of the 2020 ACM/IEEE International Conference on Human-Robot Interaction (Cambridge, United Kingdom) (HRI ’20). Association for Computing Machinery, New York, NY, USA, 558–560. https://doi.org/10.1145/3371382.3377433
[17]
Joe Connolly, Viola Mocz, Nicole Salomons, Joseph Valdez, Nathan Tsoi, Brian Scassellati, and Marynel Vázquez. 2020. Prompting Prosocial Human Interventions in Response to Robot Mistreatment. In 2020 15th ACM/IEEE International Conference on Human-Robot Interaction (HRI). IEEE, Cambridge, United Kingdom, 211–220. https://doi.org/10.1145/3319502.3374781
[18]
Louise Ferraz de Camargo, Kylie Rice, and Einar Thorsteinsson. 2022. A systematic review and empirical investigation: bullying victimisation and anxiety subtypes among adolescents. Australian Journal of Psychology 74, 1 (2022), 2145236.
[19]
M.M.A. de Graaf, Soumaya Ben Allouch, and Johannes A.G.M. van Dijk. 2016. Long-term acceptance of social robots in domestic environments: Insights from a user’s perspective. In The 2016 AAAI Spring Symposium Series. AAAI, Stanford, United States, 96–103. 2016 AAAI Spring Symposium on Enabling Computing Research in Socially Intelligent Human-Robot Interaction ; Conference date: 21-03-2016 Through 23-03-2016.
[20]
Dmitry Dereshev, David Kirk, Kohei Matsumura, and Toshiyuki Maeda. 2019. Long-Term Value of Social Robots through the Eyes of Expert Users. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–12.
[21]
Hyeonmi Hong Eun Young Oh, Donggil Song. 2019. Interactive Computing Technology in Anti-Bullying Education: The Effects of Conversation-Bot’s Role on K-12 Students’ Attitude Change Toward Bullying Problems. Journal of Educational Computing Research 58 (2019), 200–219. Issue 1.
[22]
Francesco Ferrari, Maria Paola Paladino, and Jolanda Jetten. 2016. Blurring human–machine distinctions: Anthropomorphic appearance in social robots as a threat to human distinctiveness. International Journal of Social Robotics 8 (2016), 287–302.
[23]
Laura Fuentes-Moraleda, Patricia Díaz-Pérez, Alicia Orea-Giner, Ana Muñoz- Mazón, and Teresa Villacé-Molinero. 2020. Interaction between hotel service robots and humans: A hotel-specific Service Robot Acceptance Model (sRAM). Tourism Management Perspectives 36 (2020), 100751.
[24]
Sergio García, Daniel Strüber, Davide Brugali, Thorsten Berger, and Patrizio Pelliccione. 2020. Robotics Software Engineering: A Perspective from the Service Robotics Domain. In Proceedings of the 28th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering (Virtual Event, USA) (ESEC/FSE 2020). Association for Computing Machinery, New York, NY, USA, 593–604.
[25]
Katharina Gleichauf, Ramona Schmid, and Verena Wagner-Hartl. 2022. Human-Robot-Collaboration in the Healthcare Environment: An Exploratory Study. In HCI International 2022 - Late Breaking Papers. Multimodality in Advanced Interaction Environments: 24th International Conference on Human-Computer Interaction, HCII 2022, Virtual Event, June 26 – July 1, 2022, Proceedings. Springer-Verlag, Berlin, Heidelberg, 231–240.
[26]
Lisa Hellström and Adrian Lundberg. 2020. Understanding bullying from young people’s perspectives: An exploratory study. Educational Research 62, 4 (2020), 414–433.
[27]
Yutaka Hiroi and Akinori Ito. 2008. Are bigger robots scary? —The relationship between robot size and psychological threat—. In 2008 IEEE/ASME International Conference on Advanced Intelligent Mechatronics. IEEE, Xi’an, China, 546–551. https://doi.org/10.1109/AIM.2008.4601719
[28]
Kasper Hornbæk. 2013. Some Whys and Hows of Experiments in Human–Computer Interaction. Found. Trends Hum.-Comput. Interact. 5, 4 (jun 2013), 299–373.
[29]
Netta Iivari, Leena Ventä-Olkkonen, Sumita Sharma, Tonja Molin-Juustila, and Essi Kinnunen. 2021. CHI Against Bullying: Taking Stock of the Past and Envisioning the Future. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (, Yokohama, Japan, ) (CHI ’21). Association for Computing Machinery, New York, NY, USA, Article 357, 17 pages. https://doi.org/10.1145/3411764.3445282
[30]
Stefan Johansson and Göran Englund. 2021. Cyberbullying and its relationship with physical, verbal, and relational bullying: a structural equation modelling approach. Educational Psychology 41, 3 (2021), 320–337.
[31]
Merel Keijsers and Christoph Bartneck. 2018. Mindless Robots Get Bullied. In Proceedings of the 2018 ACM/IEEE International Conference on Human-Robot Interaction (Chicago, IL, USA) (HRI ’18). Association for Computing Machinery, New York, NY, USA, 205–214.
[32]
Barbara Kühnlenz and Kolja Kühnlenz. 2020. Social Bonding Increases Unsolicited Helpfulness Towards A Bullied Robot. In 2020 29th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN). IEEE, Naples, Italy, 833–838. https://doi.org/10.1109/RO-MAN47096.2020.9223454
[33]
Tineke Klamer Maartje M. A. de Graaf, Somaya Ben Allouch. 2015. Sharing a life with Harvey: exploring the acceptance of and relationship building with a social robot. Computers in Human Behavior 43 (2015), 1–14.
[34]
Tatsuya Nomura, Takayuki Uratani, Takayuki Kanda, Kazutaka Matsumoto, Hiroyuki Kidokoro, Yoshitaka Suehiro, and Sachie Yamada. 2015. Why Do Children Abuse Robots?. In Proceedings of the Tenth Annual ACM/IEEE International Conference on Human-Robot Interaction Extended Abstracts (Portland, Oregon, USA) (HRI’15 Extended Abstracts). Association for Computing Machinery, New York, NY, USA, 63–64. https://doi.org/10.1145/2701973.2701977
[35]
Yushan Pan. 2021. Reflexivity of Account, Professional Vision, and Computer-Supported Cooperative Work: Working in the Maritime Domain. Proc. ACM Hum.-Comput. Interact. 5, CSCW2, Article 370 (oct 2021), 32 pages.
[36]
Lihui Pu, Wendy Moyle, Cindy Jones, and Michael Todorovic. 2018. The Effectiveness of Social Robots for Older Adults: A Systematic Review and Meta-Analysis of Randomized Controlled Studies. The Gerontologist 59, 1 (06 2018), e37–e51.
[37]
Astrid Rosenthal-von der Pütten, David Sirkin, Anna Abrams, and Laura Platte. 2020. The Forgotten in HRI: Incidental Encounters with Robots in Public Spaces. In Companion of the 2020 ACM/IEEE International Conference on Human-Robot Interaction (Cambridge, United Kingdom) (HRI ’20). Association for Computing Machinery, New York, NY, USA, 656–657.
[38]
Daniel Ruiz-Equihua, Jaime Romero, Sandra Maria Correia Loureiro, and Murad Ali. 2023. Human–robot interactions in the restaurant setting: the role of social cognition, psychological ownership and anthropomorphism. International Journal of Contemporary Hospitality Management 35 (2023), 1966–1985. Issue 6.
[39]
P. Salvini, G. Ciaravella, W. Yu, G. Ferri, A. Manzi, B. Mazzolai, C. Laschi, S.R. Oh, and P. Dario. 2010. How safe are service robots in urban environments? Bullying a robot. In 19th International Symposium in Robot and Human Interactive Communication. IEEE, Viareggio, Italy, 1–7. https://doi.org/10.1109/ROMAN.2010.5654677
[40]
Elaheh Sanoubari, John Edison Muñoz Cardona, Hamza Mahdi, James E. Young, Andrew Houston, and Kerstin Dautenhahn. 2021. Robots, Bullies and Stories: A Remote Co-Design Study with Children. In Proceedings of the 20th Annual ACM Interaction Design and Children Conference (Athens, Greece) (IDC ’21). Association for Computing Machinery, New York, NY, USA, 171–182.
[41]
Elaheh Sanoubari, James Young, Andrew Houston, and Kerstin Dautenhahn. 2021. Can Robots Be Bullied? A Crowdsourced Feasibility Study for Using Social Robots in Anti-Bullying Interventions. In 2021 30th IEEE International Conference on Robot & Human Interactive Communication (RO-MAN). IEEE, virtual, 931–938. https://doi.org/10.1109/RO-MAN50785.2021.9515450
[42]
Selina Schepers, Jessica Schoffelen, Bieke Zaman, and Katrien Dreessen. 2022. Going beyond short-term, ‘reduced’ PD: Towards an encompassing typology for children’s participation in infrastructuring processes. International Journal of Child-Computer Interaction 33 (2022), 100484.
[43]
Pu-Yu Su, Geng-Fu Wang, Huan He, A-Zhu Han, Guo-Bao Zhang, and Nuo Xu. 2019. Is involvement in school bullying associated with increased risk of murderous ideation and behaviours among adolescent students in China?BMC psychiatry 19, 1 (2019), 1–10.
[44]
Xiang Zhi Tan, Marynel Vázquez, Elizabeth J. Carter, Cecilia G. Morales, and Aaron Steinfeld. 2018. Inducing Bystander Interventions During Robot Abuse with Social Mechanisms. In Proceedings of the 2018 ACM/IEEE International Conference on Human-Robot Interaction (Chicago, IL, USA) (HRI ’18). Association for Computing Machinery, New York, NY, USA, 169–177. https://doi.org/10.1145/3171221.3171247
[45]
Leimin Tian and Sharon Oviatt. 2021. A Taxonomy of Social Errors in Human-Robot Interaction. J. Hum.-Robot Interact. 10, 2, Article 13 (feb 2021), 32 pages. https://doi.org/10.1145/3439720
[46]
Aarni Tuomi, Iis P. Tussyadiah, and Jason Stienmetz. 2021. Applications and Implications of Service Robots in Hospitality. Cornell Hospitality Quarterly 62, 2 (2021), 232–247.
[47]
Stefan Rädiker Udo Kuckartz. 2019. Analyzing Qualitative Data with MAXQDA: Text, Audio, and Video.
[48]
Leena Ventä-Olkkonen, Netta Iivari, Sumita Sharma, Tonja Molin-Juustila, Kari Kuutti, Nina Juustila-Cevirel, Essi Kinnunen, and Jenni Holappa. 2021. Nowhere to Now-Here: Empowering Children to Reimagine Bully Prevention at Schools Using Critical Design Fiction: Exploring the Potential of Participatory, Empowering Design Fiction in Collaboration with Children. In Proceedings of the 2021 ACM Designing Interactive Systems Conference (Virtual Event, USA) (DIS ’21). Association for Computing Machinery, New York, NY, USA, 734–748.
[49]
Jochen Wirtz, Paul G Patterson, Werner H Kunz, Thorsten Gruber, Vinh Nhat Lu, Stefanie Paluch, and Antje Martins. 2018. Brave new world: service robots in the frontline. Journal of Service Management 29, 5 (2018), 907–931.
[50]
Jacob O. Wobbrock, Leah Findlater, Darren Gergle, and James J. Higgins. 2011. The aligned rank transform for nonparametric factorial analyses using only anova procedures. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (, Vancouver, BC, Canada, ) (CHI ’11). Association for Computing Machinery, New York, NY, USA, 143–146. https://doi.org/10.1145/1978942.1978963
[51]
Shuai Yuan, Simon Coghlan, Reeva Lederman, and Jenny Waycott. 2022. Social Robots in Aged Care: Care Staff Experiences and Perspectives on Robot Benefits and Challenges. Proc. ACM Hum.-Comput. Interact. 6, CSCW2, Article 329 (nov 2022), 23 pages.
[52]
Zhijun Zhang, Yaru Niu, Shangen Wu, Shuyang Lin, and Lingdong Kong. 2018. Analysis of Influencing Factors on Humanoid Robots’ Emotion Expressions by Body Language. In Advances in Neural Networks – ISNN 2018, Tingwen Huang, Jiancheng Lv, Changyin Sun, and Alexander V. Tuzikov (Eds.). Springer International Publishing, Cham, 775–785.
[53]
Jakub Złotowski, Kumar Yogeeswaran, and Christoph Bartneck. 2017. Can we control it? Autonomous robots threaten human identity, uniqueness, safety, and resources. International Journal of Human-Computer Studies 100 (2017), 48–54.
Index Terms
- "Please Be Nice": Robot Responses to User Bullying - Measuring Performance Across Aggression Levels
Index terms have been assigned to the content through auto-classification.
Recommendations
Cyberbullying and traditional bullying involvement among heterosexual and non-heterosexual adolescents, and their associations with age and gender
IntroductionTraditional (offline) bullying and cyberbullying involvement are associated with severe psychosocial problems. Non-heterosexual (LGBQ) youth are more often victimized by traditional bullying than heterosexual (non-LGBQ) youth, but little ...
Cyberbullying and Traditional Bullying: The Experiences of Poly-Victimization Among Diverse Youth
This study sought to advance the authors' understanding of the relationship between traditional bullying i.e., verbal and physical and cyberbullying. Data were collected from 1,182 participants, ages 13 to 25 M = 19.66; SD = 3.03 from 75 different ...
Inducing Bystander Interventions During Robot Abuse with Social Mechanisms
HRI '18: Proceedings of the 2018 ACM/IEEE International Conference on Human-Robot InteractionWe explored whether a robot can leverage social influences to motivate nearby bystanders to intervene and defend them from human abuse. We designed a between-subjects study where 48 participants took part in a memorization task and observed a ...
Comments
Information & Contributors
Information
Published In
May 2024
18961 pages
ISBN:9798400703300
DOI:10.1145/3613904
Copyright © 2024 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 11 May 2024
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
Acceptance Rates
Overall Acceptance Rate 6,199 of 26,314 submissions, 24%
Upcoming Conference
CHI 2025
- Sponsor:
- sigchi
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 742Total Downloads
- Downloads (Last 12 months)742
- Downloads (Last 6 weeks)55
Reflects downloads up to 18 Feb 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderFull Text
View this article in Full Text.
Full TextHTML Format
View this article in HTML Format.
HTML Format