A Systematic Approach to Modeling Structured Behavior in Social Robots
Pages 29 - 37
Abstract
Social Robots (SRs) often require structured models of behavior to facilitate sophisticated interaction episodes in their capacity as coaches, teachers, assistants, and beyond. Techniques in human-centered design can support the translation of human-human to human-robot behavior, but can be challenging and often lead to weak interpretations. We introduce a four-step approach of data gathering, behavior model development, behavior model annotation, and robot implementation to promote a more systematic approach to the development of SR behaviors. The efficacy of this approach was demonstrated in a set of case studies involving 24 participants. We demonstrate how a structured behavior model for a SR was developed systematically by clustering observed human interaction episodes, and that the researchers’ original translations of human to robot behavior models captured task knowledge, but in each case, our model annotation step was necessary to validate the designs and further refine missing aspects.
References
[1]
Parastoo Abtahi, Neha Sharma, James A Landay, and Sean Follmer. 2021. Presenting and Exploring Challenges in Human-Robot Interaction Design Through Bodystorming. Design Thinking Research: Interrogating the Doing (2021), 327–344.
[2]
Neziha Akalin and Amy Loutfi. 2021. Reinforcement learning approaches in social robotics. Sensors 21, 4 (2021), 1292.
[3]
Talal Al-Shihabi and Ronald R Mourant. 2001. A framework for modeling human-like driving behaviors for autonomous vehicles in driving simulators. In Proceedings of the fifth international conference on Autonomous agents. 286–291.
[4]
Patrícia Alves-Oliveira, Patrícia Arriaga, Ana Paiva, and Guy Hoffman. 2021. Children as robot designers. In Proceedings of the 2021 ACM/IEEE International Conference on Human-Robot Interaction. 399–408.
[5]
Sander CJ Bakkes, Pieter HM Spronck, and Giel van Lankveld. 2012. Player behavioural modelling for video games. Entertainment Computing 3, 3 (2012), 71–79.
[6]
Elin A Björling and Emma Rose. 2019. Participatory research principles in human-centered design: engaging teens in the co-design of a social robot. Multimodal Technologies and Interaction 3, 1 (2019), 8.
[7]
Sara Cooper and Séverin Lemaignan. 2022. Towards using behaviour trees for long-term social robot behaviour. In 2022 17th ACM/IEEE International Conference on Human-Robot Interaction (HRI). IEEE, 737–741.
[8]
Aduén Darriba Frederiks, Johanna Renny Octavia, Cesar Vandevelde, and Jelle Saldien. 2019. Towards participatory design of social robots. In Human-Computer Interaction–INTERACT 2019: 17th IFIP TC 13 International Conference, Paphos, Cyprus, September 2–6, 2019, Proceedings, Part II 17. Springer, 527–535.
[9]
Zihan Ding and Hao Dong. 2020. Challenges of reinforcement learning. Deep Reinforcement Learning: Fundamentals, Research and Applications (2020), 249–272.
[10]
Juan Fasola and Maja J Matarić. 2013. A socially assistive robot exercise coach for the elderly. Journal of Human-Robot Interaction 2, 2 (2013), 3–32.
[11]
Theodoros Georgiou, Lynne Baillie, Martin K Ross, and Frank Broz. 2020. Applying the participatory design workshop method to explore how socially assistive robots could assist stroke survivors. In Companion of the 2020 ACM/IEEE International Conference on Human-Robot Interaction. 203–205.
[12]
Stephen Harvey, Christopher J. Cushion, Edward Cope, and Bob Muir. 2013. A season long investigation into coaching behaviours as a function of practice state: the case of three collegiate coaches. Sports Coaching Review 2, 1 (May 2013), 13–32. https://doi.org/10.1080/21640629.2013.837238
[13]
Paul Hatch, Md Anisur Rahman, and Joseph E Michaelis. 2023. PATHWiSE: An Authoring Tool to Support Teachers to Create Robot-Supported Social Learning Experiences During Homework. Proceedings of the ACM on Human-Computer Interaction 7, CSCW1 (2023), 1–23.
[14]
Takayuki Kanda. 2010. Natural human-robot interaction. In Simulation, Modeling, and Programming for Autonomous Robots: Second International Conference, SIMPAR 2010, Darmstadt, Germany, November 15-18, 2010. Proceedings 2. Springer, 2–2.
[15]
Maria Karyotaki, Athanasios Drigas, and Charalabos Skianis. 2022. Chatbots as cognitive, educational, advisory & coaching systems. Technium Social Sciences Journal 30 (2022), 109–126.
[16]
James Kennedy, Paul Baxter, and Tony Belpaeme. 2015. The robot who tried too hard: Social behaviour of a robot tutor can negatively affect child learning. In Proceedings of the tenth annual ACM/IEEE international conference on human-robot interaction. 67–74.
[17]
Alyssa Kubota, Emma I. C. Peterson, Vaishali Rajendren, Hadas Kress-Gazit, and Laurel D. Riek. 2020. JESSIE: Synthesizing Social Robot Behaviors for Personalized Neurorehabilitation and Beyond. In Proceedings of the 2020 ACM/IEEE International Conference on Human-Robot Interaction(HRI ’20). Association for Computing Machinery, Cambridge, United Kingdom, 121–130. https://doi.org/10.1145/3319502.3374836
[18]
Alan C. Lacy and Paul W. Darst. 1984. Evolution of a Systematic Observation System: The ASU Coaching Observation Instrument. Journal of Teaching in Physical Education 3 (1984), 59–66. https://doi.org/10.1123/jtpe.3.3.59
[19]
Allison Langer, Ronit Feingold-Polak, Oliver Mueller, Philipp Kellmeyer, and Shelly Levy-Tzedek. 2019. Trust in socially assistive robots: Considerations for use in rehabilitation. Neuroscience & Biobehavioral Reviews 104 (2019), 231–239.
[20]
Velvetina Lim, Maki Rooksby, and Emily S Cross. 2021. Social robots on a global stage: establishing a role for culture during human–robot interaction. International Journal of Social Robotics 13, 6 (2021), 1307–1333.
[21]
Marcos Maroto-Gómez, Fernando Alonso-Martín, María Malfaz, Álvaro Castro-González, José Carlos Castillo, and Miguel Ángel Salichs. 2023. A systematic literature review of decision-making and control systems for autonomous and social robots. International Journal of Social Robotics 15, 5 (2023), 745–789.
[22]
George J McCall. 1984. Systematic field observation. Annual review of sociology 10, 1 (1984), 263–282.
[23]
Mark P. McGlinchey and Sally Davenport. 2015. Exploring the decision-making process in the delivery of physiotherapy in a stroke unit. Disability and Rehabilitation 37, 14 (July 2015), 1277–1284. https://doi.org/10.3109/09638288.2014.962106
[24]
Christina Moro, Goldie Nejat, and Alex Mihailidis. 2018. Learning and personalizing socially assistive robot behaviors to aid with activities of daily living. ACM Transactions on Human-Robot Interaction (THRI) 7, 2 (2018), 1–25.
[25]
Stefanos Nikolaidis, Ramya Ramakrishnan, Keren Gu, and Julie Shah. [n. d.]. Efficient Model Learning from Joint-Action Demonstrations for Human-Robot Collaborative Tasks. In Proceedings of the Tenth Annual ACM/IEEE International Conference on Human-Robot Interaction - HRI ’15 (2015-03). ACM, 189–196. https://dl.acm.org/doi/10.1145/2696454.2696455
[26]
Olivia Nocentini, Laura Fiorini, Giorgia Acerbi, Alessandra Sorrentino, Gianmaria Mancioppi, and Filippo Cavallo. 2019. A survey of behavioral models for social robots. Robotics 8, 3 (2019), 54.
[27]
Hae Won Park, Ishaan Grover, Samuel Spaulding, Louis Gomez, and Cynthia Breazeal. 2019. A model-free affective reinforcement learning approach to personalization of an autonomous social robot companion for early literacy education. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 33. 687–694.
[28]
David Porfirio, Evan Fisher, Allison Sauppé, Aws Albarghouthi, and Bilge Mutlu. 2019. Bodystorming human-robot interactions. In proceedings of the 32nd annual ACM symposium on user Interface software and technology. 479–491.
[29]
Fraser Robinson, Zinan Cen, Hani Naguib, and Goldie Nejat. 2023. An intelligent socially assistive robot-wearable sensors system for personalized user dressing assistance. Advanced Robotics (2023), 1–18.
[30]
Martin Ross, Frank Broz, and Lynne Baillie. 2021. Observing and clustering coaching behaviours to inform the design of a personalised robotic coach. In Proceedings of the 23rd international conference on mobile human-computer interaction. 1–17.
[31]
Christian Schütze, André Groß, Britta Wrede, and Birte Richter. 2022. Enabling Non-Technical Domain Experts to Create Robot-Assisted Therapeutic Scenarios via Visual Programming. In Companion Publication of the 2022 International Conference on Multimodal Interaction. 166–170.
[32]
Micol Spitale, Minja Axelsson, and Hatice Gunes. 2023. Robotic mental well-being coaches for the workplace: An in-the-wild study on form. In Proceedings of the 2023 ACM/IEEE International Conference on Human-Robot Interaction. 301–310.
[33]
Luise Süssenbach, Nina Riether, Sebastian Schneider, Ingmar Berger, Franz Kummert, Ingo Lütkebohle, and Karola Pitsch. 2014. A robot as fitness companion: towards an interactive action-based motivation model. In The 23rd IEEE international symposium on robot and human interactive communication. IEEE, 286–293.
[34]
Sanne Van Waveren, Elizabeth J Carter, Oscar Örnberg, and Iolanda Leite. 2021. Exploring non-expert robot programming through crowdsourcing. Frontiers in Robotics and AI 8 (2021), 646002.
[35]
Isobel Voysey, Carl Bettosi, Emilyann Nault, Shenando Stals, and Lynne Baillie. 2023. Introducing Children and Young People with Sight Loss to Social Robots: A Preliminary Workshop. In Companion of the 2023 ACM/IEEE International Conference on Human-Robot Interaction. 384–388.
[36]
Jason Wei, Yi Tay, Rishi Bommasani, Colin Raffel, Barret Zoph, Sebastian Borgeaud, Dani Yogatama, Maarten Bosma, Denny Zhou, Donald Metzler, Ed H. Chi, Tatsunori Hashimoto, Oriol Vinyals, Percy Liang, Jeff Dean, and William Fedus. 2022. Emergent Abilities of Large Language Models. Transactions on Machine Learning Research (Aug. 2022). https://openreview.net/forum?id=yzkSU5zdwD
[37]
Matthew Willis. 2018. Human centered robotics: designing valuable experiences for social robots. In Proceedings of HRI2018 Workshop (Social Robots in the Wild). ACM, New York.
[38]
Katie Winkle, Séverin Lemaignan, Praminda Caleb-Solly, Paul Bremner, Ailie J Turton, and Ute Leonards. 2020. In-Situ Learning from a Domain Expert for Real World Socially Assistive Robot Deployment. In Robotics: Science and Systems.
[39]
Katie Winkle, Séverin Lemaignan, Praminda Caleb-Solly, Ute Leonards, Ailie Turton, and Paul Bremner. 2020. Couch to 5km Robot Coach: An Autonomous, Human-Trained Socially Assistive Robot. In Companion of the 2020 ACM/IEEE International Conference on Human-Robot Interaction(HRI ’20). Association for Computing Machinery, Cambridge, United Kingdom, 520–522. https://doi.org/10.1145/3371382.3378337
[40]
Yang Yu. 2018. Towards Sample Efficient Reinforcement Learning. In IJCAI. 5739–5743.
Index Terms
- A Systematic Approach to Modeling Structured Behavior in Social Robots
Recommendations
Behavior Informatics to Discover Behavior Insight for Active and Tailored Client Management
KDD '17: Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data MiningBehavior is ubiquitous, and behavior intelligence and insight play an important role in data understanding and business problem-solving. Behavior Informatics [1,2] emerges as an important tool for discovering behavior intelligence and behavior insight. ...
Do social robots walk or roll?
ICSR'10: Proceedings of the Second international conference on Social roboticsThere is a growing trend of social robots to move into the human environment. This research is set up to find the trends within social robotic designs. A sample of social robotic designs is drawn to investigate on whether there are more legged social ...
Real-Time Understanding of Abnormal Crowd Behavior on Social Robots
Proceedings, Part II, of the 16th Pacific-Rim Conference on Advances in Multimedia Information Processing -- PCM 2015 - Volume 9315Perceiving the crowd behavior is very important for social cloud robots, who serve as guiders at transportation junctions. In this paper, we propose a real-time algorithm based on background modeling to detect collective motions in complex scenes. The ...
Comments
Information & Contributors
Information
Published In
March 2024
120 pages
ISBN:9798400716614
DOI:10.1145/3648536
Copyright © 2024 Owner/Author.
This work is licensed under a Creative Commons Attribution International 4.0 License.
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 09 May 2024
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Funding Sources
- EPSRC
Conference
TAHRI 2024
TAHRI 2024: 2024 International Symposium on Technological Advances in Human-Robot Interaction
March 9 - 10, 2024
CO, Boulder, USA
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 116Total Downloads
- Downloads (Last 12 months)116
- Downloads (Last 6 weeks)32
Reflects downloads up to 09 Nov 2024
Other Metrics
Citations
View Options
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML FormatGet Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in