Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3568162.3576978acmconferencesArticle/Chapter ViewAbstractPublication PageshriConference Proceedingsconference-collections
research-article
Public Access

"Off Script:" Design Opportunities Emerging from Long-Term Social Robot Interactions In-the-Wild

Published: 13 March 2023 Publication History

Abstract

Social robots are becoming increasingly prevalent in the real world. Unsupervised user interactions in a natural and familiar setting, such as the home, can reveal novel design insights and opportunities. This paper presents an analysis and key design insights from family-robot interactions, captured via on-robot recordings during an unsupervised four-week in-home deployment of an autonomous reading companion robot for children. We analyzed interviews and 160 interaction videos involving six families who regularly interacted with a robot for four weeks. Throughout these interactions, we observed how the robot's expressions facilitated unique interactions with the child, as well as how family members interacted with the robot. In conclusion, we discuss five design opportunities derived from our analysis of natural interactions in the wild.

Supplementary Material

MP4 File (hrifp1125.mp4)
Supplemental video
MP4 File (HRI23-fp1125.mp4)
In this video we describe findings of child- and family-robot interactions that take place outside of the designed interactions, or "off-script." Through video and interview analysis, we describe how children respond in the moment to robot verbal and non-verbal actions and how families tried to get involved. We finish we some design recommendations for real-world family-robot interactions.

References

[1]
Erin Beneteau, Ashley Boone, Yuxing Wu, Julie A. Kientz, Jason Yip, and Alexis Hiniker. 2020. Parenting with Alexa: Exploring the Introduction of Smart Speakers on Family Dynamics. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1--13.
[2]
Erin Beneteau, Yini Guan, Olivia K. Richards, Mingrui Ray Zhang, Julie A. Kientz, Jason Yip, and Alexis Hiniker. 2020. Assumptions Checked: How Families Learn About and Use the Echo Dot. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 4, 1 (2020), 1--23.
[3]
Erin Beneteau, Olivia K. Richards, Mingrui Zhang, Julie A. Kientz, Jason Yip, and Alexis Hiniker. 2019. Communication breakdowns between families and Alexa. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1--13.
[4]
Virginia Braun and Victoria Clarke. 2022. Thematic analysis: A practical guide. SAGE Publications Ltd, London.
[5]
Bengisu Cagiltay. 2022. STEMMates, Long-Term In-Home Reading Companion Robot Supplemental Resources. https://osf.io/bks8w/?view_only= 7664456907db4dfb8c44d56c1d1e2cfd
[6]
Bengisu Cagiltay, Nathan White, Rabia Ibtasar, Bilge Mutlu, and Joseph Michaelis. 2022. Understanding Factors that Shape Children's Long Term Engagement with an In-Home Learning Companion Robot. ACM Interaction Design and Children (2022).
[7]
Caitlyn Clabaugh, Kartik Mahajan, Shomik Jain, Roxanna Pakkar, David Becerra, Zhonghao Shi, Eric Deng, Rhianna Lee, Gisele Ragusa, and Maja Matari?. 2019. Long-term personalization of an in-home socially assistive robot for children with autism spectrum disorders. Frontiers in Robotics and AI 6 (2019), 110.
[8]
Alexandre Coninx, Paul Baxter, Elettra Oleari, Sara Bellini, Bert Bierman, O Henkemans, Lola Cañamero, Piero Cosi, Valentin Enescu, R Espinoza, et al. 2016. Towards long-term social child-robot interaction: using multi-activity switching to engage young users. Journal of Human-Robot Interaction (2016).
[9]
Scott Davidoff, Min K. Lee, Charles Yiu, John Zimmerman, and Anind K. Dey. 2006. Principles of smart home control. In International conference on ubiquitous computing. Springer, 19--34.
[10]
Maartje MA de Graaf, Somaya Ben Allouch, and Jan AGM van Dijk. 2016. Longterm evaluation of a social robot in real homes. Interaction studies 17, 3 (2016), 462--491.
[11]
Maartje M. A. de Graaf, Somaya B. Allouch, and Jan A. G. M. van Dijk. 2017. Why do they refuse to use my robot?: Reasons for non-use derived from a long-term home study. In 2017 12th ACM/IEEE International Conference on Human-Robot Interaction (HRI). IEEE, 224--233.
[12]
Maartje M. A. de Graaf, Somaya B. Allouch, and Jan A. G. M. van Dijk. 2019. Why would I use this in my home? A model of domestic social robot acceptance. Human--Computer Interaction 34, 2 (March 2019), 115--173.
[13]
Brian R Duffy and Karolina Zawieska. 2012. Suspension of disbelief in social robotics. In 2012 IEEE RO-MAN: The 21st IEEE International Symposium on Robot and Human Interactive Communication. IEEE, 484--489.
[14]
Brian R. Duffy and Karolina Zawieska. 2012. Suspension of disbelief in social robotics. In 2012 IEEE RO-MAN: The 21st IEEE International Symposium on Robot and Human Interactive Communication. 484--489. https://doi.org/10.1109/ ROMAN.2012.6343798
[15]
Julia Fink, Séverin Lemaignan, Pierre Dillenbourg, Philippe Rétornaz, Florian Vaussard, Alain Berthoud, Francesco Mondada, Florian Wille, and Karmen Franinovi?. 2014. Which robot behavior can motivate children to tidy up their toys? Design and Evaluation of "Ranger". In Proceedings of the 2014 ACM/IEEE international conference on Human-robot interaction. 439--446.
[16]
Jeonghye Han, Miheon Jo, Sungju Park, and Sungho Kim. 2005. The educational use of home robots for children. In ROMAN 2005. IEEE International Workshop on Robot and Human Interactive Communication, 2005. IEEE, 378--383.
[17]
Judith M. Harackiewicz, Yoi Tibbetts, Elizabeth Canning, and Janet S. Hyde. 2014. Harnessing Values to Promote Motivation In Education. Advances in Motivation and Achievement: A Research Annual 18 (2014).
[18]
Leslie Rupert Herrenkohl and Lindsay Cornelius. 2013. Investigating Elementary Students' Scientific and Historical Argumentation. Journal of the Learning Sciences 22, 3 (July 2013), 413--461.
[19]
William G. Holliday and Stephen D. Cain. 2012. Teaching Science Reading Comprehension: A Realistic, Research-Based Approach. In Second International Handbook of Science Education, Barry J. Fraser, Kenneth Tobin, and Campbell J. McRobbie (Eds.). Springer Netherlands, Dordrecht, 1405--1417.
[20]
Gay Ivey and Karen Broaddus. 2000. Tailoring the Fit: Reading Instruction and Middle School Readers. The Reading Teacher 54, 1 (2000), 68--78.
[21]
Eric W. Jensen, Sherman A. James, W. Thomas Boyce, and Sue A. Hartnett. 1983. The family routines inventory: Development and validation. Social Science & Medicine 17, 4 (1983), 201--211.
[22]
Malte Jung and Pamela Hinds. 2018. Robots in the wild: A time for more robust theories of human-robot interaction. ACM Transactions on Human-Robot Interaction (THRI) 7, 1 (2018), 1--5.
[23]
Takayuki Kanda, Rumi Sato, Naoki Saiwaki, and Hiroshi Ishiguro. 2007. A twomonth field trial in an elementary school for long-term human--robot interaction. IEEE Transactions on robotics 23, 5 (2007), 962--971.
[24]
Takayuki Kanda, Masahiro Shiomi, Zenta Miyashita, Hiroshi Ishiguro, and Norihiro Hagita. 2010. A communication robot in a shopping mall. IEEE Transactions on Robotics 26, 5 (2010), 897--913.
[25]
Cory D Kidd and Cynthia Breazeal. 2008. Robots at home: Understanding longterm human-robot interaction. In 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems. IEEE, 3230--3235.
[26]
SunKyoung Kim, Masakazu Hirokawa, Atsushi Funahashi, and Kenji Suzuki. 2022. What Can We Do with a Robot for Family Playtime?. In Proceedings of the 2022 ACM/IEEE International Conference on Human-Robot Interaction (HRI '22). IEEE Press, Sapporo, Hokkaido, Japan, 847--849.
[27]
Maximilian Klein, Jinhao Zhao, Jiajun Ni, Isaac Johnson, Benjamin Mako Hill, and Haiyi Zhu. 2017. Quality Standards, Service Orientation, and Power in Airbnb and Couchsurfing. Proc. ACM Hum.-Comput. Interact. 1, CSCW (Dec. 2017), 58:1--58:21.
[28]
Jacqueline M. Kory-Westlund and Cynthia Breazeal. 2019. A Long-Term Study of Young Children's Rapport, Social Emulation, and Language Learning With a Peer-Like Robot Playmate in Preschool. Frontiers in Robotics and AI 6 (2019). https://www.frontiersin.org/articles/10.3389/frobt.2019.00081
[29]
Min Kyung Lee, Sara Kiesler, Jodi Forlizzi, and Paul Rybski. 2012. Ripple effects of an embedded social agent: a field study of a social robot in the workplace. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 695--704.
[30]
Iolanda Leite, Carlos Martinho, and Ana Paiva. 2013. Social robots for long-term interaction: A survey. International Journal of Social Robotics 5, 2 (2013), 291--308.
[31]
James C. Lester and Brian A. Stone. 1997. Increasing believability in animated pedagogical agents. In Proceedings of the first international conference on Autonomous agents. Association for Computing Machinery, New York, NY, USA, 16--21. https://doi.org/10.1145/267658.269943
[32]
Mike Ligthart, Mark. A. Neerincx, and Koen V. Hindriks. 2019. Getting Acquainted for a Long-Term Child-Robot Interaction. In Social Robotics (Lecture Notes in Computer Science), Miguel A. Salichs, Shuzhi Sam Ge, Emilia Ivanova Barakova, John-John Cabibihan, Alan R. Wagner, Álvaro Castro-González, and Hongsheng He (Eds.). Springer International Publishing, Cham, 423--433. https://doi.org/10. 1007/978--3-030--35888--4_39
[33]
Mike E.U. Ligthart, Mark A. Neerincx, and Koen V. Hindriks. 2022. Memory- Based Personalization for Fostering a Long-Term Child-Robot Relationship. In 2022 17th ACM/IEEE International Conference on Human-Robot Interaction (HRI). IEEE, Sapporo, Japan, 80--89. https://doi.org/10.1109/HRI53351.2022.9889446
[34]
Allison Master and Andrew N. Meltzoff. 2020. Cultural Stereotypes and Sense of Belonging Contribute to Gender Gaps in STEM. International Journal of Gender, Science and Technology 12, 1 (April 2020), 152--198. Number: 1.
[35]
Nora McDonald, Sarita Schoenebeck, and Andrea Forte. 2019. Reliability and Inter-rater Reliability in Qualitative Research: Norms and Guidelines for CSCW and HCI Practice. Proc. ACM Hum.-Comput. Interact. 3, CSCW (Nov. 2019), 72:1--72:23.
[36]
Joseph E Michaelis and Bilge Mutlu. 2018. Reading socially: Transforming the in-home reading experience with a learning-companion robot. Science Robotics 3, 21 (2018), eaat5999.
[37]
David H. J. Morgan. 1996. Family connections: An introduction to family studies. Vol. 45. Polity Press Cambridge.
[38]
Bilge Mutlu and Jodi Forlizzi. 2008. Robots in organizations: the role of workflow, social, and environmental factors in human-robot interaction. In 2008 3rd ACM/IEEE International Conference on Human-Robot Interaction (HRI). IEEE, 287-- 294.
[39]
Bilge Mutlu, Nicholas Roy, and Selma ?abanovi?. 2016. Cognitive human--robot interaction. Springer handbook of robotics (2016), 1907--1934.
[40]
Junya Nakanishi, Itaru Kuramoto, Jun Baba, Kohei Ogawa, Yuichiro Yoshikawa, and Hiroshi Ishiguro. 2020. Continuous Hospitality with Social Robots at a hotel. SN Applied Sciences 2, 3 (2020), 1--13.
[41]
Tatsuya Nomura, Takayuki Uratani, Takayuki Kanda, Kazutaka Matsumoto, Hiroyuki Kidokoro, Yoshitaka Suehiro, and Sachie Yamada. 2015. Why do children abuse robots?. In Proceedings of the tenth annual ACM/IEEE international conference on human-robot interaction extended abstracts. 63--64.
[42]
University of Michigan. 2022. April Tags. https://april.eecs.umich.edu/software/ apriltag
[43]
Ana Paiva, Iolanda Leite, and Tiago Ribeiro. 2014. Emotion Modeling for Social Robots. The Oxford handbook of affective computing (2014), 296.
[44]
Misty II Robot. 2022. Misty Robotics. https://www.mistyrobotics.com
[45]
Everett M Rogers. 2010. Diffusion of innovations. Simon and Schuster.
[46]
Raquel Ros, Marco Nalin, Rachel Wood, Paul Baxter, Rosemarijn Looije, Yannis Demiris, Tony Belpaeme, Alessio Giusti, and Clara Pozzi. 2011. Child-robot interaction in the wild: advice to the aspiring experimenter. In Proceedings of the 13th international conference on multimodal interfaces. 335--342.
[47]
Selma Sabanovic, Marek P Michalowski, and Reid Simmons. 2006. Robots in the wild: Observing human-robot social interaction outside the lab. In 9th IEEE International Workshop on Advanced Motion Control, 2006. IEEE, 596--601.
[48]
Magda Saraiva, Hande Ayano?lu, and Beste Özcan. 2019. Emotional Design and Human-Robot Interaction. In Emotional Design in Human-Robot Interaction. Springer, 119--141.
[49]
Allison Sauppé and Bilge Mutlu. 2015. The social impact of a robot co-worker in industrial settings. In Proceedings of the 33rd annual ACM conference on human factors in computing systems. 3613--3622.
[50]
Brian Scassellati, Laura Boccanfuso, Chien-Ming Huang, Marilena Mademtzi, Meiying Qin, Nicole Salomons, Pamela Ventola, and Frederick Shic. 2018. Improving social skills in children with ASD using a long-term, in-home social robot. Science Robotics 3, 21 (2018), eaat7544.
[51]
Masahiro Shiomi, Takayuki Kanda, Hiroshi Ishiguro, and Norihiro Hagita. 2006. Interactive humanoid robots for a science museum. In Proceedings of the 1st ACM SIGCHI/SIGART conference on Human-robot interaction. 305--312.
[52]
Mary Spagnola and Barbara H Fiese. 2007. Family routines and rituals: A context for development in the lives of young children. Infants & young children 20, 4 (2007), 284--299.
[53]
JaYoung Sung, Henrik I Christensen, and Rebecca E Grinter. 2009. Robots in the wild: understanding long-term use. In Proceedings of the 4th ACM/IEEE international conference on Human robot interaction. 45--52.
[54]
Sam Thellman, Maartje de Graaf, and Tom Ziemke. 2022. Mental State Attribution to Robots: A Systematic Review of Conceptions, Methods, and Findings. ACM Transactions on Human-Robot Interaction (THRI) 11, 4 (2022), 1--51.
[55]
AstridWeiss, Anna Pillinger, and Christiana Tsiourti. 2021. Merely a Conventional ?Diffusion'Problem? On the Adoption Process of Anki Vector. In 2021 30th IEEE International Conference on Robot & Human Interactive Communication (RO-MAN). IEEE, 712--719.
[56]
SM Wyatt, Graham Thomas, and Tiziana Terranova. 2002. They came, they surfed, they went back to the beach: Conceptualizing. Virtual society (2002), 23--40.
[57]
Zhao Zhao and Rhonda McEwen. 2022. "Let's read a book together": A Long-term Study on the Usage of Pre-school Children with Their Home Companion Robot. In Proceedings of the 2022 ACM/IEEE International Conference on Human-Robot Interaction (HRI '22). IEEE Press, Sapporo, Hokkaido, Japan, 24--32.

Cited By

View all
  • (2024)Lessons in Developing a Behavioral Coding Protocol to Analyze In-the-Wild Child–Robot Interaction Events and ExperimentsElectronics10.3390/electronics1307117513:7(1175)Online publication date: 22-Mar-2024
  • (2024)REX: Designing User-centered Repair and Explanations to Address Robot FailuresProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661559(2911-2925)Online publication date: 1-Jul-2024
  • (2024)Children's Acceptance of a Domestic Social Robot: How It Evolves over TimeACM Transactions on Human-Robot Interaction10.1145/363806613:2(1-20)Online publication date: 14-Jun-2024
  • Show More Cited By

Index Terms

  1. "Off Script:" Design Opportunities Emerging from Long-Term Social Robot Interactions In-the-Wild

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    HRI '23: Proceedings of the 2023 ACM/IEEE International Conference on Human-Robot Interaction
    March 2023
    631 pages
    ISBN:9781450399647
    DOI:10.1145/3568162
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 13 March 2023

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. child-robot interactions
    2. in-home
    3. in-the-wild
    4. reading
    5. social robots

    Qualifiers

    • Research-article

    Funding Sources

    Conference

    HRI '23
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 268 of 1,124 submissions, 24%

    Upcoming Conference

    HRI '25
    ACM/IEEE International Conference on Human-Robot Interaction
    March 4 - 6, 2025
    Melbourne , VIC , Australia

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)329
    • Downloads (Last 6 weeks)40
    Reflects downloads up to 12 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Lessons in Developing a Behavioral Coding Protocol to Analyze In-the-Wild Child–Robot Interaction Events and ExperimentsElectronics10.3390/electronics1307117513:7(1175)Online publication date: 22-Mar-2024
    • (2024)REX: Designing User-centered Repair and Explanations to Address Robot FailuresProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661559(2911-2925)Online publication date: 1-Jul-2024
    • (2024)Children's Acceptance of a Domestic Social Robot: How It Evolves over TimeACM Transactions on Human-Robot Interaction10.1145/363806613:2(1-20)Online publication date: 14-Jun-2024
    • (2024)"It's Not a Replacement:" Enabling Parent-Robot Collaboration to Support In-Home Learning Experiences of Young ChildrenProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642806(1-18)Online publication date: 11-May-2024
    • (2024)PATHWiSE: An AI-Assisted Teacher Authoring Tool for Creating Custom Robot-Assisted Learning ActivitiesCompanion of the 2024 ACM/IEEE International Conference on Human-Robot Interaction10.1145/3610978.3641086(88-90)Online publication date: 11-Mar-2024
    • (2024)Supporting Long-Term HRI through Shared Family RoutinesCompanion of the 2024 ACM/IEEE International Conference on Human-Robot Interaction10.1145/3610978.3638375(97-99)Online publication date: 11-Mar-2024
    • (2024)Effect of Social Robot's Role and Behavior on Parent-Toddler InteractionProceedings of the 2024 ACM/IEEE International Conference on Human-Robot Interaction10.1145/3610977.3634928(222-230)Online publication date: 11-Mar-2024
    • (2024)Socially Assistive Robot as Laboratory Safety Assistant for Science Students2024 IEEE International Conference on Advanced Robotics and Its Social Impacts (ARSO)10.1109/ARSO60199.2024.10557826(37-42)Online publication date: 20-May-2024
    • (2024)A multi-site language study on child-robot dialoguesAdvanced Robotics10.1080/01691864.2024.238814538:19-20(1486-1500)Online publication date: 22-Aug-2024
    • (2024)Improved Particle Swarm Optimization for Fractional Order PID Control Design in Robotic Manipulator System: A Performance AnalysisResults in Engineering10.1016/j.rineng.2024.103089(103089)Online publication date: Oct-2024
    • Show More Cited By

    View Options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Login options

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media