Research by Design: Mirrly a Humanoid Robot for Child-Robot Interaction
Authors: 
Ali Yamini, Ana Djurkovic, Vanessa Italia Anne Hughes, Cory Smith, Brandon J. DeHart, Kerstin DautenhahnAuthors Info & Claims
Ali Yamini, Ana Djurkovic, Vanessa Italia Anne Hughes, Cory Smith, Brandon J. DeHart, Kerstin DautenhahnAuthors Info & ClaimsPages 81 - 90
Abstract
Mirrly is a new humanoid robot designed to facilitate human-robot social interactions, focusing on applications in therapy and education for children. Inspired by the need for engaging and effective interactions, Mirrly’s design incorporates a friendly appearance, articulated expressive face, and multimodal interaction capabilities. A key goal of designing Mirrly was keeping costs low while still retaining affective and expressive qualities of the robot. This paper presents the process of development and design of Mirrly. We also delve into the decisions we made to choose and design hardware, software, and interactions. By comparing existing robots and exploring implications for future research, Mirrly demonstrates the potential for advancing Child-Robot Interaction in many application areas. The open-source nature of Mirrly’s platform further encourages collaboration and innovation in the research community, offering a versatile and potentially impactful platform for a diverse range of applications in human-robot social interactions.
References
[1]
Veronica Ahumada-Newhart, Taffeta S. Wood, Erin R. Taylor, Francesca O. Johnson, Siena Saltzen, and Sanjay S. Joshi. 2023. Study of Telerobot Personalization for Children: Exploring Qualitative Coding of Artwork. In Companion of the 2023 ACM/IEEE International Conference on Human-Robot Interaction (Stockholm, Sweden) (HRI ’23). Association for Computing Machinery, New York, NY, USA, 536–539. https://doi.org/10.1145/3568294.3580142
[2]
Negin Azizi, Shruti Chandra, Mike Gray, Jennifer Fane, Melissa Sager, and Kerstin Dautenhahn. 2022. User Evaluation of Social Robots as a Tool in One-to-One Instructional Settings for Students with Learning Disabilities. In Social Robotics, Filippo Cavallo, John-John Cabibihan, Laura Fiorini, Alessandra Sorrentino, Hongsheng He, Xiaorui Liu, Yoshio Matsumoto, and Shuzhi Sam Ge (Eds.). Springer Nature Switzerland, Cham, 146–159. https://doi.org/10.1007/978-3-031-24670-8_14
[3]
Esubalew Bekele, Julie A Crittendon, Amy Swanson, Nilanjan Sarkar, and Zachary E Warren. 2013. Pilot clinical application of an adaptive robotic system for young children with autism. Autism 18, 5 (Oct 2013), 598–608. https://doi.org/10.1177/1362361313479454
[4]
Jie Cao, Ananya Ganesh, Jon Cai, Rosy Southwell, E. Margaret Perkoff, Michael Regan, Katharina Kann, James H. Martin, Martha Palmer, and Sidney D’Mello. 2023. A Comparative Analysis of Automatic Speech Recognition Errors in Small Group Classroom Discourse. In Proceedings of the 31st ACM Conference on User Modeling, Adaptation and Personalization (Limassol, Cyprus) (UMAP ’23). Association for Computing Machinery, New York, NY, USA, 250–262. https://doi.org/10.1145/3565472.3595606
[5]
Shruti Chandra, Torrey Loucks, Gerardo Chavez Castaneda, and Kerstin Dautenhahn. 2022. Social Robots in the Stuttering Clinic: A Human-Centred Exploration with Speech Language Pathologists. In Social Robotics, Filippo Cavallo, John-John Cabibihan, Laura Fiorini, Alessandra Sorrentino, Hongsheng He, Xiaorui Liu, Yoshio Matsumoto, and Shuzhi Sam Ge (Eds.). Springer Nature Switzerland, Cham, 299–313. https://doi.org/10.1007/978-3-031-24670-8_27
[6]
Emily C. Collins, Tony J. Prescott, Ben Mitchinson, and Sebastian Conran. 2015. MIRO: a versatile biomimetic edutainment robot. In Proceedings of the 12th International Conference on Advances in Computer Entertainment Technology (Iskandar, Malaysia) (ACE ’15). Association for Computing Machinery, New York, NY, USA, Article 28, 4 pages. https://doi.org/10.1145/2832932.2832978
[7]
Daniela Conti, Grazia Trubia, Serafino Buono, Santo Di Nuovo, and Alessandro Di Nuovo. 2020. Social robots to support practitioners in the education and clinical care of children: The CARER-AID project. Life Span and Disability 23, 1 (Aug 2020), 17–30. https://shura.shu.ac.uk/26920/
[8]
Andreia P Costa, Georges Steffgen, Francisco Rodríguez Lera, Aida Nazarikhorram, and Pouyan Ziafati. 2017. Socially assistive robots for teaching emotional abilities to children with autism spectrum disorder. In 3rd Workshop on Child-Robot Interaction at HRI. University of Luxembourg, Esch-sur-Alzette, Luxembourg.
[9]
DJI Website. 2019. DJI Unveils The RoboMaster S1, An Advanced Educational Robot For Tech Enthusiasts Of All Ages. https://www.dji.com/newsroom/news/dji-unveils-the-robomaster-s1 Accessed: March 12, 2024.
[10]
Jill A. Dosso, Jaya N. Kailley, Susanna E. Martin, and Julie M. Robillard. 2023. “A Safe Space for Sharing Feelings”: Perspectives of Children with Lived Experiences of Anxiety on Social Robots. Multimodal Technologies and Interaction 7, 12 (2023). https://doi.org/10.3390/mti7120118
[11]
Alireza Esfandbod, Zeynab Rokhi, Ali F. Meghdari, Alireza Taheri, Minoo Alemi, and Mahdieh Karimi. 2022. Utilizing an Emotional Robot Capable of Lip-Syncing in Robot-Assisted Speech Therapy Sessions for Children with Language Disorders. International Journal of Social Robotics 15 (Nov 2022). https://doi.org/10.1007/s12369-022-00946-2
[12]
Samuel Fosso Wamba, Maciel M. Queiroz, and Lotfi Hamzi. 2023. A bibliometric and multi-disciplinary quasi-systematic analysis of social robots: Past, future, and insights of human-robot interaction. Technological Forecasting and Social Change 197 (2023), 122912. https://doi.org/10.1016/j.techfore.2023.122912
[13]
Thomas Groechel, Zhonghao Shi, Roxanna Pakkar, and Maja J Matarić. 2019. Using Socially Expressive Mixed Reality Arms for Enhancing Low-Expressivity Robots. In 2019 28th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN). IEEE Press, New Delhi, India, 1–8. https://doi.org/10.1109/RO-MAN46459.2019.8956458
[14]
Prashanth Gurunath Shivakumar and Panayiotis Georgiou. 2020. Transfer learning from adult to children for speech recognition: Evaluation, analysis and recommendations. Computer Speech & Language 63 (2020), 101077. https://doi.org/10.1016/j.csl.2020.101077
[15]
Hello Robot. 2024. MAKI - edu. https://www.hello-robo.com/maki-edu Accessed: March 4, 2024.
[16]
Melanie Jouaiti, Negin Azizi, and Kerstin Dautenhahn. 2023. Computational Methods to Support Prototyping of an Adaptive Robot Joystick Controller for Children with Upper Limb Impairments. In 2023 IEEE International Conference on Robotics and Automation (ICRA). IEEE Press, London, UK, 12001–12007. https://doi.org/10.1109/ICRA48891.2023.10160808
[17]
Yoonwon Jung and Sowon Hahn. 2023. Social Robots As Companions for Lonely Hearts: The Role of Anthropomorphism and Robot Appearance. In 2023 32nd IEEE International Conference on Robot and Human Interactive Communication (RO-MAN). IEEE Press, Busan, Korea, 2520–2525. https://doi.org/10.1109/RO-MAN57019.2023.10309617
[18]
Efstathia Karakosta, Kerstin Dautenhahn, Dag Sverre Syrdal, Luke Jai Wood, and Ben Robins. 2019. Using the humanoid robot Kaspar in a Greek school environment to support children with Autism Spectrum Condition. Paladyn, Journal of Behavioral Robotics 10, 1 (2019), 298–317. https://doi.org/10.1515/pjbr-2019-0021
[19]
Yanghee Kim and Michael Tscholl. 2021. Young children’s embodied interactions with a social robot. Educational Technology Research and Development 69, 4 (Mar 2021), 2059–2081. https://doi.org/10.1007/s11423-021-09978-3
[20]
Viviane Kostrubiec, Chloé Lajunta, Pierre-Vincent Paubel, and Jeanne Kruck. 2023. Does the Social Robot Nao Facilitate Cooperation in High Functioning Children with ASD?International Journal of Social Robotics 16, 2 (Dec 2023), 281–298. https://doi.org/10.1007/s12369-023-01063-4
[21]
Hatice Köse, Pınar Uluer, Neziha Akalın, Rabia Yorgancı, Ahmet Özkul, and Gökhan Ince. 2015. The Effect of Embodiment in Sign Language Tutoring with Assistive Humanoid Robots. International Journal of Social Robotics 7, 4 (Jun 2015), 537–548. https://doi.org/10.1007/s12369-015-0311-1
[22]
Dimitri LACROIX, Ricarda Wullenkord, and Friederike Eyssel. 2023. Who’s in Charge? Using Personalization vs. Customization Distinction to Inform HRI Research on Adaptation to Users. In Companion of the 2023 ACM/IEEE International Conference on Human-Robot Interaction (, Stockholm, Sweden,) (HRI ’23). Association for Computing Machinery, New York, NY, USA, 580–586. https://doi.org/10.1145/3568294.3580152
[23]
Gabriella Lakatos, Luke Jai Wood, Dag Sverre Syrdal, Ben Robins, Abolfazl Zaraki, and Kerstin Dautenhahn. 2021. Robot-mediated intervention can assist children with autism to develop visual perspective-taking skills. Paladyn, Journal of Behavioral Robotics 12, 1 (2021), 87–101. https://doi.org/10.1515/pjbr-2021-0007
[24]
Jamy Li. 2015. The benefit of being physically present: A survey of experimental works comparing copresent robots, telepresent robots and virtual agents. International Journal of Human-Computer Studies 77 (2015), 23–37. https://doi.org/10.1016/j.ijhcs.2015.01.001
[25]
Diana Löffler, Nina Schmidt, and Robert Tscharn. 2018. Multimodal Expression of Artificial Emotion in Social Robots Using Color, Motion and Sound. In Proceedings of the 2018 ACM/IEEE International Conference on Human-Robot Interaction (Chicago, IL, USA) (HRI ’18). Association for Computing Machinery, New York, NY, USA, 334–343. https://doi.org/10.1145/3171221.3171261
[26]
Hamza Mahdi, Shahed Saleh, Omar Shariff, and Kerstin Dautenhahn. 2020. Creating MyJay: A New Design for Robot-Assisted Play for Children with Physical Special Needs. In Social Robotics, Alan R. Wagner, David Feil-Seifer, Kerstin S. Haring, Silvia Rossi, Thomas Williams, Hongsheng He, and Shuzhi Sam Ge (Eds.). Springer International Publishing, Cham, 676–687. https://doi.org/10.1007/978-3-030-62056-1_56
[27]
Kayla Matheus, Marnyel Vázquez, and Brian Scassellati. 2022. A Social Robot for Anxiety Reduction via Deep Breathing. In 2022 31st IEEE International Conference on Robot and Human Interactive Communication (RO-MAN). IEEE Press, Napoli, Italy, 89–94. https://doi.org/10.1109/RO-MAN53752.2022.9900638
[28]
Ali Meghdari, Azadeh Shariati, Minoo Alemi, Gholamreza R Vossoughi, Abdollah Eydi, Ehsan Ahmadi, Behrad Mozafari, Ali Amoozandeh Nobaveh, and Reza Tahami. 2018. Arash: A social robot buddy to support children with cancer in a hospital environment. Proceedings of the Institution of Mechanical Engineers, Part H: Journal of Engineering in Medicine 232, 6 (2018), 605–618. https://doi.org/10.1177/0954411918777520 arXiv:https://doi.org/10.1177/0954411918777520PMID: 29890934.
[29]
Ali Mollahosseini, Behzad Hasani, and Mohammad H. Mahoor. 2019. AffectNet: A Database for Facial Expression, Valence, and Arousal Computing in the Wild. IEEE Transactions on Affective Computing 10, 1 (2019), 18–31. https://doi.org/10.1109/TAFFC.2017.2740923
[30]
Yuko Okumura, Takashi Hattori, Sanae Fujita, and Tessei Kobayashi. 2023. A robot is watching me!: Five-year-old children care about their reputation after interaction with a social robot. Child Development 94, 4 (2023), 865–873. https://doi.org/10.1111/cdev.13903 arXiv:https://srcd.onlinelibrary.wiley.com/doi/pdf/10.1111/cdev.13903
[31]
Rita Orji, Kiemute Oyibo, and Gustavo F. Tondello. 2017. A Comparison of System-Controlled and User-Controlled Personalization Approaches. In Adjunct Publication of the 25th Conference on User Modeling, Adaptation and Personalization (Bratislava, Slovakia) (UMAP ’17). Association for Computing Machinery, New York, NY, USA, 413–418. https://doi.org/10.1145/3099023.3099116
[32]
João Antonio Campos Panceri, Éberte Freitas, Josiany Carlos de Souza, Sheila da Luz Schreider, Eliete Caldeira, and Teodiano Freire Bastos. 2021. A New Socially Assistive Robot with Integrated Serious Games for Therapies with Children with Autism Spectrum Disorder and Down Syndrome: A Pilot Study. Sensors 21, 24 (2021). https://doi.org/10.3390/s21248414
[33]
Amit Kumar Pandey and Rodolphe Gelin. 2018. A Mass-Produced Sociable Humanoid Robot: Pepper: The First Machine of Its Kind. IEEE Robotics & Automation Magazine 25, 3 (2018), 40–48. https://doi.org/10.1109/MRA.2018.2833157
[34]
Raspberry Pi Foundation. 2019. Raspberry Pi 4 Model B Datasheet. https://datasheets.raspberrypi.com/rpi4/raspberry-pi-4-datasheet.pdf Accessed: March 12, 2024.
[35]
Eileen Roesler, Dietrich Manzey, and Linda Onnasch. 2023. Embodiment Matters in Social HRI Research: Effectiveness of Anthropomorphism on Subjective and Objective Outcomes. J. Hum.-Robot Interact. 12, 1, Article 7 (feb 2023), 9 pages. https://doi.org/10.1145/3555812
[36]
Srivatsan Srinivasan. 2019. Misty-A Development Platform for Socially Assistive Robots [Student’s Corner]. IEEE Robotics & Automation Magazine 26, 2 (2019), 103–105. https://doi.org/10.1109/MRA.2019.2910420
[37]
Dag Sverre Syrdal, Kerstin Dautenhahn, Ben Robins, Efstathia Karakosta, and Nan Cannon Jones. 2020. Kaspar in the wild: Experiences from deploying a small humanoid robot in a nursery school for children with autism. Paladyn, Journal of Behavioral Robotics 11, 1 (2020), 301–326. https://doi.org/10.1515/pjbr-2020-0019
[38]
Michael L Walters, Dag S Syrdal, Kerstin Dautenhahn, René Te Boekhorst, and Kheng Lee Koay. 2008. Avoiding the uncanny valley: robot appearance, personality and consistency of behavior in an attention-seeking home scenario for a robot companion. Autonomous Robots 24 (2008), 159–178. https://doi.org/10.1007/s10514-007-9058-3
[39]
Luke J. Wood, Abolfazl Zaraki, Ben Robins, and Kerstin Dautenhahn. 2021. Developing Kaspar: A Humanoid Robot for Children with Autism. International Journal of Social Robotics 13, 3 (01 Jun 2021), 491–508. https://doi.org/10.1007/s12369-019-00563-6
[40]
John Zimmerman and Jodi Forlizzi. 2014. Research Through Design in HCI. Springer New York, New York, NY, 167–189. https://doi.org/10.1007/978-1-4939-0378-8_8
[41]
Tatjana Zorcec, Ben Robins, and Kerstin Dautenhahn. 2018. Getting Engaged: Assisted Play with a Humanoid Robot Kaspar for Children with Severe Autism. In ICT Innovations 2018. Engineering and Life Sciences, Slobodan Kalajdziski and Nevena Ackovska (Eds.). Springer International Publishing, Cham, 198–207. https://doi.org/10.1007/978-3-030-00825-3_17
Index Terms
- Research by Design: Mirrly a Humanoid Robot for Child-Robot Interaction
Recommendations
From child-robot interaction to child-robot-therapist interaction: A case study in autism
Human-Robot Interaction/InterfaceTroubles in social communication as well as deficits in the cognitive treatment of emotions are supposed to be a fundamental part of autism. We present a case study based on multimodal interaction between a mobile robot and a child with autism in ...
KASPAR --a minimally expressive humanoid robot for human--robot interaction research
This paper provides a comprehensive introduction to the design of the minimally expressive robot KASPAR, which is particularly suitable for human--robot interaction studies. A low-cost design with off-the-shelf components has been used in a novel design ...
Exploring the Effects of Robot Gender on Child-Robot Interaction
HRI '18: Companion of the 2018 ACM/IEEE International Conference on Human-Robot InteractionDespite the increase of research and applications for child-robot interactions, little is known about children»s responses to a robot»s gender across age and gender groups. This paper presents an exploratory study intended to examine whether the ...
Comments
Information & Contributors
Information
Published In
November 2024
502 pages
ISBN:9798400711787
DOI:10.1145/3687272
Copyright © 2024 Owner/Author.
This work is licensed under a Creative Commons Attribution International 4.0 License.
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 24 November 2024
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Funding Sources
- NSERC
Conference
HAI '24
Sponsor:
HAI '24: International Conference on Human-Agent Interaction
November 24 - 27, 2024
Swansea, United Kingdom
Acceptance Rates
Overall Acceptance Rate 121 of 404 submissions, 30%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 213Total Downloads
- Downloads (Last 12 months)213
- Downloads (Last 6 weeks)96
Reflects downloads up to 15 Feb 2025
Other Metrics
Citations
View Options
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML FormatLogin options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in