Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3648536.3648542acmotherconferencesArticle/Chapter ViewAbstractPublication PagestahriConference Proceedingsconference-collections
research-article
Open access

A Socially Assistive Robot using Automated Planning in a Paediatric Clinical Setting

Published: 09 May 2024 Publication History

Abstract

Social robotics has recently focused on developing AI agents that recognise and respond to human emotions. The use of plan-based approaches is promising, especially in domains where collecting data in advance is challenging (e.g., medical domains). We have designed and developed a system that implements a social robot to help children cope with painful and distressing medical procedures in a clinical setting. Our approach uses automated planning as a core component for action selection in order to generate plans that include physical, sensory, and social actions for the robot to use when interacting with humans. A key capability of our system is that the robot’s behaviour adapts based on the affective state of the child patient. The robot must operate in a challenging physical and social environment where appropriate and safe interaction with children, parents/caregivers, and healthcare professionals is crucial. In this paper, we present our system, examine some of the key challenges of the scenario, and describe how they are addressed by our system. We provide an overview of some of the lab-based trials that we have conducted. The system is currently undergoing usability studies at two hospitals, with the intention of moving onto clinical trials.

References

[1]
Carole Adam, Wafa Johal, Damien Pellier, Humbert Fiorino, and Sylvie Pesty. 2016. Social Human-Robot Interaction: A New Cognitive and Affective Interaction-Oriented Architecture. In Social Robotics, Arvin Agah, John-John Cabibihan, Ayanna M. Howard, Miguel A. Salichs, and Hongsheng He (Eds.). Springer International Publishing, Cham, 253–263.
[2]
S Ali, R Manaloor, K Ma, M Sivakumar, B Vandermeer, T Beran, S Scott, T Graham, S Curtis, H Jou, 2019. LO63: humanoid robot-based distraction to reduce pain and distress during venipuncture in the pediatric emergency department: a randomized controlled trial. Canadian Journal of Emergency Medicine (2019).
[3]
Aida Amirova, Nazerke Rakhymbayeva, Elmira Yadollahi, Anara Sandygulova, and Wafa Johal. 2021. 10 Years of Human-NAO Interaction Research: A Scoping Review. Frontiers in Robotics and AI 8 (11 2021).
[4]
Tadas Baltrusaitis, Amir Zadeh, Yao Chong Lim, and Louis Philippe Morency. 2018. OpenFace 2.0: Facial behavior analysis toolkit. Proceedings - 13th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2018 (2018), 59–66. https://doi.org/10.1109/FG.2018.00019
[5]
Christine T Chambers, Anna Taddio, Lindsay S Uman, C Meghan McMurtry, and HELPinKIDS Team. 2009. Psychological interventions for reducing pain and distress during routine childhood immunizations: a systematic review. Clinical therapeutics 31 (2009), S77–S103.
[6]
Meia Chita-Tegmark and Matthias Scheutz. 2021. Assistive Robots for the Social Management of Health: A Framework for Robot Design and Human–Robot Interaction Research. International Journal of Social Robotics 13 (4 2021), 197–217. Issue 2. https://doi.org/10.1007/s12369-020-00634-z
[7]
Julia Dawe, Craig Sutherland, Alex Barco, and Elizabeth Broadbent. 2019. Can social robots help children in healthcare contexts? A scoping review. BMJ Paediatrics Open 3, 1 (2019), e000371. https://doi.org/10.1136/bmjpo-2018-000371
[8]
Jiankang Deng, Jia Guo, Yuxiang Zhou, Jinke Yu, Irene Kotsia, and Stefanos Zafeiriou. 2019. RetinaFace: Single-stage Dense Face Localisation in the Wild. https://doi.org/10.48550/ARXIV.1905.00641
[9]
D. Feil-Seifer and M.J. Mataric. 2005. Socially Assistive Robotics. In Proceedings of the International Conference on Rehabilitation Robotics.
[10]
Mary Ellen Foster, Samina Ali, Sasha Litwin, Jennifer Parker, Ronald P. A. Petrick, David Harris Smith, Jennifer Stinson, and Frauke Zeller. 2020. Using AI-Enhanced Social Robots to Improve Children’s Healthcare Experiences. In Social Robotics.
[11]
Mary Ellen Foster, Patricia Candelaria, Lauren J. Dwyer, Summer Hudson, Alan Lindsay, Fareha Nishat, Mykelle Pacquing, Ronald P. A. Petrick, Andrés Alberto Ramírez-Duque, Jennifer Stinson, Frauke Zeller, and Samina Ali. 2023. Co-Design of a Social Robot for Distraction in the Paediatric Emergency Department. In Companion of the 2023 ACM/IEEE International Conference on Human-Robot Interaction (Stockholm, Sweden) (HRI ’23). Association for Computing Machinery, New York, NY, USA, 461–465. https://doi.org/10.1145/3568294.3580127
[12]
Maria Fox, Derek Long, and Daniele Magazzeni. 2017. Explainable planning. arXiv preprint arXiv:1709.10256 (2017).
[13]
Pablo Gomez Esteban, Paul E Baxter, Tony Belpaeme, Erik Billing, Haibin Cai, Hoang-Long Cao, Mark Coeckelbergh, Cristina Costescu, Daniel David, Albert De Beir, Yinfeng Fang, Zhaojie Ju, James Kennedy, 2017. How to Build a Supervised Autonomous System for Robot-Enhanced Therapy for Children with Autism Spectrum Disorder. Paladyn Journal of Behavioral Robotics 8, 1 (2017), 18–38. https://doi.org/10.1515/pjbr-2017-0002
[14]
Xiaojie Guo, Siyuan Li, Jinke Yu, Jiawan Zhang, Jiayi Ma, Lin Ma, Wei Liu, and Haibin Ling. 2019. PFLD: A Practical Facial Landmark Detector. https://doi.org/10.48550/ARXIV.1902.10859
[15]
Anna Henschel, Guy Laban, and Emily S. Cross. 2021. What Makes a Robot Social? A Review of Social Robots from Science Fiction to a Home or Hospital Near You. Current Robotics Reports 2 (3 2021), 9–19. Issue 1. https://doi.org/10.1007/s43154-020-00035-0
[16]
Lindsay A. Jibb, Kathryn A. Birnie, Paul C. Nathan, Tanya N. Beran, Vanessa Hum, J. Charles Victor, and Jennifer N. Stinson. 2018. Using the MEDiPORT humanoid robot to reduce procedural pain and distress in children with cancer: A pilot randomized controlled trial. Pediatric Blood & Cancer 65, 9 (2018), e27242. https://doi.org/10.1002/pbc.27242
[17]
Wafa Johal. 2020. Research Trends in Social Robots for Learning. Current Robotics Reports 1 (9 2020), 75–83. Issue 3. https://doi.org/10.1007/s43154-020-00008-3
[18]
Filippos Kominis and Hector Geffner. 2017. Multiagent online planning with nested beliefs and dialogue. In Proceedings of the International Conference on Automated Planning and Scheduling.
[19]
Mike E.U. Ligthart, Mark A. Neerincx, and Koen V. Hindriks. 2022. Memory-Based Personalization for Fostering a Long-Term Child-Robot Relationship. In Proceedings of the 2022 ACM/IEEE International Conference on Human-Robot Interaction(HRI ’22). 80–89. https://doi.org/10.5555/3523760.3523775
[20]
Alan Lindsay. 2023. On Using Action Inheritance and Modularity in PDDL Domain Modelling. In Proceedings of the International Conference on Automated Planning and Scheduling.
[21]
Alan Lindsay, Andrés Alberto Ramírez-Duque, Ronald P. A. Petrick, and Mary Ellen. Foster. 2022. A Socially Assistive Robot using Automated Planning in a Paediatric Clinical Setting. In Proceedings of the AAAI Fall Symposium on Artificial Intelligence for Human-Robot Interaction (AI-HRI).
[22]
Clara J Moerman, Loek van der Heide, and Marcel Heerink. 2018. Social robots to support children’s well-being under medical treatment: A systematic state-of-the-art review. Journal of Child Health Care 23 (Nov 2018), 596–612. https://doi.org/10.1177/1367493518803031
[23]
Christian Muise, Sheila McIlraith, and Christopher Beck. 2012. Improved non-deterministic planning by exploiting state relevance. In Proceedings of the International Conference on Automated Planning and Scheduling. 172–180.
[24]
NVIDIA. 2022. NVIDIA DeepStream SDK. https://developer.nvidia.com/deepstream-sdk
[25]
Ioannis Papaioannou, Christian Dondrup, and Oliver Lemon. 2018. Human-robot interaction requires more than slot filling-multi-threaded dialogue for collaborative tasks and social conversation. In FAIM/ISCA Workshop on Artificial Intelligence for Multimodal Human Robot Interaction. 61–64.
[26]
Paola Pennisi, Alessandro Tonacci, Gennaro Tartarisco, Lucia Billeci, Liliana Ruta, Sebastiano Gangemi, and Giovanni Pioggia. 2016. Autism and social robotics: A systematic review. Autism Research (2016).
[27]
Ronald Petrick and Mary Ellen Foster. 2020. Knowledge engineering and planning for social human–robot interaction: A case study. In Knowledge Engineering Tools and Techniques for AI Planning.
[28]
Ronald PA Petrick and Mary Ellen Foster. 2013. Planning for Social Interaction in a Robot Bartender Domain. In Proceedings of the International Conference on Automated Planning and Scheduling.
[29]
Morgan Quigley, Ken Conley, Brian Gerkey, Josh Faust, Tully Foote, Jeremy Leibs, Rob Wheeler, and Andrew Y Ng. 2009. ROS: an open-source Robot Operating System. In ICRA Workshop on Open Source Software.
[30]
Silvia Rossi, Marwa Larafa, and Martina Ruocco. 2020. Emotional and Behavioural Distraction by a Social Robot for Children Anxiety Reduction During Vaccination. International Journal of Social Robotics 12, 3 (Jan 2020), 765–777. https://doi.org/10.1007/s12369-019-00616-w
[31]
Valerio Sanelli, Michael Cashmore, Daniele Magazzeni, and Luca Iocchi. 2017. Short-Term Human-Robot Interaction through Conditional Planning and Execution. In Proceedings of the International Conference on Automated Planning and Scheduling (ICAPS). 540–548.
[32]
Brian Scassellati, Laura Boccanfuso, Chien-Ming Huang, Marilena Mademtzi, Meiying Qin, Nicole Salomons, Pamela Ventola, and Frederick Shic. 2018. Improving social skills in children with ASD using a long-term, in-home social robot. Science Robotics 3, 21 (2018), eaat7544.
[33]
Matthijs H. J. Smakman, Koen Smit, Lotte Buser, Tom Monshouwer, Nigel van Putten, Thymen Trip, Coen Schoof, Daniel F. Preciado, Elly A. Konijn, Esther M. van der Roest, and Wouter M. Tiel Groenestege. 2021. Mitigating Children’s Pain and Anxiety during Blood Draw Using Social Robots. Electronics 10, 10 (May 2021), 1211. https://doi.org/10.3390/electronics10101211
[34]
Bonnie J Stevens, Laura K Abbott, Janet Yamada, Denise Harrison, Jennifer Stinson, Anna Taddio, Melanie Barwick, Margot Latimer, Shannon D Scott, Judith Rashotte, 2011. Epidemiology and management of painful procedures in children in Canadian hospitals. Cmaj (2011).
[35]
Adriana Tapus, Cristian Tapus, and Maja J Mataric. 2009. The use of socially assistive robots in the design of intelligent cognitive therapies for people with dementia. In Proceedings of the IEEE International Conference on Rehabilitation Robotics.
[36]
Margaret J Trost, Grace Chrysilla, Jeffrey I Gold, and Maja Matarić. 2020. Socially-Assistive Robots Using Empathy to Reduce Pain and Distress during Peripheral IV Placement in Children. Pain research & management (2020).
[37]
Margaret J Trost, Adam R Ford, Lynn Kysh, Jeffrey I Gold, and Maja Matarić. 2019. Socially assistive robots for helping pediatric distress and pain: a review of current evidence and recommendations for future research and practice. The Clinical journal of pain (2019).
[38]
K. Wada, T. Shibata, T. Saito, and K. Tanie. 2004. Effects of robot-assisted activity for elderly people and nurses at a day service center. Proc. IEEE (2004).
[39]
Jules Waldhart, Mamoun Gharbi, and Rachid Alami. 2016. A novel software combining task and motion planning for human-robot interaction. In 2016 AAAI Fall Symposium Series.
[40]
Jun Wang, Yinglu Liu, Yinglu Hu, Hailin Shi, and Tao Mei. 2021. FaceX-Zoo: A PyTorch Toolbox for Face Recognition. Proceedings of the 29th ACM international conference on Multimedia.

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
TAHRI '24: Proceedings of the 2024 International Symposium on Technological Advances in Human-Robot Interaction
March 2024
120 pages
ISBN:9798400716614
DOI:10.1145/3648536
This work is licensed under a Creative Commons Attribution-NonCommercial International 4.0 License.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 09 May 2024

Check for updates

Author Tags

  1. Human-Robot interaction
  2. Managing affective state
  3. Plan-based interaction
  4. Socio-Affective sensing

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Funding Sources

  • SSHRC-UKRI Canada-UK Artificial Intelligence Initiative

Conference

TAHRI 2024

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 213
    Total Downloads
  • Downloads (Last 12 months)213
  • Downloads (Last 6 weeks)55
Reflects downloads up to 15 Jan 2025

Other Metrics

Citations

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Login options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media