short-paper

An Architecture Supporting Configurable Autonomous Multimodal Joint-Attention-Therapy for Various Robotic Systems

Authors:

Christian Schütze,

Birte RichterAuthors Info & Claims

ICMI '22 Companion: Companion Publication of the 2022 International Conference on Multimodal Interaction

Pages 154 - 159

https://doi.org/10.1145/3536220.3558070

Published: 07 November 2022 Publication History

Abstract

In this paper, we present a software-architecture for robot-assisted configurable and autonomous Joint-Attention-Training scenarios to support autism therapy. The focus of the work is the expandability of the architecture for the use of different robots, as well as the maximization of the usability of the interface for the therapeutic user. By evaluating the user-experience, we draw first conclusions about the usability of the system for computer and non-computer scientists. Both groups can solve different tasks without any major issues, and the overall usability of the system was rated as good.

References

[1]

Salvatore Maria Anzalone, Elodie Tilmont, Sofiane Boucenna, Jean Xavier, Anne-Lise Jouen, Nicolas Bodeau, Koushik Maharatna, Mohamed Chetouani, and David Cohen. 2014. How children with autism spectrum disorder behave and explore the 4-dimensional (spatial 3D+time) environment during a joint attention induction task with a robot. Research in Autism Spectrum Disorders 8, 7 (July 2014), 814–826. https://doi.org/10.1016/j.rasd.2014.03.002

[2]

Kristen Bottema-Beutel. 2016. Associations between joint attention and language in autism spectrum disorder and typical development: A systematic review and meta-regression analysis. Autism Research 9, 10 (2016), 1021–1035.

[3]

John Brooke. 1986. System usability scale (SUS): a quick-and-dirty method of system evaluation user information. Reading, UK: Digital equipment co ltd 43 (1986), 1–7.

[4]

Carlos A. Cifuentes, Maria J. Pinto, Nathalia Céspedes, and Marcela Múnera. 2020. Social Robots in Therapy and Care. Current Robotics Reports 1, 3 (2020), 59–74. https://doi.org/10.1007/s43154-020-00009-2

[5]

World Wide Web Consortium. 1994. XML - XML Wiki. https://wiki.selfhtml.org/wiki/XML

[6]

Nils Dahlbäck, Arne Jönsson, and Lars Ahrenberg. 1993. Wizard of Oz studies—why and how. Knowledge-based systems 6, 4 (1993), 258–266.

[7]

SoftBank Robotics Europe. 2006. NAOqi API, SDKs 2.5. http://doc.aldebaran.com/2-4/naoqi/index.html

[8]

SoftBank Robotics Europe. 2006. Pepper und NAO, Roboter für die Bildung | SoftBank Robotics. Aldebaran Robotics, Paris, France. https://www.softbankrobotics.com/emea/en/nao

[9]

SoftBank Robotics Europe. 2014. How Aldebaran Robotics Built Its Friendly Humanoid Robot, Pepper. Aldebaran Robotics, Paris, France. https://spectrum.ieee.org/how-aldebaran-robotics-built-its-friendly-humanoid-robot-pepper

[10]

Thomas Franke, Christiane Attig, and Daniel Wessel. 2019. A personal resource for technology interaction: development and validation of the affinity for technology interaction (ATI) scale. International Journal of Human–Computer Interaction 35, 6(2019), 456–467.

[11]

Christine M. Freitag, Katrin Jensen, Karoline Teufel, Marvin Luh, Antoaneta Todorova, Christopher Lalk, and Leonora Vllasaliu. 2020. Empirisch untersuchte entwicklungsorientierte und verhaltenstherapeutisch basierte Therapieprogramme zur Verbesserung der Kernsymptome und der Sprachentwicklung bei Klein- und Vorschulkindern mit Autismus-Spektrum-Störungen. Zeitschrift für Kinder- und Jugendpsychiatrie und Psychotherapie 48, 3 (May 2020), 224–243. https://doi.org/10.1024/1422-4917/a000714

[12]

Inge Kamp-Becker, Eftichia Duketis, Judith Sinzig, Luise Poustka, and Katja Becker. 2010. Diagnostik und Therapie von Autismus-Spektrum-Störungen im Kindesalter. Kindheit und Entwicklung 19, 3 (July 2010), 144–157. https://doi.org/10.1026/0942-5403/a000019

[13]

Stefan Kopp, Brigitte Krenn, Stacy Marsella, Andrew N Marshall, Catherine Pelachaud, Hannes Pirker, Kristinn R Thórisson, and Hannes Vilhjálmsson. 2006. Towards a common framework for multimodal generation: The behavior markup language. In International workshop on intelligent virtual agents. Springer, Springer, Heidelberg, Berlin, 205–217. https://techfak.uni-bielefeld.de/ skopp/download/BML.pdf

Digital Library

[14]

Hirokazu Kumazaki, Yuichiro Yoshikawa, Yuko Yoshimura, Takashi Ikeda, Chiaki Hasegawa, Daisuke N. Saito, Sara Tomiyama, Kyung-min An, Jiro Shimaya, Hiroshi Ishiguro, Yoshio Matsumoto, Yoshio Minabe, and Mitsuru Kikuchi. 2018. The impact of robotic intervention on joint attention in children with autism spectrum disorders. Molecular Autism 9, 1 (Dec. 2018), 46. https://doi.org/10.1186/s13229-018-0230-8

[15]

Clayton Lewis. 1982. Using the" thinking-aloud" method in cognitive interface design. IBM TJ Watson Research Center Yorktown Heights, NY, Yorktown Heights, NY. https://dominoweb.draco.res.ibm.com/reports/RC9265.pdf

[16]

Arthur L Lewy and Geraldine Dawson. 1992. Social stimulation and joint attention in young autistic children. Journal of abnormal child psychology 20, 6 (1992), 555–566.

[17]

Ingo Lütkebohle, Frank Hegel, Simon Schulz, Matthias Hackel, Britta Wrede, Sven Wachsmuth, and Gerhard Sagerer. 2010. The Bielefeld anthropomorphic robot head “Flobi”. In 2010 IEEE International Conference on Robotics and Automation. IEEE, IEEE, Anchorage, Alaska, 3384–3391. https://ieeexplore.ieee.org/document/5509173

[18]

Microsoft. 2001. C#. https://docs.microsoft.com/de-de/dotnet/csharp/

[19]

Peter Mundy. 1995. Joint attention and social-emotional approach behavior in children with autism. Development and Psychopathology 7, 1 (1995), 63–82.

[20]

Tania R Nuñez and Astrid M Rosenthal-von der Pütten. 2018. Roboter und Agenten in der psychologischen Intervention. Klinische Cyberpsychologie und Cybertherapie. facultas Universitätsverlag, Wien 1, 1 (2018), 78–85.

[21]

Helmut Remschmidt and Inge Kamp-Becker. 2007. Das Asperger-Syndrom–eine Autismus-Spektrum-Störung. Deutsches Ärzteblatt 104, 13 (2007), 873–882.

[22]

Open Robotics. 2007. Nodes - ROS Wiki. http://wiki.ros.org/Nodes

[23]

Open Robotics. 2007. ROS/Concepts - ROS Wiki. Stanford Artificial Intelligence Laboratory, Stanford, California. http://wiki.ros.org/ROS/Concepts

[24]

Lars Schillingmann and Yukie Nagai. 2015. Yet another gaze detector: An embodied calibration free system for the iCub robot. In 2015 IEEE-RAS 15th International Conference on Humanoid Robots (Humanoids). IEEE, IEEE, Seoul, South Korea, 8–13. https://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=7363515

Digital Library

[25]

Ryo Suzuki, Jaeryoung Lee, and Ognjen Rudovic. 2017. Nao-dance therapy for children with ASD. In Proceedings of the Companion of the 2017 ACM/IEEE International Conference on Human-Robot Interaction. Proceedings of the Companion of the 2017 ACM/IEEE International Conference on Human-Robot Interaction, Vienna, Austria, 295–296. https://doi.org/10.1145/3029798.3038354

Digital Library

[26]

Unity Technologies. 2005. Unity - Manual: Coroutines. Unity Technologies, San Francisco, California. https://docs.unity3d.com/Manual/Coroutines.html

[27]

Unity Technologies. 2005. Unity Real-Time Development Platform | 3D, 2D VR & AR Engine. Unity Technologies, San Francisco, California. https://unity.com/

[28]

Unity Technologies. 2021. ROS-TCP-Connector. Unity Technologies, San Francisco, California. https://github.com/Unity-Technologies/ROS-TCP-Connector

[29]

Unity Technologies. 2021. Unity Robotics Hub. Unity Technologies, San Francisco, California. https://github.com/Unity-Technologies/Unity-Robotics-Hub

[30]

Sarel Van Vuuren and Leora R Cherney. 2014. A virtual therapist for speech and language therapy. In International conference on intelligent virtual agents. Springer, Boston, Massachusetts, 438–448. https://doi.org/10.1007/978-3-319-09767-1_55

[31]

Christina Whalen and Laura Schreibman. 2003. Joint attention training for children with autism using behavior modification procedures. Journal of Child Psychology and Psychiatry 44, 3 (2003), 456–468. https://doi.org/10.1111/1469-7610.00135 _eprint: https://acamh.onlinelibrary.wiley.com/doi/pdf/10.1111/1469-7610.00135.

Cited By

Richter BPutze FIvucic GBrandt MSchütze CReisenhofer RWrede BSchultz T(2023)EEG Correlates of Distractions and Hesitations in Human–Robot Interaction: A LabLinking Pilot StudyMultimodal Technologies and Interaction10.3390/mti70400377:4(37)Online publication date: 29-Mar-2023
https://doi.org/10.3390/mti7040037
Groß ASchütze CBrandt MWrede BRichter B(2023)RISE: an open-source architecture for interdisciplinary and reproducible human–robot interaction researchFrontiers in Robotics and AI10.3389/frobt.2023.124550110Online publication date: 6-Dec-2023
https://doi.org/10.3389/frobt.2023.1245501

Index Terms

An Architecture Supporting Configurable Autonomous Multimodal Joint-Attention-Therapy for Various Robotic Systems
1. Computer systems organization
  1. Embedded and cyber-physical systems
    1. Robotics
      1. Robotic control
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI design and evaluation methods
      1. Usability testing
    2. Interactive systems and tools

Recommendations

Individual Differences of Children with Autism in Robot-assisted Autism Therapy
HRI '22: Proceedings of the 2022 ACM/IEEE International Conference on Human-Robot Interaction

Research has recognized the importance of individual differences of children with Autism Spectrum Disorder (ASD) that require interventions to meet their heterogeneous needs. This relatively large-scale study investigates a robot-assisted autism therapy (...
Social Robots as Co-Therapists in Autism Therapy Sessions: A Single-Case Study
Social Robotics
Abstract
This study aimed to explore the potential value of a humanoid robot, NAO, in assisting the therapist during therapy sessions with children in the autism spectrum (ASD). We report findings from a single case, a 10-year old boy, Joe (pseudonym), ...
Social benefit analysis of the Otto robot in therapies for children with ASD
IMXw '23: Proceedings of the 2023 ACM International Conference on Interactive Media Experiences Workshops

This article aims to analyze the benefits and improvements in the life of children with Autism Spectrum Disorder (ASD) brought through the use of the Otto robot during therapeutic sessions. The article explains how robotic therapy contributes to the ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ICMI '22 Companion: Companion Publication of the 2022 International Conference on Multimodal Interaction

November 2022

225 pages

ISBN:9781450393898

DOI:10.1145/3536220

Editors:
Raj Tumuluri
Openstream
,
Nicu Sebe
University of Trento
,
Gopal Pingali
Accenture
,
Dinesh Babu Jayagopi
IIIT Bangalore
,
Abhinav Dhall
IIT Ropar
,
Richa Singh
IIT Jodhpur
,
Lisa Anthony
University of Florida
,
Albert Ali Salah
Utrecht University and Boğaziçi University

Copyright © 2022 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 November 2022

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper
Research
Refereed limited

Conference

ICMI '22

Sponsor:

SIGCHI

ICMI '22: INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION

November 7 - 11, 2022

Bengaluru, India

Acceptance Rates

Overall Acceptance Rate 453 of 1,080 submissions, 42%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
82
Total Downloads

Downloads (Last 12 months)24
Downloads (Last 6 weeks)2

Reflects downloads up to 15 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Richter BPutze FIvucic GBrandt MSchütze CReisenhofer RWrede BSchultz T(2023)EEG Correlates of Distractions and Hesitations in Human–Robot Interaction: A LabLinking Pilot StudyMultimodal Technologies and Interaction10.3390/mti70400377:4(37)Online publication date: 29-Mar-2023
https://doi.org/10.3390/mti7040037
Groß ASchütze CBrandt MWrede BRichter B(2023)RISE: an open-source architecture for interdisciplinary and reproducible human–robot interaction researchFrontiers in Robotics and AI10.3389/frobt.2023.124550110Online publication date: 6-Dec-2023
https://doi.org/10.3389/frobt.2023.1245501

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents