extended-abstract

Supporting turn-taking activities: a pilot study using a smart toy with children with a diagnosis of neurodevelopmental disorders

Authors:

Flora Giocondo,

Massimiliano Schembri,

Francesco Montedori,

Federica Giovannone,

Vincenzo Guidetti,

Valerio Sperati,

Gianluca BaldassarreAuthors Info & Claims

IDC '23: Proceedings of the 22nd Annual ACM Interaction Design and Children Conference

Pages 464 - 469

https://doi.org/10.1145/3585088.3593863

Published: 19 June 2023 Publication History

Abstract

This paper presents the preliminary results where an experimental prototype, the interactive soft toy called Octopus X-8, is used with three children with neurodevelopmental disorders in play activities involving turn-taking. This competence is fundamental for regulating social interactions and it is often impaired in those types of disorders. The pilot experiment aims to investigate if X-8 can be used as an engaging toy usable to train turn-taking skills. The toy is able to distinguish between two users and can therefore produce rewarding sensory feedback, such as coloured lights and sounds, when the turn-taking rules are respected. Preliminary results seem to show that X-8 can indeed be used as a supporting tool to improve this important social competence.

References

[1]

American Psychiatric Association. 2013. Diagnostic and Statistical Manual of Mental Disorders: DSM-5 (5th ed.). 636–638 pages. https://doi.org/10.1176/appi.books.9780890425596

[2]

Sofiane Boucenna, Antonio Narzisi, Elodie Tilmont, Filippo Muratori, Giovanni Pioggia, David Cohen, and Mohamed Chetouani. 2014. Interactive Technologies for Autistic Children: A Review. Cognitive Computation 6 (2014), 722–740. Issue 4. https://doi.org/10.1007/s12559-014-9276-x

[3]

Jeroen C.J. Brok and Emilia I. Barakova. 2010. Engaging autistic children in imitation and turn-taking games with multiagent system of interactive lighting blocks, Hoshino J. Han J.H. Yang H.S., Malaka R. (Ed.). International Conference on Entertainment Computing, Lecture Notes in Computer Science 6243, 115–126. Issue 6243. https://doi.org/10.1007/978-3-642-15399-0_11

[4]

Eunji Chong, Elysha Clark-Whitney, Audrey Southerland, Elizabeth Stubbs, Chanel Miller, Eliana L. Ajodan, Melanie R. Silverman, Catherine Lord, Agata Rozga, Rebecca M. Jones, and James M. Rehg. 2020. Detection of eye contact with deep neural networks is as accurate as human experts. Nature Communications 2020 11:1 11 (12 2020), 1–10. Issue 1. https://doi.org/10.1038/s41467-020-19712-x

[5]

Daniel O. David, Cristina A. Costescu, Silviu Matu, Aurora Szentagotai, and Anca Dobrean. 2020. Effects of a Robot-Enhanced Intervention for Children With ASD on Teaching Turn-Taking Skills. Journal of Educational Computing Research 58 (3 2020), 29–62. Issue 1. https://doi.org/10.1177/0735633119830344

[6]

Flora Giocondo, Noemi Faedda, Gioia Cavalli, Valerio Sperati, Beste Ozcan, Federica Giovannone, Carla Sogos, Vincenzo Guidetti, and Gianluca Baldassarre. 2022. Leveraging curiosity to encourage social interactions in children with Autism Spectrum Disorder: preliminary results using the interactive toy PlusMe. Conference on Human Factors in Computing Systems - Proceedings. https://doi.org/10.1145/3491101.3519716

Digital Library

[7]

Maya Gratier, Emmanuel Devouche, Bahia Guellai, Rubia Infanti, Ebru Yilmaz, and Erika Parlato-Oliveira. 2015. Early development of turn-taking in vocal interaction between mothers and infants. Frontiers in Psychology 6 (2015). Issue 1167. https://doi.org/10.3389/fpsyg.2015.01167

[8]

Ulla Holck. 2004. Turn-Taking in Music Therapy with Children with Communication Disorders. British Journal of Music Therapy 18 (2004), 45–54. Issue 2. https://doi.org/10.1177/135945750401800203

[9]

Judith Holler, Kobin H. Kendrick, Marisa Casillas, and Stephen C. Levinson. 2015. Editorial: Turn-Taking in Human Communicative Interaction. Frontiers in Psychology 6 (2015), 1–4. Issue DEC. https://doi.org/10.3389/fpsyg.2015.01919

[10]

Lila Kossyvaki and Sara Curran. 2020. The role of technology-mediated music-making in enhancing engagement and social communication in children with autism and intellectual disabilities. Journal of Intellectual Disabilities 24 (3 2020), 118–138. Issue 1. https://doi.org/10.1177/1744629518772648

[11]

Jean-Paul Noel, Matthew A De Niear, Nicholas S Lazzara, and Mark T Wallace. 2018. Uncoupling Between Multisensory Temporal Function and Nonverbal Turn-Taking in Autism Spectrum Disorder. IEEE TRANSACTIONS ON COGNITIVE AND DEVELOPMENTAL SYSTEMS 10 (2018). Issue 4. https://doi.org/10.1109/TCDS.2017.2778141

[12]

Eleuda Nunez, Soichiro Matsuda, Masakazu Hirokawa, Junichi Yamamoto, and Kenji Suzuki. 2018. Effect of sensory feedback on turn-taking using paired devices for children with ASD. Multimodal Technologies and Interaction 2 (2018), 1–18. Issue 4. https://doi.org/10.3390/mti2040061

[13]

Sarah R. Rieth, Aubyn C. Stahmer, Jessica Suhrheinrich, Laura Schreibman, Joanna Kennedy, and Benjamin Ross. 2014. Identifying critical elements of treatment: Examining the use of turn taking in autism intervention. Focus on Autism and Other Developmental Disabilities 29 (2014), 168–179. Issue 3. https://doi.org/10.1177/1088357613513792

[14]

Sally J. Rogers. 1988. Characteristics of social interactions between mothers and their disabled infants: A review. Child: care, health and development 14 (1988), 301–317. Issue 5. https://doi.org/10.1111/j.1365-2214.1988.tb00583.x

[15]

Pegah Soleiman, Hadi Moradi, Maryam Mahmoudi, Mohyeddin Teymouri, and Hamid Reza Pouretemad. 2021. Teaching Turn-Taking Skills to Children with Autism using a Parrot-Like Robot. https://arxiv.org/abs/2101.12273

[16]

Valerio Sperati, Beste Özcan, Laura Romano, Tania Moretta, Simone Scaffaro, Noemi Faedda, Giada Turturo, Francesca Fioriello, Simone Pelosi, Federica Giovannone, Carla Sogos, Vincenzo Guidetti, and Gianluca Baldassarre. 2020. Acceptability of the transitional wearable companion “+me” in children with autism spectrum disorder: A comparative pilot study. Frontiers in Psychology 11 (2020), 1–9. Issue May. https://doi.org/10.3389/fpsyg.2020.00951

[17]

Katherine Valencia, Cristian Rusu, Daniela Quiñones, and Erick Jamet. 2019. The Impact of Technology on People with Autism Spectrum Disorder: A Systematic Literature Review. Sensors 19 (2019). Issue 20. https://doi.org/10.3390/s19204485

[18]

Marjo Virnes, Eija Kärnä, and Virpi Vellonen. 2015. Review of Research on Children with Autism Spectrum Disorder and the Use of Technology. Journal of Special Education Technology 30 (2015), 13–27. Issue 1. https://doi.org/10.1177/016264341503000102

[19]

B. Özcan, D. Caligiore, V. Sperati, T. Moretta, and G. Baldassarre. 2016. Transitional Wearable Companions: A Novel Concept of Soft Interactive Social Robots to Improve Social Skills in Children with Autism Spectrum Disorder. International Journal of Social Robotics 8 (2016), 471–481. Issue 4. https://doi.org/10.1007/s12369-016-0373-8

[20]

Beste Özcan, Valerio Sperati, Flora Giocondo, and Gianluca Baldassarre. 2021. “X-8”: An Experimental Interactive Toy to Support Turn-Taking Games in Children with Autism Spectrum Disorders. Communications in Computer and Information Science 1419 (2021), 233–239. https://doi.org/10.1007/978-3-030-78635-9_32

Cited By

Sperati VOzcan BGiovannone FSchembri MFaedda NSogos CGuidetti VBaldassarre G(2024)A tangible, toy-based platform to evaluate the child's social interaction in turn-taking game: a prospective on monitoring neurodevelopmental disordersProceedings of the 23rd Annual ACM Interaction Design and Children Conference10.1145/3628516.3659368(650-654)Online publication date: 17-Jun-2024
https://dl.acm.org/doi/10.1145/3628516.3659368

Index Terms

Supporting turn-taking activities: a pilot study using a smart toy with children with a diagnosis of neurodevelopmental disorders
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI design and evaluation methods
      1. Usability testing

Recommendations

A tangible, toy-based platform to evaluate the child's social interaction in turn-taking game: a prospective on monitoring neurodevelopmental disorders
IDC '24: Proceedings of the 23rd Annual ACM Interaction Design and Children Conference

This paper describes a tangible, interactive platform presented here as an early prototype, designed to evaluate the child’s social interaction with the caregiver, during play activities based on turn-taking rules. The platform is composed by 2 elements,...
CHIMELIGHT: Augmenting Instruments in Interactive Music Therapy for Children with Neurodevelopmental Disorders
ASSETS '19: Proceedings of the 21st International ACM SIGACCESS Conference on Computers and Accessibility

In this paper, we propose a new mobile system to support therapists for teaching and tracking socio-communicative behaviors in children with neurodevelopmental disorders during music therapy sessions. The CHIMELIGHT system was designed to deal with the ...
Multimodal Conversational Agents for People with Neurodevelopmental Disorders
ICMI '23: Proceedings of the 25th International Conference on Multimodal Interaction

Neurodevelopmental Disorders (NDD) involve developmental deficits in cognition, social interaction, and communication. Despite growing interest, gaps persist in understanding usability, effectiveness, and perceptions of such agents. We organize a ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

IDC '23: Proceedings of the 22nd Annual ACM Interaction Design and Children Conference

June 2023

824 pages

ISBN:9798400701313

DOI:10.1145/3585088

Copyright © 2023 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 19 June 2023

Check for updates

Author Tags

Qualifiers

Extended-abstract
Research
Refereed limited

Conference

IDC '23

Sponsor:

SIGCHI

IDC '23: Interaction Design and Children

June 19 - 23, 2023

IL, Chicago, USA

Acceptance Rates

Overall Acceptance Rate 172 of 578 submissions, 30%

Upcoming Conference

IDC '25

Sponsor:
sigchi

Interaction Design and Children

June 23 - 26, 2025

Reykjavik , Iceland

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
143
Total Downloads

Downloads (Last 12 months)67
Downloads (Last 6 weeks)6

Reflects downloads up to 05 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Sperati VOzcan BGiovannone FSchembri MFaedda NSogos CGuidetti VBaldassarre G(2024)A tangible, toy-based platform to evaluate the child's social interaction in turn-taking game: a prospective on monitoring neurodevelopmental disordersProceedings of the 23rd Annual ACM Interaction Design and Children Conference10.1145/3628516.3659368(650-654)Online publication date: 17-Jun-2024
https://dl.acm.org/doi/10.1145/3628516.3659368

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Figures

Tables

Media

View Table of Conten