Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3491101.3519855acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
poster

Gaze-based Anxiety Sensitive Virtual Social Communication Platform for Individuals with Autism

Published: 28 April 2022 Publication History

Abstract

Difficulties in social communication along with impairments in understanding other's emotions and exhibiting atypical gaze behavior while avoiding social cues are common concerns in individuals with autism spectrum disorder (ASD). Such deficits are reported to be related with social anxiety. Social anxiety often deters the process of skill learning. Given the dramatic rise in the prevalence of ASD and limited availability of trained therapists, getting access to technology-assisted platforms that can estimate one's anxiety and autonomously vary the task challenges for effective skill learning is critical. The potential of gaze-related indices to serve as biomarkers to one's anxiety, and advancement in computing technologies allowing real-time access to gaze-related social signals, we have designed a Virtual Reality (VR)-based anxiety-sensitive social communication task platform. This features a Rule Generator that is used to offer tasks based on the composite effect of task performance and estimated anxiety from one's gaze in an individualized manner. Results of a study with 10 individuals with ASD showed that the anxiety-sensitive system showed promise in eliciting improved task performance and increased looking towards the face region of a communicator displaying emotional expression in comparison to the currently existing system that is blind to one's anxiety. This paves the way towards design of a complementary tool for the therapists.

Supplementary Material

MP4 File (3491101.3519855-talk-video.mp4)
Talk Video

References

[1]
Mariano Alcañiz, Irene Alice Chicchi-Giglioli, Lucía A. Carrasco-Ribelles, Javier Marín-Morales, Maria Eleonora Minissi, Gonzalo Teruel-García, Marian Sirera, and Luis Abad. 2022. Eye gaze as a biomarker in the recognition of autism spectrum disorder using virtual reality and machine learning: A proof of concept for diagnosis. Autism Res. 15, 1 (2022), 131–145.
[2]
American Psychiatric Association. 2014. Diagnostic and statistical manual of mental disorders: DSM-5. American Psychiatric Association.
[3]
André Antunes and Rui Neves Madeira. 2022. PLAY - Model-based Platform to Support Therapeutic Serious Games Design. Procedia Comput. Sci. 198, (2022), 211–218.
[4]
R Bakeman. 2005. Recommended effect size statistic. Behav. Res. Methods (2005).
[5]
Jennifer Brown and Donna Murray. 2001. Strategies for enhancing play skills for children with autism spectrum disorder. Educ. Train. Ment. Retard. Dev. Disabil. 36, 3 (2001), 312–317.
[6]
Louis John Camilleri, Katie Maras, and Mark Brosnan. 2022. The impact of using digitally-mediated social stories on the perceived competence and attitudes of parents and practitioners supporting children with autism. PLoS One 17, 1 (January 2022), e0262598.
[7]
Zhuoqing Chang, J Matias Di Martino, Rachel Aiello, Jeffrey Baker, Kimberly Carpenter, Scott Compton, Naomi Davis, Brian Eichner, Steven Espinosa, Jacqueline Flowers, Lauren Franz, Adrianne Harris, Jill Howard, Sam Perochon, Eliana M Perrin, Pradeep Raj, Krishnappa Babu, Marina Spanos, Connor Sullivan, Barbara K Walter, Scott H Kollins, Geraldine Dawson, and Guillermo Sapiro. 2021. Computational Methods to Measure Patterns of Gaze in Toddlers With Autism Spectrum Disorder. (2021), 1–10.
[8]
John N. Constantino. 2021. Social Responsiveness Scale. In Encyclopedia of Autism Spectrum Disorders.
[9]
Hayley Crawford, Joanna Moss, Chris Oliver, Natasha Elliott, Giles M. Anderson, and Joseph P. McCleery. 2016. Visual preference for social stimuli in individuals with autism or neurodevelopmental disorders: An eye-tracking study. Mol. Autism 7, 1 (April 2016), 1–12.
[10]
Mihaly Csikszentmihalyi. 2014. Play and intrinsic rewards. In Flow and the Foundations of Positive Psychology: The Collected Works of Mihaly Csikszentmihalyi. 135–153.
[11]
Anders Dechsling, Stian Orm, Tamara Kalandadze, Stefan Sütterlin, Roald A. Øien, Frederick Shic, and Anders Nordahl-Hansen. 2021. Virtual and Augmented Reality in Social Skills Interventions for Individuals with Autism Spectrum Disorder: A Scoping Review. J. Autism Dev. Disord. (2021).
[12]
Christina M. Finneran and Ping Zhang. 2005. Flow in Computer-Mediated Environments: Promises and Challenges. Commun. Assoc. Inf. Syst. 15, 1 (2005), 4.
[13]
Ouriel Grynszpan, Patrice L. Weiss, Fernando Perez-Diaz, and Eynat Gal. 2014. Innovative technology-based interventions for autism spectrum disorders: A meta-analysis. Autism 18, 346–361.
[14]
Stefan G. Hofmann and Jasper A.J. Smits. 2008. Cognitive-behavioral therapy for adult anxiety disorders: A meta-analysis of randomized placebo-controlled trials. J. Clin. Psychiatry 69, 4 (2008), 621–632.
[15]
Pradeep Raj Krishnappa Babu and Uttama Lahiri. 2019. Understanding the role of Proximity and Eye gaze in human–computer interaction for individuals with autism. Journal of Ambient Intelligence and Humanized Computing.
[16]
Pradeep Raj Krishnappa Babu, Poojan Oza, and Uttama Lahiri. 2018. Gaze-sensitive virtual reality based social communication platform for individuals with autism. IEEE Trans. Affect. Comput. 9, 4 (2018), 450–462.
[17]
Karunanithi Praveen Kumar and Perumal Sivanesan. 2021. Smart Virtual Reality–Based Gaze-Perceptive Common Communication System for Children With Autism Spectrum Disorder. Cogn. Behav. Hum. Comput. Interact. Based Mach. Learn. Algorithm (December 2021), 117–135.
[18]
Selvia Kuriakose and Uttama Lahiri. 2015. Understanding the Psycho-Physiological Implications of Interaction with a Virtual Reality-Based System in Adolescents with Autism: A Feasibility Study. IEEE Trans. Neural Syst. Rehabil. Eng. 23, 4 (2015), 665–675.
[19]
Adam Naples, Alyssa Nguyen-Phuc, Marika Coffman, Anna Kresse, Susan Faja, Raphael Bernier, and James C. McPartland. 2015. A computer-generated animated face stimulus set for psychophysiological research. Behav. Res. Methods 47, 2 (2015), 562–570.
[20]
Chava Peretz, Amos D. Korczyn, Evelyn Shatil, Vered Aharonson, Smadar Birnboim, and Nir Giladi. 2011. Computer-based, personalized cognitive training versus classical computer games: A randomized double-blind prospective trial of cognitive stimulation. Neuroepidemiology 36, 2 (2011), 91–99.
[21]
Jacqui Rodgers, Deborah M. Riby, Emily Janes, Brenda Connolly, and Helen McConachie. 2012. Anxiety and repetitive behaviours in autism spectrum disorders and Williams syndrome: A cross-syndrome comparison. J. Autism Dev. Disord. 42, 2 (2012), 175–180.
[22]
Frank J. Sansosti and Kelly A. Powell-Smith. 2008. Using computer-presented social stories and video models to increase the social communication skills of children with high-functioning autism spectrum disorders. J. Posit. Behav. Interv. 10, 3 (2008), 162–178.
[23]
Matthew Schmidt and Noah Glaser. 2021. Investigating the usability and learner experience of a virtual reality adaptive skills intervention for adults with autism spectrum disorder. Educ. Technol. Res. Dev. 69, 3 (June 2021), 1665–1699.
[24]
Sarah J. Schubert, Christopher W. Lee, and Peter D. Drummond. 2011. The efficacy and psychophysiological correlates of dual-attention tasks in eye movement desensitization and reprocessing (EMDR). J. Anxiety Disord. 25, 1 (2011), 1–11.
[25]
Leigh Sepeta, Naotsugu Tsuchiya, Mari S. Davies, Marian Sigman, Susan Y. Bookheimer, and Mirella Dapretto. 2012. Abnormal social reward processing in autism as indexed by pupillary responses to happy faces. J. Neurodev. Disord. 4, 1 (2012), 1–9.
[26]
Rafael Silva, Duarte Duque, Miguel Melo, and Joao Martinho Moura. 2021. The Benefits of Virtual Reality Technology for Rehabilitation of Children with Autism: A Systematic Review. (December 2021), 1–8.
[27]
Vítor Simões-Silva, António Marques, Catarina Pinho, Diana Gonçalves Pereira, Joana Ferreira Oliveira, and Maria Luísa Barros. 2022. Gamification Applied to Autism Spectrum Disorder. Digit. Ther. Psychosoc. Rehabil. Ment. Heal. (January 2022), 163–186.
[28]
Anne Snow. 2021. Social Communication Questionnaire. In Encyclopedia of Autism Spectrum Disorders. 4427–4429.
[29]
Mohammad Soleymani, Jeroen Lichtenauer, Thierry Pun, and Maja Pantic. 2012. A multimodal database for affect recognition and implicit tagging. IEEE Trans. Affect. Comput. 3, 1 (2012), 42–55.
[30]
Mirko Uljarevic and Antonia Hamilton. 2013. Recognition of emotions in autism: A formal meta-analysis. J. Autism Dev. Disord. 43, 7 (2013), 1517–1526.
[31]
Andrius Vabalas and Megan Freeth. 2016. Brief Report: Patterns of Eye Movements in Face to Face Conversation are Associated with Autistic Traits: Evidence from a Student Sample. J. Autism Dev. Disord. 46, 1 (2016), 305–314.
[32]
Maryam Zahabi and Ashiq Mohammed Abdul Razak. 2020. Adaptive virtual reality-based training: a systematic literature review and framework. Virtual Real. 24, 4 (2020), 725–752.
[33]
Kun Zhang, Yishuang Yuan, Jingying Chen, Guangshuai Wang, Qian Chen, and Meijuan Luo. 2022. Eye Tracking Research on the Influence of Spatial Frequency and Inversion Effect on Facial Expression Processing in Children with Autism Spectrum Disorder. Brain Sci. 12, 2 (February 2022), 283.
[34]
Autism and Social Skills Development | Autism Speaks. Retrieved June 7, 2021 from https://www.autismspeaks.org/tool-kit-excerpt/autism-and-social-skills-development

Cited By

View all
  • (2023)The Use of Explainable Sensor Systems in Classroom Settings - Teacher, Student and Parent Voices on the Value of Sensor SystemsUniversal Access in Human-Computer Interaction10.1007/978-3-031-35897-5_33(453-468)Online publication date: 23-Jul-2023

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
CHI EA '22: Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems
April 2022
3066 pages
ISBN:9781450391566
DOI:10.1145/3491101
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 April 2022

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Affective Computing
  2. Anxiety
  3. Autism
  4. Flow Theory
  5. Looking Pattern
  6. Virtual Reality

Qualifiers

  • Poster
  • Research
  • Refereed limited

Conference

CHI '22
Sponsor:
CHI '22: CHI Conference on Human Factors in Computing Systems
April 29 - May 5, 2022
LA, New Orleans, USA

Acceptance Rates

Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Upcoming Conference

CHI 2025
ACM CHI Conference on Human Factors in Computing Systems
April 26 - May 1, 2025
Yokohama , Japan

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)65
  • Downloads (Last 6 weeks)1
Reflects downloads up to 19 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2023)The Use of Explainable Sensor Systems in Classroom Settings - Teacher, Student and Parent Voices on the Value of Sensor SystemsUniversal Access in Human-Computer Interaction10.1007/978-3-031-35897-5_33(453-468)Online publication date: 23-Jul-2023

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media