Abstract
This paper describes the design and development of both software to create social interaction modules on a virtual reality (VR) platform and individualized affective models for affect recognition of children with autism spectrum disorders (ASD), which includes developing tasks for affect elicitation and using machine-learning mathematical tools for reliable affect recognition. A VR system will be formulated that can present realistic social communication tasks to the children with ASD and can monitor their affective response using physiological signals, such as cardiovascular activities including electrocardiogram, impedance cardiogram, photoplethysmogram, and phonocardiogram; electrodermal activities including tonic and phasic responses from galvanic skin response; electromyogram activities from corrugator supercilii, zygomaticus major, and upper trapezius muscles; and peripheral temperature. This affect-sensitive system will be capable of systematically manipulating aspects of social communication to more fully understand its salient components for children with ASD.
Chapter PDF
Similar content being viewed by others
References
Rogers, S.J.: Interventions That Facilitate Socialization in Children with Autism. Journal of Autism and Developmental Disorders 30(5), 399–409 (2000)
Parsons, S., Mitchell, P.: The potential of virtual reality in social skills training for people with autistic spectrum disorders. J. Intellect. Disabil. Res. 46(Pt 5), 430–443 (2002)
Bernard-Opitz, V., Sriram, N., Nakhoda-Sapuan, S.: Enhancing social problem solving in children with autism and normal children through computer-assisted instruction. J. Autism. Dev. Disord. 31(4), 377–384 (2001)
Blocher, K., Picard, R.W.: Affective social quest: emotion recognition therapy for autistic children. In: Dautenhahn, K., Bond, A.H., Canamero, L., Edmonds, B. (eds.) Socially Intelligent Agents: Creating Relationships with Computers and Robots. Kluwer Academic Publishers, Dordrecht (2002)
Swettenham, J.: Can children with autism be taught to understand false belief using computers? Journal of child psychology and psychiatry, and allied disciplines 37(2) (1996)
Dautenhahn, K., Werry, I.: Towards interactive robots in autism therapy: background, motivation and challenges. Pragmatics & Cognition 12(1), 1–35 (2004)
Kozima, H., Nakagawa, C., Yasuda, Y.: Interactive robots for communication-care: A case-study in autism therapy. In: IEEE International Workshop on Robot and Human Interactive Communication, Nashville, TN, pp. 341–346 (2005)
Michaud, F., Theberge-Turmel, C.: Mobile robotic toys and autism. In: Dautenhahn, K., Bond, A.H., Canamero, L., Edmonds, B. (eds.) Socially Intelligent Agents: Creating Relationships with Computers and Robots, pp. 125–132. Kluwer Academic Publishers, Dordrecht (2002)
Parsons, S., Mitchell, P., Leonard, A.: The use and understanding of virtual environments by adolescents with autistic spectrum disorders. J. Autism. Dev. Disord. 34(4), 449–466 (2004)
Strickland, D., Marcus, L.M., Mesibov, G.B., Hogan, K.: Brief report: two case studies using virtual reality as a learning tool for autistic children. J. Autism. Dev. Disord. 26(6), 651–659 (1996)
Tartaro, A., Cassell, J.: Using Virtual Peer Technology as an Intervention for Children with Autism. In: Lazar, J. (ed.) Towards Universal Usability: Designing Computer Interfaces for Diverse User Populations. John Wiley and Sons, Chichester (2007)
Picard, R.W.: Affective Computing. MIT Press, Cambridge (1997)
Seip, J.A.: Teaching the autistic and developmentally delayed: A guide for staff training and development, Delta, British Columbia (1996)
Hill, E., Berthoz, S., Frith, U.: Brief report: cognitive processing of own emotions in individuals with autistic spectrum disorder and in their relatives. J. Autism. Dev. Disord. 34(2) (2004)
Ben Shalom, D., Mostofsky, S.H., Hazlett, R.L., Goldberg, M.C., Landa, R.J., Faran, Y., McLeod, D.R., Hoehn-Saric, R.: Normal physiological emotions but differences in expression of conscious feelings in children with high-functioning autism. J. Autism. Dev. Disord. 36(3), 395–400 (2006)
Meehan, M., Razzaque, S., Insko, B., Whitton, M., Brooks Jr., F.P.: Review of four studies on the use of physiological reaction as a measure of presence in stressful virtual environments. Applied psychophysiology and biofeedback 30(3), 239–258 (2005)
Bradley, M.: Emotion and motivation. In: Cacioppo, J.T., Tassinary, L.G., Berntson, G. (eds.) Handbook of Psychophysiology. Cambridge University Press, New York (2000)
Bethel, C., Salomon, K., Murphy, R., Burke, J.: Survey of psychophysiology measurements applied to human-robot interaction. In: IEEE International Symposium on Robot and Human Interactive Communication, Jeju, Korea (2007)
Lacey, J.I., Lacey, B.C.: Verification and extension of the principle of autonomic response-stereotypy. The American Journal of Psychology 71(1), 50–73 (1958)
Rani, P., Sims, J., Brackin, R., Sarkar, N.: Online stress detection using psychophysiological signal for implicit human-robot cooperation. Robotica 20(6), 673–686 (2002)
Gillott, A., Furniss, F., Walter, A.: Anxiety in high-functioning children with autism. Autism 5(3), 277–286 (2001)
Ruble, L.A., Robson, D.M.: Individual and environmental determinants of engagement in autism. Journal of Autism and Developmental Disorders 37(8) (2006)
Cobb, S.V.G., Nichols, S., Ramsey, A., Wilson, J.R.: Virtual reality-induced symptoms and effects. Presence 8, 169–186 (1999)
Bancroft, W.J.: Research in Nonverbal Communication and Its Relationship to Pedagogy and Suggestopedia. ERIC (1995)
Groden, J., Diller, A., Bausman, M., Velicer, W., Norman, G., Cautela, J.: The development of a stress survey schedule for persons with autism and other developmental disabilities. J. Autism and Dev. Disord. 31, 207–217 (2001)
Argyle, M., Deal, J.: Eye-contact, distance and Affiliation. Sociometry 28(3) (1965)
Schneiderman, M.H., Ewens, W.L.: The cognitive effects of spatial invasion. The Pacific Sociological Review 14(4), 469–486 (1971)
Conn, K., Liu, C., Sarkar, N., Stone, W., Warren, Z.: Towards affect-sensitive assistive intervention technologies for children with autism. In: Jimmy, O. (ed.) Affective Computing: Focus on Emotion Expression, Synthesis and Recognition, pp. 365–390. I-Tech (2008)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Welch, K.C., Lahiri, U., Liu, C., Weller, R., Sarkar, N., Warren, Z. (2009). An Affect-Sensitive Social Interaction Paradigm Utilizing Virtual Reality Environments for Autism Intervention. In: Jacko, J.A. (eds) Human-Computer Interaction. Ambient, Ubiquitous and Intelligent Interaction. HCI 2009. Lecture Notes in Computer Science, vol 5612. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-02580-8_77
Download citation
DOI: https://doi.org/10.1007/978-3-642-02580-8_77
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-02579-2
Online ISBN: 978-3-642-02580-8
eBook Packages: Computer ScienceComputer Science (R0)