research-article

Temporal dynamics of multimodal multiparty interactions: a microgenesis of early social interaction

Authors:

Kaya de Barbaro,

Christine M. Johnson,

Deborah Forster,

Gedeon O. DeákAuthors Info & Claims

MB '10: Proceedings of the 7th International Conference on Methods and Techniques in Behavioral Research

Article No.: 36, Pages 1 - 3

https://doi.org/10.1145/1931344.1931380

Published: 24 August 2010 Publication History

Get Access

Abstract

This project characterizes the development of early social interactions in a longitudinal sample of mothers and their infants. To do this we track the interaction in as a temporal configuration of multimodal, multiparty components, coding a total of 14 dimensions at each frame. Our final goal is to develop methods which we can use to systematically document regularities in the way attention gets organized longitudinally in a large sample of mother-infant dyads. Coding systematically at this scale allows us to ground a developmental account of early social interaction. For this project, we developed 1) ways to reduce the labor intensity of coding frame-by-frame multidimensional data over the entire sample and 2)ways of quantifying complex configural regularities across our sample.

References

[1]

Bakeman, R. and Adamson, L. Coordinating attention to people and objects in mother-infant and peer-infant interaction. Child Development, 55, 4 (1984), 1278--1289.

Crossref

Google Scholar

[2]

Fogel, A. and DeKoeyer-Laros, I. The Developmental Transition to Secondary Intersubjectivity in the Second Half Year: A Microgenetic Case Study. Journal of Developmental Processes, 2 (2007), 63--90.

Google Scholar

[3]

Adamson, L. and Bakeman, R. The development of shared attention during infancy. Annals of child development, 8(1991), 1--41.

Google Scholar

[4]

Tomasello, M., et al., Understanding and sharing intentions: The origins of cultural cognition. Behavioral and Brain Sciences, 28, 5 (2005), 675--691.

Crossref

Google Scholar

[5]

Johnson, C. M. Distributed primate cognition: A review. Animal Cognition, 3, 4 (2001), 167--183.

Crossref

Google Scholar

[6]

Forster, D. and P. F. Rodriguez, Social Complexity and Distributed Cognition in Olive Baboons (Papio anubis): Adding System Dynamics to Analysis of Interaction Data. Aquatic Mammals, 32, 4 (2006), 528--543.

Crossref

Google Scholar

Cited By

View all

Keller ISchmuck MLohan K(2016)Towards a model for automatic action recognition for social robot companions2016 25th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN)10.1109/ROMAN.2016.7745094(85-90)Online publication date: Aug-2016
https://doi.org/10.1109/ROMAN.2016.7745094

Index Terms

Temporal dynamics of multimodal multiparty interactions: a microgenesis of early social interaction
1. Applied computing
  1. Law, social and behavioral sciences
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Web-based interaction

Recommendations

Human-robot collaborative tutoring using multiparty multimodal spoken dialogue
HRI '14: Proceedings of the 2014 ACM/IEEE international conference on Human-robot interaction

In this paper, we describe a project that explores a novel experimental setup towards building a spoken, multi-modally rich, and human-like multiparty tutoring robot. A human-robot interaction setup is designed, and a human-human dialogue corpus is ...
Multimodal Interaction During Multiparty Dialogues: Initial Results
ICMI '02: Proceedings of the 4th IEEE International Conference on Multimodal Interfaces

Groups of people involved in collaboration on a task often incorporate the objects in their mutual environment into their discussion. With this comes physical reference to these 3-D objects, including: gesture, gaze, haptics, and possibly other ...
Attention and Engagement Aware Multimodal Conversational Systems
ICMI '15: Proceedings of the 2015 ACM on International Conference on Multimodal Interaction

Despite their ability to complete certain tasks, dialog systems still suffer from poor adaptation to users' engagement and attention. We observe human behaviors in different conversational settings to understand human communication dynamics and then ...

Comments

Information & Contributors

Information

Published In

MB '10: Proceedings of the 7th International Conference on Methods and Techniques in Behavioral Research

August 2010

183 pages

ISBN:9781605589268

DOI:10.1145/1931344

Editors:
Emilia Barakova
User Experiences Department, Philips Research Europe, The Netherlands
,
Boris de Ruyter
Faculty of Industrial Design, Eindhoven University of Technology, The Netherlands
,
Andrew Spink
Noldus Information Technology, The Netherlands

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 24 August 2010

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

Measuring Behavior

Sponsor:

Measuring Behavior: Selected papers from the Proceedings of the 7th International Conference on Methods and Techniques in Behavioral research

August 24 - 27, 2010

Eindhoven, The Netherlands

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
65
Total Downloads

Downloads (Last 12 months)2
Downloads (Last 6 weeks)0

Reflects downloads up to 01 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Keller ISchmuck MLohan K(2016)Towards a model for automatic action recognition for social robot companions2016 25th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN)10.1109/ROMAN.2016.7745094(85-90)Online publication date: Aug-2016
https://doi.org/10.1109/ROMAN.2016.7745094

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Human-robot collaborative tutoring using multiparty multimodal spoken dialogue

Multimodal Interaction During Multiparty Dialogues: Initial Results

Attention and Engagement Aware Multimodal Conversational Systems