Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/2070481.2070518acmconferencesArticle/Chapter ViewAbstractPublication Pagesicmi-mlmiConference Proceedingsconference-collections
poster

Dynamic perception-production oscillation model in human-machine communication

Published: 14 November 2011 Publication History

Abstract

The goal of the present article is to introduce a new concept of a perception-production timing model in human-machine communication. The model implements a low-level cognitive timing and coordination mechanism. The basic element of the model is a dynamic oscillator capable of tracking reoccurring events in time. The organization of the oscillators in a network is being referred to as the Dynamic Perception-Production Oscillation Model (DPPOM). The DPPOM is largely based on findings in psychological and phonetic experiments on timing in speech perception and production. It consists of two sub-systems, a perception sub-system and a production sub-system. The perception sub-system accounts for information clustering in an input sequence of events. The production sub-system accounts for speech production rhythmically entrained to the input sequence. We propose a system architecture integrating both sub-systems, providing a flexible mechanism for perception-production timing in dialogues. The model's functionality was evaluated in two experiments.

References

[1]
J. Bonaiuto and K. Thórisson. Towards a neurocognitive model of turn taking in multimodal dialog. In M. L. I. Wachsmuth and G. Knoblich, editors, Embodied communication in humans and machines, pages 451--483, New York, 2008. Oxford University Press.
[2]
S. Kopp and I. Wachsmuth. Synthesizing multimodal utterances for conversational agents. Journal of Computer Animation and Virtual Worlds, 15:39--52, 2004.
[3]
E. W. Large. Dynamic representation of musical structure. The Ohio State University, Ohio, 1994.
[4]
S. M. Marcus. Acoustic determinants of perceptual center (p-center) location. Perception & Psychophysics, 30(3):247--256, 1981.
[5]
N. von Steinbüchel, M. Wittmann, and E. Pöppel. Timing in perceptual and motor tasks after disturbances of the brain. In M. Pastor and J. Artieda, editors, Time, internal clocks and movement, pages 281--304. Elsevier Science B.V., 1996.
[6]
M. Wilson and T. Wilson. An oscillator model of the timing of turn-taking. Psychonomic Bulletin and Review, 12(6):957--968, 2005.

Cited By

View all
  • (2019)An End-to-End Conversational Style Matching AgentProceedings of the 19th ACM International Conference on Intelligent Virtual Agents10.1145/3308532.3329473(111-118)Online publication date: 1-Jul-2019
  • (2013)Timing and entrainment of multimodal backchanneling behavior for an embodied conversational agentProceedings of the 15th ACM on International conference on multimodal interaction10.1145/2522848.2522890(181-188)Online publication date: 9-Dec-2013

Index Terms

  1. Dynamic perception-production oscillation model in human-machine communication

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    ICMI '11: Proceedings of the 13th international conference on multimodal interfaces
    November 2011
    432 pages
    ISBN:9781450306416
    DOI:10.1145/2070481
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 14 November 2011

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. dialogue technology
    2. dynamic systems
    3. oscillation
    4. perception
    5. production
    6. rhythm
    7. timing

    Qualifiers

    • Poster

    Conference

    ICMI'11
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 453 of 1,080 submissions, 42%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)2
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 03 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2019)An End-to-End Conversational Style Matching AgentProceedings of the 19th ACM International Conference on Intelligent Virtual Agents10.1145/3308532.3329473(111-118)Online publication date: 1-Jul-2019
    • (2013)Timing and entrainment of multimodal backchanneling behavior for an embodied conversational agentProceedings of the 15th ACM on International conference on multimodal interaction10.1145/2522848.2522890(181-188)Online publication date: 9-Dec-2013

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media