Export Citations
Save this search
Please login to be able to save your searches and receive alerts for new content matching your search criteria.
- extended-abstractMay 2024
The Discontent with Intent Estimation In-the-Wild: The Case for Unrealized Intentions
CHI EA '24: Extended Abstracts of the 2024 CHI Conference on Human Factors in Computing SystemsArticle No.: 565, Pages 1–9https://doi.org/10.1145/3613905.3644055The future of socially intelligent systems depends on developing abilities to anticipate and empathize with users. Whilst great strides have been made on developing systems for future behavior forecasting that sometimes also claim to do intention ...
- research-articleMay 2024
Why did this model forecast this future? information-theoretic saliency for counterfactual explanations of probabilistic regression models
NIPS '23: Proceedings of the 37th International Conference on Neural Information Processing SystemsArticle No.: 1443, Pages 33222–33240We propose a post hoc saliency-based explanation framework for counterfactual reasoning in probabilistic multivariate time-series forecasting (regression) settings. Building upon Miller's framework of explanations derived from research in multiple social ...
- research-articleOctober 2023
Encouraging Scientific Collaborations with ConfFlow 2021
ACM SIGMultimedia Records (SIGMM), Volume 14, Issue 1Article No.: 6, Page 1https://doi.org/10.1145/3630646.3630652We often find other collaborators by chance at a conference or by looking for them specifically through their papers. However, sometimes hidden potential social connections might exist between different researchers that cannot be immediately observed ...
- research-articleJuly 2023
Capturing Interaction Quality in Long Duration (Simulated) Space Missions With Wearables
IEEE Transactions on Affective Computing (ITAC), Volume 14, Issue 3Pages 2139–2152https://doi.org/10.1109/TAFFC.2022.3176967Space exploration is evolving with the recent increase in interest and investment. For the success of planned long-duration crewed missions, good interpersonal interactions between crew members are crucial. In this study, we evaluate the use of wearables ...
- research-articleJuly 2023
Individual and Joint Body Movement Assessed by Wearable Sensing as a Predictor of Attraction in Speed Dates
IEEE Transactions on Affective Computing (ITAC), Volume 14, Issue 3Pages 2168–2181https://doi.org/10.1109/TAFFC.2021.3138349Interpersonal attraction is known to motivate behavioral responses in the person experiencing this subjective phenomenon. Such responses may involve the imitation of behavior, as in mirroring or mimicry of postures or gestures, which have been found to be ...
-
- research-articleMay 2023
Impact of Annotation Modality on Label Quality and Model Performance in the Automatic Assessment of Laughter In-the-Wild
IEEE Transactions on Affective Computing (ITAC), Volume 15, Issue 2Pages 519–534https://doi.org/10.1109/TAFFC.2023.3269003Although laughter is known to be a multimodal signal, it is primarily annotated from audio. It is unclear how laughter labels may differ when annotated from modalities like video, which capture body movements and are relevant in in-the-wild studies. In ...
- research-articleApril 2023
Collecting <italic>Mementos</italic>: A Multimodal Dataset for Context-Sensitive Modeling of Affect and Memory Processing in Responses to Videos
IEEE Transactions on Affective Computing (ITAC), Volume 14, Issue 2Pages 1249–1266https://doi.org/10.1109/TAFFC.2021.3089584In this article we introduce <italic>Mementos</italic>: the first multimodal corpus for computational modeling of affect and memory processing in response to video content. It was collected online via crowdsourcing and captures 1995 individual responses ...
- research-articleJanuary 2023
Perceived Conversation Quality in Spontaneous Interactions
IEEE Transactions on Affective Computing (ITAC), Volume 14, Issue 4Pages 2901–2912https://doi.org/10.1109/TAFFC.2023.3233950The quality of daily spontaneous conversations is of importance towards both our well-being as well as the development of interactive social agents. Prior research directly studying the quality of social conversations has operationalized it in narrow ...
- research-articleDecember 2022
Encouraging more Diverse Scientific Collaborations with the ConfFlow application
ACM SIGMultimedia Records (SIGMM), Volume 13, Issue 2Article No.: 2, Page 1https://doi.org/10.1145/3577941.3577943ConfFlow is an application to encourage people with similar or complementary research interests to find each other at conferences. How scientific collaborations are initiated, how people meet and how an intention is developed to work together is an open ...
- research-articleApril 2024
ConfLab: a data collection concept, dataset, and benchmark for machine analysis of free-standing social interactions in the wild
NIPS '22: Proceedings of the 36th International Conference on Neural Information Processing SystemsArticle No.: 1722, Pages 23701–23715Recording the dynamics of unscripted human interactions in the wild is challenging due to the delicate trade-offs between several factors: participant privacy, ecological validity, data fidelity, and logistical overheads. To address these, following a ...
- research-articleNovember 2022
Conversation Group Detection With Spatio-Temporal Context
ICMI '22: Proceedings of the 2022 International Conference on Multimodal InteractionPages 170–180https://doi.org/10.1145/3536221.3556611In this work, we propose an approach for detecting conversation groups in social scenarios like cocktail parties and networking events, from overhead camera recordings. We posit the detection of conversation groups as a learning problem that could ...
- research-articleNovember 2022
Exploring the Detection of Spontaneous Recollections during Video-viewing In-the-Wild using Facial Behavior Analysis
ICMI '22: Proceedings of the 2022 International Conference on Multimodal InteractionPages 236–246https://doi.org/10.1145/3536221.3556609Intelligent systems might benefit from automatically detecting when a stimulus has triggered a user’s recollection of personal memories, e.g., to identify that a piece of media content holds personal significance for them. While computational research ...
- ArticleFebruary 2023
Social Processes: Self-supervised Meta-learning Over Conversational Groups for Forecasting Nonverbal Social Cues
AbstractFree-standing social conversations constitute a yet underexplored setting for human behavior forecasting. While the task of predicting pedestrian trajectories has received much recent attention, an intrinsic difference between these settings is ...
- keynoteOctober 2022
Tools for Collecting, Synchronizing, and Annotating Ecologically Valid Social Behavior In-the-Wild
M4MM '22: Proceedings of the 1st International Workshop on Methodologies for MultimediaPage 1https://doi.org/10.1145/3552487.3556436So many Multimedia Systems are designed for the online world. We may be led to believe that the real world we live in now already exists online. When I talk about the online world, I am referring to the countless images and videos, which are commonly ...
- abstractOctober 2021
Insights on Group and Team Dynamics
ICMI '21: Proceedings of the 2021 International Conference on Multimodal InteractionPages 855–856https://doi.org/10.1145/3462244.3480976We are organizing again the workshop on Interdisciplinary Insights into Group and Team Dynamics which is a joint effort between researchers in the the ICMI and INGRoup (Interdisciplinary Network for Group Research) communities. This workshop aims to ...
- research-articleOctober 2021
Recognizing Perceived Interdependence in Face-to-Face Negotiations through Multimodal Analysis of Nonverbal Behavior
ICMI '21: Proceedings of the 2021 International Conference on Multimodal InteractionPages 121–130https://doi.org/10.1145/3462244.3479935Enabling computer-based applications to display intelligent behavior in complex social settings requires them to relate to important aspects of how humans experience and understand such situations. One crucial driver of peoples’ social behavior during ...
- panelOctober 2021
Social Signals and Multimedia: Past, Present, Future
- Hayley Hung,
- Cathal Gurrin,
- Martha Larson,
- Hatice Gunes,
- Fabien Ringeval,
- Elisabeth Andre,
- Louis-Philippe Morency
MM '21: Proceedings of the 29th ACM International Conference on MultimediaPages 4610–4612https://doi.org/10.1145/3474085.3480024The rising popularity of Artificial Intelligence (AI) has brought considerable public interest as well faster and more direct transfer of research ideas into practice. One of the aspects of AI that still trails behind considerably is the role of ...
- abstractMay 2021
Facial Feedback for Reinforcement Learning: A Case Study and Offline Analysis Using the TAMER Framework
AAMAS '21: Proceedings of the 20th International Conference on Autonomous Agents and MultiAgent SystemsPages 1735–1737Interactive reinforcement learning provides a way for agents to learn to solve tasks from evaluative feedback provided by a human user. Previous research showed that humans give copious feedback early in training but very sparsely thereafter. In this ...
- research-articleMarch 2021
Multimodal Joint Head Orientation Estimation in Interacting Groups via Proxemics and Interaction Dynamics
Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT), Volume 5, Issue 1Article No.: 35, Pages 1–22https://doi.org/10.1145/3448122Human head orientation estimation has been of interest because head orientation serves as a cue to directed social attention. Most existing approaches rely on visual and high-fidelity sensor inputs and deep learning strategies that do not consider the ...
- ArticleJanuary 2021
ReproducedPapers.org: Openly Teaching and Structuring Machine Learning Reproducibility
- Burak Yildiz,
- Hayley Hung,
- Jesse H. Krijthe,
- Cynthia C. S. Liem,
- Marco Loog,
- Gosia Migut,
- Frans A. Oliehoek,
- Annibale Panichella,
- Przemysław Pawełczak,
- Stjepan Picek,
- Mathijs de Weerdt,
- Jan van Gemert
AbstractWe present : an open online repository for teaching and structuring machine learning reproducibility. We evaluate doing a reproduction project among students and the added value of an online reproduction repository among AI ...