short-paper

Multimodal Affect and Aesthetic Experience

Authors:

Theodoros Kostoulas,

Michal Muszynski,

Theodora Chaspari,

Panos AmelidisAuthors Info & Claims

ICMI '20: Proceedings of the 2020 International Conference on Multimodal Interaction

Pages 888 - 889

https://doi.org/10.1145/3382507.3420055

Published: 22 October 2020 Publication History

Abstract

The term 'aesthetic experience' corresponds to the inner state of a person exposed to form and content of artistic objects. Exploring certain aesthetic values of artistic objects, as well as interpreting the aesthetic experience of people when exposed to art can contribute towards understanding (a) art and (b) people's affective reactions to artwork. Focusing on different types of artistic content, such as movies, music, urban art and other artwork, the goal of this workshop is to enhance the interdisciplinary collaboration between affective computing and aesthetics researchers.

References

[1]

André Bazin. 1967. What Is Cinema? Hugh Gray (Berkeley, CA: University of California Press, 1967): 14.

[2]

Theodora Chaspari, Andreas Tsiartas, Leah I. Stein, Sharon A. Cermak, and Shrikanth S. Narayanan. 2015. Sparse Representation of Electrodermal Activity With Knowledge-Driven Dictionaries. IEEE Transactions on Biomedical Engineering 62, 3: 960--971. https://doi.org/10.1109/TBME.2014.2376960

[3]

Gerald C Cupchik, Oshin Vartanian, Adrian Crawley, and David J Mikulis. 2009. Viewing artworks: contributions of cognitive control and perceptual facilitation to aesthetic experience. Brain and cognition 70, 1: 84--91.

[4]

Connor Fletcher, Vedad Hulusic, and Panos Amelidis. 2019. Virtual reality ear training system: A study on spatialised audio in interval recognition. In 2019 11th International Conference on Virtual Worlds and Games for Serious Applications, VS-Games 2019 - Proceedings, 1DUUMY. https://doi.org/10.1109/VS-Games.2019.8864592

[5]

Jinwoo Kim, Megha Yadav, Changbum R. Ahn, and Theodora Chaspari. 2019. Saliency Detection Analysis of Pedestrians? Physiological Responses to Assess Adverse Built Environment Features. In Computing in Civil Engineering 2019: Smart Cities, Sustainability, and Resilience - Selected Papers from the ASCE International Conference on Computing in Civil Engineering 2019, 90--97. https://doi.org/10.1061/9780784482445.012

[6]

Jinwoo Kim, Megha Yadav, Theodora Chaspari, and Changbum R. Ahn. 2020. Saliency detection analysis of collective physiological responses of pedestrians to evaluate neighborhood built environments. Advanced Engineering Informatics 43: 101035. https://doi.org/10.1016/j.aei.2020.101035

Digital Library

[7]

Theodoros Kostoulas, Guillaume Chanel, Michal Muszynski, Patrizia Lombardo, and Thierry Pun. 2015. Dynamic Time Warping of Multimodal Signals for Detecting Highlights in Movies. In Proceedings of the 1st Workshop on Modeling INTERPERsonal SynchrONy And infLuence, ICMI 2015, 35--40.

Digital Library

[8]

Theodoros Kostoulas, Guillaume Chanel, Michal Muszynski, Patrizia Lombardo, and Thierry Pun. 2015. Identifying aesthetic highlights in movies from clustering of physiological and behavioral signals. In Quality of Multimedia Experience (QoMEX), 2015 Seventh International Workshop on, IEEE.

[9]

Theodoros Kostoulas, Guillaume Chanel, Michal Muszynski, Patrizia Lombardo, and Thierry Pun. 2017. Films, Affective Computing and Aesthetic Experience: Identifying Emotional and Aesthetic Highlights from Multimodal Signals in a Social Setting. Frontiers in ICT 4: 11. https://doi.org/10.3389/fict.2017.00011

[10]

Eleni Kroupi, J-M Vesin, and Touradj Ebrahimi. 2013. Phase-Amplitude Coupling between EEG and EDA while experiencing multimedia content. In Affective Computing and Intelligent Interaction (ACII), 2013 Humaine Association Conference on, 865--870.

Digital Library

[11]

Patrizia Lombardo. 2011. {É}motion et souvenir chez Aldo Rossi. Faces-Journal d'Architecture, 69: 34.

[12]

Patrizia Lombardo. 2014. Literature, Emotions, and the Possible: Hazlitt and Stendhal. In Mind, Values, and Metaphysics. Springer, 117--134.

[13]

Slobodan Markovic. 2012. Components of aesthetic experience: aesthetic fascination, aesthetic appraisal, and aesthetic emotion. i-Perception 3, 1: 1--17.

[14]

Michal Muszynski. 2018. Recognizing film aesthetics, spectators' affect and aesthetic emotions from multimodal signals. https://doi.org/10.13097/ARCHIVE-OUVERTE/UNIGE:114609

[15]

Michal Muszynski, Theodoros Kostoulas, Guillaume Chanel, Patrizia Lombardo, and Thierry Pun. 2015. Spectators? Synchronization Detection based on Manifold Representation of Physiological Signals: Application to Movie Highlights Detection. In Proceedings of the 2015 ACM on International Conference on Multimodal Interaction, 235--238.

Digital Library

[16]

Michal Muszynski, Leimin Tian, Catherine Lai, Johanna Moore, Theodoros Kostoulas, Patrizia Lombardo, Thierry Pun, and Guillaume Chanel. 2019. Recognizing Induced Emotions of Movie Audiences From Multimodal Information. IEEE Transactions on Affective Computing: 1--1. https://doi.org/10.1109/taffc.2019.2902091

[17]

Andrew Ortony, Gerald L Clore, and Allan Collins. 1990. The cognitive structure of emotions.

[18]

Klaus R Scherer. 2003. Introduction: Cognitive components of emotion.

[19]

Leimin Tian, Michal Muszynski, Catherine Lai, Johanna D. Moore, Theodoros Kostoulas, Patrizia Lombardo, Thierry Pun, and Guillaume Chanel. 2017. Recognizing induced emotions of movie audiences: Are induced and perceived emotions the same? In 2017 Seventh International Conference on Affective Computing and Intelligent Interaction (ACII), 28--35. https://doi.org/10.1109/ACII.2017.8273575

[20]

Megha Yadav, Theodora Chaspari, Jinwoo Kim, and Changbum R. Ahn. 2018. Capturing and quantifying emotional distress in the built environment. In Proceedings of the Human-Habitat for Health (H3): Human-Habitat Multimodal Interaction for Promoting Health and Well-Being in the Internet of Things era - 20th ACM International Conference on Multimodal Interaction, ICMI 2018, 1--8. https://doi.org/10.1145/3279963.3279967

Cited By

Muszynski MKostoulas TTian LRoman-Rangel EChaspari TAmelidis P(2023)4th International Workshop on Multimodal Affect and Aesthetic ExperienceProceedings of the 25th International Conference on Multimodal Interaction10.1145/3577190.3616886(814-815)Online publication date: 9-Oct-2023
https://dl.acm.org/doi/10.1145/3577190.3616886
Zheng WYan LWang F(2023)Two Birds With One Stone: Knowledge-Embedded Temporal Convolutional Transformer for Depression Detection and Emotion RecognitionIEEE Transactions on Affective Computing10.1109/TAFFC.2023.328270414:4(2595-2613)Online publication date: 1-Oct-2023
https://doi.org/10.1109/TAFFC.2023.3282704
Kiose MLeonteva AAgafonova O(2022)Aesthetic multimodality of speech and gesture: Towards its functional frameworkLanguages and Modalities10.3897/lamo.2.788402(1-17)Online publication date: 17-May-2022
https://doi.org/10.3897/lamo.2.78840
Show More Cited By

Index Terms

Multimodal Affect and Aesthetic Experience
1. Computing methodologies
  1. Artificial intelligence

Recommendations

4th International Workshop on Multimodal Affect and Aesthetic Experience
ICMI '23: Proceedings of the 25th International Conference on Multimodal Interaction

“Aesthetic experience” corresponds to the inner state of a person exposed to the form and content of artistic objects. Quantifying and interpreting the aesthetic experience of people in various contexts contribute towards a) creating context, and b) ...
Multimodal Affect and Aesthetic Experience
ICMI '22: Proceedings of the 2022 International Conference on Multimodal Interaction

The term “aesthetic experience” corresponds to the inner state of a person exposed to the form and content of artistic objects. Quantifying and interpreting the aesthetic experience of people in different contexts can contribute towards (a) creating ...
Designing for Aesthetic Experience
C&C '21: Proceedings of the 13th Conference on Creativity and Cognition

Digital ways of representing fine art are significantly changing the way art is put on display. New exhibition formats including digital projections of fine art allow us to rethink how we can use technology to create art experiences. However, ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ICMI '20: Proceedings of the 2020 International Conference on Multimodal Interaction

October 2020

920 pages

ISBN:9781450375818

DOI:10.1145/3382507

General Chairs:
Khiet Truong
University of Twente, the Netherlands
,
Dirk Heylen
University of Twente, the Netherlands
,
Mary Czerwinski
Microsoft Research, USA
,
Program Chairs:
Nadia Berthouze
University College London, United Kingdom
,
Mohamed Chetouani
Sorbonne University, France
,
Mikio Nakano
C4A Research Institute, Japan

Copyright © 2020 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 22 October 2020

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper

Conference

ICMI '20

Sponsor:

SIGCHI

ICMI '20: INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION

October 25 - 29, 2020

Virtual Event, Netherlands

Acceptance Rates

Overall Acceptance Rate 453 of 1,080 submissions, 42%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
149
Total Downloads

Downloads (Last 12 months)8
Downloads (Last 6 weeks)2

Reflects downloads up to 10 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Muszynski MKostoulas TTian LRoman-Rangel EChaspari TAmelidis P(2023)4th International Workshop on Multimodal Affect and Aesthetic ExperienceProceedings of the 25th International Conference on Multimodal Interaction10.1145/3577190.3616886(814-815)Online publication date: 9-Oct-2023
Zheng WYan LWang F(2023)Two Birds With One Stone: Knowledge-Embedded Temporal Convolutional Transformer for Depression Detection and Emotion RecognitionIEEE Transactions on Affective Computing10.1109/TAFFC.2023.328270414:4(2595-2613)Online publication date: 1-Oct-2023
Kiose MLeonteva AAgafonova O(2022)Aesthetic multimodality of speech and gesture: Towards its functional frameworkLanguages and Modalities10.3897/lamo.2.788402(1-17)Online publication date: 17-May-2022
Kostoulas TMuszynski MTian LRoman-Rangel EChaspari TAmelidis P(2022)Multimodal Affect and Aesthetic ExperienceProceedings of the 2022 International Conference on Multimodal Interaction10.1145/3536221.3564035(797-798)Online publication date: 7-Nov-2022
Tian LOviatt SMuszynski MChamberlain BHealey JSano A(2022)Applied Affective ComputingundefinedOnline publication date: 25-Jan-2022

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents