Article

Extracting information about emotions in films

Authors:

Andrew Salway and

Mike GrahamAuthors Info & Claims

MULTIMEDIA '03: Proceedings of the eleventh ACM international conference on Multimedia

November 2003

Pages 299 - 302

https://doi.org/10.1145/957013.957076

Published: 02 November 2003 Publication History

Get Access

Abstract

We present a method being developed to extract information about characters' emotions in films. It is suggested that this information can help describe higher levels of multimedia semantics relating to narrative structures. Our method extracts information from audio description that is provided for the visually-impaired with an increasing number of films. The method is based on a cognitive theory of emotions that links a character's emotional states to the events in their environment. In this paper the method is described along with some preliminary evaluation and discussions about the kinds of novel video retrieval and browsing applications it may support.

References

[1]

Allen, R. B. and Acheson, J. Browsing the Structure of Multimedia Stories. In Procs. 5th ACM Conference on Digital Libraries, 11--18. ACM Press, New York, 2000.

Digital Library

Google Scholar

[2]

Bordwell, D. and Thompson, K. Film Art: An Introduction. McGraw-Hill 5th Edition, New York, 1997.

Google Scholar

[3]

Dorai, C. and Venkatesh, S. Computational Media Aesthetics: Finding Meaning Beautiful! IEEE Multimedia 8(4), 10--12, (Oct.-Dec. 2001).

Digital Library

Google Scholar

[4]

Ortony A., Clore G. L. and Collins A. The Cognitive Structure of Emotions. Cambridge University Press, 1988.

Crossref

Google Scholar

[5]

Roth, V. Content-based retrieval from digital video. Image and Vision Computing 17, 531--540 (1999).

Crossref

Google Scholar

[6]

Salway, A., Graham, M., Tomadaki, E. and Xu, Y. Integrating Video and Text via Representations of Narrative. In Procs. AAAI Spring Symposium 2003, Intelligent Multimedia Knowledge Management.

Google Scholar

[7]

TIWO - Television in Words, EPSRC research project, www.computing.surrey.ac.uk/ckm/tiwo_project/Index.html <http://www.computing.surrey.ac.uk/ckm/tiwo_project/Index.html>

Google Scholar

[8]

WordNet - online lexical reference system, <http://www.cogsci.princeton.edu/~wn/>

Google Scholar

Cited By

View all

Nevsky ANeate TSimperl EVatavu R(2023)Accessibility Research in Digital Audiovisual Media: What Has Been Achieved and What Should Be Done Next?Proceedings of the 2023 ACM International Conference on Interactive Media Experiences10.1145/3573381.3596159(94-114)Online publication date: 12-Jun-2023
https://dl.acm.org/doi/10.1145/3573381.3596159
Lam Sut I MLam Sut I M(2023)IntroductionA Corpus-assisted Multimodal Analysis to Policy Addresses of Macao SAR Government10.1007/978-981-99-1195-0_1(1-15)Online publication date: 27-May-2023
https://doi.org/10.1007/978-981-99-1195-0_1
Piçarra NReis EChambel TArriaga P(2022)Searching, Navigating, and Recommending Movies through Emotions: A Scoping ReviewHuman Behavior and Emerging Technologies10.1155/2022/78310132022(1-24)Online publication date: 2-Dec-2022
https://doi.org/10.1155/2022/7831013
Show More Cited By

Index Terms

Extracting information about emotions in films
1. Information systems
  1. Information retrieval
    1. Document representation
  2. Information systems applications
    1. Multimedia information systems

Recommendations

Electrical properties of Carbon Nitride thin films: role of morphology and Hydrogen content

The influence of hydrogen content and ambient humidity on the electrical properties of carbon nitride (CN_x) films deposited by reactive magnetron sputtering from a graphite target in Ar discharges mixed with N₂ and H₂ at a substrate temperature of 350°C ...
Read More
Sharing emotions: determining films’ evoked emotional experience from their online reviews
Abstract
Online reviews are broadly believed to reflect consumers’ opinions towards the reviewed items. In this work, we postulate that online reviews for experience goods also reflect something very different, the reviewer’s emotions while experiencing ...
Read More
Associating characters with events in films
CIVR '07: Proceedings of the 6th ACM international conference on Image and video retrieval

The work presented here combines the analysis of a film's audiovisual features with the analysis of an accompanying audio description. Specifically, we describe a technique for semantic-based indexing of feature films that associates character names ...
Read More

Comments

Information & Contributors

Information

Published In

MULTIMEDIA '03: Proceedings of the eleventh ACM international conference on Multimedia

November 2003

670 pages

ISBN:1581137222

DOI:10.1145/957013

General Chairs:
Lawrence Rowe
University of California, Berkeley
,
Harrick Vin
University of Texas, Austin
,
Program Chairs:
Thomas Plagemann
University of Oslo
,
Prashant Shenoy
University of Massachusetts, Amherst
,
John R. Smith
IBM T.J. Watson Research Center

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 November 2003

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

MM03

Sponsor:

MM03: 2003 11th Annual ACM International Conference on Multimedia

November 2 - 8, 2003

CA, Berkeley, USA

Acceptance Rates

Overall Acceptance Rate 995 of 4,171 submissions, 24%

Upcoming Conference

MM '24

Sponsor:
sigmm

The 32nd ACM International Conference on Multimedia

October 28 - November 1, 2024

Melbourne , VIC , Australia

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

37
Total Citations
View Citations
1,456
Total Downloads

Downloads (Last 12 months)24
Downloads (Last 6 weeks)2

Other Metrics

View Author Metrics

Citations

Cited By

View all

Nevsky ANeate TSimperl EVatavu R(2023)Accessibility Research in Digital Audiovisual Media: What Has Been Achieved and What Should Be Done Next?Proceedings of the 2023 ACM International Conference on Interactive Media Experiences10.1145/3573381.3596159(94-114)Online publication date: 12-Jun-2023
https://dl.acm.org/doi/10.1145/3573381.3596159
Lam Sut I MLam Sut I M(2023)IntroductionA Corpus-assisted Multimodal Analysis to Policy Addresses of Macao SAR Government10.1007/978-981-99-1195-0_1(1-15)Online publication date: 27-May-2023
https://doi.org/10.1007/978-981-99-1195-0_1
Piçarra NReis EChambel TArriaga P(2022)Searching, Navigating, and Recommending Movies through Emotions: A Scoping ReviewHuman Behavior and Emerging Technologies10.1155/2022/78310132022(1-24)Online publication date: 2-Dec-2022
https://doi.org/10.1155/2022/7831013
Theo LBechan N(2021) Degrees of becoming on recent Netflix docu-shows: Representations of women in Unbelievable and Mercury 13 vs. The Keepers and The Staircase Journal of Popular Television10.1386/jptv_00048_19:2(179-193)Online publication date: 1-Jun-2021
https://doi.org/10.1386/jptv_00048_1
Ronfard R(2021)Film Directing for Computer Games and AnimationComputer Graphics Forum10.1111/cgf.14266340:2(713-730)Online publication date: 4-Jun-2021
https://doi.org/10.1111/cgf.142663
Szajerman DNapieralski PLecointe J(2018)Joint analysis of simultaneous EEG and eye tracking data for video imagesCOMPEL - The international journal for computation and mathematics in electrical and electronic engineering10.1108/COMPEL-07-2018-028137:5(1870-1884)Online publication date: 3-Sep-2018
https://doi.org/10.1108/COMPEL-07-2018-0281
Dorai C(2018)Computational Media AestheticsEncyclopedia of Database Systems10.1007/978-1-4614-8265-9_1036(544-547)Online publication date: 7-Dec-2018
https://doi.org/10.1007/978-1-4614-8265-9_1036
Szajerman DNapieralski P(2017)Joint analysis of simultaneous EEG and eye tracking data for video picture2017 18th International Symposium on Electromagnetic Fields in Mechatronics, Electrical and Electronic Engineering (ISEF) Book of Abstracts10.1109/ISEF.2017.8090693(1-2)Online publication date: Sep-2017
https://doi.org/10.1109/ISEF.2017.8090693
Hou YXiao TZhang SJiang XLi XHu XHan JGuo LMiller LNeupert RLiu T(2016)Predicting Movie Trailer Viewer's “Like/Dislike” via Learned Shot Editing PatternsIEEE Transactions on Affective Computing10.1109/TAFFC.2015.24443717:1(29-44)Online publication date: 1-Jan-2016
https://dl.acm.org/doi/10.1109/TAFFC.2015.2444371
Dorai C(2016)Computational Media AestheticsEncyclopedia of Database Systems10.1007/978-1-4899-7993-3_1036-2(1-4)Online publication date: 1-Dec-2016
https://doi.org/10.1007/978-1-4899-7993-3_1036-2
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Electrical properties of Carbon Nitride thin films: role of morphology and Hydrogen content

Sharing emotions: determining films’ evoked emotional experience from their online reviews

Associating characters with events in films