Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/2493432.2493508acmconferencesArticle/Chapter ViewAbstractPublication PagesubicompConference Proceedingsconference-collections
research-article

Predicting audience responses to movie content from electro-dermal activity signals

Published: 08 September 2013 Publication History

Abstract

The ability to assess fine-scale user responses has applications in advertising, content creation, recommendation, and psychology research. Unfortunately, current approaches, such as focus groups and audience surveys, are limited in size and scope. In this paper, we propose a combined biometric sensing and analysis methodology to leverage audience-scale electro-dermal activity (EDA) data for the purpose of evaluating user responses to video. We provide detailed characterization of how temporal physiological responses to video stimulus can be modeled, along with first-of-its-kind audience-scale EDA group experiments in uncontrolled real-world environments. Our study provides insights into the techniques used to analyze EDA, the effectiveness of the different temporal features, and group dynamics of audiences. Our experiments demonstrate the ability to classify movie ratings with accuracy of over 70% on specific films. Results of this study suggest the ability to assess emotional reactions of groups using minimally invasive sensing modalities in uncontrolled environments.

References

[1]
Basis. http://www.mybasis.com/.
[2]
BodyMedia. http://www.bodymedia.com/.
[3]
A. Breska, K. Maoz, and G. Ben-Shakhar. Interstimulus Intervals for Skin Conductance Response Measurement. Psychophysiology, 48:1--4, 2010.
[4]
A. F. Smeaton, and S. Rothwell. Biometric Responses to Music-Rich Segments in Films: The CDVPlex. In Proc. of CBMI, pages 162 --168, June 2009.
[5]
B. Sidis. The Nature and Cause of the Galvanic Phenomenon. The Journal of Abnormal Psychology, 5(2):69--74, 1910.
[6]
C. Kaiser, and R. Roessler. Galvanic Skin Responses To Motion Pictures. Perceptual and Motor Skills, 30:371--374, 1970.
[7]
C. Latulipe, E. Carroll, and D. Lottridge. Love, Hate, Arousal and Engagement: Exploring Audience Responses to Performing Arts. In Proc. of ACM SIGCHI, pages 1845--1854, April 2011.
[8]
C. Lim, C. Rennie, R. Berry, H. Bahramali, I. Lazzaro, B. Manor, and E. Gordon. Decomposing Skin Conductance Into Tonic and Phasic Components. International Journal of Psychophysiology, 25:97--109, 1997.
[9]
C. Lisetti, and F. Nasoz. Using Noninvasive Wearable Computers to Recognize Human Emotions from Physiological Signals. EURASIP Journal on Applied Signal Processing, 11:1672--1687, 2004.
[10]
D. Alexander, C. Trengove, P. Johnston, T. Cooper, J. August, and E. Gordon. Separating Individual Skin Conductance Responses in a Short Interstimulus-Interval Paradigm. Journal of Neuroscience Methods, 146:116--123, 2005.
[11]
D. Bach, J. Daunizeau, N. Kuelzow, K. Friston, and R. Dolan. Dynamic Causal Modeling of Spontenous Fluctuations in Skin Conductance. Psychophysiology, 48:1--6, 2010.
[12]
E. Haapalainen, S. Kim, J. Forlizzi, and A. Dey. Psycho-physiological Measures For Assessing Cognitive Load. In Proc. of ACM UBICOMP, pages 301--310, September 2010.
[13]
G. Davis, S. Mallat, and M. Avellaneda. Greedy Adaptive Approximation. Journal of Constructive Approximation, 13:57--98, 1997.
[14]
M. Gardner. Mood States and Consumer Behavior: A Critical Review. Journal of Consumer Research, 12(3):281--300, December 1985.
[15]
H. Critchley, R. Elliott, C. Mathias, and R. Dolan. Neural Activity Relating to Generation and Representation of Galvanic Skin Conductance Responses: A Functional Magnetic Resonance Imaging Study. The Journal of Neuroscience, 20(8):3033--3040, April 2000.
[16]
H. Gunes. Automatic, Dimensional and Continuous Emotional Recognition. In International Journal of Synthetic Emotions, volume 1, 2010.
[17]
H. Lu, D. Frauendorfer, M. Rabbi, M. Mast, G. Chittaranjan, A. Campbell, D. Gatica-Perez, T. Choudhury. StressSense: Detecting Stress In Unconstrained Acoustic Environments Using Smartphones. In Proc. of ACM UBICOMP, pages 351--360, September 2012.
[18]
J. Fleureau, P. Guillotel, and Q. Huynh-Thu. Physiological-Based Affect Event Detector for Entertainment Video Applications. IEEE Transactions on Affective Computing, 3(3):379 --385, July 2012.
[19]
J. Healey, L. Nachman, S. Subramanian, J. Shahabdeen, and M. Morris. Out of the Lab And Into The Fray: Towards Modeling Emotion In Everyday Life. In Proc. of Pervasive Computing, pages 156--173, May 2010.
[20]
M. Benedek, and C. Kaernbach. Decomposition of Skin Conductance Data by Means of Nonnegative Deconvolution. Psychophysiology, 47:647--658, 2010.
[21]
M. Dawson, A. Schell, and D. Filion. The Electrodermal System. Handbook of Psychophysiology, pages 200--223, 2000.
[22]
M. Tarvainen, A. Koistinen, M. Valkonen-Korhone, J. Partanen, and P. Karjalainen. Analysis of Galvanic Skin Responses with Principal Components and Clustering Techniques. IEEE Transactions on Biomedical Engineering, 48(10):1071--1079, October 2001.
[23]
M. Tkali, A. Koir, and J. Tasi. Affective Recommender Systems: The Role Of Emotions In Recommender Systems. In Proc. of ACM Decisions@RecSys, October 2011.
[24]
P. Lang. The Emotion Probe: Studies of Motivation and Attention. American Psychologist, 50(5):372--385, 1995.
[25]
R. Calvo, and S. D'Mello. Affect Detection: An Interdisciplinary Review of Models, Methods and Their Applications. In IEEE Transactions of Affective Computing, volume 1, January-June 2010.
[26]
R. Mandryk, M. Atkins, and K. Inkpen. A Continuous and Objective Evaluation of Emotional Experience with Interactive Play Environments. In Proc. of ACM SIGCHI, pages 1027--1036, April 2006.
[27]
R. Marich. Marketing to Moviegoers: A Handbook of Strategies and Tactics, Third Edition. Southern Illinois University Press, 2013.
[28]
S. Rothwell, B. Lehane, C. Chan, A. F. Smeaton, N. O'Connor, G. Jones, and D. Diamond. The CDVPlex Biometric Cinema. In Adjunct Proc. of Pervasive, May 2006.
[29]
T. Hastie, R. Tibshirani and J. Friedman. The Elements of Statistical Learning: Data Mining, Inference, and Prediction, Second Edition. Southern Illinois University Press, 2009.
[30]
T. Nishiyama, J. Sugenoya, T. Matsumoto, S. Iwawe, and T. Mano. Irregular Activation of Individual Sweat Glands in Human Sole Observed by a Videomicroscopy. Automatic Neuroscience: Basic and Clinical, 88:117--126, 2001.

Cited By

View all
  • (2024)Towards Everyday Physiological Monitoring: A Sock Prototype for Electrodermal Activity Measurements2024 9th International Conference on Smart and Sustainable Technologies (SpliTech)10.23919/SpliTech61897.2024.10612408(1-6)Online publication date: 25-Jun-2024
  • (2024)Detecting Users' Emotional States during Passive Social Media UseProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36596068:2(1-30)Online publication date: 15-May-2024
  • (2024)SensEmo: Enabling Affective Learning through Real-time Emotion Recognition with Smartwatches2024 IEEE 21st International Conference on Mobile Ad-Hoc and Smart Systems (MASS)10.1109/MASS62177.2024.00066(453-459)Online publication date: 23-Sep-2024
  • Show More Cited By

Index Terms

  1. Predicting audience responses to movie content from electro-dermal activity signals

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    UbiComp '13: Proceedings of the 2013 ACM international joint conference on Pervasive and ubiquitous computing
    September 2013
    846 pages
    ISBN:9781450317702
    DOI:10.1145/2493432
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Sponsors

    In-Cooperation

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 08 September 2013

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. affective computing
    2. biometrics
    3. gsr
    4. signal processing
    5. user experiments

    Qualifiers

    • Research-article

    Conference

    UbiComp '13
    Sponsor:

    Acceptance Rates

    UbiComp '13 Paper Acceptance Rate 92 of 394 submissions, 23%;
    Overall Acceptance Rate 764 of 2,912 submissions, 26%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)31
    • Downloads (Last 6 weeks)3
    Reflects downloads up to 25 Jan 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Towards Everyday Physiological Monitoring: A Sock Prototype for Electrodermal Activity Measurements2024 9th International Conference on Smart and Sustainable Technologies (SpliTech)10.23919/SpliTech61897.2024.10612408(1-6)Online publication date: 25-Jun-2024
    • (2024)Detecting Users' Emotional States during Passive Social Media UseProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36596068:2(1-30)Online publication date: 15-May-2024
    • (2024)SensEmo: Enabling Affective Learning through Real-time Emotion Recognition with Smartwatches2024 IEEE 21st International Conference on Mobile Ad-Hoc and Smart Systems (MASS)10.1109/MASS62177.2024.00066(453-459)Online publication date: 23-Sep-2024
    • (2024)EEG-Based Tension Recognition Annotated with Electrodermal Activity2024 46th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC)10.1109/EMBC53108.2024.10782145(1-4)Online publication date: 15-Jul-2024
    • (2023)Towards Enhancing a Recorded Concert Experience in Virtual Reality by Visualizing the Physiological Data of the AudienceProceedings of the Augmented Humans International Conference 202310.1145/3582700.3583709(330-333)Online publication date: 12-Mar-2023
    • (2023)Linking Audience Physiology to ChoreographyACM Transactions on Computer-Human Interaction10.1145/355788730:1(1-32)Online publication date: 7-Mar-2023
    • (2023)MMPosE: Movie-Induced Multi-Label Positive Emotion Classification Through EEG SignalsIEEE Transactions on Affective Computing10.1109/TAFFC.2022.322155414:4(2925-2938)Online publication date: 1-Oct-2023
    • (2022)Current trends and opportunities in the methodology of electrodermal activity measurementPhysiological Measurement10.1088/1361-6579/ac500743:2(02TR01)Online publication date: 4-Mar-2022
    • (2022)Capturing Environmental Distress of Pedestrians Using Multimodal Data: The Interplay of Biosignals and Image-Based DataJournal of Computing in Civil Engineering10.1061/(ASCE)CP.1943-5487.000100936:2Online publication date: Mar-2022
    • (2022)CS-Based Decomposition of Acoustic Stimuli-Driven GSR Peaks Sensed by an IoT-Enabled Wearable DeviceIoT Technologies for Health Care10.1007/978-3-030-99197-5_14(166-179)Online publication date: 23-Mar-2022
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media