poster

Vlogcast yourself: nonverbal behavior and attention in social media

Authors:

Joan-Isaac Biel,

Daniel Gatica-PerezAuthors Info & Claims

ICMI-MLMI '10: International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interaction

Article No.: 50, Pages 1 - 4

https://doi.org/10.1145/1891903.1891964

Published: 08 November 2010 Publication History

Abstract

We introduce vlogs as a type of rich human interaction which is multimodal in nature and suitable for new large-scale behavioral data analysis. The automatic analysis of vlogs is useful not only to study social media, but also remote communication scenarios, and requires the integration of methods for multimodal processing and for social media understanding. Based on works from social psychology and computing, we first propose robust audio, visual, and multimodal cues to measure the nonverbal behavior of vloggers in their videos. Then, we investigate the relation between behavior and the attention videos receive in YouTube. Our study shows significant correlations between some nonverbal behavioral cues and the average number of views per video.

References

[1]

N. Ambady and R. Rosenthal. Thin slices of expressive behavior as predictors of interpersonal consequences: a meta-analysis. Psychology Bulletin, 111(2), 1992.

[2]

S. Basu. Conversational scene analysis. PhD thesis, MIT Media Lab, Sept. 2002.

Digital Library

[3]

J.-I. Biel and D. Gatica-Perez. Wearing a YouTube hat: directors, comedians, gurus, and user aggregated behavior. In Proc. of ACM MM'09, 2009.

Digital Library

[4]

G. Bradski and A. Kaehler. Learning OpenCV: Computer Vision with the OpenCV Library. O'Reilly, 2008.

[5]

J. Burgess and J. Green. YouTube: Online video and participatory culture. Polity, Cambridge, UK, 2009.

[6]

J. R. Curhan and A. Pentland. Thin slices of negotiation: Predicting outcomes from conversational dynamics within the first 5 minutes. Jour. of Applied Psych., 92(3), 2007.

[7]

D. Gatica-Perez. Automatic nonverbal analysis of social interaction in small groups: A review. Image Vision Computing, 27(12), 2009.

Digital Library

[8]

J. A. Gill, S. Nowson, and J. Oberlander. What are they blogging about? Personality, topic, and motivation in blogs. In Proc. of AAAI ICWSM, 2009.

[9]

B. A. Huberman, D. M. Romero, and F. Wu. Crowdsourcing, attention and productivity. Journal of Information Science, 35(6), 2009.

Digital Library

[10]

D. B. Jayagopi, H. Hung, C. Yeo, and D. Gatica-Perez. Modeling dominance in group conversations using nonverbal activity cues. IEEE Transactions Audio, Speech and Language Processing, 17(3), 2009.

Digital Library

[11]

M. L. Knapp. Nonverbal communication in human interaction. Holt, Rinehart and Winston, New York, 2005.

[12]

H. Molyneaux, S. O'Donnell, K. Gibson, and J. Singer. Exploring the gender divide on YouTube: An analysis of the creation and reception of vlogs. Journal of American Communication, 10(2), 2008.

[13]

B. O'Conaill, S. Whittaker, and S. Wilbur. Conversations over video conferences: an evaluation of the spoken aspects of video-mediated communication. Human-Computer Interaction, 8(4), 1993.

Digital Library

[14]

A. Pentland. Honest signals: How they shape our world. The MIT Press, 2008.

Digital Library

[15]

C. L. Ridgeway. Nonverbal behavior, dominance, and the basis of status in task groups. Journal of Social Personal Relationships, 52(5), 1987.

[16]

P. Viola and M. Jones. Robust real-time object detection. Int. Journal of Computer Vision, 57(2), 2002.

Digital Library

[17]

YouTube Blog. Upload limit increases to 15 minutes for all users, July 2010.

Cited By

Cosma ARadoi E(2024)PsyMo: A Dataset for Estimating Self-Reported Psychological Traits from Gait2024 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)10.1109/WACV57701.2024.00454(4591-4601)Online publication date: 3-Jan-2024
https://doi.org/10.1109/WACV57701.2024.00454
Liu ZImai M(2023)Telepresence Chameleon: Improve User Experience of Telepresence Robot With Chameleon EffectProceedings of the 11th International Conference on Human-Agent Interaction10.1145/3623809.3623828(55-62)Online publication date: 4-Dec-2023
https://dl.acm.org/doi/10.1145/3623809.3623828
Dewi ICiptadewi NIkhsan RBenhardy KWijaya LPrasarry Y(2023)It's Important Using Beauty Vloggers on Youtube to Create Brand Preference2023 8th International Conference on Business and Industrial Research (ICBIR)10.1109/ICBIR57571.2023.10147547(123-127)Online publication date: 18-May-2023
https://doi.org/10.1109/ICBIR57571.2023.10147547
Show More Cited By

Recommendations

Uses and gratifications of social networking sites for bridging and bonding social capital

Applying uses and gratifications theory (UGT) and social capital theory, our study examined users of four social networking sites (SNSs) (Facebook, Twitter, Instagram, and Snapchat), and their influence on online bridging and bonding social capital. ...
My Social Media for Seniors (2nd Edition)
Does social capital affect SNS usage? A look at the roles of subjective well-being and social identity

Examines the effects of social capital on SNS use (qualitative and quantitative use).Found that bridging capital significantly impacts qualitative SNS use.Verified the mediating role of subjective well-being between bonding capital and quantitative SNS ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ICMI-MLMI '10: International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interaction

November 2010

311 pages

ISBN:9781450304146

DOI:10.1145/1891903

General Chairs:
Wen Gao
PKU, China
,
Chin-Hui Lee
Georgia Tech
,
Jie Yang
Carnegie Mellon
,
Program Chairs:
Xilin Chen
ICT, CAS, China
,
Maxine Eskenazi
Carnegie Mellon
,
Zhengyou Zhang
MSR

Copyright © 2010 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 November 2010

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Poster

Conference

ICMI-MLMI '10

Sponsor:

SIGCHI

ICMI-MLMI '10: INTERNATIONAL CONFERENCE ON MULTIMODAL INTERFACES/WORKSHOP ON MACHINE LEARNING FOR MULTIMODAL INTERFACES

November 8 - 10, 2010

Beijing, China

Acceptance Rates

ICMI-MLMI '10 Paper Acceptance Rate 41 of 100 submissions, 41%;

Overall Acceptance Rate 453 of 1,080 submissions, 42%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
579
Total Downloads

Downloads (Last 12 months)22
Downloads (Last 6 weeks)3

Reflects downloads up to 25 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Cosma ARadoi E(2024)PsyMo: A Dataset for Estimating Self-Reported Psychological Traits from Gait2024 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)10.1109/WACV57701.2024.00454(4591-4601)Online publication date: 3-Jan-2024
https://doi.org/10.1109/WACV57701.2024.00454
Liu ZImai M(2023)Telepresence Chameleon: Improve User Experience of Telepresence Robot With Chameleon EffectProceedings of the 11th International Conference on Human-Agent Interaction10.1145/3623809.3623828(55-62)Online publication date: 4-Dec-2023
https://dl.acm.org/doi/10.1145/3623809.3623828
Dewi ICiptadewi NIkhsan RBenhardy KWijaya LPrasarry Y(2023)It's Important Using Beauty Vloggers on Youtube to Create Brand Preference2023 8th International Conference on Business and Industrial Research (ICBIR)10.1109/ICBIR57571.2023.10147547(123-127)Online publication date: 18-May-2023
https://doi.org/10.1109/ICBIR57571.2023.10147547
Jacques Junior JGucluturk YPerez MGuclu UAndujar CBaro XEscalante HGuyon Ivan Gerven Mvan Lier REscalera S(2022)First Impressions: A Survey on Vision-Based Apparent Personality Trait AnalysisIEEE Transactions on Affective Computing10.1109/TAFFC.2019.293005813:1(75-95)Online publication date: 1-Jan-2022
https://doi.org/10.1109/TAFFC.2019.2930058
Gatica-Perez DVinciarelli AOdobez J(2014)Nonverbal Behavior AnalysisMultimodal Interactive Systems Management10.1201/b15535-15(165-187)Online publication date: 2-Apr-2014
https://doi.org/10.1201/b15535-15
Aran OGatica-Perez DEpps JChen FOviatt SMase KSears AJokinen KSchuller B(2013)Cross-domain personality predictionProceedings of the 15th ACM on International conference on multimodal interaction10.1145/2522848.2522858(127-130)Online publication date: 9-Dec-2013
https://dl.acm.org/doi/10.1145/2522848.2522858
Korchagin DAbutalebi H(2011)Social focus of attention as a time function derived from multimodal signalsProceedings of the 2011 IEEE International Conference on Multimedia and Expo10.1109/ICME.2011.6012241(1-4)Online publication date: 11-Jul-2011
https://dl.acm.org/doi/10.1109/ICME.2011.6012241

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten