research-article

Smart Face: enhancing creativity during video conferences using real-time facial deformation

Authors:

Naoto Nakazato,

Shigeo Yoshida,

Tomohiro Tanikawa,

Michitaka HiroseAuthors Info & Claims

CSCW '14: Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing

Pages 75 - 83

https://doi.org/10.1145/2531602.2531637

Published: 15 February 2014 Publication History

Abstract

This study develops a method for improving creativity by changing the facial appearance of people during video conferences. We focus on enhancing creativity during human interactions, especially cooperative work situations such as video conferences. Psychological studies have revealed that the facial appearance of people can affect creativity, i.e., "emotion can affect creativity" and "the appearance of others can affect the emotions." Based on the knowledge, we hypothesized that the media technology which modifies the facial appearance of people appropriately can enhance our creativity during cooperative work. Therefore, we develop a method to affect creativity by changing the facial appearance in real-time, such as facial expressions and facial resemblance. We test the effectiveness of this method by building a system for collaborative video conferences. The user study show that the proposed method could enhance creativity.

Supplementary Material

suppl.mov (cscw0253-file3.mp4)

Supplemental video

Download
14.56 MB

References

[1]

Amabile, T., Barsade, S., Mueller, J. and Staw, B., Affect and Creativity at Work. Administrative Science Quarterly 50, (2005), 367--403.

[2]

Mansfield, R.S., Busse, T.V. and Krepelka, E.J. The effectiveness of creativity training. Review of Educational Research 48, 4 (1978), 517--536.

[3]

Isen, A., Daubman, K. and Nowicki, G.P. Positive Affect Facilitates Creative Problem Solving. Journal of Personality and Social Psychology 52, (1987), 11221131.

[4]

Lewis, S., Dontcheva, M. and Gerber, E., Affective computational priming and creativity. Proceedings of the 2011 annual conference on Human factors in computing systems, (2011), 735--744.

Digital Library

[5]

Dimberg, U., Facial reactions to facial expressions. Psychophysiology 19, 6 (1982), 643--647.

[6]

DeBruine, L.M., Facial resemblance enhances trust. Proceedings of the Royal Society of London. Series B: Biological Sciences 269, 1498 (2002) 1307--1312.

[7]

Amabile, T., The social psychology of creativity: A componential conceptualization. Journal of Personality and Social Psychology 45, (1983), 357--376.

[8]

Nishimoto, K. and Sumi, Y. and Mase, K., Toward an outsider agent for supporting a brainstorming session-an information retrieval method from a different viewpoint. Knowledge-Based Systems 9, 6 (1996), 377--384.

Digital Library

[9]

Nishimoto, K., Sumi, Y. and Mase, K., Enhancement of creative aspects of a daily conversation with a topic development agent. Coordination Technology for Collaborative Applications, (1998), 63--76.

Digital Library

[10]

Watanabe, T., Okubo, M. and Danbara, R., InterActor for human interaction and communication support. Proceedings of the International Conference on HumanComputer Interaction, (2003), 113--120.

[11]

Ishii, Y. and Watanabe, T., E-VChat: A video communication system in which a speech-driven embodied entrainment character working with head motion is superimposed for a virtual face-to-face scene. RO-MAN, 2012 IEEE, (2012), 191--196.

[12]

Yoshida, S., Sakurai, S., Narumi, T., Tanikawa, T. and Hirose, M., Manipulation of an emotional experience by real-time deformed facial feedback. Proceedings of the 4th Augmented Human International Conference, (2013), 35--42.

Digital Library

[13]

Saragih, J.M., Lucey, S. and Cohn, J.F., Deformable model fitting by regularized landmark mean-shift. International Journal of Computer Vision 91, 2 (2011), 200--215.

Digital Library

[14]

Schaefer, S., McPhail, T. and Warren, J., Image deformation using moving least squares. ACM Transactions on Graphics (TOG) 25, 3 (2006), 553--540.

Digital Library

[15]

Ekman, P. and Friesen W., Unmasking the Face. Prentice Hall, Inc, Englewood Cliffs (1975).

[16]

Clark, C., Rona, G. and Patrel, P., Brainstorming. Dunod, (1971).

[17]

Isaksen, Scott G. A review of brainstorming research: Six critical issues for inquiry. Creative Research Unit, Creative Problem Solving Group-Buffalo, (1998).

[18]

Meadow, A. and Parnes, S.J., Evaluation of training in creative problem solving. Journal of Applied Psychology 43, 3 (1959), 189.

[19]

Bao, P., Gerber, E., Gergle, D. and Hoffman, D. Momentum, getting and staying on topic during a brainstorm. In Proc. CHI 2010, ACM (2010), 1233--1236.

Digital Library

[20]

Diehl, M., and Wolfgang S. "Productivity loss in brainstorming groups: Toward the solution of a riddle." Journal of personality and social psychology 53.3 (1987): 497.

[21]

Parnes, Sidney J. "Effects of extended effort in creative problem solving." Journal of Educational psychology 52.3 (1961): 117.

[22]

Clark L.A. and Watson D., Mood and the mundane: Relations between daily life events and self-reported mood. Journal of Personality and Social Psychology 54, (1988), 296--308.

[23]

Watson D., Clark L.A. and Tellegen A., Cross-cultural convergence in the structure of mood: A Japanese replication and comparison with U. S. findings. Journal of Personality and Social Psychology 47, (1984), 127--144.

[24]

Clark, L.A., and Watson, D., The Japanese Positive and Negative Affect Schedule: Factor-based scales for the assessment of mood. Unpublished manuscript, University of Iowa (1989).

[25]

Watson D., Clark L.A. and Tellegen A., Development and Validation of Brief Measures of Positive and Negative Affect: The PANAS Scales. Journal of Personality and Social Psychology 54, (1988), 1063--1070.

[26]

Zajonc, R.B., Attitudinal effects of mere exposure. Journal of personality and social psychology 9, 2 (1968), 1.

[27]

Trang G., Raoul B. and Axel B., Does facial resemblance enhance cooperation? PloS one 7, 10 (2012), e47809.

Cited By

Song XXu LPeng CPan SAdibi AWang XLu Z(2025)Enhanced creativity at the cost of increased stress? The impact of generative AI on serious games for creativity stimulationBehaviour & Information Technology10.1080/0144929X.2025.2459267(1-25)Online publication date: 13-Feb-2025
https://doi.org/10.1080/0144929X.2025.2459267
Seitz JBenke IHeinzl AMaedche A(2024)The Impact of Video Meeting Systems on Psychological User StatesInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2023.103178182:COnline publication date: 1-Feb-2024
https://dl.acm.org/doi/10.1016/j.ijhcs.2023.103178
Hagen MCruzes DJaccheri LFails J(2024)Evaluating digital creativity support for childrenInternational Journal of Child-Computer Interaction10.1016/j.ijcci.2023.10060338:COnline publication date: 27-Feb-2024
https://dl.acm.org/doi/10.1016/j.ijcci.2023.100603
Show More Cited By

Index Terms

Smart Face: enhancing creativity during video conferences using real-time facial deformation
1. Human-centered computing
  1. Collaborative and social computing

Recommendations

Cultural-based visual expression: emotional analysis of human face via Peking Opera Painted Faces (POPF)

Peking Opera as a branch of Chinese traditional cultures and arts has a very distinct colourful facial make-up for all actors in the stage performance. Such make-up is stylised in nonverbal symbolic semantics which all combined together to form the ...
Emotional facial expression interface: effects of displayed facial designs
Ergo'IA '10: Proceedings of the Ergonomie et Informatique Avancee Conference

In supporting the visual-mediated emotional recognition, little research has centred on analysing the effect of presenting different combinatorial facial designs. Moreover, in the theoretical field of emotions, research on the recognition of emotional ...
Emotion recognition using facial expressions with active appearance models
HCI '08: Proceedings of the Third IASTED International Conference on Human Computer Interaction

Recognizing emotion using facial expressions is a key element in human communication. In this paper we discuss a framework for the classification of emotional states, based on still images of the face. The technique we present involves the creation of ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CSCW '14: Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing

February 2014

1600 pages

ISBN:9781450325400

DOI:10.1145/2531602

General Chairs:
Susan Fussell
Cornell University
,
Wayne Lutters
University of Maryland, Baltimore County
,
Program Chairs:
Meredith Ringel Morris
Microsoft Research
,
Madhu Reddy
Penn State University

Copyright © 2014 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 15 February 2014

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CSCW'14

Sponsor:

SIGCHI

CSCW'14: Computer Supported Cooperative Work

February 15 - 19, 2014

Maryland, Baltimore, USA

Upcoming Conference

CSCW '25

Sponsor:
sigchi

Computer-Supported Cooperative Work and Social Computing

October 18 - 22, 2025

Bergen , Norway

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

33
Total Citations
View Citations
914
Total Downloads

Downloads (Last 12 months)47
Downloads (Last 6 weeks)7

Reflects downloads up to 23 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Song XXu LPeng CPan SAdibi AWang XLu Z(2025)Enhanced creativity at the cost of increased stress? The impact of generative AI on serious games for creativity stimulationBehaviour & Information Technology10.1080/0144929X.2025.2459267(1-25)Online publication date: 13-Feb-2025
https://doi.org/10.1080/0144929X.2025.2459267
Seitz JBenke IHeinzl AMaedche A(2024)The Impact of Video Meeting Systems on Psychological User StatesInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2023.103178182:COnline publication date: 1-Feb-2024
https://dl.acm.org/doi/10.1016/j.ijhcs.2023.103178
Hagen MCruzes DJaccheri LFails J(2024)Evaluating digital creativity support for childrenInternational Journal of Child-Computer Interaction10.1016/j.ijcci.2023.10060338:COnline publication date: 27-Feb-2024
https://dl.acm.org/doi/10.1016/j.ijcci.2023.100603
Yoneyama JFujimoto YOkazaki KSawabe TKanbara MKato H(2024)Augmented conversations: AR face filters for facilitating comfortable in-person interactionsJournal on Multimodal User Interfaces10.1007/s12193-024-00446-9Online publication date: 5-Dec-2024
https://doi.org/10.1007/s12193-024-00446-9
Lyu QWatanabe KUmemura HMurai A(2023)Design-thinking skill enhancement in virtual reality: A literature studyFrontiers in Virtual Reality10.3389/frvir.2023.11372934Online publication date: 4-Apr-2023
https://doi.org/10.3389/frvir.2023.1137293
Yang CYoshida SKuzuoka HNarumi TYamashita N(2023)Affective Profile Pictures: Exploring the Effects of Changing Facial Expressions in Profile Pictures on Text-Based CommunicationProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581061(1-17)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581061
Leong JPerteneder FRajvee MMaes P(2023)“Picture the Audience...”: Exploring Private AR Face Filters for Online Public SpeakingProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581039(1-13)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581039
Inami MUriu DKashino ZYoshida SSaito HMaekawa AKitazaki M(2022)Cyborgs, Human Augmentation, Cybernetics, and JIZAI BodyProceedings of the Augmented Humans International Conference 202210.1145/3519391.3519401(230-242)Online publication date: 13-Mar-2022
https://dl.acm.org/doi/10.1145/3519391.3519401
Rojas CZuccarelli EChin APatekar GEsquivel DMaes P(2022)Towards Enhancing Empathy Through Emotion Augmented Remote CommunicationExtended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491101.3519797(1-9)Online publication date: 27-Apr-2022
https://dl.acm.org/doi/10.1145/3491101.3519797
Masai KPerusquia-Hernandez MSugimoto MKumano SKimura T(2022)Consistent Smile Intensity Estimation from Wearable Optical Sensors2022 10th International Conference on Affective Computing and Intelligent Interaction (ACII)10.1109/ACII55700.2022.9953867(1-8)Online publication date: 18-Oct-2022
https://doi.org/10.1109/ACII55700.2022.9953867
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten