short-paper

Perception of lighting and shading for animated virtual characters

Authors:

Pisut Wisessing,

John Dingliana,

Rachel McDonnellAuthors Info & Claims

SAP '16: Proceedings of the ACM Symposium on Applied Perception

Pages 25 - 29

https://doi.org/10.1145/2931002.2931015

Published: 22 July 2016 Publication History

Abstract

The design of lighting in Computer Graphics is directly derived from cinematography, and many digital artists follow the conventional wisdom on how lighting is set up to convey drama, appeal, or emotion. In this paper, we are interested in investigating the most commonly used lighting techniques to more formally determine their effect on our perception of animated virtual characters. Firstly, we commissioned a professional animator to create a sequence of dramatic emotional sentences for a typical CG cartoon character. Then, we rendered that character using a range of lighting directions, intensities, and shading techniques. Participants of our experiment rated the emotion, the intensity of the performance, and the appeal of the character. Our results provide new insights into how animated virtual characters are perceived, when viewed under different lighting conditions.

Supplementary Material

MOV File (p25-wisessing.mov)

Download
132.01 MB

References

[1]

Alton, J. 1995. Painting with light. University of California Press.

[2]

Alvarez, J. M. G., and Lora, A. M., 2016. MeryProject.com. http://www.meryproject.com.

[3]

Birn, J. 2013. Digital lighting and rendering. Pearson Education.

[4]

Calahan, S. 2000. Storytelling through lighting: a computer graphics perspective. Advanced RenderMan: Creating CGI for motion pictures. Morgan Kaufmann, ch. 13, 337--382.

[5]

de Melo, C., and Paiva, A. 2007. Affective Computing and Intelligent Interaction: Second International Conference, ACII 2007 Lisbon, Portugal, September 12-14, 2007 Proceedings. Springer Berlin Heidelberg, Berlin, Heidelberg, ch. Expression of Emotions in Virtual Humans Using Lights, Shadows, Composition and Filters, 546--557.

Digital Library

[6]

Ekman, P. 1992. An argument for basic emotions. Cognition and Emotion 6, 3-4, 169--200.

[7]

Grodal, T. 2005. 9 film lighting and mood. Moving Image Theory: Ecological Considerations, 152.

[8]

Gurney, J. 2010. Color and light: A guide for the realist painter. Andrews McMeel Publishing.

[9]

Hall, M. 1992. Color and Meaning: Practice and Theory in Renaissance Painting. Cambridge University Press.

[10]

Hery, C., and Villemin, R., 2013. Physically based lighting at pixar. http://graphics.pixar.com/library/PhysicallyBasedLighting/.

[11]

Hyde, J., Carter, E. J., Kiesler, S., and Hodgins, J. K. 2014. Assessing naturalness and emotional intensity: A perceptual study of animated facial motion. In Proceedings of the ACM Symposium on Applied Perception, ACM, New York, NY, USA, SAP '14, 15--22.

Digital Library

[12]

Lake, A., Marshall, C., Harris, M., and Blackstein, M. 2000. Stylized rendering techniques for scalable real-time 3d animation. In Proceedings of the 1st International Symposium on Non-photorealistic Animation and Rendering, ACM, New York, NY, USA, NPAR '00, 13--20.

Digital Library

[13]

Lowell, R. 1992. Matters of light and depth. lowel-light manufacturing. Inc., New York.

[14]

Malkiewicz, K., and Mullen, M. D. 2005. Cinematography. Simon and Schuster.

[15]

Martin, O., Kotsia, I., Macq, B., and Pitas, I. 2006. The enterface'05 audio-visual emotion database. In Proceedings of the 22Nd International Conference on Data Engineering Workshops, IEEE Computer Society, Washington, DC, USA, ICDEW '06, 8.

Digital Library

[16]

McCloud, S. 1994. Understanding Comics: The Invisible Art. HarperPerennial.

[17]

McDonnell, R., Breidt, M., and Bülthoff, H. H. 2012. Render me real?: Investigating the effect of render style on the perception of animated virtual humans. ACM Trans. Graph. 31, 4 (July), 91:1--91:11.

Digital Library

[18]

Millerson, G. 1991. The Technique of Lighting for Telivision and Film. Focus Press.

[19]

Moffitt, J. 2004. Caravaggio in Context: Learned Naturalism and Renaissance Humanism. McFarland & Company.

[20]

Mould, D., Mandryk, R. L., and Li, H. 2012. Special section on CANS: Emotional response and visual attention to non-photorealistic images. Comput. Graph. 36, 6 (Oct.), 658--672.

Digital Library

[21]

Poland, J. L. 2015. Light, Camera, Emotion! An Examination on Film Lighting and It's Impact on AudiencesEmotional Response. PhD thesis, Cleveland State University.

[22]

Schumann, J., Strothotte, T., Laser, S., and Raab, A. 1996. Assessing the effect of non-photorealistic rendered images in CAD. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM, New York, NY, USA, CHI '96, 35--41.

Digital Library

[23]

Seif El-Nasr, M., Niedenthal, S., Kenz, I., Almeida, P., and Zupko, J. 2006. Dynamic lighting for tension in games. Game Studies 7, 1.

[24]

Seifi, H., DiPaola, S., and Enns, J. T. 2012. Exploring the effect of color palette in painterly rendered character sequences. In Proceedings of the Eighth Annual Symposium on Computational Aesthetics in Graphics, Visualization, and Imaging, Eurographics Association, Aire-la-Ville, Switzerland, Switzerland, CAe '12, 89--97.

Digital Library

[25]

Todo, H., Anjyo, K.-i., Baxter, W., and Igarashi, T. 2007. Locally controllable stylized shading. ACM Trans. Graph. 26, 3 (July).

Digital Library

[26]

Volante, M., Babu, S. V., Chaturvedi, H., Newsome, N., Ebrahimi, E., Roy, T., Daily, S. B., and Fasolino, T. 2016. Effects of virtual human appearance fidelity on emotion contagion in affective inter-personal simulations. IEEE Transactions on Visualization and Computer Graphics 22, 4 (April), 1326--1335.

Digital Library

[27]

Wallraven, C., Bülthoff, H. H., Cunningham, D. W., Fischer, J., and Bartz, D. 2007. Evaluation of real-world and computer-generated stylized facial expressions. ACM Trans. Appl. Percept. 4, 3 (Nov.).

Digital Library

[28]

Wolf, R., and Block, D. 2014. Scene design and stage lighting. Cengage Learning.

Cited By

Mal DDöllinger NWolf EWenninger SBotsch MWienrich CLatoschik M(2024)Am I the odd one? Exploring (in)congruencies in the realism of avatars and virtual others in virtual realityFrontiers in Virtual Reality10.3389/frvir.2024.14170665Online publication date: 19-Jul-2024
https://doi.org/10.3389/frvir.2024.1417066
Wisessing PMcDonnell R(2024)Blinded by the light: Does portrait lighting design affect perception of realistic virtual humans?ACM Symposium on Applied Perception 202410.1145/3675231.3675245(1-10)Online publication date: 30-Aug-2024
https://dl.acm.org/doi/10.1145/3675231.3675245
Lee YJi Y(2024)Effects of Visual Realism on Avatar Perception in Immersive and Non-Immersive Virtual EnvironmentsInternational Journal of Human–Computer Interaction10.1080/10447318.2024.2351713(1-14)Online publication date: 14-May-2024
https://doi.org/10.1080/10447318.2024.2351713
Show More Cited By

Index Terms

Perception of lighting and shading for animated virtual characters
1. Computing methodologies
  1. Computer graphics
    1. Graphics systems and interfaces
      1. Perception

Recommendations

A fast relighting engine for interactive cinematic lighting design
SIGGRAPH '00: Proceedings of the 27th annual conference on Computer graphics and interactive techniques

We present new techniques for interactive cinematic lighting design of complex scenes that use procedural shaders. Deep-framebuffers are used to store the geometric and optical information of the visible surfaces of an image. The geometric information ...
KatanaForFX: intertwine FX and lighting
SIGGRAPH '18: ACM SIGGRAPH 2018 Talks

On many shows we are working on at MPC, we have to deal with shots containing a high number of FX elements of various types (particles, volumes, animated geometry). A large majority of these effects are rendered by the Lighting department in Katana and ...
Lighting with paint

Lighting is a fundamental aspect of computer cinematography that involves the placement and configuration of lights to establish mood and enhance storytelling. This process is labor intensive as artists repeatedly adjust the parameters of a large set of ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SAP '16: Proceedings of the ACM Symposium on Applied Perception

July 2016

149 pages

ISBN:9781450343831

DOI:10.1145/2931002

Conference Chairs:
Eakta Jain
University of Florida
,
Sophie Joerg
Clemson University

Copyright © 2016 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 22 July 2016

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper

Funding Sources

Science Foundation Ireland

Conference

SAP '16

Sponsor:

SIGGRAPH

SAP '16: ACM Symposium on Applied Perception 2016

July 22 - 23, 2016

California, Anaheim

Acceptance Rates

Overall Acceptance Rate 43 of 94 submissions, 46%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

11
Total Citations
View Citations
544
Total Downloads

Downloads (Last 12 months)65
Downloads (Last 6 weeks)3

Reflects downloads up to 06 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Mal DDöllinger NWolf EWenninger SBotsch MWienrich CLatoschik M(2024)Am I the odd one? Exploring (in)congruencies in the realism of avatars and virtual others in virtual realityFrontiers in Virtual Reality10.3389/frvir.2024.14170665Online publication date: 19-Jul-2024
https://doi.org/10.3389/frvir.2024.1417066
Wisessing PMcDonnell R(2024)Blinded by the light: Does portrait lighting design affect perception of realistic virtual humans?ACM Symposium on Applied Perception 202410.1145/3675231.3675245(1-10)Online publication date: 30-Aug-2024
https://dl.acm.org/doi/10.1145/3675231.3675245
Lee YJi Y(2024)Effects of Visual Realism on Avatar Perception in Immersive and Non-Immersive Virtual EnvironmentsInternational Journal of Human–Computer Interaction10.1080/10447318.2024.2351713(1-14)Online publication date: 14-May-2024
https://doi.org/10.1080/10447318.2024.2351713
Mascaró-Oliver MAmengual-Alcover ERoig-Maimó MMas-Sansó R(2023)UIBVFEDPlus-Light: Virtual facial expression dataset with lightingPLOS ONE10.1371/journal.pone.028700618:9(e0287006)Online publication date: 29-Sep-2023
https://doi.org/10.1371/journal.pone.0287006
Mehrez AAdamo NGiri NLarson D(2023)Fiat Lux! Does the Lighting Design Affect Viewers’ Perception of an Animated Character Personality?HCI in Games10.1007/978-3-031-35979-8_21(263-272)Online publication date: 23-Jul-2023
https://dl.acm.org/doi/10.1007/978-3-031-35979-8_21
Lawrence JPan YGoldman DMcDonnell RRobillard JO'Sullivan CSheikh YZollhoefer MSaragih JNandigjav MShinar T(2022)State of the art in telepresenceACM SIGGRAPH 2022 Courses10.1145/3532720.3535673(1-159)Online publication date: 2-Aug-2022
https://dl.acm.org/doi/10.1145/3532720.3535673
Debarba HChague SCharbonnier C(2022)On the Plausibility of Virtual Body Animation Features in Virtual RealityIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2020.302517528:4(1880-1893)Online publication date: 1-Apr-2022
https://doi.org/10.1109/TVCG.2020.3025175
Wisessing PMcDonnell R(2020)Evalu-light: A practical approach for evaluating character lighting in real-timeACM Symposium on Applied Perception 202010.1145/3385955.3407937(1-6)Online publication date: 12-Sep-2020
https://dl.acm.org/doi/10.1145/3385955.3407937
Wisessing PZibrek KCunningham DDingliana JMcDonnell R(2020)Enlighten MeACM Transactions on Graphics10.1145/338319539:3(1-12)Online publication date: 17-Apr-2020
https://dl.acm.org/doi/10.1145/3383195
Wisessing PZibrek KW. Cunningham DMcdonnell R(2019)A psychophysical model to control the brightness and key-to-fill ratio in CG cartoon character lightingACM Symposium on Applied Perception 201910.1145/3343036.3343127(1-7)Online publication date: 19-Sep-2019
https://dl.acm.org/doi/10.1145/3343036.3343127
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents