research-article

Gloss perception in painterly and cartoon rendering

Authors:

Adrien Bousseau,

James P. O'shea,

Ravi Ramamoorthi,

Maneesh AgrawalaAuthors Info & Claims

ACM Transactions on Graphics (TOG), Volume 32, Issue 2

Article No.: 18, Pages 1 - 13

https://doi.org/10.1145/2451236.2451244

Published: 30 April 2013 Publication History

Abstract

Depictions with traditional media such as painting and drawing represent scene content in a stylized manner. It is unclear, however, how well stylized images depict scene properties like shape, material, and lighting. In this article, we describe the first study of material perception in stylized images (specifically painting and cartoon) and use nonphotorealistic rendering algorithms to evaluate how such stylization alters the perception of gloss. Our study reveals a compression of the range of representable gloss in stylized images so that shiny materials appear more diffuse in painterly rendering, while diffuse materials appear shinier in cartoon images. From our measurements we estimate the function that maps realistic gloss parameters to their perception in a stylized rendering. This mapping allows users of NPR algorithms to predict the perception of gloss in their images. The inverse of this function exaggerates gloss properties to make the contrast between materials in a stylized image more faithful. We have conducted our experiment both in a lab and on a crowdsourcing Web site. While crowdsourcing allows us to quickly design our pilot study, a lab experiment provides more control on how subjects perform the task. We provide a detailed comparison of the results obtained with the two approaches and discuss their advantages and drawbacks for studies like ours.

Supplementary Material

bousseau (bousseau.zip)

Supplemental movie and image files for, Perceptual models of viewpoint preference

Download
43.62 MB

MP4 File (tp156.mp4)

Download
12.02 MB

References

[1]

Baird, J. and Noma, E. 1978. Fundamentals of Scaling and Psychophysics. Wiley Series in Behavior. Wiley.

[2]

Berzhanskaya, J., Swaminathan, G., Beck, J., and Mingolla, E. 2002. Highlights and surface gloss perception. J. Vis. 2, 3.

[3]

Cole, F., Sanik, K., DeCarlo, D., Finkelstein, A., Funkhouser, T., Rusinkiewicz, S., and Singh, M. 2009. How well do line drawings depict shape&quest; ACM Trans. Graph. 28.

Digital Library

[4]

Cooke, H. L. 1967. Painting Lessons from the Great Masters. Watson-Guptill Publications.

[5]

Curtis, C. J., Anderson, S. E., Seims, J. E., Fleischer, K. W., and Salesin, D. H. 1997. Computer-Generated watercolor. In Proceedings of the Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH'97).

Digital Library

[6]

DeCarlo, D. and Santella, A. 2002. Stylization and abstraction of photographs. ACM Trans. Graph. 21, 3, 769--776.

Digital Library

[7]

Dror, R. O., Adelson, E. H., and Willsky, A. S. 2001. Recognition of surface reflectance properties from a single image under unknown real-world illumination. In Proceedings of the IEEE Workshop on Identifying Objects across Variations in Lighting.

[8]

Ferwerda, J. A., Pellacini, F., and Greenberg, D. P. 2001. A psychophysically-based model of surface gloss perception. In Proceedings of the SPIE Conference on Human Vision and Electronic Imaging.

[9]

Fleming, R. W., Dror, R. O., and Adelson, E. H. 2001. How do humans determine reflectance properties under unknown illumination&quest; In Proceedings of the IEEE Workshop on Identifying Objects across Variations in Lighting.

[10]

Fleming, R. W., Dror, R. O., and Adelson, E. H. 2003. Real-World illumination and the perception of surface reflectance properties. J. Vis. 3, 5, 347--368.

[11]

Gooch, A., Gooch, B., Shirley, P., and Cohen, E. 1998. A non-photorealistic lighting model for automatic technical illustration. In Proceedings of the Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH'98). 447--452.

Digital Library

[12]

Gooch, B., Reinhard, E., and Gooch, A. 2004. Human facial illustrations: Creation and psychophysical evaluation. ACM Trans. Graph. 23, 1.

Digital Library

[13]

Haeberli, P. 1990. Paint by numbers: Abstract image representations. In Proceedings of the Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH'90). 207--214.

Digital Library

[14]

Hays, J. and Essa, I. 2004. Image and video based painterly animation. In Proceedings of the International Symposium on Non-Photorealistic Animation and Rendering (NPAR'04). 113--120.

Digital Library

[15]

Heer, J. and Bostock, M. 2010. Crowdsourcing graphical perception: Using mechanical turk to assess visualization design. In Proceedings of the 28^th International Conference on Human Factors in Computing Systems (CHI'10).

Digital Library

[16]

Hertzmann, A. 1998. Painterly rendering with curved brush strokes of multiple sizes. In Proceedings of the Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH'98). 453--460.

Digital Library

[17]

Johnson, C. 1992. Creating Textures in Watercolor. North Light Books.

[18]

Kang, H., Lee, S., and Chui, C. K. 2007. Coherent line drawing. In Proceedings of the International Symposium on Non-Photorealistic Animation and Rendering (NPAR'07). 43--50.

Digital Library

[19]

Kozlowski, O. and Kautz, J. 2007. Is accurate occlusion of glossy reflections necessary&quest; In Proceedings of the ACM Symposium on Applied Perception in Graphics and Visualization (APGV'07). 91--98.

Digital Library

[20]

Krivanek, J., Ferwerda, J. A., and Bala, K. 2010. Effects of global illumination approximations on material appearance. ACM Trans. Graph. 29, 3.

Digital Library

[21]

Litwinowicz, P. 1997. Processing images and video for an impressionist effect. In Proceedings of the Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH'97). 407--414.

Digital Library

[22]

Meier, B. J. 1996. Painterly rendering for animation. In Proceedings of the Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH'96).

Digital Library

[23]

Nishida, S. and Shinya, M. 1998. Use of image-based information in judgments of surface-reflectance properties. J. Opt. Soc. Amer. A: Opt. Image Sci. Vis. 15, 12.

[24]

Ott, J. and Kuseno, Y. 2005. Let's Draw Manga: Using Color. Digital Manga Publishing.

[25]

Pellacini, F., Ferwerda, J. A., and Greenberg, D. P. 2000. Toward a psychophysically-based light reflection model for image synthesis. In Proceedings of the Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH' 00). 55--64.

Digital Library

[26]

Pharr, M. and Humphreys, G. 2004. Physically Based Rendering: From Theory to Implementation. Morgan Kaufmann, San Fransisco, CA.

Digital Library

[27]

Ramanarayanan, G., Ferwerda, J., Walter, B., and Bala, K. 2007. Visual equivalence: Towards a new standard for image fidelity. ACM Trans. Graph. 26, 3.

Digital Library

[28]

Smith, K., Soler, C., Luft, T., Deussen, O., and Thollot, J. 2010. Automatic pen-and-ink illustration of tone, gloss, and texture. Res. rep. RR-7194, INRIA.

[29]

Vangorp, P. and Dutre, P. 2008. Shape-Dependent gloss correction. In Proceedings of the ACM Symposium on Applied Perception in Graphics and Visualization (APGV'08). 123--130.

Digital Library

[30]

Vangorp, P., Laurijssen, J., and Dutre, P. 2007. The influence of shape on the perception of material reflectance. ACM Trans. Graph. 26, 3, 77.

Digital Library

[31]

Wallraven, C., Bulthoff, H. H., Cunningham, D. W., Fischer, J., and Bartz, D. 2007. Evaluation of real-world and computer-generated stylized facial expressions. ACM Trans. Appl. Percept. 4, 3, 16.

Digital Library

[32]

Ward, G. J. 1992. Measuring and modeling anisotropic reflection. ACM Trans. Graph. 26, 2, 265--272.

Digital Library

[33]

Wills, J., Agarwal, S., Kriegman, D., and Belongie, S. 2009. Toward a perceptual space for gloss. ACM Trans. Graph. 28, 4.

Digital Library

[34]

Winkenbach, G. and Salesin, D. H. 1996. Rendering parametric surfaces in pen and ink. In Proceedings of the Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH'96). 469--476.

Digital Library

[35]

Winnemoeller, H., Olsen, S. C., and Gooch, B. 2006. Real-Time video abstraction. ACM Trans. Graph. 25, 3.

Digital Library

[36]

Winnemoeller, H., Feng, D., Gooch, B., and Suzuki, S. 2007. Using npr to evaluate perceptual shape cues in dynamic environments. In Proceedings of the International Symposium on Non-Photorealistic Animation and Rendering (NPAR'07). 85--92.

Digital Library

[37]

Xue, S., Chen, X., Dorsey, J., and Rushmeier, H. E. 2010. Printed patterns for enhanced shape perception of papercraft models. Comput. Graph. Forum 29, 2, 625--634.

[38]

Zeng, K., Zhao, M., Xiong, C., and Zhu, S.-C. 2009. From image parsing to painterly rendering. ACM Trans. Graph. 29, 1.

Digital Library

Cited By

Zhao YStumpel Jde Ridder HWijntjes M(2024)Material perception across different media—comparing perceived attributes in oil paintings and engravingsi-Perception10.1177/2041669524126114015:4Online publication date: 3-Aug-2024
https://doi.org/10.1177/20416695241261140
Delanoy JSerrano AMasia BGutierrez D(2021)Perception of material appearance: A comparison between painted and rendered imagesJournal of Vision10.1167/jov.21.5.1621:5(16)Online publication date: 17-May-2021
https://doi.org/10.1167/jov.21.5.16
Meekes MVaxman A(2021)Unconventional patterns on surfacesACM Transactions on Graphics10.1145/3450626.345993340:4(1-16)Online publication date: 19-Jul-2021
https://dl.acm.org/doi/10.1145/3450626.3459933
Show More Cited By

Index Terms

Gloss perception in painterly and cartoon rendering
1. Computing methodologies
  1. Computer graphics
    1. Graphics systems and interfaces

Recommendations

Non-photorealistic ray tracing with paint and toon shading
SIGGRAPH '21: ACM SIGGRAPH 2021 Posters

We present a modification to traditional ray tracing that stylistically renders a scene with cartoon and painterly styles. Previous methods rely on post-processing, materials, or textures to achieve a non-photorealistic look. Our method uses a ray ...
Real-time painterly rendering for MR applications
GRAPHITE '04: Proceedings of the 2nd international conference on Computer graphics and interactive techniques in Australasia and South East Asia

In this paper we describe a real-time system for AR/MR rendering applications in a painterly style. Impressionistic images are created using a large number of brush strokes, which are organized as 3d particles to achieve frame-to-frame coherence. ...
Real-Time Painterly Rendering of Terrains
ICVGIP '08: Proceedings of the 2008 Sixth Indian Conference on Computer Vision, Graphics & Image Processing

We present a non-photo realistic, real-time painterly rendering technique for terrains. The painterly appearance and the impression of terrains is created by effectively rendering several brush strokes. The strokes have fixed locations on the surfaces ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics

ACM Transactions on Graphics Volume 32, Issue 2

April 2013

134 pages

ISSN:0730-0301

EISSN:1557-7368

DOI:10.1145/2451236

Issue’s Table of Contents

Copyright © 2013 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 30 April 2013

Accepted: 01 November 2012

Revised: 01 September 2012

Received: 01 May 2011

Published in TOG Volume 32, Issue 2

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Funding Sources

National Science Foundation
INRIA-UC Berkeley associate team CRISP
Okawa Foundation for Information and Telecommunications
Adobe Systems
Intel Corporation
Nvidia

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

20
Total Citations
View Citations
766
Total Downloads

Downloads (Last 12 months)22
Downloads (Last 6 weeks)1

Reflects downloads up to 23 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Zhao YStumpel Jde Ridder HWijntjes M(2024)Material perception across different media—comparing perceived attributes in oil paintings and engravingsi-Perception10.1177/2041669524126114015:4Online publication date: 3-Aug-2024
https://doi.org/10.1177/20416695241261140
Delanoy JSerrano AMasia BGutierrez D(2021)Perception of material appearance: A comparison between painted and rendered imagesJournal of Vision10.1167/jov.21.5.1621:5(16)Online publication date: 17-May-2021
https://doi.org/10.1167/jov.21.5.16
Meekes MVaxman A(2021)Unconventional patterns on surfacesACM Transactions on Graphics10.1145/3450626.345993340:4(1-16)Online publication date: 19-Jul-2021
https://dl.acm.org/doi/10.1145/3450626.3459933
Serrano AChen BWang CPiovarči MSeidel HDidyk PMyszkowski K(2021)The effect of shape and illumination on material perceptionACM Transactions on Graphics10.1145/3450626.345981340:4(1-16)Online publication date: 19-Jul-2021
https://dl.acm.org/doi/10.1145/3450626.3459813
Bangaru SMichel JMu KBernstein GLi TRagan-Kelley J(2021)Systematically differentiating parametric discontinuitiesACM Transactions on Graphics10.1145/3450626.345977540:4(1-18)Online publication date: 19-Jul-2021
https://dl.acm.org/doi/10.1145/3450626.3459775
Lee SLee SLee YLee J(2021)Learning a family of motor skills from a single motion clipACM Transactions on Graphics10.1145/3450626.345977440:4(1-13)Online publication date: 19-Jul-2021
https://dl.acm.org/doi/10.1145/3450626.3459774
Ahmed AWonka P(2020)Screen-space blue-noise diffusion of monte carlo sampling error via hierarchical ordering of pixelsACM Transactions on Graphics10.1145/3414685.341788139:6(1-15)Online publication date: 27-Nov-2020
https://dl.acm.org/doi/10.1145/3414685.3417881
Shah NZhou D(2020)Approval Voting and Incentives in CrowdsourcingACM Transactions on Economics and Computation10.1145/33968638:3(1-40)Online publication date: 22-Jun-2020
https://dl.acm.org/doi/10.1145/3396863
Toscani MGuarnera DGuarnera GHardeberg JGegenfurtner K(2020)Three Perceptual Dimensions for Specular and Diffuse ReflectionACM Transactions on Applied Perception10.1145/338074117:2(1-26)Online publication date: 18-May-2020
https://dl.acm.org/doi/10.1145/3380741
Yamamoto SHirasawa YDomon RKintou HTsumura N(2019)Improved viewpoint entropy to evaluate material appearance under various lighting positionsOptical Review10.1007/s10043-019-00563-x27:1(45-56)Online publication date: 12-Nov-2019
https://doi.org/10.1007/s10043-019-00563-x
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents