research-article

Customizing painterly rendering styles using stroke processes

Authors:

Song-Chun ZhuAuthors Info & Claims

NPAR '11: Proceedings of the ACM SIGGRAPH/Eurographics Symposium on Non-Photorealistic Animation and Rendering

Pages 137 - 146

https://doi.org/10.1145/2024676.2024698

Published: 05 August 2011 Publication History

Abstract

In this paper, we study the stroke placement problem in painterly rendering, and present a solution named stroke processes, which enables intuitive and interactive customization of painting styles by mapping perceptual characteristics to rendering parameters. Using our method, a user can adjust styles (e.g., Fig.1) easily by controlling these intuitive parameters. Our model and algorithm are capable of reflecting various styles in a single framework, which includes point processes and stroke neighborhood graphs to model the spatial layout of brush strokes, and stochastic reaction-diffusion processes to compute the levels and contrasts of their attributes to match desired statistics. We demonstrate the rendering quality and flexibility of this method with extensive experiments.

Supplementary Material

JPG File (p137-zhao.jpg)

Download
31.58 KB

AVI File (p137-zhao.avi)

Download
20.96 MB

References

[1]

Baxter, W. V. 2004. Physically-Based Modeling Techniques for Interactive Digital Painting. PhD thesis, University of North Carolina at Chapel Hill.

Digital Library

[2]

Chu, N., Baxter, W., Wei, L.-Y., and Govindaraju, N. 2010. Detail-preserving paint modeling for 3D brushes. In Proc. NPAR '10, 27--34.

Digital Library

[3]

Cockshott, T., Patterson, J., and England, D. 1992. Modelling the texture of paint. Comput. Graphics Forum 11, 3, 217--226.

[4]

Collomosse, J. P., and Hall, P. M. 2002. Painterly rendering using image salience. In Proc. EGUK '02, 122--128.

Digital Library

[5]

Collomosse, J. P., Rowntree, D., and Hall, P. M. 2005. Stroke surfaces: temporally coherent artistic animations from video. IEEE Trans. Visual Comput. Graphics 11, 5, 540--549.

Digital Library

[6]

Cooke, H. L. 1978. Painting Techniques of the Masters. Watson Guptill/Pitman Publishing.

[7]

de Berg, M., Cheong, O., van Kreveld, M., and Overmars, M. 2010. Computational Geometry: Algorithms and Applications, 3rd ed. Springer.

Digital Library

[8]

Deussen, O., Hiller, S., van Overveld, C., and Strothotte, T. 2000. Floating points: A method for computing stipple drawings. Comput. Graphics Forum 19, 3, 40--51.

[9]

Freeman, W. T., and Adelson, E. H. 1991. The design and use of steerable filters. IEEE Trans. Patten Anal. Mach. Intell. 13, 9, 891--906.

Digital Library

[10]

Gamito, M. N., and Maddock, S. C. 2009. Accurate multidimensional poisson-disk sampling. ACM Trans. Graph. 29, 1, 8:1--8:19.

Digital Library

[11]

Gonzalez, R. C., and Woods, R. E. 2002. Digital Image Processing, 2nd ed. Prentice Hall.

Digital Library

[12]

Gooch, B., and Gooch, A. 2001. Non-Photorealistic Rendering. A K Peters/CRC Press.

Digital Library

[13]

Gooch, B., Coombe, G., and Shirley, P. 2002. Artistic vision: painterly rendering using computer vision techniques. In Proc. NPAR '02, 83--91.

Digital Library

[14]

Guo, C.-E., Zhu, S.-C., and Wu, Y. N. 2003. Modeling visual patterns by integrating descriptive and generative methods. Int. J. Comput. Vision 53, 1, 5--29.

Digital Library

[15]

Haeberli, P. 1990. Paint by numbers: abstract image representations. In Proc. SIGGRAPH '90, 207--214.

Digital Library

[16]

Hays, J., and Essa, I. 2004. Image and video based painterly animation. In Proc. NPAR '04, 113--120.

Digital Library

[17]

Hertzmann, A., and Perlin, K. 2000. Painterly rendering for video and interaction. In Proc. NPAR '00, 7--12.

Digital Library

[18]

Hertzmann, A. 1998. Painterly rendering with curved brush strokes of multiple sizes. In Proc. SIGGRAPH '98, 453--460.

Digital Library

[19]

Hertzmann, A. 2001. Paint by relaxation. In Proc. CGI '01, 47--54.

Digital Library

[20]

Hertzmann, A. 2002. Fast paint texture. In Proc. NPAR '02, 91--96.

Digital Library

[21]

Hertzmann, A. 2003. A survey of stroke-based rendering. IEEE Comput. Graph. Appl. 23, 4, 70--81.

Digital Library

[22]

Hughes, J. M., Graham, D. J., and Rockmore, D. N. 2010. Quantification of artistic style through sparse coding analysis in the drawings of Pieter Bruegel the Elder. PNAS 107, 4, 1279--1283.

[23]

Hurtut, T., Landes, P.-E., Thollot, J., Gousseau, Y., Drouillhet, R., and Coeurjolly, J.-F. 2009. Appearance-guided synthesis of element arrangements by example. In Proc. NPAR '09, 51--60.

Digital Library

[24]

Kagaya, M., Brendel, W., Deng, Q., Kesterson, T., Todorovic, S., Neill, P., and Zhang, E. 2011. Video painting with space-time-varying style parameters. IEEE Trans. Visual Comput. Graphics 17, 1, 74--87.

Digital Library

[25]

Lin, L., Zeng, K., Lv, H., Wang, Y., Xu, Y., and Zhu, S.-C. 2010. Painterly animation using video semantics and feature correspondence. In Proc. NPAR '10, 73--80.

Digital Library

[26]

Litwinowicz, P. 1997. Processing images and video for an impressionist effect. In Proc. SIGGRAPH '97, 407--414.

Digital Library

[27]

Lu, J., Sander, P. V., and Finkelstein, A. 2010. Interactive painterly stylization of images, videos and 3D animations. In Proc. I3D '10, 127--134.

Digital Library

[28]

Meier, B. J. 1996. Painterly rendering for animation. In Proc. SIGGRAPH '96, 477--484.

Digital Library

[29]

O'Donovan, P., and Hertzmann, A. 2011. Anipaint: Interactive painterly animation from video. IEEE Trans. Visual Comput. Graphics, PrePrints.

Digital Library

[30]

Perona, P. 1998. Orientation diffusions. IEEE Trans. Image Proces. 7, 3, 457--467.

Digital Library

[31]

Poynton, C. 2002. Digital Video and HDTV: Algorithms and Interfaces, 1st ed. Morgan Kaufmann.

Digital Library

[32]

Stoyan, D., Kendall, W. S., and Mecke, J. 1996. Stochastic Geometry and Its Applications, 2nd ed. Wiley.

[33]

Strassmann, S. 1986. Hairy brushes. In Proc. SIGGRAPH '86, 225--232.

Digital Library

[34]

Strothotte, T., and Schlechtweg, S. 2002. Non-Photorealistic Computer Graphics: Modeling, Rendering, and Animation. Morgan Kaufmann.

Digital Library

[35]

Turk, G., and Banks, D. 1996. Image-guided streamline placement. In Proc. SIGGRAPH '96, 453--460.

Digital Library

[36]

Turk, G. 1991. Generating textures on arbitrary surfaces using reaction-diffusion. In Proc. SIGGRAPH '91, 289--298.

Digital Library

[37]

Vanderhaeghe, D., Barla, P., Thollot, J., and Sillion, F. 2007. Dynamic point distribution for stroke-based rendering. In Proc. EGSR '07, 139--146.

Digital Library

[38]

Wallraven, C., Fleming, R., Cunningham, D., Rigau, J., Feixas, M., and Sbert, M. 2009. Categorizing art: Comparing humans and computers. Comput. Graph. 33, 4, 484--495.

Digital Library

[39]

Zeng, K., Zhao, M., Xiong, C., and Zhu, S.-C. 2009. From image parsing to painterly rendering. ACM Trans. Graph. 29, 1, 2:1--2:11.

Digital Library

[40]

Zhao, M., and Zhu, S.-C. 2010. Sisley the abstract painter. In Proc. NPAR '10, 99--107.

Digital Library

[41]

Zhu, S. C., and Mumford, D. 1997. Prior learning and Gibbs reaction-diffusion. IEEE Trans. Pattern Anal. Mach. Intell. 19, 11, 1236--1250.

Digital Library

Cited By

Duan HWang MLi YYang Y(2024)Neural 3D Strokes: Creating Stylized 3D Scenes with Vectorized 3D Strokes2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52733.2024.00501(5240-5249)Online publication date: 16-Jun-2024
https://doi.org/10.1109/CVPR52733.2024.00501
Chen YKwan KFu H(2023)Autocompletion of repetitive stroking with image guidanceComputational Visual Media10.1007/s41095-022-0288-29:3(581-596)Online publication date: 8-Mar-2023
https://doi.org/10.1007/s41095-022-0288-2
Zhu YZhao YZhang LLiu X(2022)Computer Aided DIY Design of Stylized Generation of Random Needle EmbroideryJournal of Computer-Aided Design & Computer Graphics10.3724/SP.J.1089.2022.1896234:04(645-658)Online publication date: 2-Dec-2022
https://doi.org/10.3724/SP.J.1089.2022.18962
Show More Cited By

Index Terms

Customizing painterly rendering styles using stroke processes
1. Applied computing
  1. Arts and humanities
    1. Fine arts
    2. Performing arts
2. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision representations
        Image representations
  2. Computer graphics
    1. Graphics systems and interfaces

Recommendations

Portrait painting using active templates
NPAR '11: Proceedings of the ACM SIGGRAPH/Eurographics Symposium on Non-Photorealistic Animation and Rendering

Portraiture plays a substantial role in traditional painting, yet it has not been studied in depth in painterly rendering research. The difficulty in rendering human portraits is due to our acute visual perception to the structure of human face. To ...
Real-time painterly rendering for MR applications
GRAPHITE '04: Proceedings of the 2nd international conference on Computer graphics and interactive techniques in Australasia and South East Asia

In this paper we describe a real-time system for AR/MR rendering applications in a painterly style. Impressionistic images are created using a large number of brush strokes, which are organized as 3d particles to achieve frame-to-frame coherence. ...
Real-Time Painterly Rendering of Terrains
ICVGIP '08: Proceedings of the 2008 Sixth Indian Conference on Computer Vision, Graphics & Image Processing

We present a non-photo realistic, real-time painterly rendering technique for terrains. The painterly appearance and the impression of terrains is created by effectively rendering several brush strokes. The strokes have fixed locations on the surfaces ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

NPAR '11: Proceedings of the ACM SIGGRAPH/Eurographics Symposium on Non-Photorealistic Animation and Rendering

August 2011

234 pages

ISBN:9781450309073

DOI:10.1145/2024676

Conference Chairs:
John Collomosse
University of Surrey, UK
,
Paul Asente
Adobe Systems
,
Editor:
Stephen N. Spencer
University of Washington

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques
EUROGRAPHICS: The European Association for Computer Graphics

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 05 August 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Conference

SBIM/NPAR/CAe 2011

Sponsor:

SIGGRAPH
EUROGRAPHICS

SBIM/NPAR/CAe 2011: Joint Symposia on Sketch-Based Interfaces and Modeling, Non-Photorealistic Animation and Computational Aesthetics

August 5 - 7, 2011

British Columbia, Vancouver, Canada

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

32
Total Citations
View Citations
614
Total Downloads

Downloads (Last 12 months)28
Downloads (Last 6 weeks)1

Reflects downloads up to 16 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Duan HWang MLi YYang Y(2024)Neural 3D Strokes: Creating Stylized 3D Scenes with Vectorized 3D Strokes2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52733.2024.00501(5240-5249)Online publication date: 16-Jun-2024
https://doi.org/10.1109/CVPR52733.2024.00501
Chen YKwan KFu H(2023)Autocompletion of repetitive stroking with image guidanceComputational Visual Media10.1007/s41095-022-0288-29:3(581-596)Online publication date: 8-Mar-2023
https://doi.org/10.1007/s41095-022-0288-2
Zhu YZhao YZhang LLiu X(2022)Computer Aided DIY Design of Stylized Generation of Random Needle EmbroideryJournal of Computer-Aided Design & Computer Graphics10.3724/SP.J.1089.2022.1896234:04(645-658)Online publication date: 2-Dec-2022
https://doi.org/10.3724/SP.J.1089.2022.18962
Fan ZJiang YWang PGong XXu DWang Z(2022)Unified Implicit Neural StylizationComputer Vision – ECCV 202210.1007/978-3-031-19784-0_37(636-654)Online publication date: 31-Oct-2022
https://doi.org/10.1007/978-3-031-19784-0_37
Yang LXu TDu JWu E(2019)Easy Drawing: Generation of Artistic Chinese Flower Painting by Stroke-Based StylizationIEEE Access10.1109/ACCESS.2019.29046697(35449-35456)Online publication date: 2019
https://doi.org/10.1109/ACCESS.2019.2904669
Qian WXu DCao JGuan ZPu Y(2019)Aesthetic art simulation for embroidery styleMultimedia Tools and Applications10.1007/s11042-018-6002-978:1(995-1016)Online publication date: 1-Jan-2019
https://dl.acm.org/doi/10.1007/s11042-018-6002-9
Lindemeier TGülzow JDeussen OWeiskopf DBeck FDachsbacher CSadlo F(2018)Painterly rendering using limited paint color palettesProceedings of the Conference on Vision, Modeling, and Visualization10.2312/vmv.20181263(135-145)Online publication date: 10-Oct-2018
https://dl.acm.org/doi/10.2312/vmv.20181263
Yang KSun Z(2018)Paint with stitchesMultimedia Tools and Applications10.1007/s11042-017-4882-877:10(12259-12292)Online publication date: 1-May-2018
https://dl.acm.org/doi/10.1007/s11042-017-4882-8
Miao ZZhang YZheng ZSun Z(2017)Image paletteMultimedia Tools and Applications10.1007/s11042-016-3408-076:6(7989-8010)Online publication date: 1-Mar-2017
https://dl.acm.org/doi/10.1007/s11042-016-3408-0
Lindemeier TSpicker MDeussen OGuthe MHullin MStamminger MWeinkauf T(2016)Artistic composition for painterly renderingProceedings of the Conference on Vision, Modeling and Visualization10.5555/3056901.3056921(119-126)Online publication date: 10-Oct-2016
https://dl.acm.org/doi/10.5555/3056901.3056921
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents