Article

Real-time painterly rendering for MR applications

Authors:

Michael Haller,

Daniel SperlAuthors Info & Claims

GRAPHITE '04: Proceedings of the 2nd international conference on Computer graphics and interactive techniques in Australasia and South East Asia

Pages 30 - 38

https://doi.org/10.1145/988834.988839

Published: 15 June 2004 Publication History

Abstract

In this paper we describe a real-time system for AR/MR rendering applications in a painterly style. Impressionistic images are created using a large number of brush strokes, which are organized as 3d particles to achieve frame-to-frame coherence. Reference pictures are used to compute the properties of each stroke.The presented technique is based on B. J. Meier's "Painterly Rendering for Animation". We modified the algorithm of Meier for real-time AR/MR environments by extensively using modern 3d hardware. Vertex and pixel shaders allow both the rendering of thousands of brush strokes per frame and the correct application of their properties. Direct rendering to textures allows rapid generation of reference pictures and assures great flexibility, since arbitrary rendering systems can be combined (e. g. painterly rendering of toon shaded objects, etc.).

References

[1]

CURTIS, C. J., ANDERSON, S. E., SEIMS, J. E., FLEISCHER, K. W., AND SALESIN, D. H. 1997. Computer-generated watercolor. In Proceedings of SIGGRAPH 97, 421--430.]]

Digital Library

[2]

DIETRICH, S. 2000. Cartoon rendering and advanced texture features of the geforce 256 texture matrix, projective textures, cube maps, texture coordinate generation and dotproduct3 texture blending. Tech. rep., nVIDIA.]]

[3]

DRONE, S., KRISHNAMACHARI, P., LAPAN, D., MICHAELS, J., SCHMIDT, D., AND SMITH, P. 2000. Project aember: Real-time painterly rendering of 3d scenery. Tech. rep., UIUC ACM SIGGRAPH, August.]]

[4]

DURAND, F. 2002. An invitation to discuss computer depiction. In Proceedings of the second international symposium on Non-photorealistic animation and rendering, ACM Press, 111--124.]]

Digital Library

[5]

FENG DONG, GORDON J. CLAPWORTHY, HAI LIN, AND MELEAGROS A. KROKOS. 2003. Nonphotorealistic Rendering of Medical Volume Data. IEEE Computer Graphics and Applications 23, 4 (July/August), 44--52.]]

Digital Library

[6]

FERNANDO, R., AND KILGARD, M. J. 2003. Cg Tutorial, The: The Definitive Guide to Programmable Real-Time Graphics. Addison-Wesley.]]

Digital Library

[7]

FREUDENBERG, B., MASUCH, M., ROEBER, N., AND STROTHOTTE, T. 2001. The Computer-Visualistik-Raum: Veritable and Inexpensive Presentation of a Virtual Reconstruction. In In Proceedings VAST 2001: Virtual Reality, Archaelogy, and Cultural Heritage, 97--102.]]

Digital Library

[8]

GOOCH, B., COOMBE, G., AND SHIRLEY, P. 2002. Artistic vision: painterly rendering using computer vision techniques. In Proceedings of the second international symposium on Non-photorealistic animation and rendering, ACM Press, 83--ff.]]

Digital Library

[9]

HAEBERLI, P. E. 1990. Paint by numbers: Abstract image representations. In Proceedings of SIGGRAPH 90, 207--214.]]

Digital Library

[10]

HERTZMANN, A., AND PERLIN, K. 2000. Painterly rendering for video and interaction. In Proceedings of the first international symposium on Non-photorealistic animation and rendering, ACM Press, 7--12.]]

Digital Library

[11]

KAPLAN, M., GOOCH, B., AND COHEN, E. 2000. Interactive artistic rendering. In Proceedings of the first international symposium on Non-photorealistic animation and rendering, ACM Press, 67--74.]]

Digital Library

[12]

KATO, H., BILLINGHURST, M., BLANDING, B., AND MAY, R. 1999. ARToolKit.]]

[13]

KEN-ICHI ANJYO, AND KATSUAKI HIRAMITSU. 2003. Stylized High-lights for Cartoon Rendering and Animation. IEEE Computer Graphics and Applications 23, 4 (July/August), 54--61.]]

Digital Library

[14]

KIRK, D. 2003. Cg Toolkit - User's Manual, Release 1.1, 1 ed. nVIDIA Corporation, March.]]

[15]

LANDER, J. 2000. Shades of disney: Opaquing a 3d world. Game Developers Magazine (March).]]

[16]

MAJUMDER, A., AND GOPI, M. 2002. Hardware accelerated real time charcoal rendering. In Proceedings of the second international symposium on Non-photorealistic animation and rendering, ACM Press, 59--66.]]

Digital Library

[17]

MARK, W. R., GLANVILLE, R. S., AKELEY, K., AND KILGARD, M. J. 2003. Cg: A system for programming graphics hardware in a c-like language. In Proceedings of SIGGRAPH 2003, 896--907.]]

Digital Library

[18]

MARKOSIAN, L., KOWALSKI, M. A., TRYCHIN, S. J., BOURDEV, L. D., GOLDSTEIN, D., AND HUGHES, J. F. 1997. Real-time nonphotorealistic rendering. In Proceedings of SIGGRAPH 97, 415--420.]]

Digital Library

[19]

MEIER, B. J. 1996. Painterly rendering for animation. In Proceedings of SIGGRAPH 96, 477--484.]]

Digital Library

[20]

PRAUN, E., HOPPE, H., WEBB, M., AND FINKELSTEIN, A. 2001. Real-time hatching. In Proceedings of SIGGRAPH 2001, 581.]]

Digital Library

[21]

REEVES, W. T., AND BLAU, R. 1985. Approximate and probabilistic algorithms for shading and rendering structured particle systems. In SIGGRAPH 85 Proceedings.]]

Digital Library

[22]

SALISBURY, M. P., ANDERSON, S. E., BARZEL, R., AND SALESIN, D. H. 1994. Interactive pen-and-ink illustration. In Proceedings of SIGGRAPH 94, 101--108.]]

Digital Library

[23]

WINKENBACH, G., AND SALESIN, D. H. 1994. Computer-generated pen-and-ink illustration. In Proceedings of SIGGRAPH 94, 91--100.]]

Digital Library

Cited By

Curtis CDart KLatzko TKahrs J(2020)Real-time non-photorealistic animation for immersive storytelling in “Age of Sail”Graphics and Visual Computing10.1016/j.cagx.2019.1000123(100012)Online publication date: Jun-2020
https://doi.org/10.1016/j.cagx.2019.100012
Curtis CDart KLatzko TKahrs JJorge JBartram LCatalano CKaplan CForbes ADiVerdi S(2019)Non-photorealistic animation for immersive storytellingProceedings of the 8th ACM/Eurographics Expressive Symposium on Computational Aesthetics and Sketch Based Interfaces and Modeling and Non-Photorealistic Animation and Rendering10.2312/exp.20191071(1-10)Online publication date: 5-May-2019
https://dl.acm.org/doi/10.2312/exp.20191071
Curtis CDart KLatzko TKahrs J(2019)WITHDRAWN: Real-time non-photorealistic animation for immersive storytelling in “Age of Sail”Computers & Graphics10.1016/j.cag.2019.11.001Online publication date: Nov-2019
https://doi.org/10.1016/j.cag.2019.11.001
Show More Cited By

Index Terms

Real-time painterly rendering for MR applications

Recommendations

Real-Time Painterly Rendering of Terrains
ICVGIP '08: Proceedings of the 2008 Sixth Indian Conference on Computer Vision, Graphics & Image Processing

We present a non-photo realistic, real-time painterly rendering technique for terrains. The painterly appearance and the impression of terrains is created by effectively rendering several brush strokes. The strokes have fixed locations on the surfaces ...
Fin textures for real-time painterly aesthetics
MIG '15: Proceedings of the 8th ACM SIGGRAPH Conference on Motion in Games

We present a novel method for real-time stylized rendering in video games. Recent advances in painterly character authoring and rendering allow artists to create characters represented by 3D geometry as well as 3D paint strokes embedded on and around ...
Interactive Painterly Rendering for Mobile Devices
Entertainment Computing - ICEC 2015
Abstract
Painterly rendering is among the most popular non-photorealistic rendering techniques and has been employed in many applications. Research on painterly rendering mainly focuses on automatically generating artistic results. In this study, we aim to ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

GRAPHITE '04: Proceedings of the 2nd international conference on Computer graphics and interactive techniques in Australasia and South East Asia

June 2004

267 pages

ISBN:1581138830

DOI:10.1145/988834

Conference Chair:
Yong Tsui Lee
Nanyang Technological University, Singapore
,
Editor:
Stephen N. Spencer
The University of Washington
,
Program Chairs:
Alan Chalmers,
Hock Soon Seah

Copyright © 2004 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 15 June 2004

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

GRAPHITE04

Sponsor:

SIGGRAPH

GRAPHITE04: International Conference on Computer Graphics and Interactive Techniques in Australasia and South East Asia

June 15 - 18, 2004

Singapore

Acceptance Rates

GRAPHITE '04 Paper Acceptance Rate 39 of 65 submissions, 60%;

Overall Acceptance Rate 124 of 241 submissions, 51%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

12
Total Citations
View Citations
1,081
Total Downloads

Downloads (Last 12 months)14
Downloads (Last 6 weeks)3

Reflects downloads up to 16 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Curtis CDart KLatzko TKahrs J(2020)Real-time non-photorealistic animation for immersive storytelling in “Age of Sail”Graphics and Visual Computing10.1016/j.cagx.2019.1000123(100012)Online publication date: Jun-2020
https://doi.org/10.1016/j.cagx.2019.100012
Curtis CDart KLatzko TKahrs JJorge JBartram LCatalano CKaplan CForbes ADiVerdi S(2019)Non-photorealistic animation for immersive storytellingProceedings of the 8th ACM/Eurographics Expressive Symposium on Computational Aesthetics and Sketch Based Interfaces and Modeling and Non-Photorealistic Animation and Rendering10.2312/exp.20191071(1-10)Online publication date: 5-May-2019
https://dl.acm.org/doi/10.2312/exp.20191071
Curtis CDart KLatzko TKahrs J(2019)WITHDRAWN: Real-time non-photorealistic animation for immersive storytelling in “Age of Sail”Computers & Graphics10.1016/j.cag.2019.11.001Online publication date: Nov-2019
https://doi.org/10.1016/j.cag.2019.11.001
Rolim CSchmalstieg DKalkofen DTeichrieb V(2015)[POSTER] Design Guidelines for Generating Augmented Reality InstructionsProceedings of the 2015 IEEE International Symposium on Mixed and Augmented Reality10.1109/ISMAR.2015.36(120-123)Online publication date: 29-Sep-2015
https://dl.acm.org/doi/10.1109/ISMAR.2015.36
Lu JSander PFinkelstein AAliaga DOliveira MVarshney AWyman C(2010)Interactive painterly stylization of images, videos and 3D animationsProceedings of the 2010 ACM SIGGRAPH symposium on Interactive 3D Graphics and Games10.1145/1730804.1730825(127-134)Online publication date: 19-Feb-2010
https://dl.acm.org/doi/10.1145/1730804.1730825
Vanderhaeghe DBarla PThollot JSillion F(2007)Dynamic point distribution for stroke-based renderingProceedings of the 18th Eurographics conference on Rendering Techniques10.5555/2383847.2383867(139-146)Online publication date: 25-Jun-2007
https://dl.acm.org/doi/10.5555/2383847.2383867
Fischer JCunningham DBartz DWallraven CBülthoff HStraßer W(2006)Measuring the discernability of virtual objects in conventional and stylized augmented realityProceedings of the 12th Eurographics conference on Virtual Environments10.5555/2386021.2386029(53-61)Online publication date: 8-May-2006
https://dl.acm.org/doi/10.5555/2386021.2386029
Shin JHaller MMukundan RIshii HLee NNatkin STsushima K(2006)A stylized cartoon hair rendererProceedings of the 2006 ACM SIGCHI international conference on Advances in computer entertainment technology10.1145/1178823.1178899(64-es)Online publication date: 14-Jun-2006
https://dl.acm.org/doi/10.1145/1178823.1178899
Bhattacharjee SAdabala N(2006)Texture guided realtime painterly rendering of geometric modelsProceedings of the 5th Indian conference on Computer Vision, Graphics and Image Processing10.1007/11949619_28(311-320)Online publication date: 13-Dec-2006
https://dl.acm.org/doi/10.1007/11949619_28
Haller MLanderl FBillinghurst MWyvill GArnold DBillinghurst M(2005)A loose and sketchy approach in a mediated reality environmentProceedings of the 3rd international conference on Computer graphics and interactive techniques in Australasia and South East Asia10.1145/1101389.1101463(371-379)Online publication date: 29-Nov-2005
https://dl.acm.org/doi/10.1145/1101389.1101463
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents