Article

Stylizing 2.5-D video

Authors:

C. Lawrence Zitnick,

Sing Bing Kang,

Michael CohenAuthors Info & Claims

NPAR '06: Proceedings of the 4th international symposium on Non-photorealistic animation and rendering

Pages 63 - 69

https://doi.org/10.1145/1124728.1124739

Published: 05 June 2006 Publication History

Abstract

In recent years considerable interest has been given to non-photorealistic rendering of photographs, video, and 3D models for illustrative or artistic purposes. Conventional 2D inputs such as photographs and video are easy to create and capture, while 3D models allow for a wider variety of stylization techniques, such as cross-hatching. In this paper, we propose using video with depth information (2.5-D video) to combine the advantages of 2D and 3D input. 2.5-D video is becoming increasingly easy to capture, and with the additional depth information, stylization techniques that require shape information can be applied. However, because 2.5-D video contains only limited shape information and 3D correspondence over time is unknown, it is difficult to create temporally coherent stylized animations directly from raw 2.5-D video. In this paper, we present techniques for processing 2.5-D video to overcome these drawbacks, and demonstrate several styles that can be created using these techniques.

References

[1]

Agarwala, A., Hertzmann, A., Salesin, D., and Seitz, S. 2004. Keyframe-based tracking for rotoscoping and animation. In SIGGRAPH Conference Proceedings, 584--591.]]

Digital Library

[2]

Allen, B., Curless, B., and Popović, Z. 2003. The space of all body shapes: Reconstruction and parameterization from range scans. In SIGGRAPH Conference Proceedings, 587--594.]]

Digital Library

[3]

Anuar, N., and Guskov, I. 2004. Extracting animated meshes with adaptive motion estimation. In Proceedings of the 9th International Fall Workshop on Vision, Modeling, and Visualization, 63--71.]]

[4]

Arya, S., Mount, D. M., Netanyahu, N. S., Silverman, R., and Wu, A. Y. 1998. An optimal algorithm for approximate nearest neighbor searching fixed dimensions. Journal of the ACM 45, 6, 891--923.]]

Digital Library

[5]

Besl, P. J., and McKay, N. D. 1992. A method for registration of 3-D shapes. IEEE Trans. on Pattern Analysis and Machine Intelligence 14, 2, 239--256.]]

Digital Library

[6]

Curless, B., and Levoy, M. 1996. A volumetric method for building complex models from range images. In SIGGRAPH '96: Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, ACM Press, New York, NY, USA, 303--312.]]

Digital Library

[7]

Elber, G. 1998. Line art illustrations of parametric and implicit forms. IEEE Transactions on Visualization and Computer Graphics 4, 1, 71--81.]]

Digital Library

[8]

Girshick, A., Interrante, V., Haker, S., and Lemoine, T. 2000. Line direction matters: an argument for the use of principal directions in 3d line drawings. In NPAR '00: Proceedings of the 1st international symposium on Non-photorealistic animation and rendering, ACM Press, New York, NY, USA, 43--52.]]

Digital Library

[9]

Gooch, B., and Gooch, A. 2001. Non-Photorealistic Rendering. A K Peters, Ltd.]]

Digital Library

[10]

Haeberli, P. 1990. Paint by numbers: abstract image representations. In SIGGRAPH '90: Proceedings of the 17th annual conference on Computer graphics and interactive techniques, ACM Press, New York, NY, USA, 207--214.]]

Digital Library

[11]

Hameiri, E., and Shimshoni, I. 2002. Estimating the principal curvatures and the Darboux frame from real 3D range data. In IEEE Inter. Symp. on 3D Data Proc. Visual. Trans., 258--267.]]

[12]

Hays, J. H., and Essa, I. 2004. Image and video-based painterly animation. In Symposium on Non-Photorealistic Animation and Rendering (NPAR), 113--120.]]

Digital Library

[13]

Hertzmann, A., and Perlin, K. 2000. Painterly rendering for video and interaction. In Symposium on Non-Photorealistic Animation and Rendering (NPAR), 7--12.]]

Digital Library

[14]

Hertzmann, A., and Zorin, D. 2000. Illustrating smooth surfaces. In SIGGRAPH Conference Proceedings, 517--526.]]

Digital Library

[15]

Hertzmann, A. 1998. Painterly rendering with curved brush strokes of multiple sizes. Computer Graphics 32, Annual Conference Series, 453--460.]]

Digital Library

[16]

Levoy, M., Pulli, K., Curless, B., Rusinkiewicz, S., Koller, D., Pereira, L., Ginzton, M., Anderson, S., Davis, J., Ginsberg, J., Shade, J., and Fulk, D. 2000. The Digital Michelangelo Project: 3D scanning of large statues. In SIGGRAPH Conference Proceedings, 131--144.]]

Digital Library

[17]

Li, Y., Sun, J., and Shum, H.-Y. 2005. Video object cut and paste. SIGGRAPH Conference Proceedings 24, 3, 595--600.]]

Digital Library

[18]

Litwinowicz, P. 1997. Processing images and video for an impressionist effect. In SIGGRAPH '97: Proceedings of the 24th annual conference on Computer graphics and interactive techniques, ACM Press/Addison-Wesley Publishing Co., New York, NY, USA, 407--414.]]

Digital Library

[19]

Meier, B. J. 1996. Painterly rendering for animation. In SIGGRAPH '96: Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, ACM Press, New York, NY, USA, 477--484.]]

Digital Library

[20]

Praun, E., Hoppe, H., Webb, M., and Finkelstein, A. 2001. Real-time hatching. In Proceedings of ACM SIGGRAPH 2001, 579--584.]]

Digital Library

[21]

Raskar, R., Tan, K., Feris, R., Yu, J., and Turk, M. 2004. Non-photorealistic camera: Depth edge detection and stylized rendering using multi-flash imaging. In SIGGRAPH Conference Proceedings, 679--688.]]

Digital Library

[22]

Salisbury, M. P., Wong, M. T., Hughes, J. F., and Salesin, D. H. 1997. Orientable textures for image-based pen-and-ink illustration. In SIGGRAPH Conference Proceedings, 401--406.]]

Digital Library

[23]

Strothotte, T., and Schlechtweg, S. 2002. Non-Photorealistic Computer Graphics. Modelling, Animation, and Rendering, Morgan Kaufmann.]]

Digital Library

[24]

Sumner, R. W., and Popović, J. 2004. Deformation transfer for triangle meshes. ACM Transactions on Graphics 23, 3, 399--405.]]

Digital Library

[25]

Vedula, S., Baker, S., Rander, P., Collins, R., and Kanade, T. 1999. Three-dimensional scene flow. In Int'l Conf. on Computer Vision (ICCV), vol. 2, 722--729.]]

Digital Library

[26]

Wang, J., Xu, Y., Shum, H.-Y., and Cohen, M. F. 2004. Video tooning. In SIGGRAPH Conference Proceedings, 574--583.]]

Digital Library

[27]

Wang, J., Bhat, P., Colburn, R. A., Agrawala, M., and Cohen, M. F. 2005. Interactive video cutout. SIGGRAPH Conference Proceedings 24, 3, 585--594.]]

Digital Library

[28]

Zander, J., Isenberg, T., Schlechtweg, S., and Strothotte, T. 2004. High quality hatching. Computer Graphics Forum (EG'04) 23, 3 (September), 421--430.]]

[29]

Zhang, L., Curless, B., and Seitz, S. M. 2003. Spacetime stereo: Shape recovery for dynamic scenes. In IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), 367--374.]]

[30]

Zhang, L., Snavely, N., Curless, B., and Seitz, S. M. 2004. Spacetime faces: High-resolution capture for modeling and animation. In SIGGRAPH Conference Proceedings, 548--558.]]

Digital Library

[31]

Zhu, C., Byrd, R. H., and Nocedal, J. 1997. Algorithm 778: L-BFGS-B, FORTRAN routines for large scale bound constrained optimization. ACM Transactions on Mathematical Software 23, 4, 550--560.]]

Digital Library

Cited By

Yu EBlackburn-Matzen KNguyen CWang OHabib Kazi RBousseau A(2023)VideoDoodles: Hand-Drawn Animations on Videos with Scene-Aware CanvasesACM Transactions on Graphics10.1145/359241342:4(1-12)Online publication date: 26-Jul-2023
https://dl.acm.org/doi/10.1145/3592413
Hauptfleisch FTexler OTexler AKrivánek JSýkora D(2020)StyleProp: Real‐time Example‐based Stylization of 3D ModelsComputer Graphics Forum10.1111/cgf.1416939:7(575-586)Online publication date: 24-Nov-2020
https://doi.org/10.1111/cgf.14169
Jamriška OSochorová ŠTexler OLukáč MFišer JLu JShechtman ESýkora D(2019)Stylizing video by exampleACM Transactions on Graphics10.1145/3306346.332300638:4(1-11)Online publication date: 12-Jul-2019
https://dl.acm.org/doi/10.1145/3306346.3323006
Show More Cited By

Index Terms

Stylizing 2.5-D video
1. Applied computing
  1. Document management and text processing
    1. Document capture
      1. Graphics recognition and interpretation
2. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision tasks
        Scene understanding
      2. Image and video acquisition
        3D imaging
  2. Computer graphics
    1. Animation

Recommendations

Automatic expressive deformations for stylizing motion
GRAPHITE '06: Proceedings of the 4th international conference on Computer graphics and interactive techniques in Australasia and Southeast Asia

3D computer animation often struggles to compete with the flexibility and expressiveness commonly found in traditional animation, particularly when rendered non-photorealistically. We present an animation tool that takes skeleton-driven 3D computer ...
Automatic expressive deformations for implying and stylizing motion
Abstract
Three-dimensional computer animation often struggles to compete with the flexibility and expressiveness commonly found in traditional animation, particularly when rendered non-photorealistically. We present an animation tool that takes skeleton-...
Turning to the masters: motion capturing cartoons

In this paper, we present a technique we call "cartoon capture and retargeting" which we use to track the motion from traditionally animated cartoons and retarget it onto 3-D models, 2-D drawings, and photographs. By using animation as the source, we ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

NPAR '06: Proceedings of the 4th international symposium on Non-photorealistic animation and rendering

June 2006

160 pages

ISBN:1595933573

DOI:10.1145/1124728

Conference Chairs:
Doug DeCarlo
Rutgers University
,
Lee Markosian
University of Michigan

Copyright © 2006 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Annecy Animation Festival

In-Cooperation

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 05 June 2006

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

NPAR06

Sponsor:

NPAR06: The 4th International Symposium on Non-Photorealistic Animation

June 5 - 7, 2006

Annecy, France

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

14
Total Citations
View Citations
719
Total Downloads

Downloads (Last 12 months)18
Downloads (Last 6 weeks)1

Reflects downloads up to 23 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Yu EBlackburn-Matzen KNguyen CWang OHabib Kazi RBousseau A(2023)VideoDoodles: Hand-Drawn Animations on Videos with Scene-Aware CanvasesACM Transactions on Graphics10.1145/359241342:4(1-12)Online publication date: 26-Jul-2023
https://dl.acm.org/doi/10.1145/3592413
Hauptfleisch FTexler OTexler AKrivánek JSýkora D(2020)StyleProp: Real‐time Example‐based Stylization of 3D ModelsComputer Graphics Forum10.1111/cgf.1416939:7(575-586)Online publication date: 24-Nov-2020
https://doi.org/10.1111/cgf.14169
Jamriška OSochorová ŠTexler OLukáč MFišer JLu JShechtman ESýkora D(2019)Stylizing video by exampleACM Transactions on Graphics10.1145/3306346.332300638:4(1-11)Online publication date: 12-Jul-2019
https://dl.acm.org/doi/10.1145/3306346.3323006
Othman MBright WSenan NSuparjoh S(2017)Application of A Computer Animation Technique to Assist the Teaching of Pre-Handwriting Skills to Children with Coordination Difficulties/DyspraxiaMATEC Web of Conferences10.1051/matecconf/201713500074135(00074)Online publication date: 20-Nov-2017
https://doi.org/10.1051/matecconf/201713500074
Eichhardt IChetverikov DJankó Z(2017)Image-guided ToF depth upsamplingMachine Vision and Applications10.1007/s00138-017-0831-928:3-4(267-282)Online publication date: 1-May-2017
https://dl.acm.org/doi/10.1007/s00138-017-0831-9
Silva JGomes LAguero KBellon OSilva L(2013)Real-time acquisition and super-resolution techniques on 3D reconstruction2013 IEEE International Conference on Image Processing10.1109/ICIP.2013.6738440(2135-2139)Online publication date: Sep-2013
https://doi.org/10.1109/ICIP.2013.6738440
Northam LAsente PKaplan C(2013)Stereoscopic 3D image stylizationComputers and Graphics10.1016/j.cag.2012.11.00537:5(389-402)Online publication date: 1-Aug-2013
https://dl.acm.org/doi/10.1016/j.cag.2012.11.005
Northam LAsente PKaplan CAsente PGrimm C(2012)Consistent stylization and painterly rendering of stereoscopic 3D imagesProceedings of the Symposium on Non-Photorealistic Animation and Rendering10.5555/2330147.2330158(47-56)Online publication date: 4-Jun-2012
https://dl.acm.org/doi/10.5555/2330147.2330158
Richardt CStoll CDodgson NSeidel HTheobalt C(2012)Coherent Spatiotemporal Filtering, Upsampling and Rendering of RGBZ VideosComputer Graphics Forum10.1111/j.1467-8659.2012.03003.x31:2pt1(247-256)Online publication date: 1-May-2012
https://dl.acm.org/doi/10.1111/j.1467-8659.2012.03003.x
Bénard PBousseau AThollot J(2011)State‐of‐the‐Art Report on Temporal Coherence for Stylized AnimationsComputer Graphics Forum10.1111/j.1467-8659.2011.02075.x30:8(2367-2386)Online publication date: 25-Oct-2011
https://doi.org/10.1111/j.1467-8659.2011.02075.x
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents