Article

Appearance-space texture synthesis

Authors:

Sylvain Lefebvre,

Hugues HoppeAuthors Info & Claims

SIGGRAPH '06: ACM SIGGRAPH 2006 Papers

Pages 541 - 548

https://doi.org/10.1145/1179352.1141921

Published: 01 July 2006 Publication History

Abstract

The traditional approach in texture synthesis is to compare color neighborhoods with those of an exemplar. We show that quality is greatly improved if pointwise colors are replaced by appearance vectors that incorporate nonlocal information such as feature and radiance-transfer data. We perform dimensionality reduction on these vectors prior to synthesis, to create a new appearance-space exemplar. Unlike a texton space, our appearance space is low-dimensional and Euclidean. Synthesis in this information-rich space lets us reduce runtime neighborhood vectors from 5x5 grids to just 4 locations. Building on this unifying framework, we introduce novel techniques for coherent anisometric synthesis, surface texture synthesis directly in an ordinary atlas, and texture advection. Remarkably, we achieve all these functionalities in real-time, or 3 to 4 orders of magnitude faster than prior work.

Supplementary Material

JPG File (p541-lefebre-high.jpg)

Download
24.36 KB

JPG File (p541-lefebre-low.jpg)

Download
20.42 KB

High Resolution (p541-lefebre-high.mov)

Download
55.89 MB

Low Resolution (p541-lefebre-low.mov)

Download
19.73 MB

References

[1]

Ashikhmin, M. 2001. Synthesizing natural textures. Symposium on Interactive 3D Graphics, 217--226.]]

Digital Library

[2]

De Bonet, J. 1997. Multiresolution sampling procedure for analysis and synthesis of texture images. ACM SIGGRAPH, 361--368.]]

Digital Library

[3]

Efros, A., and Leung, T. 1999. Texture synthesis by non-parametric sampling. ICCV, 1033--1038.]]

Digital Library

[4]

Garber, D. 1981. Computational models for texture analysis and texture synthesis. PhD Dissertation, University of Southern California.]]

Digital Library

[5]

Heeger, D., and Bergen, J. 1995. Pyramid-based texture analysis/synthesis. ACM SIGGRAPH, 229--238.]]

Digital Library

[6]

Hertzmann, A., Jacobs, C., Oliver, N., Curless, B., and Salesin, D. 2001. Image analogies. ACM SIGGRAPH, 327--340.]]

Digital Library

[7]

Hertzmann, A., and Zorin, D. 2000. Illustrating smooth surfaces. ACM SIGGRAPH, 517--526.]]

Digital Library

[8]

Kwatra, V., Essa, I., Bobick, A., and Kwatra, N. 2005. Texture optimization for example-based synthesis. SIGGRAPH, 795--802.]]

Digital Library

[9]

Lefebvre, S., and Hoppe, H. 2005. Parallel controllable texture synthesis. ACM SIGGRAPH, 777--786.]]

Digital Library

[10]

Leung, T., and Malik, J. 2001. Representing and recognizing the visual appearance of materials using 3D textons. IJCV 43(1), 29--44.]]

Digital Library

[11]

Liang, L., Liu, C., Xu, Y., Guo, B., and Shum, H.-Y. 2001. Real-time texture synthesis by patch-based sampling. ACM TOG 20(3), 127--150.]]

Digital Library

[12]

Magda, S., and Kriegman, D. 2003. Fast texture synthesis on arbitrary meshes. Eurographics Symposium on Rendering, 82--89.]]

Digital Library

[13]

Malik, J., Belongie, S., Shi, J., and Leung, T. 1999. Textons, contours and regions: Cue integration in image segmentation. ICCV, 918--925.]]

Digital Library

[14]

Neyret, F., and Cani, M.-P. 1999. Pattern-based texturing revisited. ACM SIGGRAPH, 235--242.]]

Digital Library

[15]

Neyret, F. 2003. Advected textures. Symposium on computer animation, 147--153.]]

Digital Library

[16]

Popat, K., and Picard, R. 1993. Novel cluster-based probability model for texture synthesis, classification, and compression. Visual Communications and Image Processing, 756--768.]]

[17]

Portilla, J., and Simoncelli, E. 2000. A parametric texture model based on joint statistics of complex wavelet coefficients. IJCV (40) 1.]]

Digital Library

[18]

Praun, E., Finkelstein, A., and Hoppe, H. 2000. Lapped textures. ACM SIGGRAPH, 465--470.]]

Digital Library

[19]

Roweis, S. 1997. EM algorithms for PCA and SPCA. NIPS, 626--632.]]

Digital Library

[20]

Roweis, S., and Saul, L. 2000. Nonlinear dimensionality reduction by locally linear embedding. Science, 290:2323--2326.]]

[21]

Sloan, P.-P., Liu, X., Shum, H.-Y., and Snyder, J. 2003. Bi-scale radiance transfer. ACM SIGGRAPH, 370--375.]]

Digital Library

[22]

Taponecco, F., and Alexa, M. 2004. Steerable texture synthesis. Eurographics Conference.]]

[23]

Tenenbaum, J., De Silva, V., and Langford, J. 2000. A global geometric framework for nonlinear dimensionality reduction. Science, 290:2319--2323.]]

[24]

Tong, X., Zhang, J., Liu, L., Wang, X., Guo, B., and Shum, H.-Y. 2002. Synthesis of bidirectional texture functions on arbitrary surfaces. ACM SIGGRAPH, 665--672.]]

Digital Library

[25]

Turk, G. 2001. Texture synthesis on surfaces. SIGGRAPH, 347--354.]]

Digital Library

[26]

Wei, L.-Y., and Levoy, M. 2000. Fast texture synthesis using tree-structured vector quantization. ACM SIGGRAPH, 479--488.]]

Digital Library

[27]

Wei, L.-Y., and Levoy, M. 2001. Texture synthesis over arbitrary manifold surfaces. ACM SIGGRAPH, 355--360.]]

Digital Library

[28]

Wei, L.-Y., and Levoy, M. 2003. Order-independent texture synthesis. http://graphics.stanford.edu/papers/texture-synthesis-sig03/.]]

[29]

Wu, Q., and Yu, Y. 2004. Feature matching and deformation for texture synthesis. ACM SIGGRAPH, 362--365.]]

Digital Library

[30]

Ying, L., Hertzmann, A., Biermann, H., and Zorin, D. 2001. Texture and shape synthesis on surfaces. Symposium on Rendering, 301--312.]]

Digital Library

[31]

Zhang, J., Zhou, K., Velho, L., Guo, B., and Shum, H.-Y. 2003. Synthesis of progressively-variant textures on arbitrary surfaces. ACM SIGGRAPH, 295--302.]]

Digital Library

Cited By

Scott JDodgson N(2022)Evaluating Realism in Example-based Terrain SynthesisACM Transactions on Applied Perception10.1145/353152619:3(1-18)Online publication date: 2-Sep-2022
https://dl.acm.org/doi/10.1145/3531526
Tu PWei LZwicker M(2022)Clustered vector texturesACM Transactions on Graphics10.1145/3528223.353006241:4(1-23)Online publication date: 22-Jul-2022
https://dl.acm.org/doi/10.1145/3528223.3530062
Arora RSingh K(2021)Mid-Air Drawing of Curves on 3D Surfaces in Virtual RealityACM Transactions on Graphics10.1145/345909040:3(1-17)Online publication date: 15-Jul-2021
https://dl.acm.org/doi/10.1145/3459090
Show More Cited By

Index Terms

Appearance-space texture synthesis
1. Computing methodologies
  1. Computer graphics
    1. Image manipulation
      1. Texturing
    2. Shape modeling
      1. Parametric curve and surface models
      2. Volumetric models
2. Theory of computation
  1. Randomness, geometry and discrete structures

Recommendations

Appearance-space texture synthesis

The traditional approach in texture synthesis is to compare color neighborhoods with those of an exemplar. We show that quality is greatly improved if pointwise colors are replaced by appearance vectors that incorporate nonlocal information such as ...
Texture Synthesis Using the Structure Tensor
This paper proposes a two-stage texture synthesis algorithm. At the first stage, a structure tensor map carrying information about the local orientation is synthesized from the exemplar's data and used at the second stage to constrain the synthesis of the ...
Variational Texture Synthesis with Sparsity and Spectrum Constraints

This paper introduces a new approach for texture synthesis. We propose a unified framework that both imposes first order statistical constraints on the use of atoms from an adaptive dictionary, as well as second order constraints on pixel values. This ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SIGGRAPH '06: ACM SIGGRAPH 2006 Papers

July 2006

742 pages

ISBN:1595933646

DOI:10.1145/1179352

Conference Chair:
John Finnegan
Purdue University
,
Program Chair:
Julie Dorsey
Yale University

Copyright © 2006 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 July 2006

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

SIGGRAPH06

Sponsor:

SIGGRAPH

SIGGRAPH06: Special Interest Group on Computer Graphics and Interactive Techniques Conference

July 30 - August 3, 2006

Massachusetts, Boston

Acceptance Rates

SIGGRAPH '06 Paper Acceptance Rate 86 of 474 submissions, 18%;

Overall Acceptance Rate 1,822 of 8,601 submissions, 21%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

62
Total Citations
View Citations
2,595
Total Downloads

Downloads (Last 12 months)3
Downloads (Last 6 weeks)1

Reflects downloads up to 10 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Scott JDodgson N(2022)Evaluating Realism in Example-based Terrain SynthesisACM Transactions on Applied Perception10.1145/353152619:3(1-18)Online publication date: 2-Sep-2022
https://dl.acm.org/doi/10.1145/3531526
Tu PWei LZwicker M(2022)Clustered vector texturesACM Transactions on Graphics10.1145/3528223.353006241:4(1-23)Online publication date: 22-Jul-2022
https://dl.acm.org/doi/10.1145/3528223.3530062
Arora RSingh K(2021)Mid-Air Drawing of Curves on 3D Surfaces in Virtual RealityACM Transactions on Graphics10.1145/345909040:3(1-17)Online publication date: 15-Jul-2021
https://dl.acm.org/doi/10.1145/3459090
Scott JDodgson N(2021)Example-based terrain synthesis with pit removalComputers and Graphics10.1016/j.cag.2021.06.01299:C(43-53)Online publication date: 1-Oct-2021
https://dl.acm.org/doi/10.1016/j.cag.2021.06.012
Sethapakdi TMcCann JBrewster SFitzpatrick GCox AKostakos V(2019)Painting with CATSProceedings of the 2019 CHI Conference on Human Factors in Computing Systems10.1145/3290605.3300287(1-9)Online publication date: 2-May-2019
https://dl.acm.org/doi/10.1145/3290605.3300287
Derouet‐Jourdan ASalvati MJonchier T(2019)Generating Stochastic Wall Patterns On‐the‐fly with Wang TilesComputer Graphics Forum10.1111/cgf.1363538:2(255-264)Online publication date: 7-Jun-2019
https://doi.org/10.1111/cgf.13635
Yu NBarnes CShechtman EAmirghodsi SLukac M(2019)Texture Mixer: A Network for Controllable Synthesis and Interpolation of Texture2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR.2019.01244(12156-12165)Online publication date: Jun-2019
https://doi.org/10.1109/CVPR.2019.01244
Miao ZZhang YZheng ZSun Z(2017)Image paletteMultimedia Tools and Applications10.1007/s11042-016-3408-076:6(7989-8010)Online publication date: 1-Mar-2017
https://dl.acm.org/doi/10.1007/s11042-016-3408-0
Jiang XSheng BLin WLi PMa LShen R(2017)Antialiased super-resolution with parallel high-frequency synthesisMultimedia Tools and Applications10.1007/s11042-015-3049-876:1(543-560)Online publication date: 1-Jan-2017
https://dl.acm.org/doi/10.1007/s11042-015-3049-8
Suarez JBelhadj FBoyer V(2017)Real-time 3D rendering with hatchingThe Visual Computer: International Journal of Computer Graphics10.1007/s00371-016-1222-333:10(1319-1334)Online publication date: 1-Oct-2017
https://dl.acm.org/doi/10.1007/s00371-016-1222-3
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents