research-article

High-Performance By-Example Noise using a Histogram-Preserving Blending Operator

Authors:

Fabrice NeyretAuthors Info & Claims

Proceedings of the ACM on Computer Graphics and Interactive Techniques, Volume 1, Issue 2

Article No.: 31, Pages 1 - 25

https://doi.org/10.1145/3233304

Published: 24 August 2018 Publication History

Abstract

We propose a new by-example noise algorithm that takes as input a small example of a stochastic texture and synthesizes an infinite output with the same appearance. It works on any kind of random-phase inputs as well as on many non-random-phase inputs that are stochastic and non-periodic, typically natural textures such as moss, granite, sand, bark, etc. Our algorithm achieves high-quality results comparable to state-of-the-art procedural-noise techniques but is more than 20 times faster.

Our approach is conceptually simple: we partition the output texture space on a triangle grid and associate each vertex with a random patch from the input such that the evaluation inside a triangle is done by blending 3 patches. The key to this approach is the blending operation that usually produces visual artifacts such as ghosting, softened discontinuities and reduced contrast, or introduces new colors not present in the input. We analyze these problems by showing how linear blending impacts the histogram and show that a blending operator that preserves the histogram prevents these problems.

The main requirement for a rendering application is to implement such an operator in a fragment shader without further post-processing, i.e. we need a histogram-preserving blending operator that operates only at the pixel level. Our insight for the design of this operator is that, with Gaussian inputs, histogram-preserving blending boils down to mean and variance preservation, which is simple to obtain analytically. We extend this idea to non-Gaussian inputs by "Gaussianizing" them with a histogram transformation and "de-Gaussianizing" them with the inverse transformation after the blending operation. We show how to precompute and store these histogram transformations such that our algorithm can be implemented in a fragment shader.

References

[1]

Nicolas Bonneel. 2016. FastTransport. http://liris.cnrs.fr/nbonneel/FastTransport/.

[2]

Nicolas Bonneel, Michiel van de Panne, Sylvain Paris, and Wolfgang Heidrich. 2011. Displacement Interpolation Using Lagrangian Mass Transport. ACM Trans. Graph. 30, 6, Article 158 (2011), 12 pages.

Digital Library

[3]

Michael F. Cohen, Jonathan Shade, Stefan Hiller, and Oliver Deussen. 2003. Wang Tiles for Image and Texture Generation. ACM Trans. Graph. 22, 3 (2003), 287--294.

Digital Library

[4]

Luc Devroye. 1986. Non-Uniform Random Variate Generation.

[5]

Alexei A. Efros and William T. Freeman. 2001. Image Quilting for Texture Synthesis and Transfer (SIGGRAPH '01). 341--346.

Digital Library

[6]

Bruno Galerne, Ares Lagae, Sylvain Lefebvre, and George Drettakis. 2012. Gabor Noise by Example. ACM Transactions on Graphics (Proceedings of ACM SIGGRAPH 2012) 31, 4 (2012), 73:1--73:9.

Digital Library

[7]

B. Galerne, A. Leclaire, and L. Moisan. 2017a. Texton Noise. Computer Graphics Forum (2017).

[8]

Bruno Galerne, Arthur Leclaire, and Julien Rabin. 2017b. Semi-Discrete Optimal Transport in Patch Space for Enriching Gaussian Textures. In Geometric Science of Information (Lecture Notes in Computer Science), Vol. 10589.

[9]

G. Gilet, J-M. Dischler, and D. Ghazanfarpour. 2012. Multiple Kernels Noise for Improved Procedural Texturing. Vis. Comput. 28, 6-8 (June 2012), 679--689.

Digital Library

[10]

Guillaume Gilet, Basile Sauvage, Kenneth Vanhoey, Jean-Michel Dischler, and Djamchid Ghazanfarpour. 2014. Local Random-phase Noise for Procedural Texturing. ACM Trans. Graph. 33, 6, Article 195 (2014), 11 pages.

Digital Library

[11]

David J. Heeger and James R. Bergen. 1995. Pyramid-based Texture Analysis/Synthesis. In Proceedings of the 22Nd Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '95). 229--238.

Digital Library

[12]

Ares Lagae and Philip Dutré. 2006. An Alternative for Wang Tiles: Colored Edges versus Colored Corners. ACM Transactions on Graphics 25, 4 (2006), 1442--1459.

Digital Library

[13]

Ares Lagae, Sylvain Lefebvre, Rob Cook, Tony DeRose, George Drettakis, D.S. Ebert, J.P. Lewis, Ken Perlin, and Matthias Zwicker. 2010. State of the Art in Procedural Noise Functions. In EG 2010 - State of the Art Reports.

[14]

Ares Lagae, Sylvain Lefebvre, George Drettakis, and Philip Dutré. 2009. Procedural Noise using Sparse Gabor Convolution. ACM Transactions on Graphics (Proceedings of ACM SIGGRAPH 2009) 28, 3 (2009), 54--64.

Digital Library

[15]

John-Peter Lewis. 1984. Texture Synthesis for Digital Painting. In Proceedings of the 11th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '84). 245--252.

Digital Library

[16]

Ján Morovic and Pei-Li Sun. 2003. Accurate 3D Image Colour Histogram Transformation. Pattern Recogn. Lett. 24, 11 (July 2003), 1725--1735.

Digital Library

[17]

Fabrice Neyret and Marie-Paule Cani. 1999. Pattern-based Texturing Revisited. In Proceedings of the 26th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '99). 235--242.

Digital Library

[18]

Ken Perlin. 1985. An Image Synthesizer. In Computer Graphics (SIGGRAPH '85 Proceedings), B. A. Barsky (Ed.), Vol. 19. 287--296.

Digital Library

[19]

Ken Perlin. 2001. Noise hardware. Real-time shading languages, SIGGRAPH 2001 Course.

[20]

Ken Perlin. 2002. Improving Noise. In Proceedings of the 29th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '02). 681--682.

Digital Library

[21]

Emil Praun, Adam Finkelstein, and Hugues Hoppe. 2000. Lapped Textures (SIGGRAPH '00). 465--470.

Digital Library

[22]

Erik Reinhard, Michael Ashikhmin, Bruce Gooch, and Peter Shirley. 2001. Color Transfer Between Images. IEEE Comput. Graph. Appl. 21, 5 (2001), 34--41.

Digital Library

[23]

Jarke J. van Wijk. 1991. Spot Noise Texture Synthesis for Data Visualization. In Proceedings of the 18th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '91). 309--318.

Digital Library

[24]

Kenneth Vanhoey, Basile Sauvage, Frédéric Larue, and Jean-Michel Dischler. 2013. On-the-fly Multi-scale Infinite Texturing from Example. ACM Trans. Graph. 32, 6, Article 208 (2013), 10 pages.

Digital Library

[25]

Li-Yi Wei, Sylvain Lefebvre, Vivek Kwatra, and Greg Turk. 2009. State of the Art in Example-based Texture Synthesis. In Eurographics 2009, State of the Art Report, EG-STAR.

[26]

Lance Williams. 1983. Pyramidal Parametrics. SIGGRAPH Comput. Graph. 17, 3 (1983), 1--11.

Digital Library

[27]

Steven P. Worley. 1996. A Cellular Texture Basis Function. In SIGGRAPH 96 Conf. Proc. 291--294.

Digital Library

[28]

Qizhi Yu, Fabrice Neyret, Eric Bruneton, and Nicolas Holzschuch. 2011. Lagrangian Texture Advection: Preserving Both Spectrum and Velocity Field. IEEE Transactions on Visualization and Computer Graphics 17, 11 (2011), 1612--1623.

Digital Library

Cited By

Yang SZhou YLiu ZLoy C(2023)Rerender A Video: Zero-Shot Text-Guided Video-to-Video TranslationSIGGRAPH Asia 2023 Conference Papers10.1145/3610548.3618160(1-11)Online publication date: 10-Dec-2023
https://dl.acm.org/doi/10.1145/3610548.3618160
Li BShi LMatusik W(2023)End-to-end Procedural Material Capture with Proxy-Free Mixed-Integer OptimizationACM Transactions on Graphics10.1145/359213242:4(1-15)Online publication date: 26-Jul-2023
https://dl.acm.org/doi/10.1145/3592132
Baldi GAllègre RDischler J(2023)Differentiable point process texture basis functions for inverse procedural modeling of cellular stochastic structuresComputers and Graphics10.1016/j.cag.2023.04.004112:C(116-131)Online publication date: 1-May-2023
https://dl.acm.org/doi/10.1016/j.cag.2023.04.004
Show More Cited By

Index Terms

High-Performance By-Example Noise using a Histogram-Preserving Blending Operator
1. Computing methodologies
  1. Computer graphics
    1. Image manipulation
      1. Texturing

Recommendations

Local random-phase noise for procedural texturing

Local random-phase noise is a noise model for procedural texturing. It is defined on a regular spatial grid by local noises, which are sums of cosines with random phase. Our model is versatile thanks to separate sampling in the spatial and spectral ...
Hue-Preserving Color Blending

We propose a new perception-guided compositing operator for color blending. The operator maintains the same rules for achromatic compositing as standard operators (such as the over operator), but it modifies the computation of the chromatic channels. ...
Feature-preserving procedural texture

This paper presents how to synthesize a texture in a procedural way that preserves the features of the input exemplar. The exemplar is analyzed in both spatial and frequency domains to be decomposed into feature and non-feature parts. Then, the non-...

Comments

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Computer Graphics and Interactive Techniques

Proceedings of the ACM on Computer Graphics and Interactive Techniques Volume 1, Issue 2

August 2018

223 pages

EISSN:2577-6193

DOI:10.1145/3273023

Issue’s Table of Contents

Copyright © 2018 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 24 August 2018

Published in PACMCGIT Volume 1, Issue 2

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

13
Total Citations
View Citations
272
Total Downloads

Downloads (Last 12 months)43
Downloads (Last 6 weeks)4

Reflects downloads up to 27 Jul 2024

Other Metrics

View Author Metrics

Citations

Cited By

Yang SZhou YLiu ZLoy C(2023)Rerender A Video: Zero-Shot Text-Guided Video-to-Video TranslationSIGGRAPH Asia 2023 Conference Papers10.1145/3610548.3618160(1-11)Online publication date: 10-Dec-2023
https://dl.acm.org/doi/10.1145/3610548.3618160
Li BShi LMatusik W(2023)End-to-end Procedural Material Capture with Proxy-Free Mixed-Integer OptimizationACM Transactions on Graphics10.1145/359213242:4(1-15)Online publication date: 26-Jul-2023
https://dl.acm.org/doi/10.1145/3592132
Baldi GAllègre RDischler J(2023)Differentiable point process texture basis functions for inverse procedural modeling of cellular stochastic structuresComputers and Graphics10.1016/j.cag.2023.04.004112:C(116-131)Online publication date: 1-May-2023
https://dl.acm.org/doi/10.1016/j.cag.2023.04.004
Guo SDeschaintre VNoll DRoullier A(2022)U-Attention to Textures: Hierarchical Hourglass Vision Transformer for Universal Texture SynthesisProceedings of the 19th ACM SIGGRAPH European Conference on Visual Media Production10.1145/3565516.3565525(1-10)Online publication date: 1-Dec-2022
https://dl.acm.org/doi/10.1145/3565516.3565525
Deng HLiu YWang BYang JMa LHolzschuch NYan L(2022)Constant-Cost Spatio-Angular Prefiltering of Glinty Appearance Using Tensor DecompositionACM Transactions on Graphics10.1145/350791541:2(1-17)Online publication date: 22-Jan-2022
https://dl.acm.org/doi/10.1145/3507915
Shi LLi BHašan MSunkavalli KBoubekeur TMech RMatusik W(2020)MatchACM Transactions on Graphics10.1145/3414685.341778139:6(1-15)Online publication date: 27-Nov-2020
https://dl.acm.org/doi/10.1145/3414685.3417781
Wang BHašan MHolzschuch NYan L(2020)Example-Based Microstructure Rendering with Constant StorageACM Transactions on Graphics10.1145/340683639:5(1-12)Online publication date: 10-Aug-2020
https://dl.acm.org/doi/10.1145/3406836
De Goes FButts ADesbrun M(2020)Discrete differential operators on polygonal meshesACM Transactions on Graphics10.1145/3386569.339238939:4(110:1-110:14)Online publication date: 12-Aug-2020
https://dl.acm.org/doi/10.1145/3386569.3392389
Schuster KTrettner PSchmitz PKobbelt L(2020)A Three-Level Approach to Texture Mapping and Synthesis on 3D SurfacesProceedings of the ACM on Computer Graphics and Interactive Techniques10.1145/33845423:1(1-19)Online publication date: 4-May-2020
https://dl.acm.org/doi/10.1145/3384542
Curtis CDart KLatzko TKahrs JJorge JBartram LCatalano CKaplan CForbes ADiVerdi S(2019)Non-photorealistic animation for immersive storytellingProceedings of the 8th ACM/Eurographics Expressive Symposium on Computational Aesthetics and Sketch Based Interfaces and Modeling and Non-Photorealistic Animation and Rendering10.2312/exp.20191071(1-10)Online publication date: 5-May-2019
https://dl.acm.org/doi/10.2312/exp.20191071
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents