research-article

Milliseconds Color Stippling

Authors:

Yanyun ChenAuthors Info & Claims

MM '21: Proceedings of the 29th ACM International Conference on Multimedia

Pages 2539 - 2548

https://doi.org/10.1145/3474085.3475427

Published: 17 October 2021 Publication History

Abstract

Stippling is a popular and fascinating sketching art in stylized illustrations. Various digital stippling techniques have been proposed to reduce tedious manual work. In this paper, we present a novel method to create high-quality color stippling from an input image in milliseconds. The key idea is to obtain stipples with predetermined incremental 2D sample sequences, which algorithms generate with sequential incrementality and distributional uniformity features. Two typical sequences are employed in our work: one is constructed from incremental Voronoi sets, and the other is from Poisson disk distributions. A threshold-based algorithm is then applied to determine stipple appearance and guarantee result quality. We extend color stippling with multitone level and radius adjustment to achieve improved visual quality. Detailed comparisons of the two sequences are conducted to explore further the strengths and weaknesses of the proposed method. For more information, please visit https://gitlab.com/maleiwhat/milliseconds-color-stippling.

References

[1]

Abdalla Ahmed, Jianwei Guo, Dong-Ming Yan, J.-Y. Franceschi, Xiaopeng Zhang, and Oliver Deussen. 2017. A Simple Push-Pull Algorithm for Blue-Noise Sampling. IEEE Trans. on Vis. and Comp. Graphics 23, 12 (2017), 2496--2508.

[2]

A. Ahmed, T. Niese, H. Huang, and O. Deussen. 2017. An Adaptive Point Sampler on a Regular Lattice. ACM Trans. Graph. 36, 4 (July 2017), 138:1--138:13.

Digital Library

[3]

A. Ahmed, H. Perrier, D. Coeurjolly, V. Ostromoukhov, J. Guo, D. Yan, H. Huang, and O. Deussen. 2016. Low-discrepancy Blue Noise Sampling. ACM Trans. Graph. 35, 6, Article 247 (nov 2016), 13 pages.

Digital Library

[4]

Abdalla G. M. Ahmed, Hui Huang, and Oliver Deussen. 2015. AA Patterns for Point Sets with Controlled Spectral Properties. ACM Trans. Graph. 34, 6, Article 212 (Oct. 2015), 8 pages.

Digital Library

[5]

Ignacio Ascencio-Lopez, Oscar Meruvia-Pastor, and Hugo Hidalgo-Silva. 2010. Adaptive Incremental Stippling using the Poisson-Disk Distribution. Journal of Graphics, GPU, and Game Tools 15, 1 (2010), 29--47.

[6]

M. Balzer, T. Schlömer, and O. Deussen. 2009. Capacity-constrained point distributions: A variant of Lloyd's method. ACM Trans. Graph. (Proc. SIGGRAPH) 28, 6 (2009), 86:1--86:8.

Digital Library

[7]

Bryce. E. Bayer. 1973. An optimum method for two-level rendition of continuous-tone pictures. IEEE Int. Conf. on Communications 26 (1973), 11--15.

[8]

Robert Bridson. 2007. Fast Poisson disk sampling in arbitrary dimensions. In 34. International Conference on Computer Graphics and Interactive Techniques, SIGGRAPH 2007, San Diego, California, USA, August 5--9, 2007, Sketches, Marc Alexa and Adam Finkelstein (Eds.). ACM, 22. https://doi.org/10.1145/1278780.1278807

Digital Library

[9]

Jiating Chen, Xiaoyin Ge, Li-Yi Wei, Bin Wang, Yusu Wang, Huamin Wang, Yun Fei, Kang-Lai Qian, Jun-Hai Yong, and Wenping Wang. 2013. Bilateral Blue Noise Sampling. ACM Trans. Graph. (Proc. SIGGRAPH Asia) 32, 6 (2013), 216:1--216:11.

Digital Library

[10]

Renjie Chen and Craig Gotsman. 2012. Parallel blue-noise sampling by constrained farthest point optimization. Comput. Graph. Forum (Proc. SGP) 31, 5 (2012), 1775--1785.

Digital Library

[11]

Zhonggui Chen, Zhan Yuan, Yi-King Choi, Ligang Liu, and Wenping Wang. 2012. Variational Blue Noise Sampling. IEEE Trans. on Vis. and Comp. Graphics 18, 10 (2012), 1784--1796.

Digital Library

[12]

D. Cline, S. Jeschke, A. Razdan, K. White, and P. Wonka. 2009. Dart throwing on surfaces. Comput. Graph. Forum (Proc. EGSR) 28, 4 (2009), 1217--1226.

Digital Library

[13]

Michael F. Cohen, Jonathan Shade, Stefan Hiller, and Oliver Deussen. 2003. Wang Tiles for image and texture generation. international conference on computer graphics and interactive techniques 22, 3 (2003), 287--294.

Digital Library

[14]

R. L. Cook. 1986. Stochastic sampling in computer graphics. ACM Trans. Graph. 5, 1 (1986), 69--78.

Digital Library

[15]

F. de Goes, K. Breeden, V. Ostromoukhov, and M. Desbrun. 2012. Blue Noise through Optimal Transport. ACM Trans. Graph. (Proc. SIGGRAPH Asia) 31 (2012), 171:1--171:12. Issue 6.

Digital Library

[16]

Oliver Deussen, Stefan Hiller, Cornelius Van Overveld, and Thomas Strothotte. 2000. Floating points: A method for computing stipple drawings. In Computer Graphics Forum, Vol. 19. Wiley Online Library, 41--50.

[17]

Oliver Deussen, Marc Spicker, and Qian Zheng. 2017. Weighted linde-buzo-gray stippling. ACM Transactions on Graphics (TOG) 36, 6 (2017), 1--12.

Digital Library

[18]

Qiang Du, Vance Faber, and Max Gunzburger. 1999. Centroidal Voronoi tessellations: applications and algorithms. SIAM Rev. 41 (1999), 637--676.

Digital Library

[19]

Mohamed S. Ebeida, Scott A. Mitchell, Anjul Patney, Andrew A. Davidson, and John D. Owens. 2012. A simple algorithm for maximal Poisson-disk sampling in high dimensions. Comput. Graph. Forum (Proc. EUROGRAPHICS) 31, 2 (2012), 785--794.

Digital Library

[20]

Mohamed S. Ebeida, Anjul Patney, Scott A. Mitchell, Patrick M. Knupp Andrew Davidson, and John D. Owens. 2011. Efficient maximal Poisson-disk sampling. ACM Trans. Graph. (Proc. SIGGRAPH) 30, 4 (2011), 49:1--49:12.

Digital Library

[21]

Y. Eldar, M. Lindenbaum, M. Porat, and Y. Y. Zeevi. 1997. The farthest point strategy for progressive image sampling. IEEE Transactions on Image Processing 6, 9 (Sept. 1997), 1305--1315.

Digital Library

[22]

Raanan Fattal. 2011. Blue-Noise Point Sampling using Kernel Density Model. ACM Trans. Graph. (Proc. SIGGRAPH) 28, 3 (2011), 48:1--48:10.

Digital Library

[23]

Leon A Gatys, Alexander S Ecker, and Matthias Bethge. 2015. A neural algorithm of artistic style. arXiv preprint arXiv:1508.06576 (2015).

[24]

Leon A Gatys, Alexander S Ecker, and Matthias Bethge. 2015. Texture synthesis using convolutional neural networks. arXiv preprint arXiv:1505.07376 (2015).

Digital Library

[25]

Iliyan Georgiev and Marcos Fajardo. 2016. Blue-noise Dithered Sampling. In ACM SIGGRAPH 2016 Talks (Anaheim, California) (SIGGRAPH '16). ACM, New York, NY, USA, Article 35, 1 pages.

Digital Library

[26]

Pascal Gwosdek, Christian Schmaltz, Joachim Weickert, and Tanja Teuber. 2014. Electrostatic Halftoning. Journal of Real-Time Image Processing 9, 2 (2014), 379--392.

Digital Library

[27]

Xun Huang and Serge Belongie. 2017. Arbitrary style transfer in real-time with adaptive instance normalization. In Proceedings of the IEEE International Conference on Computer Vision. 1501--1510.

[28]

Justin Johnson, Alexandre Alahi, and Li Fei-Fei. 2016. Perceptual losses for real-time style transfer and super-resolution. In European conference on computer vision. Springer, 694--711.

[29]

Henry R. Kang. 1999. Digital Color Halftoning (1st ed.). Society of Photo-Optical Instrumentation Engineers (SPIE), Bellingham, WA, USA.

Digital Library

[30]

Jong-Hyun Kim and Jung Lee. 2020. Layered non-photorealistic rendering with anisotropic depth-of-field filtering. Multimedia Tools and Applications 79, 1 (2020), 1291--1309.

[31]

Qunye Kong, Yun Sheng, and Guixu Zhang. 2018. Hybrid noise for LIC-based pencil hatching simulation. In 2018 IEEE International Conference on Multimedia and Expo (ICME). IEEE, 1--6.

[32]

J. Kopf, D. Cohen-Or, O. Deussen, and D. Lischinski. 2006. Recursive Wang tiles for real-time blue noise. ACM Trans. Graph. (Proc. SIGGRAPH) 11, 2 (2006), 509--518.

Digital Library

[33]

Kriss and Michael. 2015. Handbook of Digital Imaging. John Wiley & Sons, Inc. 1--51 pages.

[34]

A. Lagae and P. Dutré. 2006. An alternative for Wang tiles: colored edges versus colored corners. ACM Trans. Graph. 25, 4 (2006), 1442--1459.

Digital Library

[35]

A. Lagae and P. Dutré. 2008. A comparison of methods for generating Poisson disk distributions. Comput. Graph. Forum 27, 1 (2008), 114--129.

[36]

Chuan Li and Michael Wand. 2016. Combining markov random fields and convolutional neural networks for image synthesis. In Proceedings of the IEEE conference on computer vision and pattern recognition. 2479--2486.

[37]

S. A. Lloyd. 1982. Least squares quantization in PCM. IEEE Transactions on Information Theory 28, 2 (1982), 129--137.

Digital Library

[38]

Aidong Lu, Christopher J. Morris, Joe Taylor, David S. Ebert, Charles Hansen, Penny Rheingans, and Mark Hartner. 2003. Illustrative interactive stipple rendering. IEEE Trans. on Vis. and Comp. Graphics 9, 2 (2003), 127--138.

Digital Library

[39]

Lei Ma, Yanyun Chen, Yinling Qian, and Hanqiu Sun. 2018. Incremental Voronoi sets for instant stippling. Vis. Comput. 34, 6--8 (2018), 863--873. https://doi.org/10.1007/s00371-018--1541--7

Digital Library

[40]

Domingo Martín, Germán Arroyo, Alejandro Rodríguez, and Tobias Isenberg. 2017. A survey of digital stippling. Computers & Graphics 67 (2017), 24--44.

Digital Library

[41]

Michael Mccool and Eugene Fiume. 1992. Hierarchical Poisson disk sampling distributions. Proceedings - Graphics Interface (1992).

Digital Library

[42]

Theophano Mitsa and Kevin J. Parker. 1992. Digital halftoning technique using a blue-noise mask. J. Opt. Soc. Am. A 9, 11 (Nov. 1992), 1920--1929.

[43]

J. L. Newbern and V. M. Bove, Jr. 1997. Generation of blue noise arrays by genetic algorithm. In Human Vision and Electronic Imaging II (procspie, Vol. 3016), B. E. Rogowitz and T. N. Pappas (Eds.). 441--450.

[44]

Harald Niederreiter. 1988. Low-discrepancy and low-dispersion sequences. Journal of number theory 30, 1 (1988), 51--70.

[45]

Harald Niederreiter. 1992. Random number generation and quasi-monte carlo methods. J. Amer. Statist. Assoc. 88, 89 (1992), 147 ?C153.

[46]

V. Ostromoukhov, C. Donohue, and P.-M. Jodoin. 2004. Fast hierarchical importance sampling with blue noise properties. ACM Trans. Graph. (Proc. SIGGRAPH) 23, 3 (2004), 488--495.

Digital Library

[47]

V. Ostromoukhov, C. Donohue, and P.-M. Jodoin. 2007. Sampling with polyominoes. ACM Trans. Graph. (Proc. SIGGRAPH) 26, 3 (2007), 78:1--78:6.

Digital Library

[48]

W. Purgathofer, R. F. Tobler, and M. Geiler. 1994. Forced random dithering: improved threshold matrices for ordered dithering. In Proceedings of 1st International Conference on Image Processing, Vol. 2. 1032--1035 vol.2.

[49]

T. Schlömer, D. Heck, and O. Deussen. 2011. Farthest-Point Optimized Point Sets with Maximized Minimum Distance. In High Performance Graphics Proceedings. 135--142.

Digital Library

[50]

Colas Schretter, Leif Kobbelt, and Paulolivier Dehaye. 2012. Golden Ratio Sequences for Low-Discrepancy Sampling. Journal of Graphics Tools 16, 2 (2012), 95--104.

[51]

Adrian Secord. 2002. Weighted Voronoi stippling. Proceedings of the second international symposium on Non-photorealistic animation and rendering - NPAR '02 1 (2002), 37.

Digital Library

[52]

Amir Semmo, Tobias Isenberg, and Jürgen Döllner. 2017. Neural style transfer: A paradigm shift for image-based artistic rendering?. In Proceedings of the symposium on non-photorealistic animation and rendering. 1--13.

Digital Library

[53]

Robert Ulichney. 1987. Digital Halftoning. MIT Press.

Digital Library

[54]

R Ulichney. 1987. Dithering with Blue Noise. MIT Press. 233--331 pages.

[55]

Robert A. Ulichney. 1993. Void-and-cluster method for dither array generation., 1913 - 1913 - 12 pages.

[56]

Florent Wachtel, Adrien Pilleboue, David Coeurjolly, Katherine Breeden, Gurprit Singh, Gaël Cathelin, Fernando de Goes, Mathieu Desbrun, and Victor Ostromoukhov. 2014. Fast Tile-based Adaptive Sampling with User-specified Fourier Spectra. ACM Trans. Graph. 33, 4, Article 56 (July 2014), 11 pages.

Digital Library

[57]

Tien-Tsin Wong, Wai-Shing Luk, and Pheng-Ann Heng. 1997. Sampling with Hammersley and Halton Points. Journal of Graphics Tools 2, 2 (1997), 9--24. arXiv:http://dx.doi.org/10.1080/10867651.1997.10487471

Digital Library

[58]

Xingpeng Xu, Wojciech Michal Matkowski, and Adams Wai Kin Kong. 2020. A portrait photo-to-tattoo transform based on digital tattooing. Multimedia Tools and Applications 79, 33 (2020), 24367--24392.

[59]

Yin Xu, Ligang Liu, Craig Gotsman, and Steven J Gortler. 2011. Computers & Graphics Capacity-Constrained Delaunay Triangulation for point distributions. Computers and Graphics 35, 3 (2011), 510--516.

Digital Library

[60]

Dong-Ming Yan, Jianwei Guo, Xiaohong Jia, Xiaopeng Zhang, and Peter Wonka. 2014. Blue-Noise Remeshing with Farthest Point Optimization. Comput. Graph. Forum (Proc. SGP) 33, 5 (2014), 167--176.

Digital Library

[61]

Dong-Ming Yan, Jianwei Guo, Bin Wang, Xiaopeng Zhang, and Peter Wonka. 2015. A Survey of Blue-Noise Sampling and Its Applications. 30, 3 (2015), 439--452.

[62]

Dong-Ming Yan and Peter Wonka. 2013. Gap Processing for Adaptive Maximal Poisson-Disk Sampling. ACM Trans. Graph. 32, 5 (2013), 148:1--148:15.

Digital Library

[63]

Kewei Yang, Zhengxing Sun, Shuang Wang, and Hui-Hsia Chen. 2017. Image Stylization for Thread Art via Color Quantization and Sparse Modeling. In Pacific Rim Conference on Multimedia. Springer, 515--525.

[64]

Cem Yuksel. 2015. Sample Elimination for Generating Poisson Disk Sample Sets. Comput. Graph. Forum 34, 2 (May 2015), 25--32.

Digital Library

[65]

Hang Zhang and Kristin Dana. 2018. Multi-style generative network for real-time transfer. In Proceedings of the European Conference on Computer Vision (ECCV) Workshops. 0--0.

[66]

Bingfeng Zhou and Xifeng Fang. 2003. Improving mid-tone quality of variable-coefficient error diffusion using threshold modulation. Acm Transactions on Graphics 22, 3 (2003), 437--444.

Digital Library

[67]

Zhiqiang Zhou, Bo Wang, and Jinlei Ma. 2017. Scale-aware edge-preserving image filtering via iterative global optimization. IEEE Transactions on Multimedia 20, 6 (2017), 1392--1405.

Cited By

Wang LCao P(2023)Image rendering algorithm based on handwritten signature cell modulationSixth International Conference on Intelligent Computing, Communication, and Devices (ICCD 2023)10.1117/12.2682873(40)Online publication date: 16-Jun-2023
https://doi.org/10.1117/12.2682873

Index Terms

Milliseconds Color Stippling
1. Computing methodologies
  1. Computer graphics
    1. Image manipulation
      1. Image processing
    2. Rendering
      1. Non-photorealistic rendering

Recommendations

Real-time structure aware color stippling
SIGGRAPH '19: ACM SIGGRAPH 2019 Posters

In computer graphics, stippling is a widely used non-photorealistic rendering technique. As the art of representing images with dots, one of the key problems is the placement of dots. In general, they should be distributed evenly, and with some ...
Weighted Voronoi stippling
NPAR '02: Proceedings of the 2nd international symposium on Non-photorealistic animation and rendering

The traditional artistic technique of stippling places small dots of ink onto paper such that their density give the impression of tone. The artist tightly controls the relative placement of the stipples on the paper to produce even tones and avoid ...
A Deep Learning Method for 2D Image Stippling
Advances in Computer Graphics
Abstract
Stippling is a fascinating art form, which is widely used in printing industry. In computer graphics, digital color stippling produces colored points with a certain distribution (e.g. blue noise distribution) from an input color image. However, it ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

MM '21: Proceedings of the 29th ACM International Conference on Multimedia

October 2021

5796 pages

ISBN:9781450386517

DOI:10.1145/3474085

General Chairs:
Heng Tao Shen
University of Electronic Science&Technology of China, China
,
Yueting Zhuang
Zhejiang University, China
,
John R. Smith
IBM, USA
,
Program Chairs:
Yang Yang
University of Electronic Science and Technology of China, China
,
Pablo Cesar
CWI&TU Delft, The Netherlands
,
Florian Metze
FACEBOOK, Inc., USA
,
Balakrishnan Prabhakaran
University of Texas at Dallas, USA

Copyright © 2021 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGMM: ACM Special Interest Group on Multimedia

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 17 October 2021

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Beijing Academy of Artificial Intelligence
National Key Research and Development Program of China
National Natural Science Foundation of China

Conference

MM '21

Sponsor:

SIGMM

MM '21: ACM Multimedia Conference

October 20 - 24, 2021

Virtual Event, China

Acceptance Rates

Overall Acceptance Rate 995 of 4,171 submissions, 24%

Upcoming Conference

MM '24

Sponsor:
sigmm

The 32nd ACM International Conference on Multimedia

October 28 - November 1, 2024

Melbourne , VIC , Australia

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
146
Total Downloads

Downloads (Last 12 months)24
Downloads (Last 6 weeks)2

Reflects downloads up to 04 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Wang LCao P(2023)Image rendering algorithm based on handwritten signature cell modulationSixth International Conference on Intelligent Computing, Communication, and Devices (ICCD 2023)10.1117/12.2682873(40)Online publication date: 16-Jun-2023
https://doi.org/10.1117/12.2682873

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents