research-article

Sparse PDF maps for non-linear multi-resolution image operations

Authors:

Markus Hadwiger,

Torsten MöllerAuthors Info & Claims

ACM Transactions on Graphics (TOG), Volume 31, Issue 6

Article No.: 133, Pages 1 - 12

https://doi.org/10.1145/2366145.2366152

Published: 01 November 2012 Publication History

Abstract

We introduce a new type of multi-resolution image pyramid for high-resolution images called sparse pdf maps (sPDF-maps). Each pyramid level consists of a sparse encoding of continuous probability density functions (pdfs) of pixel neighborhoods in the original image. The encoded pdfs enable the accurate computation of non-linear image operations directly in any pyramid level with proper pre-filtering for anti-aliasing, without accessing higher or lower resolutions. The sparsity of sPDF-maps makes them feasible for gigapixel images, while enabling direct evaluation of a variety of non-linear operators from the same representation. We illustrate this versatility for antialiased color mapping, O(n) local Laplacian filters, smoothed local histogram filters (e.g., median or mode filters), and bilateral filters.

Supplementary Material

ZIP File (133-198-0291.zip)

Supplemental Materials for Sparse PDF maps for non-linear multi-resolution image operations

Download
14.88 MB

References

[1]

Aubry, M., Paris, S., Hasinoff, S. W., Kautz, J., and Durand, F. 2011. Fast and Robust Pyramid-based Image Processing. Tech. rep., MIT. MIT-CSAIL-TR-2011-049.

[2]

Burt, P., and Adelson, T. 1983. The Laplacian pyramid as a compact image code. IEEE Transactions on Communications 9, 4, 532--540.

[3]

Carpenter, L. 1983. The A-buffer, an antialiased hidden surface method. In Proceedings of SIGGRAPH 1983, ACM Press/ACM SIGGRAPH, 1--11.

Digital Library

[4]

Chen, J., Paris, S., and Durand, F. 2007. Real-time edge-aware image processing with the bilateral grid. ACM Transactions on Graphics (Proceedings of SIGGRAPH 2007) 26, 3, 103:1--103:9.

Digital Library

[5]

Crow, F. C. 1977. The aliasing problem in computer-generated shaded images. In Proceedings of SIGGRAPH 1977, ACM Press/ACM SIGGRAPH, 799--805.

Digital Library

[6]

Donnelly, W., and Lauritzen, A. 2006. Variance shadow maps. In Proceedings of 2006 Symposium On Interactive 3D Graphics and Games, ACM Press, 161--165.

Digital Library

[7]

Fattal, R., Agrawala, M., and Rusinkiewicz, S. 2007. Multiscale shape and detail enhancement from multi-light image collections. ACM Transactions on Graphics (Proceedings of SIGGRAPH 2007) 26, 3, 51:1--51:9.

Digital Library

[8]

Fattal, R. 2009. Edge-avoiding wavelets and their applications. ACM Transactions on Graphics (Proceedings of SIGGRAPH 2009) 28, 3, 22:1--22:10.

Digital Library

[9]

Felsberg, M., Forssen, P.-E., and Scharr, H. 2006. Channel smoothing: Efficient robust smoothing of low-level signal features. IEEE Transactions on Pattern Analysis and Machine Intelligence 28, 2, 209--222.

Digital Library

[10]

Greene, N., and Heckbert, P. 1986. Creating raster omni-max images from multiple perspective views using the elliptical weighted average filter. IEEE Computer Graphics and Applications 6, 6, 21--27.

Digital Library

[11]

Han, C., Sun, B., Ramamoorthi, R., and Grinspun, E. 2007. Frequency domain normal map filtering. ACM Transactions on Graphics (Proceedings of SIGGRAPH 2007) 26, 3, 28:1--28:12.

Digital Library

[12]

Hanika, J., Dammertz, H., and Lensch, H. 2011. Edge-optimized À-trous wavelets for local contrast enhancement with robust denoising. Computer Graphics Forum 30, 7, 1879--1886.

[13]

Heckbert, P. 1989. Fundamentals of Texture Mapping and Image Warping. Master's thesis, U. C. Berkeley.

[14]

Jeong, W.-K., Johnson, M. K., Yu, I., Kautz, J., Pfister, H., and Paris, S. 2011. Display-aware image editing. In Proceedings of IEEE International Conference on Computational Photography.

[15]

Kass, M., and Solomon, J. 2010. Smoothed local histogram filters. ACM Transactions on Graphics (Proceedings of SIGGRAPH 2010) 29, 4, 100:1--100:10.

Digital Library

[16]

Kazhdan, M., and Hoppe, H. 2008. Streaming multigrid for gradient-domain operations on large images. ACM Transactions on Graphics (Proceedings of SIGGRAPH 2008) 27, 3, 21:1--21:10.

Digital Library

[17]

Koenderink, J. J., and Van Doorn, A. J. 1999. The structure of locally orderless images. International Journal of Computer Vision 31, 2--3 (Apr.), 159--168.

Digital Library

[18]

Kopf, J., Uyttendaele, M., Deussen, O., and Cohen, M. F. 2007. Capturing and viewing gigapixel images. ACM Transactions on Graphics (Proceedings of SIGGRAPH 2007) 26, 3, 93:1--93:10.

Digital Library

[19]

Mallat, S., and Zhang, Z. 1993. Matching pursuits with time-frequency dictionaries. IEEE Transactions on Signal Processing 41, 12 (Dec), 3397--3415.

Digital Library

[20]

Mallat, S. 2009. A Wavelet Tour of Signal Processing: The Sparse Way, 3rd ed. Academic Press.

Digital Library

[21]

NASA, 2005. Blue marble: Next generation. NASA Earth Observatory. http://earthobservatory.nasa.gov/Features/BlueMarble/.

[22]

Paris, S., and Durand, F. 2006. A fast approximation of the bilateral filter using a signal processing approach. In Proceedings of European Conference on Computer Vision (ECCV) 2006, 568--580.

Digital Library

[23]

Paris, S., Hasinoff, S. W., and Kautz, J. 2011. Local Laplacian filters: Edge-aware image processing with a Laplacian pyramid. ACM Transactions on Graphics (Proceedings of SIGGRAPH 2011) 30, 4, 68:1--68:12.

Digital Library

[24]

Reeves, W., Salesin, D., and Cook, R. 1987. Rendering antialiased shadows with depth maps. In Proceedings of SIGGRAPH 1987, ACM Press/ACM SIGGRAPH, 283--291.

Digital Library

[25]

Summa, B., Scorzelli, G., Jiang, M., Bremer, P.-T., and Pascucci, V. 2010. Interactive editing of massive imagery made simple: Turning Atlanta into Atlantis. ACM Transactions on Graphics 30, 2, 7:1--7:13.

Digital Library

[26]

Tan, P., Lin, S., Quan, L., Guo, B., and Shum, H. 2008. Filtering and rendering of resolution-dependent reflectance models. IEEE Transactions on Visualization and Computer Graphics 14, 2, 412--425.

Digital Library

[27]

Thompson, D., Levine, J., Bennett, J., Breemer, P.-T., Gyulassy, A., Pebay, P., and Pascucci, V. 2011. Analysis of large-scale scalar data using hixels. In Proceedings of IEEE Symposium on Large-Scale Data Analysis and Visualization (LDAV), 23--30.

[28]

Tomasi, C., and Manduchi, R. 1998. Bilateral filtering for gray and color images. In Proceedings of International Conference on Computer Vision (ICCV) '98, 839--846.

Digital Library

[29]

Williams, L. 1983. Pyramidal parametrics. In Proceedings of SIGGRAPH 1983, ACM Press/ACM SIGGRAPH, 1--11.

Digital Library

[30]

Younesy, H., Möller, T., and Carr, H. 2006. Improving the quality of multi-resolution volume rendering. In Proceedings of Eurovis 2006, 251--258.

Digital Library

Cited By

Afzal SGhani SHittawe MRashid SKnio OHadwiger MHoteit I(2023)Visualization and Visual Analytics Approaches for Image and Video Datasets: A SurveyACM Transactions on Interactive Intelligent Systems10.1145/357693513:1(1-41)Online publication date: 9-Mar-2023
https://dl.acm.org/doi/10.1145/3576935
Sicat RIbrahim MAgeeli AMannuss FRautek PHadwiger M(2023)Real-Time Visualization of Large-Scale Geological Models With Nonlinear Feature-Preserving Levels of DetailIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2021.312037229:2(1491-1505)Online publication date: 1-Feb-2023
https://doi.org/10.1109/TVCG.2021.3120372
Ageeli AJaspe-Villanueva ASicat RMannuss FRautek PHadwiger M(2022)Multivariate Probabilistic Range Queries for Scalable Interactive 3D VisualizationIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2022.3209439(1-11)Online publication date: 2022
https://doi.org/10.1109/TVCG.2022.3209439
Show More Cited By

Index Terms

Sparse PDF maps for non-linear multi-resolution image operations
1. Computing methodologies
  1. Computer graphics
    1. Image manipulation
      1. Texturing

Recommendations

Image Denoising Based on Adaptive Filtering and Multi-frame Averaging Filtering
AICI '09: Proceedings of the 2009 International Conference on Artificial Intelligence and Computational Intelligence - Volume 03

To deal with some problem of existing single- frame denoising methods, a adaptive spatial filtering method for denoising of multi-fame images is presented. Firstly each frame is processed by adaptive filters to suppressive noise and to preserve the edge ...
Progressive Image Denoising using Fast Noise Variance Estimation
VisionNet'16: Proceedings of the Third International Symposium on Computer Vision and the Internet

The patch-less Progressive Image Denoising(PID) is physical process of reducing the noise in image based on deterministic annealing i.e. temperature decreases from high to low so that shape of kernel changes according to it. The results of PID ...
Parameter Customization of Bilateral Filtering Image
ICMSS 2018: Proceedings of the 2018 2nd International Conference on Management Engineering, Software Engineering and Service Sciences

This paper is to improve the bilateral filtering algorithm by customizing the parameters so as to denoise the blurred image edges better and quicker. By the analysis of bilateral filtering algorithm, we find that two important parameters affecting ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics

ACM Transactions on Graphics Volume 31, Issue 6

November 2012

794 pages

ISSN:0730-0301

EISSN:1557-7368

DOI:10.1145/2366145

Issue’s Table of Contents

Copyright © 2012 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 November 2012

Published in TOG Volume 31, Issue 6

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

22
Total Citations
View Citations
796
Total Downloads

Downloads (Last 12 months)1
Downloads (Last 6 weeks)0

Reflects downloads up to 13 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Afzal SGhani SHittawe MRashid SKnio OHadwiger MHoteit I(2023)Visualization and Visual Analytics Approaches for Image and Video Datasets: A SurveyACM Transactions on Interactive Intelligent Systems10.1145/357693513:1(1-41)Online publication date: 9-Mar-2023
https://dl.acm.org/doi/10.1145/3576935
Sicat RIbrahim MAgeeli AMannuss FRautek PHadwiger M(2023)Real-Time Visualization of Large-Scale Geological Models With Nonlinear Feature-Preserving Levels of DetailIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2021.312037229:2(1491-1505)Online publication date: 1-Feb-2023
https://doi.org/10.1109/TVCG.2021.3120372
Ageeli AJaspe-Villanueva ASicat RMannuss FRautek PHadwiger M(2022)Multivariate Probabilistic Range Queries for Scalable Interactive 3D VisualizationIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2022.3209439(1-11)Online publication date: 2022
https://doi.org/10.1109/TVCG.2022.3209439
Wan YHolman HHansen C(2021)Interactive analysis for large volume data from fluorescence microscopy at cellular precisionComputers and Graphics10.1016/j.cag.2021.05.00698:C(138-149)Online publication date: 1-Aug-2021
https://dl.acm.org/doi/10.1016/j.cag.2021.05.006
Guo YCheng ZNie LWang YMa JKankanhalli M(2019)Attentive Long Short-Term Preference Modeling for Personalized Product SearchACM Transactions on Information Systems10.1145/329582237:2(1-27)Online publication date: 11-Jan-2019
https://dl.acm.org/doi/10.1145/3295822
Loni BPagano RLarson MHanjalic A(2019)Top-N Recommendation with Multi-Channel Positive Feedback using Factorization MachinesACM Transactions on Information Systems10.1145/329175637:2(1-23)Online publication date: 13-Feb-2019
https://dl.acm.org/doi/10.1145/3291756
Ballester-Ripoll RPajarola R(2019)Tensor Decompositions for Integral Histogram Compression and Look-UpIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2018.280252125:2(1435-1446)Online publication date: 1-Feb-2019
https://doi.org/10.1109/TVCG.2018.2802521
Ibrahim MWickenhauser PRautek PReina GHadwiger M(2018)Screen-Space Normal Distribution Function Caching for Consistent Multi-Resolution Rendering of Large Particle DataIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2017.274397924:1(944-953)Online publication date: Jan-2018
https://doi.org/10.1109/TVCG.2017.2743979
Paris SHasinoff SKautz J(2015)Local Laplacian filtersCommunications of the ACM10.1145/272369458:3(81-91)Online publication date: 23-Feb-2015
https://dl.acm.org/doi/10.1145/2723694
Beyer JHadwiger MPfister H(2015)State-of-the-Art in GPU-Based Large-Scale Volume VisualizationComputer Graphics Forum10.1111/cgf.1260534:8(13-37)Online publication date: 1-Dec-2015
https://dl.acm.org/doi/10.1111/cgf.12605
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents