Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

Local Laplacian filters: edge-aware image processing with a Laplacian pyramid

Published: 25 July 2011 Publication History

Abstract

The Laplacian pyramid is ubiquitous for decomposing images into multiple scales and is widely used for image analysis. However, because it is constructed with spatially invariant Gaussian kernels, the Laplacian pyramid is widely believed as being unable to represent edges well and as being ill-suited for edge-aware operations such as edge-preserving smoothing and tone mapping. To tackle these tasks, a wealth of alternative techniques and representations have been proposed, e.g., anisotropic diffusion, neighborhood filtering, and specialized wavelet bases. While these methods have demonstrated successful results, they come at the price of additional complexity, often accompanied by higher computational cost or the need to post-process the generated results. In this paper, we show state-of-the-art edge-aware processing using standard Laplacian pyramids. We characterize edges with a simple threshold on pixel values that allows us to differentiate large-scale edges from small-scale details. Building upon this result, we propose a set of image filters to achieve edge-preserving smoothing, detail enhancement, tone mapping, and inverse tone mapping. The advantage of our approach is its simplicity and flexibility, relying only on simple point-wise nonlinearities and small Gaussian convolutions; no optimization or post-processing is required. As we demonstrate, our method produces consistently high-quality results, without degrading edges or introducing halos.

Supplementary Material

MP4 File (tp067_11.mp4)

References

[1]
Aubert, G., and Kornprobst, P. 2002. Mathematical problems in image processing: Partial Differential Equations and the Calculus of Variations, vol. 147 of Applied Mathematical Sciences. Springer.
[2]
Bae, S., Paris, S., and Durand, F. 2006. Two-scale tone management for photographic look. ACM Transactions on Graphics (Proc. SIGGRAPH) 25, 3, 637--645.
[3]
Bhat, P., Zitnick, C. L., Cohen, M., and Curless, B. 2010. Gradientshop: A gradient-domain optimization framework for image and video filtering. ACM Transactions on Graphics 29, 2.
[4]
Buades, A., Coll, B., and Morel, J.-M. 2006. The staircasing effect in neighborhood filters and its solution. IEEE Transactions on Image Processing 15, 6, 1499--1505.
[5]
Burt, P. J., and Adelson, E. H. 1983. The Laplacian pyramid as a compact image code. IEEE Transactions on Communication 31, 4, 532--540.
[6]
Chen, J., Paris, S., and Durand, F. 2007. Real-time edge-aware image processing with the bilateral grid. ACM Transactions on Graphics (Proc. SIGGRAPH) 26, 3.
[7]
Criminisi, A., Sharp, T., Rother, C., and Perez, P. 2010. Geodesic image and video editing. ACM Transactions on Graphics 29, 5.
[8]
Dippel, S., Stahl, M., Wiemker, R., and Blaffert, T. 2002. Multiscale contrast enhancement for radiographies: Laplacian pyramid versus fast wavelet transform. IEEE Transactions on Medical Imaging 21, 4.
[9]
Durand, F., and Dorsey, J. 2002. Fast bilateral filtering for the display of high-dynamic-range images. ACM Transactions on Graphics (Proc. SIGGRAPH) 21, 3.
[10]
Farbman, Z., Fattal, R., Lischinski, D., and Szeliski, R. 2008. Edge-preserving decompositions for multi-scale tone and detail manipulation. ACM Transactions on Graphics (Proc. SIGGRAPH) 27, 3.
[11]
Fattal, R., Lischinski, D., and Werman, M. 2002. Gradient domain high dynamic range compression. ACM Transactions on Graphics (Proc. SIGGRAPH) 21, 3.
[12]
Fattal, R., Agrawala, M., and Rusinkiewicz, S. 2007. Multiscale shape and detail enhancement from multi-light image collections. ACM Transactions on Graphics (Proc. SIGGRAPH) 26, 3.
[13]
Fattal, R., Carroll, R., and Agrawala, M. 2009. Edge-based image coarsening. ACM Transactions on Graphics 29, 1.
[14]
Fattal, R. 2009. Edge-avoiding wavelets and their applications. ACM Transactions on Graphics (Proc. SIGGRAPH) 28, 3.
[15]
He, K., Sun, J., and Tang, X. 2010. Guided image filtering. In Proceedings of European Conference on Computer Vision.
[16]
Heeger, D. J., and Bergen, J. R. 1995. Pyramid-based texture analysis/synthesis. In Proceedings of the ACM SIGGRAPH conference.
[17]
Kass, M., and Solomon, J. 2010. Smoothed local histogram filters. ACM Transactions on Graphics (Proc. SIGGRAPH) 29, 3.
[18]
Kimmel, R. 2003. Numerical Geometry of Images: Theory, Algorithms, and Applications. Springer. ISBN 0387955623.
[19]
Li, Y., Sharan, L., and Adelson, E. H. 2005. Compressing and companding high dynamic range images with subband architectures. ACM Transactions on Graphics (Proc. SIGGRAPH) 24, 3.
[20]
Lischinski, D., Farbman, Z., Uyttendaele, M., and Szeliski, R. 2006. Interactive local adjustment of tonal values. ACM Transactions on Graphics (Proc. SIGGRAPH) 25, 3.
[21]
Mantiuk, R., Myszkowski, K., and Seidel, H.-P. 2006. A perceptual framework for contrast processing of high dynamic range images. ACM Transactions on Applied Perception 3, 3, 286--308.
[22]
Mantiuk, R., Mantiuk, R., Tomaszewska, A., and Heidrich, W. 2009. Color correction for tone mapping. Computer Graphics Forum (Proc. Eurographics) 28, 2, 193--202.
[23]
Masia, B., Agustin, S., Fleming, R. W., Sorkine, O., and Gutierrez, D. 2009. Evaluation of reverse tone mapping through varying exposure conditions. ACM Transactions on Graphics (Proc. SIGGRAPH Asia) 28, 5.
[24]
Paris, S., and Durand, F. Tone-mapping code. http://people.csail.mit.edu/sparis/code/src/tone_mapping.zip. Accessed on January 14th, 2011.
[25]
Paris, S., Kornprobst, P., Tumblin, J., and Durand, F. 2009. Bilateral filtering: Theory and applications. Foundations and Trends in Computer Graphics and Vision.
[26]
Perona, P., and Malik, J. 1990. Scale-space and edge detection using anisotropic diffusion. IEEE Transactions Pattern Analysis Machine Intelligence 12, 7, 629--639.
[27]
Reinhard, E., Stark, M., Shirley, P., and Ferwerda, J. 2002. Photographic tone reproduction for digital images. ACM Transactions on Graphics (Proc. SIGGRAPH) 21, 3.
[28]
Subr, K., Soler, C., and Durand, F. 2009. Edge-preserving multiscale image decomposition based on local extrema. ACM Transactions on Graphics (Proc. SIGGRAPH Asia) 28, 5.
[29]
Sunkavalli, K., Johnson, M. K., Matusik, W., and Pfister, H. 2010. Multi-scale image harmonization. ACM Transactions on Graphics (Proc. SIGGRAPH) 29, 3.
[30]
Szeliski, R. 2006. Locally adapted hierarchical basis preconditioning. ACM Transactions on Graphics (Proc. SIGGRAPH) 25, 3.
[31]
Tomasi, C., and Manduchi, R. 1998. Bilateral filtering for gray and color images. In Proceedings of the International Conference on Computer Vision, IEEE, 839--846.
[32]
Tumblin, J., and Turk, G. 1999. Low curvature image simplifiers (LCIS): A boundary hierarchy for detail-preserving contrast reduction. In Proceedings of SIGGRAPH.
[33]
Vuylsteke, P., and Schoeters, E. P. 1994. Multiscale image contrast amplification (MUSICA). In Proceedings SPIE, vol. 2167, 551--560.
[34]
Witkin, A., Terzopoulos, D., and Kass, M. 1987. Signal matching through scale space. International Journal of Computer Vision 1, 2, 759--764.
[35]
Witkin, A. 1983. Scale-space filtering. In Proceedings of the International Joint Conference on Artificial Intelligence, vol. 2, 1019--1022.

Cited By

View all
  • (2024)Endoscopic Image Enhancement: Wavelet Transform and Guided Filter Decomposition-Based Fusion ApproachJournal of Imaging10.3390/jimaging1001002810:1(28)Online publication date: 20-Jan-2024
  • (2024)A Light-Weight Self-Supervised Infrared Image Perception Enhancement MethodElectronics10.3390/electronics1318369513:18(3695)Online publication date: 18-Sep-2024
  • (2024)Multimodal Medical Image Fusion based on the VGG19 Model in the NSCT DomainRecent Advances in Computer Science and Communications10.2174/012666255825672123100904590117:5Online publication date: Jul-2024
  • Show More Cited By

Index Terms

  1. Local Laplacian filters: edge-aware image processing with a Laplacian pyramid

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Transactions on Graphics
      ACM Transactions on Graphics  Volume 30, Issue 4
      July 2011
      829 pages
      ISSN:0730-0301
      EISSN:1557-7368
      DOI:10.1145/2010324
      Issue’s Table of Contents
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 25 July 2011
      Published in TOG Volume 30, Issue 4

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. edge-aware image processing
      2. image pyramids

      Qualifiers

      • Research-article

      Funding Sources

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)23
      • Downloads (Last 6 weeks)1
      Reflects downloads up to 10 Oct 2024

      Other Metrics

      Citations

      Cited By

      View all
      • (2024)Endoscopic Image Enhancement: Wavelet Transform and Guided Filter Decomposition-Based Fusion ApproachJournal of Imaging10.3390/jimaging1001002810:1(28)Online publication date: 20-Jan-2024
      • (2024)A Light-Weight Self-Supervised Infrared Image Perception Enhancement MethodElectronics10.3390/electronics1318369513:18(3695)Online publication date: 18-Sep-2024
      • (2024)Multimodal Medical Image Fusion based on the VGG19 Model in the NSCT DomainRecent Advances in Computer Science and Communications10.2174/012666255825672123100904590117:5Online publication date: Jul-2024
      • (2024)Bilateral Guided Radiance Field ProcessingACM Transactions on Graphics10.1145/365814843:4(1-13)Online publication date: 19-Jul-2024
      • (2024)Filter-Guided Diffusion for Controllable Image GenerationACM SIGGRAPH 2024 Conference Papers10.1145/3641519.3657489(1-10)Online publication date: 13-Jul-2024
      • (2024)Dynamic path planning based on multi-heuristic factor ant colony and DWA algorithmThird International Conference on Electronic Information Engineering, Big Data, and Computer Technology (EIBDCT 2024)10.1117/12.3031419(355)Online publication date: 19-Jul-2024
      • (2024)Low-Light Enhancement Method Based on a Retinex Model for Structure PreservationIEEE Transactions on Multimedia10.1109/TMM.2023.326886726(650-662)Online publication date: 2024
      • (2024)An Efficient Advanced-YOLOv8 Framework for THz Object DetectionIEEE Transactions on Instrumentation and Measurement10.1109/TIM.2024.339448773(1-11)Online publication date: 2024
      • (2024)The Devil Is in the Boundary: Boundary-Enhanced Polyp SegmentationIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2023.334859834:7(5414-5423)Online publication date: 1-Jul-2024
      • (2024)Unsupervised HDR Image and Video Tone Mapping via Contrastive LearningIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2023.329035134:2(786-798)Online publication date: 1-Feb-2024
      • Show More Cited By

      View Options

      Get Access

      Login options

      Full Access

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media