Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

Efficient affinity-based edit propagation using K-D tree

Published: 01 December 2009 Publication History

Abstract

Image/video editing by strokes has become increasingly popular due to the ease of interaction. Propagating the user inputs to the rest of the image/video, however, is often time and memory consuming especially for large data. We propose here an efficient scheme that allows affinity-based edit propagation to be computed on data containing tens of millions of pixels at interactive rate (in matter of seconds). The key in our scheme is a novel means for approximately solving the optimization problem involved in edit propagation, using adaptive clustering in a high-dimensional, affinity space. Our approximation significantly reduces the cost of existing affinity-based propagation methods while maintaining visual fidelity, and enables interactive stroke-based editing even on high resolution images and long video sequences using commodity computers.

References

[1]
Adams, A., Gelfand, N., Dolson, J., and Levoy, M. 2009. Gaussian kd-trees for fast high-dimensional filtering. ACM Trans. Graph. 28, 3, 21.
[2]
Agarwala, A. 2007. Efficient gradient-domain compositing using quadtrees. ACM Trans. Graph. 26, 3, 94.
[3]
An, X., and Pellacini, F. 2008. Appprop: all-pairs appearance-space edit propagation. ACM Trans. Graph. 27, 3, 40.
[4]
Chen, J., Sylvain, P., and Frédo, D. 2007. Real-time edge-aware image processing with the bilateral grid. ACM Trans. Graph. 26, 3, 103.
[5]
Cheslack-Postava, E., Wang, R., Akerlund, O., and Pellacini, F. 2008. Fast, realistic lighting and material design using nonlinear cut approximation. ACM Trans. Graph. 27, 5, 128.
[6]
Fattal, R., Carroll, R., and Agrawala, M. 2009. Edge-based image coarsening. to appear in ACM Trans. Graph.
[7]
Fattal, R. 2009. Edge-avoiding wavelets and their applications. ACM Trans. Graph. 28, 3, 22.
[8]
Hanrahan, P., Salzman, D., and Aupperle, L. 1991. A rapid hierarchical radiosity algorithm. SIGGRAPH Comput. Graph. 25, 4, 197--206.
[9]
Kopf, J., Cohen, M. F., Lischinski, D., and Uyttendaele, M. 2007. Joint bilateral upsampling. ACM Trans. Graph. 26, 3, 96.
[10]
Levin, A., Lischinski, D., and Weiss, Y. 2004. Colorization using optimization. ACM Trans. Graph. 23, 3, 689--694.
[11]
Li, Y., H., A. E., and Aseem, A. 2008. Scribbleboost: Adding classification to edge-aware interpolation of local image and video adjustments. Computer Graphics Forum 27, 4 (June), 1255--1264.
[12]
Lischinski, D., Farbman, Z., Uyttendaele, M., and Szeliski, R. 2006. Interactive local adjustment of tonal values. ACM Trans. Graph. 25, 3, 646--653.
[13]
Pellacini, F., and Lawrence, J. 2007. Appwand: editing measured materials using appearance-driven optimization. ACM Trans. Graph. 26, 3, 54.
[14]
Shi, J., and Malik, J. 2000. Normalized cuts and image segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence 22, 8, 888--905.
[15]
Walter, B., Fernandez, S., Arbree, A., Bala, K., Donikian, M., and Greenberg, D. P. 2005. Lightcuts: a scalable approach to illumination. ACM Trans. Graph. 24, 3, 1098--1107.
[16]
Walter, B., Arbree, A., Bala, K., and Greenberg, D. P. 2006. Multidimensional lightcuts. ACM Trans. Graph. 25, 3, 1081--1088.
[17]
Yatziv, L., and Sapiro, G. 2006. Fast image and video colorization using chrominance blending. IEEE Transactions on Image Processing 15, 5, 1120--1129.

Cited By

View all
  • (2024)I2VEdit: First-Frame-Guided Video Editing via Image-to-Video Diffusion ModelsSIGGRAPH Asia 2024 Conference Papers10.1145/3680528.3687656(1-11)Online publication date: 3-Dec-2024
  • (2024)Identity-Aware and Shape-Aware Propagation of Face Editing in VideosIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.323536430:7(3444-3456)Online publication date: Jul-2024
  • (2023)RecolorNeRF: Layer Decomposed Radiance Fields for Efficient Color Editing of 3D ScenesProceedings of the 31st ACM International Conference on Multimedia10.1145/3581783.3611957(8004-8015)Online publication date: 26-Oct-2023
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics
ACM Transactions on Graphics  Volume 28, Issue 5
December 2009
646 pages
ISSN:0730-0301
EISSN:1557-7368
DOI:10.1145/1618452
Issue’s Table of Contents

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 December 2009
Published in TOG Volume 28, Issue 5

Permissions

Request permissions for this article.

Check for updates

Qualifiers

  • Research-article

Funding Sources

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)14
  • Downloads (Last 6 weeks)3
Reflects downloads up to 13 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2024)I2VEdit: First-Frame-Guided Video Editing via Image-to-Video Diffusion ModelsSIGGRAPH Asia 2024 Conference Papers10.1145/3680528.3687656(1-11)Online publication date: 3-Dec-2024
  • (2024)Identity-Aware and Shape-Aware Propagation of Face Editing in VideosIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.323536430:7(3444-3456)Online publication date: Jul-2024
  • (2023)RecolorNeRF: Layer Decomposed Radiance Fields for Efficient Color Editing of 3D ScenesProceedings of the 31st ACM International Conference on Multimedia10.1145/3581783.3611957(8004-8015)Online publication date: 26-Oct-2023
  • (2023)SVCNet: Scribble-Based Video Colorization Network With Temporal AggregationIEEE Transactions on Image Processing10.1109/TIP.2023.329853732(4443-4458)Online publication date: 1-Jan-2023
  • (2023)QuickFPS: Architecture and Algorithm Co-Design for Farthest Point Sampling in Large-Scale Point CloudsIEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems10.1109/TCAD.2023.327492242:11(4011-4024)Online publication date: 1-Nov-2023
  • (2022)Interactive Deep Colorization and its Application for Image CompressionIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2020.302151028:3(1557-1572)Online publication date: 1-Mar-2022
  • (2022)A Blind Color Separation Model for Faithful Palette-Based Image RecoloringIEEE Transactions on Multimedia10.1109/TMM.2021.306746324(1545-1557)Online publication date: 2022
  • (2022)Fast Edit Propagation for 360 Degree Panoramas Using Function InterpolationIEEE Access10.1109/ACCESS.2022.316866510(43882-43894)Online publication date: 2022
  • (2022)Semantic-Sparse Colorization Network for Deep Exemplar-Based ColorizationComputer Vision – ECCV 202210.1007/978-3-031-20068-7_29(505-521)Online publication date: 23-Oct-2022
  • (2021)Video recoloring via spatial-temporal geometric palettesACM Transactions on Graphics10.1145/3450626.345967540:4(1-16)Online publication date: 19-Jul-2021
  • Show More Cited By

View Options

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media