Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

WYSIWYG computational photography via viewfinder editing

Published: 01 November 2013 Publication History

Abstract

Digital cameras with electronic viewfinders provide a relatively faithful depiction of the final image, providing a WYSIWYG experience. If, however, the image is created from a burst of differently captured images, or non-linear interactive edits significantly alter the final outcome, then the photographer cannot directly see the results, but instead must imagine the post-processing effects. This paper explores the notion of viewfinder editing, which makes the viewfinder more accurately reflect the final image the user intends to create. We allow the user to alter the local or global appearance (tone, color, saturation, or focus) via stroke-based input, and propagate the edits spatiotemporally. The system then delivers a real-time visualization of these modifications to the user, and drives the camera control routines to select better capture parameters.

Supplementary Material

ZIP File (a198-baek.zip)
Supplemental material.

References

[1]
Adams, A. B., Baek, J., and Davis, A. 2010. Fast high-dimensional filtering using the permutohedral lattice. Computer Graphics Forum 29, 2.
[2]
Adams, A. B., Talvala, E., Park, S. H., Jacobs, D. E., et al. 2010. The Frankencamera: An experimental platform for computational photography. ACM Trans. Graph. 29, 4.
[3]
Agarwala, A., Dontcheva, M., Agrawala, M., Drucker, S., Colburn, A., Curless, B., Salesin, D., and Cohen, M. 2004. Interactive digital photomontage. ACM Trans. Graph. 23, 3.
[4]
An, X., and Pellacini, F. 2008. Appprop: all-pairs appearance-space edit propagation. ACM Trans. Graph. 27, 3.
[5]
Bie, X., Huang, H., and Wang, W. 2011. Real time edit propagation by efficient sampling. Comp. Graphics Forum 30, 7.
[6]
Chen, X., Zou, D., Zhao, Q., and Tan, P. 2012. Manifold preserving edit propagation. ACM Trans. Graph. 31, 6.
[7]
Farbman, Z., Fattal, R., Lischinski, D., and Szeliski, R. 2008. Edge-preserving decompositions for multi-scale tone and detail manipulation. ACM Trans. Graph. 27, 3.
[8]
Farbman, Z., Fattal, R., and Lischinski, D. 2010. Diffusion maps for edge-aware image editing. ACM Trans. Graph. 29, 6.
[9]
Fattal, R. 2009. Edge-avoiding wavelets and their applications. ACM Trans. Graph. 28, 3.
[10]
Gallo, O., Tico, M., Manduchi, R., Gelfand, N., and Pulli, K. 2012. Metering for exposure stacks. Computer Graphics Forum 31, 2.
[11]
Gastal, E. S. L., and Oliveira, M. M. 2011. Domain transform for edge-aware image and video processing. ACM Trans. Graph. 30, 4.
[12]
Gastal, E. S. L., and Oliveira, M. M. 2012. Adaptive manifolds for real-time high-dimensional filtering. ACM Trans. Graph. 31, 4.
[13]
Granados, M., Ajdin, B., Wand, M., Theobalt, C., Seidel, H.-P., and Lensch, H. P. A. 2010. Optimal HDR reconstruction with linear digital cameras. IEEE Computer Vision and Pattern Recognition, 215--222.
[14]
Hasinoff, S. W., and Kutulakos, K. N. 2008. Light-efficient photography. In European Conf. on Computer Vision, Springer.
[15]
Hasinoff, S. W., Durand, F., and Freeman, W. T. 2010. Noise-optimal capture for high dynamic range photography. In Computer Vision and Pattern Recognition, IEEE.
[16]
Jacobs, D. E., Baek, J., and Levoy, M. 2012. Focal stack compositing for depth of field control. Tech. Rep. 1, Stanford Computer Graphics Laboratory, 10.
[17]
Levin, A., Lischinski, D., and Weiss, Y. 2004. Colorization using optimization. ACM Trans. Graph. 23, 3.
[18]
Li, Y., Adelson, E., and Agarwala, A. 2008. ScribbleBoost: Adding classification to edge-aware interpolation of local image and video adjustments. Computer Graphics Forum 27, 4.
[19]
Li, Y., Ju, T., and Hu, S.-M. 2010. Instant propagation of sparse edits on images and videos. Computer Graphics Forum, 7.
[20]
Liang, C. K., Chen, W. C., and Gelfand, N. 2010. Touchtone: Interactive local image adjustment using point-and-swipe. Computer Graphics Forum 29, 2.
[21]
Lischinski, D., Farbman, Z., Uyttendaele, M., and Szeliski, R. 2006. Interactive local adjustment of tonal values. ACM Trans. Graph. 25, 3.
[22]
Liu, L., Chen, R., Wolf, L., and Cohen-Or, D. 2010. Optimizing photo composition. Computer Graphic Forum 29, 2.
[23]
Mantiuk, R., Daly, S., and Kerofsky, L. 2008. Display adaptive tone mapping. ACM Trans. Graph. 27, 3.
[24]
Nik Software, 2012. Snapseed | snap it. tweak it. love it. share it. http://www.snapseed.com. Accessed: 12/11/2012.
[25]
Ragan-Kelley, J., Adams, A., Paris, S., Levoy, M., Amarasinghe, S., and Durand, F. 2012. Decoupling algorithms from schedules for easy optimization of image processing pipelines. ACM Trans. Graph. 31, 4.
[26]
Reinhard, E., Stark, M., Shirley, P., and Ferwerda, J. 2002. Photographic tone reproduction for digital images. ACM Trans. Graph. 21, 3.
[27]
Reinhard, E., Ward, G., Pattanaik, S., and Debevec, P. 2005. High Dynamic Range Imaging: Acquisition, Display, and Image-Based Lighting. Morgan Kaufmann.
[28]
Robertson, M. A., Borman, S., and Stevenson, R. L. 1999. Dynamic range improvement through multiple exposures. In Int. Conf. on Image Processing, IEEE.
[29]
Rubinstein, M., Shamir, A., and Avidan, S. 2008. Improved seam carving for video retargeting. ACM Trans. Graph. 27, 3.
[30]
Subr, K., Paris, S., Soler, C., and Kautz, J. 2013. Accurate binary image selection from inaccurate user input. Computer Graphics Forum 32, 2.
[31]
Vaquero, D., Gelfand, N., Tico, M., Pulli, K., and Turk, M. 2011. Generalized autofocus. In Workshop on Applications of Computer Vision, IEEE.
[32]
Winnemöller, H., Olsen, S. C., and Gooch, B. 2006. Realtime video abstraction. ACM Trans. Graph. 25, 3.
[33]
Xu, K., Li, Y., Ju, T., Hu, S.-M., and Liu, T.-Q. 2009. Efficient affinity-based edit propagation using k-d tree. ACM Trans. Graph. 28, 5.

Cited By

View all
  • (2023)Color Field: Developing Professional Vision by Visualizing the Effects of Color FiltersProceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586183.3606828(1-16)Online publication date: 29-Oct-2023
  • (2020)Accurate angle estimation based on moment for multirotation computation imagingApplied Optics10.1364/AO.59.00049259:2(492)Online publication date: 9-Jan-2020
  • (2019)Efficient High-Dimensional, Edge-Aware FilteringIEEE Computer Graphics and Applications10.1109/MCG.2016.11936:6(86-95)Online publication date: 19-Nov-2019
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics
ACM Transactions on Graphics  Volume 32, Issue 6
November 2013
671 pages
ISSN:0730-0301
EISSN:1557-7368
DOI:10.1145/2508363
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 November 2013
Published in TOG Volume 32, Issue 6

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. HDR metering
  2. burst photography
  3. image editing

Qualifiers

  • Research-article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)8
  • Downloads (Last 6 weeks)0
Reflects downloads up to 10 Nov 2024

Other Metrics

Citations

Cited By

View all
  • (2023)Color Field: Developing Professional Vision by Visualizing the Effects of Color FiltersProceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586183.3606828(1-16)Online publication date: 29-Oct-2023
  • (2020)Accurate angle estimation based on moment for multirotation computation imagingApplied Optics10.1364/AO.59.00049259:2(492)Online publication date: 9-Jan-2020
  • (2019)Efficient High-Dimensional, Edge-Aware FilteringIEEE Computer Graphics and Applications10.1109/MCG.2016.11936:6(86-95)Online publication date: 19-Nov-2019
  • (2017)Patch2Vec: Globally Consistent Image Patch RepresentationComputer Graphics Forum10.1111/cgf.1328436:7(183-194)Online publication date: 13-Oct-2017
  • (2017)Consistent Video Filtering for Camera ArraysComputer Graphics Forum10.1111/cgf.1313536:2(397-407)Online publication date: 1-May-2017
  • (2016)A Software Platform for Manipulating the Camera Imaging PipelineComputer Vision – ECCV 201610.1007/978-3-319-46448-0_26(429-444)Online publication date: 17-Sep-2016
  • (2015)Direct view manipulation for drone photographySIGGRAPH Asia 2015 Posters10.1145/2820926.2820945(1-1)Online publication date: 2-Nov-2015
  • (2015)Where2StandACM Transactions on Intelligent Systems and Technology10.1145/27708797:1(1-22)Online publication date: 7-Oct-2015
  • (2015)Distinguishing Local and Global Edits for Their Simultaneous Propagation in a Uniform FrameworkIEEE Transactions on Image Processing10.1109/TIP.2015.242144224:8(2478-2487)Online publication date: Aug-2015

View Options

Get Access

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media