Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
Skip to main content
SpringerLink
Log in

Hand-held 3D light field photography and applications

  • Original Article
  • Published:
The Visual Computer Aims and scope Submit manuscript

Abstract

We propose a method to acquire 3D light fields using a hand-held camera, and describe several computational photography applications facilitated by our approach. As our input we take an image sequence from a camera translating along an approximately linear path with limited camera rotations. Users can acquire such data easily in a few seconds by moving a hand-held camera. We include a novel approach to resample the input into regularly sampled 3D light fields by aligning them in the spatio-temporal domain, and a technique for high-quality disparity estimation from light fields. We show applications including digital refocusing and synthetic aperture blur, foreground removal, selective colorization, and others.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

Notes

  1. Using cv::goodFeaturesToTrack().

References

  1. Tanskanen, P., Kolev, K., Meier, L, Camposeco, F., Saurer, O., Pollefeys, M.: Live metric 3d reconstruction on mobile phones. In: IEEE ICCV, December 2013, pp. 65–72

  2. Davis, A., Levoy, M., Durand, F.: Unstructured light fields. Comput. Graphics Forum 31(2pt1), 305–314 (2012)

  3. Liu, F., Gleicher, M., Wang, J., Jin, H., Agarwala, A.: Subspace video stabilization. ACM Trans. Graph. 30(1), 4:1–4:10 (2011)

  4. Liu, F., Gleicher, M., Jin, H., Agarwala, A.: Content-preserving warps for 3d video stabilization. ACM Trans. Graph. 28(3), 44:1–44:9 (2009)

  5. Wang, Y.-S., Liu, F., Hsu, P.-S., Lee, T.-Y.: Spatially and temporally optimized video stabilization. IEEE Trans. Vis. Comp. Graph. 19(8), 1354–1361 (Aug. 2013)

  6. Rhemann, C., Hosni, A., Bleyer, M., Rother, C., Gelautz, M.: Fast cost-volume filtering for visual correspondence and beyond. In: IEEE CVPR, Washington, DC, USA, 2011, CVPR ’11, pp. 3017–3024. IEEE Computer Society, New York

  7. Kim, C., Zimmer, H., Pritch, Y., Sorkine-Hornung, A., Gross, M.: Scene reconstruction from high spatio-angular resolution light fields. ACM Trans. Graph. 32(4), 73:1–73:12 (2013)

  8. He, K., Sun, J., Tang, X.: Guided image filtering. In: Proceedings of the 11th European Conference on Computer Vision: Part I, ECCV’10, pp. 1–14. Springer, Berlin (2010)

  9. Gastal, E.S.L., Oliveira, M.M.: Domain transform for edge-aware image and video processing. ACM Trans. Graph. 30(4), 69:1–69:12 (2011)

  10. Ng, R.: Fourier slice photography. ACM Trans. Graph. 24(3), 735–744 (2005)

  11. Isaksen, A., McMillan, L., Gortler, S.J.: Dynamically reparameterized light fields. In: Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques, New York, NY, USA, 2000, SIGGRAPH ’00, pp. 297–306. ACM Press/Addison-Wesley Publishing Co., New York

  12. Nokia Refocus app. https://refocus.nokia.com/, (2014)

  13. Joshi, N., Avidan, S., Matusik, W., Kriegman, D.: Synthetic aperture tracking: Tracking through occlusions. In: IEEE 11th International Conference on Computer Vision, 2007. ICCV 2007, pp. 1–8 (2007)

  14. Bae, S., Durand, F.: Defocus magnification. Comput. Graphics Forum 26(3), 571–579 (2007)

    Article  Google Scholar 

  15. Joshi, N., Matusik, W., Avidan, S.: Natural video matting using camera arrays. ACM Trans. Graph. 25(3), 779–786 (July 2006)

  16. Lippmann, G.: Épreuves réversibles donnant la sensation du relief. J. Phys. Theor. Appl. 7(1), 821–825 (1908)

    Article  Google Scholar 

  17. Irani, M.: Multi-frame correspondence estimation using subspace constraints. Int. J. Comput. Vis. 48(3), 173–194 (July 2002)

  18. Gastal, E.S.L., Oliveira, M.M.: Domain transform for edge-aware image and video processing. In: ACM SIGGRAPH 2011 Papers, New York, NY, USA, 2011, SIGGRAPH ’11, pp. 69:1–69:12. ACM, New York

  19. Tomasi, C., Manduchi, R.: Bilateral filtering for gray and color images. In: Proceedings of the Sixth International Conference on Computer Vision, Washington, DC, USA, 1998, ICCV ’98, pp. 839. IEEE Computer Society, New York

  20. Wanner, S., Goldluecke, B.: Globally consistent depth labeling of 4d light fields. In: 2012 IEEE Conference on Computer Vision and Pattern Recognition, pp. 41–48 (2012)

Download references

Acknowledgments

This project was partially supported by funding from the Swiss Commission for Technology and Innovation CTI through project no. 15592.1 PFES-ES.

Author information

Authors and Affiliations

  1. University of Bern, Bern, Switzerland

    Daniel Donatsch & Matthias Zwicker

  2. University of Neuchatel, Neuchâtel, Switzerland

    Siavash Arjomand Bigdeli

  3. 3D Impact Media, Sarnen, Switzerland

    Siavash Arjomand Bigdeli & Philippe Robert

Authors
  1. Daniel Donatsch
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Siavash Arjomand Bigdeli
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Philippe Robert
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Matthias Zwicker
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Daniel Donatsch.

Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary material 1 (zip 34211 KB)

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Donatsch, D., Bigdeli, S.A., Robert, P. et al. Hand-held 3D light field photography and applications. Vis Comput 30, 897–907 (2014). https://doi.org/10.1007/s00371-014-0979-5

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00371-014-0979-5

Keywords

Search

Navigation