research-article

Unsynchronized structured light

Authors:

Gabriel TaubinAuthors Info & Claims

ACM Transactions on Graphics (TOG), Volume 34, Issue 6

Article No.: 178, Pages 1 - 11

https://doi.org/10.1145/2816795.2818062

Published: 02 November 2015 Publication History

Abstract

Various Structured Light (SL) methods are used to capture 3D range images, where a number of binary or continuous light patterns are sequentially projected onto a scene of interest, while a digital camera captures images of the illuminated scene. All existing SL methods require the projector and camera to be hardware or software synchronized, with one image captured per projected pattern. A 3D range image is computed from the captured images. The two synchronization methods have disadvantages, which limit the use of SL methods to niche industrial and low quality consumer applications. Unsynchronized Structured Light (USL) is a novel SL method which does not require synchronization of pattern projection and image capture. The light patterns are projected and the images are captured independently, at constant, but possibly different, frame rates. USL synthesizes new binary images as would be decoded from the images captured by a camera synchronized to the projector, reducing the subsequent computation to standard SL. USL works both with global and rolling shutter cameras. USL enables most burst-mode-capable cameras, such as modern smartphones, tablets, DSLRs, and point-and-shoots, to function as high quality 3D snapshot cameras. Beyond the software, which can run in the devices, a separate SL Flash, able to project the sequence of patterns cyclically, during the acquisition time, is needed to enable the functionality.

References

[1]

Bell, T., and Zhang, S. 2014. Towards superfast 3D optical metrology with digital micromirror device (DMD) platforms. In SPIE MOEMS-MEMS, ., 897907--897907.

[2]

Bradley, D., Atcheson, B., Ihrke, I., and Heidrich, W. 2009. Synchronization and rolling shutter compensation for consumer video camera arrays. In CVPR Workshops, IEEE, 1--8.

[3]

Fujiyoshi, H., Shimizu, S., Nishi, T., Nagasaka, Y., and Takahashi, T. 2003. Fast 3D position measurement with two unsynchronized cameras. In CIRA, vol. 3, IEEE, 1239--1244.

[4]

Goddyn, L., and Gvozdjak, P. 2003. Binary gray codes with long bit runs. the electronic journal of combinatorics 10, 1, R27.

[5]

Gupta, M., Agrawal, A., Veeraraghavan, A., and Narasimhan, S. 2011. Structured light 3D scanning in the presence of global illumination. In CVPR 2011, 713--720.

Digital Library

[6]

Hasler, N., Rosenhahn, B., Thormahlen, T., Wand, M., Gall, J., and Seidel, H.-P. 2009. Markerless motion capture with unsynchronized moving cameras. In CVPR, ., 224--231.

[7]

Hu, W., Gu, H., and Pu, Q. 2013. Lightsync: Unsynchronized visual communication over screen-camera links. In Proceedings of the 19th MobiCom, ACM, 15--26.

Digital Library

[8]

Inokuchi, S., Sato, K., and Matsuda, F. 1984. Range imaging system for 3D object recognition. In Proceedings of the ICPR, vol. 48, 806--808.

[9]

Jaeggli, T., Koninckx, T. P., and Van Gool, L. 2003. Online 3D acquisition and model integration. In Proc. IEEE Intl Workshop Projector-Camera Systems, 4.

[10]

Koppal, S. J., Yamazaki, S., and Narasimhan, S. G. 2012. Exploiting DLP illumination dithering for reconstruction and photography of high-speed scenes. IJCV 96, 1, 125--144.

Digital Library

[11]

Langlotz, T., and Bimber, O. 2007. Unsynchronized 4D barcodes. In Advances in Visual Computing. Springer, 363--374.

Digital Library

[12]

Moreno, D., and Taubin, G. 2012. Simple, accurate, and robust projector-camera calibration. In 3DIMPVT, ., 464--471.

Digital Library

[13]

Moreno, D., Son, K., and Taubin, G. 2015. Embedded phase shifting: Robust phase shifting with embedded signals. In CVPR.

[14]

Nayar, S., Krishnan, G., Grossberg, M. D., and Raskar, R. 2006. Fast Separation of Direct and Global Components of a Scene using High Frequency Illumination. ACM TOG (Jul).

Digital Library

[15]

O'Toole, m., Mather, J., and Kutulakos, K. N. 2014. 3D shape and indirect appearance by structured light transport. In CVPR, IEEE Conference on, 3246--3253.

Digital Library

[16]

Posdamer, J., and Altschuler, M. 1982. Surface measurement by space-encoded projected beam systems. Computer Graphics and Image Processing 18, 1, 1--17.

[17]

Salvi, J., Pags, J., and Batlle, J. 2004. Pattern codification strategies in structured light systems. Pattern Recognition 37, 4, 827--849.

[18]

Salvi, J., Fernandez, S., Pribanic, T., and Llado, X. 2010. A state of the art in structured light patterns for surface profilometry. Pattern Recognition 43, 8, 2666--2680.

Digital Library

[19]

Sato, K. 1987. Range imaging system utilizing nematic liquid crystal mask. In Proc. 1st ICCV, 1987, 657--661.

[20]

Shirai, Y., and Suwa, M. 1971. Recognition of polyhedrons with a range finder. In Proceedings of the 2nd IJCAI, Morgan Kaufmann Publishers Inc., 80--87.

Digital Library

[21]

Srinivasan, V., Liu, H. C., and Halioua, M. 1985. Automated phase-measuring profilometry: a phase mapping approach. Appl. Opt. 24, 2 (Jan), 185--188.

[22]

Xu, Y., and Aliaga, D. G. 2007. Robust pixel classification for 3D modeling with structured light. In Proceedings of Graphics Interface 2007, GI '07, 233--240.

Digital Library

[23]

Zhang, S. 2010. Recent progresses on real-time 3D shape measurement using digital fringe projection techniques. Optics and lasers in engineering 48, 2, 149--158.

Cited By

Lu LBu CSu ZGuan BYu QPan WZhang Q(2024)Generative deep-learning-embedded asynchronous structured light for three-dimensional imagingAdvanced Photonics10.1117/1.AP.6.4.0460046:04Online publication date: 1-Jul-2024
https://doi.org/10.1117/1.AP.6.4.046004
Mirdehghan PWu MChen WLindell DKutulakos K(2024)TurboSL: Dense, Accurate and Fast 3D by Neural Inverse Structured Light2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52733.2024.02368(25067-25076)Online publication date: 16-Jun-2024
https://doi.org/10.1109/CVPR52733.2024.02368
Sharma ARaut SShimasaki KSenoo TIshii I(2021)Visual-Feedback-Based Frame-by-Frame Synchronization for 3000 fps Projector–Camera Visual Light CommunicationElectronics10.3390/electronics1014163110:14(1631)Online publication date: 8-Jul-2021
https://doi.org/10.3390/electronics10141631
Show More Cited By

Index Terms

Unsynchronized structured light
1. Applied computing
  1. Document management and text processing
    1. Document capture
      1. Document scanning
2. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Image and video acquisition

Recommendations

Simple, Accurate, and Robust Projector-Camera Calibration
3DIMPVT '12: Proceedings of the 2012 Second International Conference on 3D Imaging, Modeling, Processing, Visualization & Transmission

Structured-light systems are simple and effective tools to acquire 3D models. Built with off-the-shelf components, a data projector and a camera, they are easy to deploy and compare in precision with expensive laser scanners. But such a high precision ...
Computing Epipolar Geometry from Unsynchronized Cameras

Recently, many application systems have been developed by using a large number of cameras. If 3D points are observed from synchronized cameras, the multiple view geometry of these cameras can be computed and the 3D reconstruction of the scene is ...
Texture Illumination Separation for Single-Shot Structured Light Reconstruction
Active illumination based methods have a trade-off between acquisition time and resolution of the estimated 3D shapes. Multi-shot approaches can generate dense reconstructions but require stationary scenes. Single-shot methods are applicable to dynamic ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics

ACM Transactions on Graphics Volume 34, Issue 6

November 2015

944 pages

ISSN:0730-0301

EISSN:1557-7368

DOI:10.1145/2816795

Issue’s Table of Contents

Copyright © 2015 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 November 2015

Published in TOG Volume 34, Issue 6

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

National Science Foundation

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

9
Total Citations
View Citations
726
Total Downloads

Downloads (Last 12 months)16
Downloads (Last 6 weeks)1

Reflects downloads up to 23 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Lu LBu CSu ZGuan BYu QPan WZhang Q(2024)Generative deep-learning-embedded asynchronous structured light for three-dimensional imagingAdvanced Photonics10.1117/1.AP.6.4.0460046:04Online publication date: 1-Jul-2024
https://doi.org/10.1117/1.AP.6.4.046004
Mirdehghan PWu MChen WLindell DKutulakos K(2024)TurboSL: Dense, Accurate and Fast 3D by Neural Inverse Structured Light2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52733.2024.02368(25067-25076)Online publication date: 16-Jun-2024
https://doi.org/10.1109/CVPR52733.2024.02368
Sharma ARaut SShimasaki KSenoo TIshii I(2021)Visual-Feedback-Based Frame-by-Frame Synchronization for 3000 fps Projector–Camera Visual Light CommunicationElectronics10.3390/electronics1014163110:14(1631)Online publication date: 8-Jul-2021
https://doi.org/10.3390/electronics10141631
Klein VEdel MStamminger MBauer F(2021)Robust marker-based projector-camera synchronizationGraphics and Visual Computing10.1016/j.gvc.2021.200034(200034)Online publication date: Nov-2021
https://doi.org/10.1016/j.gvc.2021.200034
Sharma ARaut SShimasaki KSenoo TIshii I(2020)HFR Projector Camera Based Visible Light Communication System for Real-Time Video StreamingSensors10.3390/s2018536820:18(5368)Online publication date: 19-Sep-2020
https://doi.org/10.3390/s20185368
Song ZSong ZZhao JGu F(2020)Micrometer-level 3D measurement techniques in complex scenes based on stripe-structured light and photometric stereoOptics Express10.1364/OE.40185028:22(32978)Online publication date: 19-Oct-2020
https://doi.org/10.1364/OE.401850
Chen WMirdehghan PFidler SKutulakos K(2020)Auto-Tuning Structured Light by Optical Stochastic Gradient Descent2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR42600.2020.00601(5969-5979)Online publication date: Jun-2020
https://doi.org/10.1109/CVPR42600.2020.00601
Zhang FLei TLi JCai XShao XChang JTian F(2018)Real-Time Calibration and Registration Method for Indoor Scene with Joint Depth and Color CameraInternational Journal of Pattern Recognition and Artificial Intelligence10.1142/S021800141854021632:07(1854021)Online publication date: Jul-2018
https://doi.org/10.1142/S0218001418540216
El Asmi CRoy S(2018)Fast Unsynchronized Unstructured Light2018 15th Conference on Computer and Robot Vision (CRV)10.1109/CRV.2018.00046(277-284)Online publication date: May-2018
https://doi.org/10.1109/CRV.2018.00046
Shi BLiang J(2016)Guide to quickly build high-quality three-dimensional models with a structured light range scannerApplied Optics10.1364/AO.55.01015855:36(10158)Online publication date: 13-Dec-2016
https://doi.org/10.1364/AO.55.010158

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents