Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

Proactive 3D scanning of inaccessible parts

Published: 27 July 2014 Publication History

Abstract

The evolution of 3D scanning technologies have revolutionized the way real-world object are digitally acquired. Nowadays, high-definition and high-speed scanners can capture even large scale scenes with very high accuracy. Nevertheless, the acquisition of complete 3D objects remains a bottleneck, requiring to carefully sample the whole object's surface, similar to a coverage process. Holes and undersampled regions are common in 3D scans of complex-shaped objects with self occlusions and hidden interiors. In this paper we introduce the novel paradigm of proactive scanning, in which the user actively modifies the scene while scanning it, in order to reveal and access occluded regions. We take a holistic approach and integrate the user interaction into the continuous scanning process. Our algorithm allows for dynamic modifications of the scene as part of a global 3D scanning process. We utilize a scan registration algorithm to compute motion trajectories and separate between user modifications and other motions such as (hand-held) camera movements and small deformations. Thus, we reconstruct together the static parts into a complete unified 3D model. We evaluate our technique by scanning and reconstructing 3D objects and scenes consisting of inaccessible regions such as interiors, entangled plants and clutter.

Supplementary Material

ZIP File (a157-yan.zip)
Supplemental material.
MP4 File (a157-sidebyside.mp4)

References

[1]
Amberg, B., Romdhani, S., and Vetter, T. 2007. Optimal step nonrigid icp algorithms for surface registration. In CVPR.
[2]
Barber, C. B., Dobkin, D. P., and Huhdanpaa, H. 1996. The quickhull algorithm for convex hulls. ACM TRANSACTIONS ON MATHEMATICAL SOFTWARE 22, 4, 469--483.
[3]
Besl, P. J., and McKay, N. D. 1992. A method for registration of 3-d shapes. IEEE Trans. Pattern Anal. Mach. Intell. 14, 2 (Feb.), 239--256.
[4]
Bouaziz, S., Tagliasacchi, A., and Pauly, M. 2013. Sparse iterative closest point. In Proc. Eurographics Symp. on Geometry Processing, 113--123.
[5]
Brown, B. J., and Rusinkiewicz, S. 2007. Global non-rigid alignment of 3-d scans. In ACM SIGGRAPH 2007 Papers, ACM, New York, NY, USA, SIGGRAPH '07.
[6]
Chang, W., and Zwicker, M. 2008. Automatic registration for articulated shapes. Computer Graphics Forum (Special Issue of Symposium on Geometry Processing) 27, 5, 1459--1468.
[7]
Chang, W., and Zwicker, M. 2011. Global registration of dynamic range scans for articulated model reconstruction. ACM Trans. Graph. 30, 3 (May), 26:1--26:15.
[8]
Chen, Y., and Medioni, G. 1992. Object modelling by registration of multiple range images. Image Vision Comput. 10, 3 (Apr.), 145--155.
[9]
Chui, H., and Rangarajan, A. 2003. A new point matching algorithm for non-rigid registration. Comput. Vis. Image Underst. 89, 2--3 (Feb.), 114--141.
[10]
de Aguiar, E., Stoll, C., Theobalt, C., Ahmed, N., Seidel, H.-P., and Thrun, S. 2008. Performance capture from sparse multi-view video. In ACM SIGGRAPH 2008 papers, ACM, New York, NY, USA, SIGGRAPH '08, 98:1--98:10.
[11]
Horn, B. K. P. 1987. Closed-form solution of absolute orientation using unit quaternions. J. Opt. Soc. Am. A 4, 4 (Apr), 629--642.
[12]
Huang, Q.-X., Adams, B., Wicke, M., and Guibas, L. J. 2008. Non-rigid registration under isometric deformations. In Proceedings of the Symposium on Geometry Processing, Eurographics Association, Aire-la-Ville, Switzerland, Switzerland, SGP '08, 1449--1457.
[13]
Izadi, S., Kim, D., Hilliges, O., Molyneaux, D., Newcombe, R., Kohli, P., Shotton, J., Hodges, S., Freeman, D., Davison, A., and Fitzgibbon, A. 2011. Kinect-fusion: Real-time 3d reconstruction and interaction using a moving depth camera. In Proceedings of the ACM Symposium on User Interface Software and Technology, 559--568.
[14]
Kazhdan, M., Bolitho, M., and Hoppe, H. 2006. Poisson surface reconstruction. In Proceedings of the Fourth Eurographics Symposium on Geometry Processing, Eurographics Association, Aire-la-Ville, Switzerland, Switzerland, SGP '06, 61--70.
[15]
Li, H., Sumner, R. W., and Pauly, M. 2008. Global correspondence optimization for non-rigid registration of depth scans. In Proceedings of the Symposium on Geometry Processing, Eurographics Association, Aire-la-Ville, Switzerland, Switzerland, SGP '08, 1421--1430.
[16]
Li, H., Adams, B., Guibas, L. J., and Pauly, M. 2009. Robust single-view geometry and motion reconstruction. In ACM SIGGRAPH Asia 2009 papers, 175:1--175:10.
[17]
Li, H., Vouga, E., Gudym, A., Luo, L., Barron, J. T., and Gusev, G. 2013. 3d self-portraits. ACM Transactions on Graphics (Proceedings SIGGRAPH Asia 2013) 32, 6 (November).
[18]
Mitra, N. J., Flory, S., Ovsjanikov, M., Gelfand, N., Guibas, L., and Pottmann, H. 2007. Dynamic geometry registration. In Proceedings of the fifth Eurographics symposium on Geometry processing, Eurographics Association, Aire-la-Ville, Switzerland, Switzerland, SGP '07, 173--182.
[19]
Muja, M., and Lowe, D. G. 2009. Fast approximate nearest neighbors with automatic algorithm configuration. In International Conference on Computer Vision Theory and Application VISSAPP'09), INSTICC Press, 331--340.
[20]
Pekelny, Y., and Gotsman, C. 2008. Articulated object reconstruction and markerless motion capture from depth video. Computer Graphics Forum 27, 2 (Apr.), 399--408.
[21]
Sharf, A., Alcantara, D. A., Lewiner, T., Greif, C., Sheffer, A., Amenta, N., and Cohen-Or, D. 2008. Space-time surface reconstruction using incompressible flow. In ACM SIGGRAPH Asia 2008 papers, ACM, New York, NY, USA, SIGGRAPH Asia '08, 110:1--110:10.
[22]
Sumner, R. W., Schmid, J., and Pauly, M. 2007. Embedded deformation for shape manipulation. In ACM SIGGRAPH 2007 Papers, ACM, New York, NY, USA, SIGGRAPH '07.
[23]
Süssmuth, J., Winter, M., and Greiner, G. 2008. Reconstructing animated meshes from time-varying point clouds. In Proceedings of the Symposium on Geometry Processing, Eurographics Association, Aire-la-Ville, Switzerland, Switzerland, SGP '08, 1469--1476.
[24]
Tevs, A., Berner, A., Wand, M., Ihrke, I., Bokeloh, M., Kerber, J., and Seidel, H.-P. 2012. Animation cartography - intrinsic reconstruction of shape and motion. ACM Trans. Graph., 12:1--12:15.
[25]
Wand, M., Jenke, P., Huang, Q., Bokeloh, M., Guibas, L., and Schilling, A. 2007. Reconstruction of deforming geometry from time-varying point clouds. In Proceedings of the fifth Eurographics symposium on Geometry processing, Eurographics Association, Aire-la-Ville, Switzerland, Switzerland, SGP '07, 49--58.
[26]
Wand, M., Adams, B., Ovsjanikov, M., Berner, A., Bokeloh, M., Jenke, P., Guibas, L., Seidel, H.-P., and Schilling, A. 2009. Efficient reconstruction of nonrigid shape and motion from real-time 3d scanner data. ACM Trans. Graph. 28, 2 (May), 15:1--15:15.

Cited By

View all
  • (2023)Real‐Time Rendering of Glinty Appearances using Distributed Binomial Laws on Anisotropic GridsComputer Graphics Forum10.1111/cgf.1486642:8Online publication date: 2-Aug-2023
  • (2023)Measuring and preliminary modeling of drift interception by plant speciesJournal of Environmental Quality10.1002/jeq2.2047252:3(641-651)Online publication date: 14-Apr-2023
  • (2022)3D modeling and reconstruction of plants and trees: A cross-cutting review across computer graphics, vision, and plant phenotypingBreeding Science10.1270/jsbbs.2107472:1(31-47)Online publication date: 2022
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics
ACM Transactions on Graphics  Volume 33, Issue 4
July 2014
1366 pages
ISSN:0730-0301
EISSN:1557-7368
DOI:10.1145/2601097
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 July 2014
Published in TOG Volume 33, Issue 4

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. 3D scanning
  2. non-rigid registration
  3. piecewise-smooth segmentation
  4. trajectory clustering

Qualifiers

  • Research-article

Funding Sources

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)11
  • Downloads (Last 6 weeks)0
Reflects downloads up to 25 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2023)Real‐Time Rendering of Glinty Appearances using Distributed Binomial Laws on Anisotropic GridsComputer Graphics Forum10.1111/cgf.1486642:8Online publication date: 2-Aug-2023
  • (2023)Measuring and preliminary modeling of drift interception by plant speciesJournal of Environmental Quality10.1002/jeq2.2047252:3(641-651)Online publication date: 14-Apr-2023
  • (2022)3D modeling and reconstruction of plants and trees: A cross-cutting review across computer graphics, vision, and plant phenotypingBreeding Science10.1270/jsbbs.2107472:1(31-47)Online publication date: 2022
  • (2022)Real‐Time Microstructure Rendering with MIP‐Mapped Normal Map SamplesComputer Graphics Forum10.1111/cgf.1444841:1(495-506)Online publication date: Feb-2022
  • (2022)3D scanning in the art & design industryMaterials Today: Proceedings10.1016/j.matpr.2022.05.06963(718-725)Online publication date: 2022
  • (2022)Real-time image-based lighting of metallic and pearlescent car paintsComputers and Graphics10.1016/j.cag.2022.04.009105:C(36-45)Online publication date: 1-Jun-2022
  • (2019)A Stationary SVBRDF Material Modeling Method Based on Discrete MicrosurfaceComputer Graphics Forum10.1111/cgf.1387638:7(745-754)Online publication date: 14-Nov-2019
  • (2019)Rescan: Inductive Instance Segmentation for Indoor RGBD Scans2019 IEEE/CVF International Conference on Computer Vision (ICCV)10.1109/ICCV.2019.00263(2541-2550)Online publication date: Oct-2019
  • (2018)Semantic object reconstruction via casual handheld scanningACM Transactions on Graphics10.1145/3272127.327502437:6(1-12)Online publication date: 4-Dec-2018
  • (2018)A proposal of experimental protocol to assembly scanningComputer-Aided Design and Applications10.1080/16864360.2017.139789215:3(416-431)Online publication date: 4-Jan-2018
  • Show More Cited By

View Options

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media