article

Real-time 3D model acquisition

Authors:

Szymon Rusinkiewicz,

Olaf Hall-Holt,

Marc LevoyAuthors Info & Claims

ACM Transactions on Graphics (TOG), Volume 21, Issue 3

Pages 438 - 446

https://doi.org/10.1145/566654.566600

Published: 01 July 2002 Publication History

Abstract

The digitization of the 3D shape of real objects is a rapidly expanding field, with applications in entertainment, design, and archaeology. We propose a new 3D model acquisition system that permits the user to rotate an object by hand and see a continuously-updated model as the object is scanned. This tight feedback loop allows the user to find and fill holes in the model in real time, and determine when the object has been completely covered. Our system is based on a 60 Hz. structured-light rangefinder, a real-time variant of ICP (iterative closest points) for alignment, and point-based merging and rendering algorithms. We demonstrate the ability of our prototype to scan objects faster and with greater ease than conventional model acquisition pipelines.

References

[1]

ALLEN, B., CURLESS, B., AND POPOVIC, Z. 2002. "Human Body Deformation From Range Scans," Proc. ACM SIGGRAPH 2002.

[2]

BESL, P. AND MCKAY, N. 1992. "A Method for Registration of 3-D Shapes," Trans. PAMI, Vol. 14, No. 2.

[3]

BLAIS, G. AND LEVINE, M. 1995. "Registering Multiview Range Data to Create 3D Computer Objects," Trans. PAMI, Vol. 17, No. 8.

[4]

BOYER, K. L. AND KAK, A. C. 1987. "Color-Encoded Structured Light for Rapid Active Ranging," Trans. PAMI, Vol. 9, No. 1.

[5]

BREGLER, C., HERTZMANN, A., AND BIERMANN, H. 2000. "Recovering Non-Rigid 3D Shape from Image Streams," Proc. CVPR 2000.

[6]

CHEN, C., HUNG, Y., AND CHENG, J. 1999. "RANSAC-Based DARCES: A New Approach to Fast Automatic Registration of Partially Overlapping Range Images," Trans. PAMI, Vol. 21, No. 11.

[7]

CHEN, Y. AND MEDIONI, G. 1991. "Object Modeling by Registration of Multiple Range Images," Proc. IEEE Conf. on Robotics and Automation 1991.

[8]

CLINE, H. E., LORENSEN, W. E., LUDKE, S., CRAWFORD, C. R., AND TEETER, B. C. 1998. "Two Algorithms for the Three-Dimensional Reconstruction of Tomograms," Medical Physics, Vol. 15, No. 3.

[9]

COSTEIRA, J. AND KANADE, T. 1998. "A Multi-Body Factorization Method for Motion Analysis," IJCV, Vol. 29, No. 3.

[10]

CURLESS, B. AND LEVOY, M. 1996. "A Volumetric Method for Building Complex Models from Range Images," Proc. ACM SIGGRAPH 96.

[11]

DAVIS, J. AND CHEN, X. 2001. "A Laser Range Scanner Designed for Minimum Calibration Complexity," Proc. 3DIM 2001.

[12]

GRUSS, A., TADA, S., AND KANADE, T. 1992. "A VLSI Smart Sensor for Fast Range Imaging," Proc. IEEE Int. Conf. on Intelligent Robots and Systems 1992.

[13]

HALL-HOLT, O. AND RUSINKIEWICZ, S. 2001. "Stripe Boundary Codes for Real-Time Structured-Light Range Scanning of Moving Objects," Proc. ICCV 2001.

[14]

JOHNSON, A. AND HEBERT, M. 1997. "Surface Registration by Matching Oriented Points," Proc. 3DIM 1997.

[15]

KANADE, T., YOSHIDA, A., ODA, K., KANO, H., AND TANAKA, M. 1996. "A Stereo Machine for Video-rate Dense Depth Mapping and Its New Applications," Proc. CVPR 1996.

[16]

LEVOY, M., PULLI, K., CURLESS, B., RUSINKIEWICZ, S., KOLLER, D., PEREIRA, L., GINZTON, M., ANDERSON, S., DAVIS, J., GINSBERG, J., SHADE, J., AND FULK, D. 2000. "The Digital Michelangelo Project: 3D Scanning of Large Statues," Proc. ACM SIGGRAPH 2000.

[17]

MATSUMOTO, Y., TERASAKI, H., SUGIMOTO, K., AND ARAKAWA, T. 1997. "A Portable Three-Dimensional Digitizer," Proc. 3DIM 1997.

[18]

MATUSIK, W., BUEHLER, C., RASKAR, R., GORTLER, S., AND MCMILLAN, L. 2000. "Image-Based Visual Hulls," Proc. ACM SIGGRAPH 2000.

[19]

MAVER, J. AND BAJCSY, R. 1993. "Occlusions as a Guide for Planning the Next View," Trans. PAMI, Vol. 15, No. 5.

[20]

MIYAZAKI, D., OOISHI, T., NISHIKAWA, T., SAGAWA, R., NISHINO, K. TOMOMATSU, T., TAKASE, Y., AND IKEUCHI, K. 2000. Proc. VSMM 2000.

[21]

NAYAR, S. K., WATANABE, M., AND NOGUCHI, M. 1996. "Real-Time Focus Range Sensor," Trans. PAMI, Vol. 18, No. 12.

[22]

PENTLAND, A., DARRELL, T., TURK, M. AND HUANG, W. 1989. "A Simple, Real-Tie Range Camera," Proc. CVPR 1989.

[23]

PFISTER, H., ZWICKER, M., VAN BAAR, J., AND GROSS, M. 2000. "Surfels: Surface Elements as Rendering Primitives," Proc. ACM SIGGRAPH 2000.

[24]

PROESMANS, M. VAN GOOL, L., AND DEFOORT, F. 1998. "Reading Between the Lines --- A Method for Extracting Dynamic 3D with Texture," Proc. ICCV 1998.

[25]

PULLI, K. 1999. "Multiview Registration for Large Data Sets," Proc. 3DIM 1999.

[26]

ROSSIGNAC, J. AND BORREL, P. 1993. "Multi-Resolution 3D Approximations for Rendering Complex Scenes," Geometric Modeling in Computer Graphics.

[27]

RUSHMEIER, H., BERNARDINI, F., MITTLEMAN, J. AND TAUBIN, G. 1998. "Acquiring Input for Rendering at Appropriate Levels of Detail: Digitizing a Pietà," Proc. Eurographics Rendering Workshop 1998.

[28]

RUSINKIEWICZ, S. AND LEVOY, M. 2000. "QSplat: A Multiresolution Point Rendering System for Large Meshes," Proc. ACM SIGGRAPH 2000.

[29]

RUSINKIEWICZ, S. 2001. "Real-Time Acquisition and Rendering of Large 3D Models," Ph.D. Dissertation, Stanford University.

[30]

RUSINKIEWICZ, S. AND LEVOY, M. 2001. "Efficient Variants of the ICP Algorithm," Proc. 3DIM 2001.

[31]

SOUCY, M. AND LAURENDEAU, D. 1992. "Multi-Resolution Surface Modeling from Multiple Range Views," Proc. CVPR 1992.

[32]

STAMOS, I. AND ALLEN, P. 1998. "Interactive Sensor Planning," Proc. CVPR 1998.

[33]

TURK, G. AND LEVOY, M. 1994. "Zippered Polygon Meshes from Range Images," Proc. ACM SIGGRAPH 94.

Cited By

Li J(2024)Accuracy Assessment of Different Processing Methods for 3D Capture and Texture Seam Restoration of Artifacts in Virtual MuseumsProceedings of the 2024 International Conference on Machine Intelligence and Digital Applications10.1145/3662739.3662747(826-836)Online publication date: 30-May-2024
https://dl.acm.org/doi/10.1145/3662739.3662747
Van Brummelen JUrwin LJohnston OSayed MBrostow G(2024)Don’t Look Now: Audio/Haptic Guidance for 3D Scanning of LandmarksProceedings of the CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642271(1-20)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642271
Logothetis FBudvytis ICipolla R(2024)A Neural Height-Map Approach for the Binocular Photometric Stereo Problem2024 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)10.1109/WACV57701.2024.00159(1557-1566)Online publication date: 3-Jan-2024
https://doi.org/10.1109/WACV57701.2024.00159
Show More Cited By

Index Terms

Real-time 3D model acquisition

Recommendations

Real-time 3D model acquisition
SIGGRAPH '02: Proceedings of the 29th annual conference on Computer graphics and interactive techniques

The digitization of the 3D shape of real objects is a rapidly expanding field, with applications in entertainment, design, and archaeology. We propose a new 3D model acquisition system that permits the user to rotate an object by hand and see a ...
When Specular Object Meets RGB-D Camera 3D Scanning: Color Image Plus Fragmented Depth Map
ISM '14: Proceedings of the 2014 IEEE International Symposium on Multimedia

3D scanning is an important technology since one can apply the scanning results of objects to numerous 3D applications (e.g. Artwork sculpture preserving, 3D animation and 3D printing). However, 3D laser scanners are too expensive to be adopted in daily ...
Hyper-patches for 3D model acquisition and tracking
CVPR '97: Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR '97)

Automatic 3D model acquisition and 3D tracking of simple objects under motion using a single camera is often difficult due to the sparsity of information from which to establish the model. We have developed an automatic scheme that first computes a ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics

ACM Transactions on Graphics Volume 21, Issue 3

July 2002

548 pages

ISSN:0730-0301

EISSN:1557-7368

DOI:10.1145/566654

Issue’s Table of Contents

Copyright © 2002 ACM.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 July 2002

Published in TOG Volume 21, Issue 3

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

329
Total Citations
View Citations
5,847
Total Downloads

Downloads (Last 12 months)108
Downloads (Last 6 weeks)8

Reflects downloads up to 02 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Li J(2024)Accuracy Assessment of Different Processing Methods for 3D Capture and Texture Seam Restoration of Artifacts in Virtual MuseumsProceedings of the 2024 International Conference on Machine Intelligence and Digital Applications10.1145/3662739.3662747(826-836)Online publication date: 30-May-2024
https://dl.acm.org/doi/10.1145/3662739.3662747
Van Brummelen JUrwin LJohnston OSayed MBrostow G(2024)Don’t Look Now: Audio/Haptic Guidance for 3D Scanning of LandmarksProceedings of the CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642271(1-20)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642271
Logothetis FBudvytis ICipolla R(2024)A Neural Height-Map Approach for the Binocular Photometric Stereo Problem2024 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)10.1109/WACV57701.2024.00159(1557-1566)Online publication date: 3-Jan-2024
https://doi.org/10.1109/WACV57701.2024.00159
Lee ISeo JYoo B(2024)Autonomous view planning methods for 3D scanningAutomation in Construction10.1016/j.autcon.2024.105291160(105291)Online publication date: Apr-2024
https://doi.org/10.1016/j.autcon.2024.105291
Xie WHong X(2023)Omnidirectional-Sensor-System-Based Texture Noise Correction in Large-Scale 3D ReconstructionSensors10.3390/s2401007824:1(78)Online publication date: 22-Dec-2023
https://doi.org/10.3390/s24010078
Wang JBi SLiu WZhou LLi TMacleod ILeach R(2023)Stitching Locally Fitted T-Splines for Fast Fitting of Large-Scale Freeform Point CloudsSensors10.3390/s2324981623:24(9816)Online publication date: 14-Dec-2023
https://doi.org/10.3390/s23249816
Elahi AZhu QLu JHammad ZBilal MLi Y(2023)Single-Shot, Pixel-Encoded Strip Patterns for High-Resolution 3D MeasurementPhotonics10.3390/photonics1011121210:11(1212)Online publication date: 31-Oct-2023
https://doi.org/10.3390/photonics10111212
Xu DXu WYang QZhang WWen SLuo H(2023)All-optical object identification and three-dimensional reconstruction based on optical computing metasurfaceOpto-Electronic Advances10.29026/oea.2023.2301206:12(230120-230120)Online publication date: 2023
https://doi.org/10.29026/oea.2023.230120
Lin JYuan CCai YLi HRen YZou YHong XZhang F(2023)ImMesh: An Immediate LiDAR Localization and Meshing FrameworkIEEE Transactions on Robotics10.1109/TRO.2023.332122739:6(4312-4331)Online publication date: 1-Dec-2023
https://dl.acm.org/doi/10.1109/TRO.2023.3321227
Hampali SHodan TTran LMa LKeskin CLepetit V(2023)In-Hand 3D Object Scanning from an RGB Sequence2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52729.2023.01638(17079-17088)Online publication date: Jun-2023
https://doi.org/10.1109/CVPR52729.2023.01638
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents