Article

Reconstruction of deforming geometry from time-varying point clouds

Authors:

Martin Bokeloh,

Leonidas Guibas,

Andreas SchillingAuthors Info & Claims

SGP '07: Proceedings of the fifth Eurographics symposium on Geometry processing

Pages 49 - 58

Published: 04 July 2007 Publication History

Abstract

In this paper, we describe a system for the reconstruction of deforming geometry from a time sequence of unstructured, noisy point clouds, as produced by recent real-time range scanning devices. Our technique reconstructs both the geometry and dense correspondences over time. Using the correspondences, holes due to occlusion are filled in from other frames. Our reconstruction technique is based on a statistical framework: The reconstruction should both match the measured data points and maximize prior probability densities that prefer smoothness, rigid deformation and smooth movements over time. The optimization procedure consists of an inner loop that optimizes the 4D shape using continuous numerical optimization and an outer loop that infers the discrete 4D topology of the data set using an iterative model assembly algorithm. We apply the technique to a variety of data sets, demonstrating that the new approach is capable of robustly retrieving animated models with correspondences from data sets suffering from significant noise, outliers and acquisition holes.

References

[1]

{ABW} ABW GmbH: http://www.abw-3d.de

[2]

{ACL00} Alexa, M., Cohen-Or, D., Levin, D.: As-rigid-as-possible shape interpolation. In: Proc. SIGGRAPH 2000.

Digital Library

[3]

{ACP02} Allen, B., Curless, B., Popović, Z.: Articulated Body Deformation from Range Scan Data. In: ACM Trans. on Graphics 21(3), 2002.

Digital Library

[4]

{ACP03} Allen, B., Curless, B., Popović, Z. The space of all body shapes: reconstruction and parameterization from range scans. In: ACM Trans. on Graphics 22(3), 587--594, 2003.

Digital Library

[5]

{AG04} Anuar, N., Guskov, I.: Extracting Animated Meshes with Adaptive Motion Estimation. In: Proc. Vision, Modeling, and Visualization 2004.

[6]

{ASK*05} Anguelov, D., Srinivasan, Koller, D., Thrun, S., Rodgers, J., Davis, J.: SCAPE: Shape Completion and Animation of People. In: ACM Trans. on Graphics 24(3), 408--416, 2005.

Digital Library

[7]

{ASP*04} Anguelov, D., Srinivasan, P., Pang, H. C., Koller, D., Thrun, S., Davis, J.: The Correlated Correspondence Algorithm for Unsupervised Registration of Nonrigid Surfaces. In: NIPS 2004.

[8]

{BFS04} Biber, P., Fleck, S. Strasser, W.: A Probabilistic Framework for Robust and Accurate Matching of Point Clouds. In: Proc. 26th Pattern Recognition Symposium, 2004.

[9]

{BM92} Besl, P., McKay, N.: A method for registration of 3d shapes. In: IEEE PAMI 14(2), 1992.

Digital Library

[10]

{BW98} Baraff, D., Witkin, A.: Large steps in cloth simulation. In: Proc. SIGGRAPH 98, pp. 43--54, 1998.

Digital Library

[11]

{CTM*03} Carranza, J., Theobalt, C., Magnor, M., Seidel, H. P.: Free-Viewpoint Video of Human Actors. In: ACM Trans. on Graphics 22(3), 569--577, 2003

Digital Library

[12]

{CSEM} CSEM SA: http://www.swissranger.ch.

[13]

{DNR*05} Davis, J., Nehab, D., Ramamoothi, R., Rusinkiewicz, S.: Spacetime Stereo: A Unifying Framework for Depth from Triangulation. In: IEEE PAMI, 27(2), 2005.

Digital Library

[14]

{DTB06} Diebel, J. R., Thrun, S., Brünig, M.: A Bayesian method for probable surface reconstruction and decimation. In: ACM Trans. on Graphics 25(1), 39--59, 2006.

Digital Library

[15]

{FB05} Fong, P., Buron., F.: High-Resolution Three-Dimensional Sensing of Fast Deforming Objects. In: IEEE/RSJ Int. Conf. on Intelligent Robots and Systems (IROS), 2005.

[16]

{GK07} Gumhold, S., König, S.: personal communication, 2007.

[17]

{HDD*92} Hoppe H., DeRose T., Duchamp T., McDonald J., Stuetzle W.: Surface Reconstruction from Unorganized Points. In: Computer Graphics, 26(2), 71--78, 1992.

Digital Library

[18]

{Hor87} Horn, B. Closed-form solution of absolute orientation using unit quaternions. In: J. Opt. Society of America A 4, 1987.

[19]

{HP04} Hofer, M., Pottmann, H.: Energy-minimizing splines in manifolds. In: ACM Trans. on Graphics 23(3), 284--293, 2004.

Digital Library

[20]

{HSL*06} Huang, J., Shi, X., Liu, X., Zhou, K., Wei, L.-Y., Teng, S.-H., Bao, H., Guo, B., Shum, H.-Y.: Subspace gradient domain mesh deformation. In: ACM Trans. on Graphics 25(3), 2006.

Digital Library

[21]

{HTB03} Hähnel, D., Thrun, S., Burgard, W.: An Extension of the ICP Algorithm for Modeling Nonrigid Objects with Mobile Robots. In: Proc. Int. Joint Conf. on Artificial Intelligence (IJCAI) 2003.

Digital Library

[22]

{JWB*06} Jenke, P., Wand, M., Bokeloh, M., Schilling, A., Strasser, W.: Bayesian Point Cloud Reconstruction. In: Computer Graphics Forum 25(3), 379--388, 2006.

[23]

{LZJ*05} Lu, D., Zhao, H., Jiang, M., Zhou, S., Zhou, T.: A Surface Reconstruction Method for Highly Noisy Point Clouds. In: Proc. Variational, Geometric, and Level Set Methods in Computer Vision, LNCS, Springer, 2005.

Digital Library

[24]

{MGR00} Marschner, S. R., Guenter, B., Raghupathy, S.: Modeling and Rendering for Realistic Facial Animation. In: Proc. Eurographics Workshop on Rendering 2000.

Digital Library

[25]

{MLT00} Medioni, G. Lee, M. S., Tang C. K.: A Computational Framework for Segmentation and Grouping, Elsevier, 2000.

Digital Library

[26]

{PH03} Pottmann, H., Hofer, M.: Geometry of the squared distance function to curves and surfaces. In: Visualization and Mathematics III, Springer, pp. 223--244, 2003.

[27]

{PH06} Park, S. I., Hodgins, J. K: Capturing and Animating Skin Deformation in Human Motion. In: ACM Transaction on Graphics 25(3), 881--889, 2006.

Digital Library

[28]

{PMD} PMD technologies: http://www.pmdtec.com

[29]

{PMG*05} Pauly M., Mitra N. J., Giesen, J., Gross, M., Guibas L. J.: Example-Based 3D Scan Completion. In: Proc. Eurographics Symp. on Geometry Processing, pp. 23--32, 2005.

Digital Library

[30]

{RHL02} Rusinkiewicz, S., Hall-Holt, O., Levoy, M.: Real-Time 3D Model Acquisition. In: ACM Trans. on Graphics, 21(3), 2002.

Digital Library

[31]

{SCL*04} Sorkine, O., Cohen-Or, D., Lipman, Y., Alexa, M., Rössl, C., Seidel, H.-P.: Laplacian surface editing. In: Proc. Symp. on Geometry Processing 2004, pp. 175 -- 184.

Digital Library

[32]

{Shi04} Shinya, M.: Unifying measured point sequences of deforming objects. In: Proc. 3D Data Processing, Visualization and Transmission 2004.

Digital Library

[33]

{SMP03} Sand, P., McMillan, L., Popović, J.: Continuous Capture of Skin Deformation. In: ACM Trans. on Graphics 22(3), 2003.

Digital Library

[34]

{SOS04} Shen, C., O'Brien, J. F., and Shewchuk, J. R.: Interpolating and approximating implicit surfaces from polygon soup. In: ACM Trans. Graph. 23(3), 896--904, 2004.

Digital Library

[35]

{SP04} Sumner, R. W., Popović, J.: Deformation transfer for triangle meshes. In: ACM Trans. on Graphics 23(3), 399--405, 2004.

Digital Library

[36]

{STT93} Szeliski, R., Tonnesen, D., Terzopoulos, D.,: Modeling surfaces of arbitrary topology with dynamic particles. In: Proc. IEEE CVPR, pp. 82--87, 1993.

[37]

{SYB*06} Shi, L., Yu, Y., Bell, N., Feng, W.-W.: A fast multigrid algorithm for mesh deformation. In: ACM Trans. on Graphics, 25(3), 1108--1117, 2006.

Digital Library

[38]

{TPB*87} Terzopoulos, D., Platt, J., Barr, A., Fleischer, K.: Elastically deformable models. In: Computer Graphics 21(4), 1987.

Digital Library

[39]

{Wan04} Wand, M.: Point-based Multi-Resolution Rendering. PhD thesis, University of Tübingen, 2004.

[40]

{WLS*03} Würmlin, S., Lamboray, E., Staadt, O., Gross, M.: 3D Video Recorder: A System for Recording and Playing Free-Viewpoint Video. In: Computer Graphics Forum, 22(2), 2003.

[41]

{ZSC*04} Zhang, L., Snavely, N., Curless, B., Seitz., S. M.: Spacetime Faces: High-resolution capture for modeling and animation. In: ACM Trans. on Graphics23(3), 548 -- 558, 2004.

Digital Library

[42]

{ZHS*05} Zhou, K., Huang, J., Snyder, J., Liu, X., Bao, H., Guo, B., Shum, H.-Y.: Large mesh deformation using the volumetric graph Laplacian. In: ACM Trans. on Graphics 24(3), 2005.

Digital Library

[43]

{ZKU*04} Zitnick, C. L., Kang, S. B., Uyttendaele, M., Winder, S., Szeliski, R.: High-quality video view interpolation using a layered representation. In: ACM Trans. on Graphics, 23(3), 2004.

Digital Library

Cited By

Savoye Y(2018)Cage-based performance captureACM SIGGRAPH 2018 Courses10.1145/3214834.3214836(1-72)Online publication date: 12-Aug-2018
https://dl.acm.org/doi/10.1145/3214834.3214836
Afzal HAouada DMirbach BOttersten B(2018)Full 3D Reconstruction of Non-Rigidly Deforming ObjectsACM Transactions on Multimedia Computing, Communications, and Applications10.1145/317775614:1s(1-23)Online publication date: 26-Mar-2018
https://dl.acm.org/doi/10.1145/3177756
Xu KKim VHuang QMitra NKalogerakis EMitra N(2016)Data-driven shape analysis and processingSIGGRAPH ASIA 2016 Courses10.1145/2988458.2988473(1-38)Online publication date: 28-Nov-2016
https://dl.acm.org/doi/10.1145/2988458.2988473
Show More Cited By

Index Terms

Reconstruction of deforming geometry from time-varying point clouds
1. Applied computing
  1. Document management and text processing
    1. Document capture
      1. Document scanning
      2. Graphics recognition and interpretation
2. Computing methodologies
  1. Computer graphics
    1. Animation
    2. Image manipulation

Recommendations

A Survey of Surface Reconstruction from Point Clouds

The area of surface reconstruction has seen substantial progress in the past two decades. The traditional problem addressed by surface reconstruction is to recover the digital representation of a physical shape that has been scanned, where the scanned ...
Reconstruction of Wire Structures from Scanned Point Clouds
Proceedings, Part I, of the 9th International Symposium on Advances in Visual Computing - Volume 8033

This paper proposes a method for reconstructing a 3D shape from a point cloud obtained by scanning an object consisting of a wire structure . When scanning a wire structure, the point cloud has many missing parts; thus, it is difficult to apply ...
Tomographic surface reconstruction from point cloud

Inspired by computed tomography (CT), this paper presents a novel surface reconstruction algorithm, tomographic surface reconstruction, to reconstruct a surface mesh from a point cloud equipped with oriented normals. In the process of scanning a real ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

SGP '07: Proceedings of the fifth Eurographics symposium on Geometry processing

July 2007

273 pages

ISBN:9783905673463

Conference Chairs:
Alexander Belyaev
MPI Informatik
,
Michael Garland
NVIDIA Corporation

Sponsors

EUROGRAPHICS: The European Association for Computer Graphics

Publisher

Eurographics Association

Goslar, Germany

Publication History

Published: 04 July 2007

Check for updates

Qualifiers

Article

Conference

SGP '07

Sponsor:

EUROGRAPHICS

SGP '07: Geometry processing

July 4 - 6, 2007

Barcelona, Spain

Acceptance Rates

SGP '07 Paper Acceptance Rate 21 of 74 submissions, 28%;

Overall Acceptance Rate 64 of 240 submissions, 27%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

38
Total Citations
View Citations
1
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 27 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Savoye Y(2018)Cage-based performance captureACM SIGGRAPH 2018 Courses10.1145/3214834.3214836(1-72)Online publication date: 12-Aug-2018
https://dl.acm.org/doi/10.1145/3214834.3214836
Afzal HAouada DMirbach BOttersten B(2018)Full 3D Reconstruction of Non-Rigidly Deforming ObjectsACM Transactions on Multimedia Computing, Communications, and Applications10.1145/317775614:1s(1-23)Online publication date: 26-Mar-2018
https://dl.acm.org/doi/10.1145/3177756
Xu KKim VHuang QMitra NKalogerakis EMitra N(2016)Data-driven shape analysis and processingSIGGRAPH ASIA 2016 Courses10.1145/2988458.2988473(1-38)Online publication date: 28-Nov-2016
https://dl.acm.org/doi/10.1145/2988458.2988473
Savoye YMitra N(2016)Cage-based performance captureSIGGRAPH ASIA 2016 Courses10.1145/2988458.2988459(1-53)Online publication date: 28-Nov-2016
https://dl.acm.org/doi/10.1145/2988458.2988459
Wuhrer SLang JTekieh MShu C(2015)Finite element based tracking of deforming surfacesGraphical Models10.1016/j.gmod.2014.10.00277:C(1-17)Online publication date: 1-Jan-2015
https://dl.acm.org/doi/10.1016/j.gmod.2014.10.002
Li XIyengar S(2014)On Computing Mapping of 3D ObjectsACM Computing Surveys10.1145/266802047:2(1-45)Online publication date: 19-Dec-2014
https://dl.acm.org/doi/10.1145/2668020
Yan FSharf ALin WHuang HChen B(2014)Proactive 3D scanning of inaccessible partsACM Transactions on Graphics10.1145/2601097.260119133:4(1-8)Online publication date: 27-Jul-2014
https://dl.acm.org/doi/10.1145/2601097.2601191
Huang QGuibas LMitra N(2014)Near-Regular Structure Discovery Using Linear ProgrammingACM Transactions on Graphics10.1145/253559633:3(1-17)Online publication date: 2-Jun-2014
https://dl.acm.org/doi/10.1145/2535596
Gafni NSharf ALai YMartin R(2014)3D motion completion in crowded scenesProceedings of the Symposium on Geometry Processing10.1111/cgf.12432(65-74)Online publication date: 9-Jul-2014
https://dl.acm.org/doi/10.1111/cgf.12432
Kurz CWu XWand MThormählen TKohli PSeidel H(2014)Symmetry-Aware Template Deformation and FittingComputer Graphics Forum10.1111/cgf.1234433:6(205-219)Online publication date: 1-Sep-2014
https://dl.acm.org/doi/10.1111/cgf.12344
Show More Cited By

View Options

View options

Figures

Tables

Media

View Table of Conten