research-article

Public Access

Spatiotemporal atlas parameterization for evolving meshes

Authors:

Hugues HoppeAuthors Info & Claims

ACM Transactions on Graphics (TOG), Volume 36, Issue 4

Article No.: 58, Pages 1 - 12

https://doi.org/10.1145/3072959.3073679

Published: 20 July 2017 Publication History

Abstract

We convert a sequence of unstructured textured meshes into a mesh with incrementally changing connectivity and atlas parameterization. Like prior work on surface tracking, we seek temporally coherent mesh connectivity to enable efficient representation of surface geometry and texture. Like recent work on evolving meshes, we pursue local remeshing to permit tracking over long sequences containing significant deformations or topological changes. Our main contribution is to show that both goals are realizable within a common framework that simultaneously evolves both the set of mesh triangles and the parametric map. Sparsifying the remeshing operations allows the formation of large spatiotemporal texture charts. These charts are packed as prisms into a 3D atlas for a texture video. Reducing tracking drift using mesh-based optical flow helps improve compression of the resulting video stream.

Supplementary Material

ZIP File (a58-prada.zip)

Supplemental files.

Download
140.78 MB

MP4 File (papers-0418.mp4)

Download
400.73 MB

References

[1]

Alexander I Bobenko and Peter Schröder. 2005. Discrete Willmore flow. Symposium on Geometry Processing (2005).

Digital Library

[2]

Morten Bojsen-Hansen, Hao Li, and Chris Wojtan. 2012. Tracking surfaces with evolving topology. ACM Trans. Graph. 31, 4, Article 53 (July 2012).

Digital Library

[3]

Chris Budd, Peng Huang, Martin Klaudiny, and Adrian Hilton. 2013. Global non-rigid alignment of surface sequences. Int. J. Comput. Vision 102 (2013).

Digital Library

[4]

Alvaro Collet, Ming Chuang, Pat Sweeney, Don Gillett, Dennis Evseev, David Calabrese, Hugues Hoppe, Adam Kirk, and Steve Sullivan. 2015. High-quality streamable free-viewpoint video. ACM Trans. Graph. 34 (2015).

Digital Library

[5]

Mingsong Dou, Sameh Khamis, Yury Degtyarev, Philip Davidson, Sean Ryan Fanello, Adarsh Kowdle, Sergio Orts Escolano, Christoph Rhemann, David Kim, Jonathan Taylor, Pushmeet Kohli, Vladimir Tankovich, and Shahram Izadi. 2016. Fusion4D: Real-time performance capture of challenging scenes. ACM Trans. Graph. 35, 4, Article 114 (July 2016).

Digital Library

[6]

Alec Jacobson, Daniele Panozzo, and others. 2016. libigl: A simple C++ geometry processing library. http://libigl.github.io/libigl/. (2016).

[7]

Vladimir G. Kim, Yaron Lipman, and Thomas Funkhouser. 2011. Blended intrinsic maps. ACM Trans. Graph., Article 79 (2011).

Digital Library

[8]

Bruno Lévy, Sylvain Petitjean, Nicolas Ray, and Jérome Maillot. 2002. Least squares conformal maps for automatic texture atlas generation. In Proc. ACM SIGGRAPH.

Digital Library

[9]

Hao Li, Bart Adams, Leonidas J. Guibas, and Mark Pauly. 2009. Robust single-view geometry and motion reconstruction. ACM Trans. Graph. 28 (2009).

Digital Library

[10]

Hao Li, Linjie Luo, Daniel Vlasic, Pieter Peers, Jovan Popović, Mark Pauly, and Szymon Rusinkiewicz. 2012. Temporally coherent completion of dynamic shapes. ACM Trans. Graph. 31, 1, Article 2 (Feb. 2012).

Digital Library

[11]

Hao Li, Robert W. Sumner, and Mark Pauly. 2008. Global correspondence optimization for non-rigid registration of depth scans. In Symposium on Geometry Processing. 10.

[12]

Haggai Maron, Nadav Dym, Itay Kezurer, Shahar Kovalsky, and Yaron Lipman. 2016. Point registration via efficient convex relaxation. ACM Trans. Graph. 35, 4, Article 73 (July 2016).

Digital Library

[13]

Microsoft. 2011. UVAtlas. https://github.com/Microsoft/UVAtlas. (2011).

[14]

Richard A. Newcombe, Dieter Fox, and Steven M. Seitz. 2015. DynamicFusion: Reconstruction and tracking of non-rigid scenes in real-time. In IEEE CVPR.

[15]

Fabián Prada, Misha Kazhdan, Ming Chuang, Alvaro Collet, and Hugues Hoppe. 2016. Motion graphs for unstructured textured meshes. ACM Trans. Graph. 35, 4, Article 108 (July 2016).

Digital Library

[16]

Pedro Sander, John Snyder, Steven Gortler, and Hugues Hoppe. 2001. Texture mapping progressive meshes. In Proc. ACM SIGGRAPH. 409--416.

Digital Library

[17]

Alla Shefler, Emil Praun, and Kenneth Rose. 2006. Mesh parameterization methods and their applications. Foundations and Trends in Computer Graphics and Vision 2, 2 (2006).

[18]

Justin Solomon, Gabriel Peyré, Vladimir G. Kim, and Suvrit Sra. 2016. Entropic metric alignment for correspondence problems. ACM Trans. Graph. 35, 4, Article 72 (July 2016), 13 pages.

Digital Library

[19]

Olga Sorkine and Marc Alexa. 2007. As-rigid-as-possible surface modeling. In Symp. on Geometry Processing.

[20]

Jonathan Starck and Adrian Hilton. 2007. Surface capture for performance-based animation. IEEE Computer Graphics and Application 27 (2007).

Digital Library

[21]

Robert W. Sumner, Johannes Schmid, and Mark Pauly. 2007. Embedded deformation for shape manipulation. ACM Trans. Graph. 26 (2007).

Digital Library

[22]

Vitaly Surazhsky, Tatiana Surazhsky, Danil Kirsanov, Steven J. Gortler, and Hugues Hoppe. 2005. Fast exact and approximate geodesics on meshes. ACM Trans. Graph. 24, 3 (July 2005).

Digital Library

[23]

Gabriel Taubin. 1995. A signal processing approach to fair surface design. In Proc. ACM SIGGRAPH. 8.

Digital Library

[24]

Art Tevs, Alexander Berner, Michael Wand, Ivo Ihrke, Martin Bokeloh, Jens Kerber, and Hans-Peter Seidel. 2012. Animation cartography: Intrinsic reconstruction of shape and motion. ACM Trans. Graph. 31, 2 (2012).

Digital Library

[25]

Chris Wojtan, Nils Thürey, Markus Gross, and Greg Turk. 2009. Deforming meshes that split and merge. ACM Trans. Graph. 28, 3, Article 76 (July 2009).

Digital Library

[26]

Faxin Yu, Zheming Lu, Hao Luo, and Pinghui Wang. 2011. Three-dimensional model analysis and processing. Springer Science & Business Media.

[27]

C Lawrence Zitnick, Sing Bing Kang, Matthew Uyttendaele, Simon Winder, and Richard Szeliski. 2004. High-quality video view interpolation using a layered representation. ACM Trans. Graph. 23 (2004).

[28]

Michael Zollhöfer, Matthias Nießner, Shahram Izadi, Christoph Rehmann, Christopher Zach, Matthew Fisher, Chenglei Wu, Andrew Fitzgibbon, Charles Loop, Christian Theobalt, and Marc Stamminger. 2014. Real-time non-rigid reconstruction using an RGB-D camera. ACM Trans. Graph. 33 (2014).

Digital Library

Cited By

Rendle GKreskowski AFroehlich B(2023)Volumetric Avatar Reconstruction with Spatio-Temporally Offset RGBD Cameras2023 IEEE Conference Virtual Reality and 3D User Interfaces (VR)10.1109/VR55154.2023.00023(72-82)Online publication date: Mar-2023
https://doi.org/10.1109/VR55154.2023.00023
Marvie JKrivokuća MGraziosi D(2023)Coding of dynamic 3D meshesImmersive Video Technologies10.1016/B978-0-32-391755-1.00020-1(387-423)Online publication date: 2023
https://doi.org/10.1016/B978-0-32-391755-1.00020-1
Dvořák JHácha FVáša L(2023)Global Optimisation for Improved Volume Tracking of Time-Varying MeshesComputational Science – ICCS 202310.1007/978-3-031-36027-5_9(113-127)Online publication date: 3-Jul-2023
https://dl.acm.org/doi/10.1007/978-3-031-36027-5_9
Show More Cited By

Index Terms

Spatiotemporal atlas parameterization for evolving meshes
1. Computing methodologies
  1. Computer graphics

Recommendations

5-6-7 meshes
GI '12: Proceedings of Graphics Interface 2012

We introduce a new type of meshes called 5-6-7 meshes. For many mesh processing tasks, low- or high-valence vertices are undesirable. At the same time, it is not always possible to achieve complete vertex valence regularity, i.e., to only have valence-6 ...
Parameterization of Quadrilateral Meshes
ICCS '07: Proceedings of the 7th international conference on Computational Science, Part II

Low-distortion parameterization of 3D meshes is a fundamental problem in computer graphics. Several widely used approaches have been presented for triangular meshes. But no direct parameterization techniques are available for quadrilateral meshes yet. ...
Transforming 3D mesh surfaces into images by parameterization
Integrated image and graphics technologies

This chapter addresses the problem of mesh parameterization for transforming 3D mesh surfaces into images. We begin with a survey of the algorithms for parameterizing a chart, a simply connected mesh isomorphic to a topological disk, into a 2D domain ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics

ACM Transactions on Graphics Volume 36, Issue 4

August 2017

2155 pages

ISSN:0730-0301

EISSN:1557-7368

DOI:10.1145/3072959

Issue’s Table of Contents

Copyright © 2017 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 20 July 2017

Published in TOG Volume 36, Issue 4

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

National Science Foundation

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

36
Total Citations
View Citations
901
Total Downloads

Downloads (Last 12 months)88
Downloads (Last 6 weeks)9

Reflects downloads up to 10 Aug 2024

Other Metrics

View Author Metrics

Citations

Cited By

Rendle GKreskowski AFroehlich B(2023)Volumetric Avatar Reconstruction with Spatio-Temporally Offset RGBD Cameras2023 IEEE Conference Virtual Reality and 3D User Interfaces (VR)10.1109/VR55154.2023.00023(72-82)Online publication date: Mar-2023
https://doi.org/10.1109/VR55154.2023.00023
Marvie JKrivokuća MGraziosi D(2023)Coding of dynamic 3D meshesImmersive Video Technologies10.1016/B978-0-32-391755-1.00020-1(387-423)Online publication date: 2023
https://doi.org/10.1016/B978-0-32-391755-1.00020-1
Dvořák JHácha FVáša L(2023)Global Optimisation for Improved Volume Tracking of Time-Varying MeshesComputational Science – ICCS 202310.1007/978-3-031-36027-5_9(113-127)Online publication date: 3-Jul-2023
https://dl.acm.org/doi/10.1007/978-3-031-36027-5_9
Zheng CLin WXu F(2022)A Self-Occlusion Aware Lighting Model for Real-Time Dynamic ReconstructionIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2022.317823729:10(4062-4073)Online publication date: 27-May-2022
https://dl.acm.org/doi/10.1109/TVCG.2022.3178237
Huang CZhang XTian JXu XLiu S(2022)Boundary-Preserved Geometry Video for Dynamic Mesh Coding2022 Picture Coding Symposium (PCS)10.1109/PCS56426.2022.10018051(133-137)Online publication date: 7-Dec-2022
https://doi.org/10.1109/PCS56426.2022.10018051
Dvořák JKáčereková ZVaněček PHruda LVáša L(2022)As-rigid-as-possible volume tracking for time-varying surfacesComputers and Graphics10.1016/j.cag.2021.10.015102:C(329-338)Online publication date: 1-Feb-2022
https://dl.acm.org/doi/10.1016/j.cag.2021.10.015
Epstein ZGroh MDubey APentland A(2021)Social Influence Leads to the Formation of Diverse Local TrendsProceedings of the ACM on Human-Computer Interaction10.1145/34795535:CSCW2(1-18)Online publication date: 18-Oct-2021
https://dl.acm.org/doi/10.1145/3479553
Miller MSonalkar NMabogunje ALeifer LBailenson J(2021)Synchrony within Triads using Virtual RealityProceedings of the ACM on Human-Computer Interaction10.1145/34795445:CSCW2(1-27)Online publication date: 18-Oct-2021
https://dl.acm.org/doi/10.1145/3479544
Kim HKim JNam HPark JLee S(2021)Spatiotemporal Texture Reconstruction for Dynamic Objects Using a Single RGB‐D CameraComputer Graphics Forum10.1111/cgf.14265240:2(523-535)Online publication date: 4-Jun-2021
https://doi.org/10.1111/cgf.142652
Habermann MXu WZollhoefer MPons-Moll GTheobalt C(2021)A Deeper Look into DeepCapIEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/TPAMI.2021.3093553(1-1)Online publication date: 2021
https://doi.org/10.1109/TPAMI.2021.3093553
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

Media

Figures

Other

Tables

View Issue’s Table of Contents