Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

Learning the Geodesic Embedding with Graph Neural Networks

Published: 05 December 2023 Publication History

Abstract

We present GEGNN, a learning-based method for computing the approximate geodesic distance between two arbitrary points on discrete polyhedra surfaces with constant time complexity after fast precomputation. Previous relevant methods either focus on computing the geodesic distance between a single source and all destinations, which has linear complexity at least or require a long precomputation time. Our key idea is to train a graph neural network to embed an input mesh into a high-dimensional embedding space and compute the geodesic distance between a pair of points using the corresponding embedding vectors and a lightweight decoding function. To facilitate the learning of the embedding, we propose novel graph convolution and graph pooling modules that incorporate local geodesic information and are verified to be much more effective than previous designs. After training, our method requires only one forward pass of the network per mesh as precomputation. Then, we can compute the geodesic distance between a pair of points using our decoding function, which requires only several matrix multiplications and can be massively parallelized on GPUs. We verify the efficiency and effectiveness of our method on ShapeNet and demonstrate that our method is faster than existing methods by orders of magnitude while achieving comparable or better accuracy. Additionally, our method exhibits robustness on noisy and incomplete meshes and strong generalization ability on out-of-distribution meshes. The code and pretrained model can be found on https://github.com/IntelligentGeometry/GeGnn.

References

[1]
Yohanes Yudhi Adikusuma, Zheng Fang, and Ying He. 2020. Fast construction of discrete geodesic graphs. ACM Trans. Graph. 39, 2 (2020).
[2]
G. H. Bendels and R. Klein. 2003. Mesh Forging: Editing of 3D-Meshes Using Implicitly Defined Occluders. In SGP.
[3]
Pravin Bhat, Stephen Ingram, and Greg Turk. 2004. Geometric texture synthesis by example. In Symp. Geom. Proc.
[4]
Shaked Brody, Uri Alon, and Eran Yahav. 2022. How Attentive are Graph Attention Networks?. In ICLR.
[5]
J. Douglas Carroll and Phipps Arabie. 1998. Multidimensional scaling. Measurement, judgment and decision making (1998).
[6]
Angel X. Chang, Thomas Funkhouser, Leonidas J. Guibas, Pat Hanrahan, Qixing Huang, Zimo Li, Silvio Savarese, Manolis Savva, Shuran Song, Hao Su, Jianxiong Xiao, Li Yi, and Fisher Yu. 2015. ShapeNet: An information-rich 3D model repository. arXiv preprint arXiv:1512.03012 (2015).
[7]
Jindong Chen and Yijie Han. 1990. Shortest paths on a polyhedron. In Proceedings of the sixth annual symposium on Computational geometry.
[8]
Ronald R Coifman, Stephane Lafon, Ann B Lee, Mauro Maggioni, Boaz Nadler, Frederick Warner, and Steven W Zucker. 2005. Geometric diffusions as a tool for harmonic analysis and structure definition of data: Diffusion maps. Proceedings of the national academy of sciences 102, 21 (2005).
[9]
Keenan Crane, Fernando de Goes, Mathieu Desbrun, and Peter Schröder. 2013a. Digital geometry processing with discrete exterior calculus. In ACM SIGGRAPH 2013 courses.
[10]
Keenan Crane, Marco Livesu, Enrico Puppo, and Yipeng Qin. 2020. A survey of algorithms for geodesic paths and distances. arXiv preprint arXiv:2007.10430 (2020).
[11]
Keenan Crane, Clarisse Weischedel, and Max Wardetzky. 2013b. Geodesics in heat: A new approach to computing distance based on heat flow. ACM Trans. Graph. 32, 5 (2013).
[12]
Keenan Crane, Clarisse Weischedel, and Max Wardetzky. 2017. The Heat Method for Distance Computation. Commun. ACM 60, 11 (2017).
[13]
Congyue Deng, Or Litany, Yueqi Duan, Adrien Poulenard, Andrea Tagliasacchi, and Leonidas J Guibas. 2021. Vector neurons: A general framework for so (3)-equivariant networks. In CVPR.
[14]
Matthias Fey and Jan Eric Lenssen. 2019. Fast Graph Representation Learning with PyTorch Geometric. In ICLR Workshop.
[15]
Matthias Fey, Jan Eric Lenssen, Frank Weichert, and Heinrich Müller. 2018. SplineCNN: Fast Geometric Deep Learning with Continuous B-Spline Kernels. In CVPR.
[16]
Francois Fouss, Alain Pirotte, Jean-Michel Renders, and Marco Saerens. 2007. Randomwalk computation of similarities between nodes of a graph with application to collaborative recommendation. IEEE Transactions on knowledge and data engineering 19, 3 (2007).
[17]
Michael Garland and Paul S Heckbert. 1997. Surface simplification using quadric error metrics. In SIGGRAPH.
[18]
Justin Gilmer, Samuel S Schoenholz, Patrick F Riley, Oriol Vinyals, and George E Dahl. 2017. Neural message passing for quantum chemistry. In ICML.
[19]
Craig Gotsman and Kai Hormann. 2022. Compressing Geodesic Information for Fast Point-to-Point Geodesic Distance Queries. In SIGGRAPH Asia.
[20]
Will Hamilton, Zhitao Ying, and Jure Leskovec. 2017. Inductive Representation Learning on Large Graphs. In NeurIPS.
[21]
Rana Hanocka, Amir Hertz, Noa Fish, Raja Giryes, Shachar Fleishman, and Daniel Cohen-Or. 2019. MeshCNN: A network with an edge. ACM Trans. Graph. (SIGGRAPH) 38, 4 (2019).
[22]
Rana Hanocka, Gal Metzer, Raja Giryes, and Daniel Cohen-Or. 2020. Point2Mesh: A Self-Prior for Deformable Meshes. ACM Trans. Graph. (SIGGRAPH) 39, 4 (2020).
[23]
Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2016. Deep residual learning for image recognition. In CVPR.
[24]
Hugues Hoppe, Tony DeRose, Tom Duchamp, John McDonald, and Werner Stuetzle. 1993. Mesh optimization. In SIGGRAPH.
[25]
Qingyong Hu, Bo Yang, Linhai Xie, Stefano Rosa, Yulan Guo, Zhihua Wang, Niki Trigoni, and Andrew Markham. 2020. RandLA-Net: Efficient Semantic Segmentation of Large-Scale Point Clouds. CVPR.
[26]
Shi-Min Hu, Zheng-Ning Liu, Meng-Hao Guo, Jun-Xiong Cai, Jiahui Huang, Tai-Jiang Mu, and Ralph R Martin. 2022. Subdivision-based mesh convolution networks. ACM Trans. Graph. 41, 3 (2022).
[27]
Ron Kimmel and James A. Sethian. 1998. Computing geodesic paths on manifolds. Proceedings of the National Academy of Science 95, 15 (1998).
[28]
Thomas N Kipf and Max Welling. 2017. Semi-supervised classification with graph convolutional networks. In ICLR.
[29]
Yangyan Li, Rui Bu, Mingchao Sun, Wei Wu, Xinhan Di, and Baoquan Chen. 2018. PointCNN: Convolution on X-transformed points. In NeurIPS.
[30]
Yaron Lipman, Raif M Rustamov, and Thomas A Funkhouser. 2010. Biharmonic distance. ACM Trans. Graph. 29, 3 (2010).
[31]
Hsueh-Ti Derek Liu, Vladimir G. Kim, Siddhartha Chaudhuri, Noam Aigerman, and Alec Jacobson. 2020. Neural Subdivision. ACM Trans. Graph. (SIGGRAPH) 39, 4 (2020).
[32]
Charles Loop. 1987. Smooth subdivision surfaces based on triangles. Thesis, University of Utah (1987).
[33]
Ilya Loshchilov and Frank Hutter. 2019. Decoupled weight decay regularization. In ICLR.
[34]
Hiroshi Maehara. 2013. Euclidean embeddings of finite metric spaces. Discrete Mathematics 313, 23 (2013).
[35]
Michael Martinek, Matthias Ferstl, and Roberto Grosso. 2012. 3D Shape Matching based on Geodesic Distance Distributions. In Vision, Modeling and Visualization.
[36]
Facundo Mémoli and Guillermo Sapiro. 2001. Fast computation of weighted distance functions and geodesics on implicit hyper-surfaces. Journal of computational Physics 173, 2 (2001).
[37]
Facundo Mémoli and Guillermo Sapiro. 2005. Distance Functions and Geodesics on Submanifolds of Rd and Point Clouds. SIAM J. Appl. Math. 65, 4 (2005).
[38]
Joseph S. B. Mitchell, David M. Mount, and Christos H. Papadimitriou. 1987. The discrete geodesic problem. SIAM J. Comput. 16, 4 (1987).
[39]
Robert Osada, Thomas Funkhouser, Bernard Chazelle, and David Dobkin. 2002. Shape distributions. ACM Trans. Graph. 21, 4 (2002).
[40]
Daniele Panozzo, Ilya Baran, Olga Diamanti, and Olga Sorkine-Hornung. 2013. Weighted averages on surfaces. ACM Trans. Graph. (SIGGRAPH) 32, 4 (2013).
[41]
Adam Paszke, Sam Gross, Francisco Massa, Adam Lerer, James Bradbury, Gregory Chanan, Trevor Killeen, Zeming Lin, Natalia Gimelshein, Luca Antiga, Alban Desmaison, Andreas Kopf, Edward Yang, Zachary DeVito, Martin Raison, Alykhan Tejani, Sasank Chilamkurthy, Benoit Steiner, Lu Fang, Junjie Bai, and Soumith Chintala. 2019. PyTorch: An Imperative Style, High-Performance Deep Learning Library. In NeurIPS.
[42]
Tobias Pfaff, Meire Fortunato, Alvaro Sanchez-Gonzalez, and Peter Battaglia. 2020. Learning Mesh-Based Simulation with Graph Networks. In ICLR.
[43]
Andrew Pressley and Andrew Pressley. 2010. Gauss' theorema egregium. Elementary differential geometry (2010).
[44]
Charles R. Qi, Li Yi, Hao Su, and Leonidas J. Guibas. 2017. PointNet++: Deep hierarchical feature learning on point sets in a metric space. In NeurIPS.
[45]
Yipeng Qin, Xiaoguang Han, Hongchuan Yu, Yizhou Yu, and Jianjun Zhang. 2016. Fast and exact discrete geodesic computation based on triangle-oriented wavefront propagation. ACM Trans. Graph. (SIGGRAPH) 35, 4 (2016).
[46]
Dan Raviv, Alexander M Bronstein, Michael M Bronstein, and Ron Kimmel. 2010. Full and partial symmetries of non-rigid shapes. International Journal of Computer Vision 89, 1 (2010).
[47]
Olaf Ronneberger, Philipp Fischer, and Thomas Brox. 2015. U-Net: Convolutional networks for biomedical image segmentation. In International Conference on Medical image computing and computer-assisted intervention.
[48]
Raif M Rustamov, Yaron Lipman, and Thomas Funkhouser. 2009. Interior distance using barycentric coordinates. Comput. Graph. Forum (SGP) 28, 5 (2009).
[49]
Ryan Schmidt, Cindy Grimm, and Brian Wyvill. 2006. Interactive Decal Compositing with Discrete Exponential Maps. In SIGGRAPH.
[50]
James A. Sethian. 1999. Fast marching methods. SIAM review 41, 2 (1999).
[51]
Gil Shamai, Michael Zibulevsky, and Ron Kimmel. 2018. Efficient inter-geodesic distance computation and fast classical scaling. TPAMI 42, 1 (2018).
[52]
Nicholas Sharp and Keenan Crane. 2020. You can find geodesic paths in triangle meshes by just flipping edges. ACM Trans. Graph. (SIGGRAPH ASIA) 39, 6 (2020).
[53]
Martin Simonovsky and Nikos Komodakis. 2017. Dynamic edge-conditioned filters in convolutional neural networks on graphs. In CVPR.
[54]
Justin Solomon, Raif Rustamov, Leonidas Guibas, and Adrian Butscher. 2014. Earth mover's distances on discrete surfaces. ACM Trans. Graph. (SIGGRAPH) 33, 4 (2014).
[55]
Vitaly Surazhsky, Tatiana Surazhsky, Danil Kirsanov, Steven J Gortler, and Hugues Hoppe. 2005. Fast exact and approximate geodesics on meshes. ACM Trans. Graph. 24, 3 (2005).
[56]
Jiong Tao, Juyong Zhang, Bailin Deng, Zheng Fang, Yue Peng, and Ying He. 2019. Parallel and scalable heat methods for geodesic distance computation. IEEE Trans. Pattern Anal. Mach. Intell. 43, 2 (2019).
[57]
Hugues Thomas, Charles R. Qi, Jean-Emmanuel Deschaud, Beatriz Marcotegui, François Goulette, and Leonidas J. Guibas. 2019. KPConv: Flexible and deformable convolution for point clouds. In ICCV.
[58]
John N. Tsitsiklis. 1995. Efficient algorithms for globally optimal trajectories. IEEE transactions on Automatic Control 40, 9 (1995).
[59]
Petar Velickovic, Guillem Cucurull, Arantxa Casanova, Adriana Romero, Pietro Lio, and Yoshua Bengio. 2017. Graph attention networks. stat 1050, 20 (2017).
[60]
Nanyang Wang, Yinda Zhang, Zhuwen Li, Yanwei Fu, Wei Liu, and Yu-Gang Jiang. 2018. Pixel2Mesh: Generating 3D mesh models from single RGB images. In CVPR.
[61]
Peng-Shuai Wang, Yang Liu, and Xin Tong. 2022. Dual Octree Graph Networks for Learning Adaptive Volumetric Shape Representations. ACM Trans. Graph. (SIGGRAPH) 41, 4 (2022).
[62]
Yue Wang, Yongbin Sun, Ziwei Liu, Sanjay E Sarma, Michael M Bronstein, and Justin M Solomon. 2019. Dynamic graph CNN for learning on point clouds. ACM Trans. Graph. 38, 5 (2019).
[63]
Ofir Weber, Yohai S Devir, Alexander M Bronstein, Michael M Bronstein, and Ron Kimmel. 2008. Parallel algorithms for approximation of distance maps on parametric surfaces. ACM Transactions on Graphics (TOG) (2008).
[64]
Yuxin Wu and Kaiming He. 2018. Group normalization. In ECCV.
[65]
Zonghan Wu, Shirui Pan, Fengwen Chen, Guodong Long, Chengqi Zhang, and S Yu Philip. 2020. A comprehensive survey on graph neural networks. IEEE Transactions on Neural Networks and Learning Systems 32, 1 (2020).
[66]
Qianwei Xia, Juyong Zhang, Zheng Fang, Jin Li, Mingyue Zhang, Bailin Deng, and Ying He. 2021. GeodesicEmbedding (GE): a high-dimensional embedding approach for fast geodesic distance queries. IEEE. T. Vis. Comput. Gr. (2021).
[67]
Shi-Qing Xin and Guo-Jin Wang. 2009. Improving Chen and Han's algorithm on the discrete geodesic problem. ACM Trans. Graph. (SIGGRAPH) 28, 4 (2009).
[68]
Shi-Qing Xin, Xiang Ying, and Ying He. 2012. Constant-time all-pairs geodesic distance query on triangle meshes. In I3D.
[69]
Chunxu Xu, Tuanfeng Y Wang, Yong-Jin Liu, Ligang Liu, and Ying He. 2015. Fast wavefront propagation (FWP) for computing exact geodesic distances on meshes. IEEE. T. Vis. Comput. Gr. 21, 7 (2015).
[70]
Keyulu Xu, Weihua Hu, Jure Leskovec, and Stefanie Jegelka. 2018b. How powerful are graph neural networks? arXiv preprint arXiv:1810.00826 (2018).
[71]
Kai Xu, Hao Zhang, Andrea Tagliasacchi, Ligang Liu, Guo Li, Min Meng, and Yueshan Xiong. 2009. Partial intrinsic reflectional symmetry of 3D shapes. In ACM Trans. Graph. (SIGGRAPH ASIA).
[72]
Yifan Xu, Tianqi Fan, Mingye Xu, Long Zeng, and Yu Qiao. 2018a. SpiderCNN: Deep Learning on Point Sets with Parameterized Convolutional Filters. In ECCV.
[73]
Luh Yen, Francois Fouss, Christine Decaestecker, Pascal Francq, and Marco Saerens. 2007. Graph nodes clustering based on the commute-time kernel. In Advances in Knowledge Discovery and Data Mining.
[74]
Li Yi, Hao Su, Xingwen Guo, and Leonidas J. Guibas. 2017. SyncSpecCNN: Synchronized spectral CNN for 3D shape segmentation. In CVPR.
[75]
Xiang Ying, Xiaoning Wang, and Ying He. 2013. Saddle vertex graph (SVG) a novel solution to the discrete geodesic problem. ACM Trans. Graph. (SIGGRAPH ASIA) 32, 6 (2013).
[76]
Xiang Ying, Shi-Qing Xin, and Ying He. 2014. Parallel Chen-Han (PCH) algorithm for discrete geodesics. ACM Trans. Graph. 33, 1 (2014).
[77]
Qijian Zhang, Junhui Hou, Yohanes Yudhi Adikusuma, Wenping Wang, and Ying He. 2023. NeuroGF: A Neural Representation for Fast Geodesic Distance and Path Queries. arXiv preprint arXiv:2306.00658 (2023).
[78]
Gil Zigelman, Ron Kimmel, and Nahum Kiryati. 2002. Texture mapping using surface flattening via multidimensional scaling. IEEE. T. Vis. Comput. Gr. 8, 2 (2002).

Cited By

View all
  • (2024)Differentiable Geodesic Distance for Intrinsic Minimization on Triangle MeshesACM Transactions on Graphics10.1145/365812243:4(1-14)Online publication date: 19-Jul-2024

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics
ACM Transactions on Graphics  Volume 42, Issue 6
December 2023
1565 pages
ISSN:0730-0301
EISSN:1557-7368
DOI:10.1145/3632123
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 05 December 2023
Published in TOG Volume 42, Issue 6

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. geodesic distance
  2. geodesic embedding
  3. graph neural network

Qualifiers

  • Research-article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)173
  • Downloads (Last 6 weeks)18
Reflects downloads up to 10 Nov 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Differentiable Geodesic Distance for Intrinsic Minimization on Triangle MeshesACM Transactions on Graphics10.1145/365812243:4(1-14)Online publication date: 19-Jul-2024

View Options

Get Access

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media