Split-and-Fit: Learning B-Reps via Structure-Aware Voronoi Partitioning
Authors: 
Yilin Liu, Jiale Chen, Shanshan Pan, Daniel Cohen-Or, Hao Zhang, 
Hui HuangAuthors Info & Claims
Yilin Liu, Jiale Chen, Shanshan Pan, Daniel Cohen-Or, Hao Zhang, Hui HuangAuthors Info & ClaimsArticle No.: 108, Pages 1 - 13
Abstract
We introduce a novel method for acquiring boundary representations (B-Reps) of 3D CAD models which involves a two-step process: it first applies a spatial partitioning, referred to as the "split", followed by a "fit" operation to derive a single primitive within each partition. Specifically, our partitioning aims to produce the classical Voronoi diagram of the set of ground-truth (GT) B-Rep primitives. In contrast to prior B-Rep constructions which were bottom-up, either via direct primitive fitting or point clustering, our Split-and-Fit approach is top-down and structure-aware, since a Voronoi partition explicitly reveals both the number of and the connections between the primitives. We design a neural network to predict the Voronoi diagram from an input point cloud or distance field via a binary classification. We show that our network, coined NVD-Net for neural Voronoi diagrams, can effectively learn Voronoi partitions for CAD models from training data and exhibits superior generalization capabilities. Extensive experiments and evaluation demonstrate that the resulting B-Reps, consisting of parametric surfaces, curves, and vertices, are more plausible than those obtained by existing alternatives, with significant improvements in reconstruction quality. Code will be released on https://github.com/yilinliu77/NVDNet.
Supplementary Material
supplemental
- Download
- 345.43 MB
References
[1]
Pierre Alliez, David Cohen-Steiner, Yiying Tong, and Mathieu Desbrun. 2007. Voronoi-based variational reconstruction of unoriented point sets. In Proc. Eurographics Symp. on Geometry Processing, Vol. 257. 39--48.
[2]
Marco Attene and Giuseppe Patanè. 2010. Hierarchical Structure Recovery of Point-Sampled Surfaces. Computer Graphics Forum 29, 6 (2010), 1905--1920.
[3]
Jean-Philippe Bauchet and Florent Lafarge. 2020. Kinetic shape reconstruction. ACM Trans. on Graphics (Proc. SIGGRAPH) 39, 5 (2020), 156:1--15614.
[4]
Ding-Yun Chen, Xiao-Pei Tian, Yu-Te Shen, and Ming Ouhyoung. 2003. On Visual Similarity Based 3D Model Retrieval. Computer Graphics Forum 22, 3 (2003), 223--232.
[5]
Zhiqin Chen, Andrea Tagliasacchi, Thomas Funkhouser, and Hao Zhang. 2022. Neural Dual Contouring. ACM Trans. on Graphics (Proc. SIGGRAPH) 41, 4 (2022), 104:1--104:13.
[6]
Zhiqin Chen, Andrea Tagliasacchi, and Hao Zhang. 2020. BSP-Net: Generating Compact Meshes via Binary Space Partitioning. In Proc. IEEE/CVF Conf. on Computer Vision & Pattern Recognition. 42--51.
[7]
David Cohen-Steiner, Pierre Alliez, and Mathieu Desbrun. 2004. Variational shape approximation. ACM Trans. on Graphics (Proc. SIGGRAPH) 23, 3 (2004), 905--914.
[8]
Jianmin Zheng Daxuan Ren, Jianfei Cai, Haiyong Jiang Jiatong Li, Zhongang Cai, Junzhe Zhang, Liang Pan, Mingyuan Zhang, Haiyu Zhao, and Shuai Yi. 2021. CSG-Stump: A Learning Friendly CSG-Like Representation for Interpretable Shape Parsing. In ICCV. 12458--12467.
[9]
David Eberly. 2000. Geometric Tools. https://www.geometrictools.com/.
[10]
Pierre-Alain Fayolle and Markus Friedrich. 2023. A Survey of Methods for Converting Unstructured Data to CSG Models. arXiv:2305.01220 [cs.GR]
[11]
Martin A Fischler and Robert C Bolles. 1981. Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 24, 6 (1981), 381--395.
[12]
Rao Fu, Cheng Wen, Qian Li, Xiao Xiao, and Pierre Alliez. 2023. BPNet: B\'ezier Primitive Segmentation on 3D Point Clouds. In Proc. Int. Joint Conf. on Artificial Intelligence. 754--762.
[13]
Haoxiang Guo, Shilin Liu, Hao Pan, Yang Liu, Xin Tong, and Baining Guo. 2022. ComplexGen: CAD reconstruction by B-rep chain complex generation. ACM Trans. on Graphics (Proc. SIGGRAPH) 41, 4 (2022), 129:1--129:18.
[14]
Jingwei Huang, Yanfeng Zhang, and Mingwei Sun. 2021. PrimitiveNet: Primitive Instance Segmentation with Local Primitive Embedding under Adversarial Metric. In Proc. Int. Conf. on Computer Vision. 15323--15333.
[15]
Pradeep Kumar Jayaraman, Joseph George Lambourne, Nishkrit Desai, Karl D. D. Willis, Aditya Sanghi, and Nigel J. W. Morris. 2023. SolidGen: An Autoregressive Model for Direct B-rep Synthesis. Trans. Mach. Learn. Res. (2023).
[16]
Adrien Kaiser, José Alonso Ybáñez Zepeda, and Tamy Boubekeur. 2019. A Survey of Simple Geometric Primitives Detection Methods for Captured 3D Data. Computer Graphics Forum 38, 1 (2019), 167--196.
[17]
Kacper Kania, Maciej Zieba, and Tomasz Kajdanowicz. 2020. UCSG-NET-unsupervised discovering of constructive solid geometry tree. In Proc. Conf. on Neural Information Processing Systems, Vol. 33. 8776--8786.
[18]
Sebastian Koch, Albert Matveev, Zhongshi Jiang, Francis Williams, Alexey Artemov, Evgeny Burnaev, Marc Alexa, Denis Zorin, and Daniele Panozzo. 2019. ABC: A Big CAD Model Dataset for Geometric Deep Learning. In Proc. IEEE/CVF Conf. on Computer Vision & Pattern Recognition. 9601--9611.
[19]
Florent Lafarge and Clément Mallet. 2012. Creating large-scale city models from 3D-point clouds: a robust approach with hybrid representation. Proc. Int. Conf. on Computer Vision 99 (2012), 69--85.
[20]
Joseph G. Lambourne, Karl D.D. Willis, Pradeep Kumar Jayaraman, Aditya Sanghi, Peter Meltzer, and Hooman Shayani. 2021. BRepNet: A topological message passing system for solid models. In Proc. IEEE/CVF Conf. on Computer Vision & Pattern Recognition. 12773--12782.
[21]
Joseph G. Lambourne, Karl D. D. Willis, Pradeep Kumar Jayaraman, Longfei Zhang, Aditya Sanghi, and Kamal Rahimi Malekshan. 2022. Reconstructing Editable Prismatic CAD from Rounded Voxel Models. In Proc. SIGGRAPH Asia. 53:1--53:9.
[22]
Lingxiao Li, Minhyuk Sung, Anastasia Dubrovina, Li Yi, and Leonidas J. Guibas. 2019a. Supervised Fitting of Geometric Primitives to 3D Point Clouds. In Proc. IEEE/CVF Conf. on Computer Vision & Pattern Recognition. 2652--2660.
[23]
Lingxiao Li, Minhyuk Sung, Anastasia Dubrovina, Li Yi, and Leonidas J. Guibas. 2019b. Supervised Fitting of Geometric Primitives to 3D Point Clouds. In Proc. IEEE/CVF Conf. on Computer Vision & Pattern Recognition. 2652--2660.
[24]
Pu Li, Jianwei Guo, Xiaopeng Zhang, and Dong-Ming Yan. 2023a. SECAD-Net: Self-Supervised CAD Reconstruction by Learning Sketch-Extrude Operations. In Proc. IEEE/CVF Conf. on Computer Vision & Pattern Recognition. 16816--16826.
[25]
Yuanqi Li, Shun Liu, Xinran Yang, Jianwei Guo, Jie Guo, and Yanwen Guo. 2023b. Surface and Edge Detection for Primitive Fitting of Point Clouds. In Proc. SIGGRAPH. 44:1--44:10.
[26]
Yangyan Li, Xiaokun Wu, Yiorgos Chrysathou, Andrei Sharf, Daniel Cohen-Or, and Niloy J Mitra. 2011. Globfit: Consistently fitting primitives by discovering global relations. ACM Trans. on Graphics (Proc. SIGGRAPH) 30, 4 (2011), 52:1--52:12.
[27]
Cheng Lin, Lingjie Liu, Changjian Li, Leif Kobbelt, Bin Wang, Shiqing Xin, and Wenping Wang. 2022. SEG-MAT: 3D Shape Segmentation Using Medial Axis Transform. IEEE Trans. Visualization & Computer Graphics 28, 6 (2022), 2430--2444.
[28]
Tsung-Yi Lin, Priya Goyal, Ross B. Girshick, Kaiming He, and Piotr Dollár. 2020. Focal Loss for Dense Object Detection. IEEE Trans. Pattern Analysis & Machine Intelligence 42, 2 (2020), 318--327.
[29]
Yujia Liu, Anton Obukhov, Jan Dirk Wegner, and Konrad Schindler. 2023. Point2CAD: Reverse Engineering CAD Models from 3D Point Clouds. In Proc. IEEE/CVF Conf. on Computer Vision & Pattern Recognition Workshops.
[30]
Yong-Jin Liu, Chun-Xu Xu, Dian Fan, and Ying He. 2015. Efficient Construction and Simplification of Delaunay Meshes. ACM Trans. on Graphics 34, 6 (2015), 174:1--174:13.
[31]
Nissim Maruani, Roman Klokov, Maks Ovsjanikov, Pierre Alliez, and Mathieu Desbrun. 2023. VoroMesh: Learning Watertight Surface Meshes with Voronoi Diagrams. In Proc. IEEE/CVF Conf. on Computer Vision & Pattern Recognition. 14565--14574.
[32]
Albert Matveev, Ruslan Rakhimov, Alexey Artemov, Gleb Bobrovskikh, Vage Egiazarian, Emil Bogomolov, Daniele Panozzo, Denis Zorin, and Evgeny Burnaev. 2022. Def: Deep Estimation of Sharp Geometric Features in 3D Shapes. ACM Trans. on Graphics (Proc. SIGGRAPH) 41, 4 (2022), 108:1--108:22.
[33]
Liangliang Nan and Peter Wonka. 2017. PolyFit: Polygonal Surface Reconstruction from Point Clouds. In Proc. Int. Conf. on Computer Vision. 2372--2380.
[34]
Charlie Nash, Yaroslav Ganin, S. M. Ali Eslami, and Peter W. Battaglia. 2020. PolyGen: An Autoregressive Generative Model of 3D Meshes. In Proc. Int. Conf. on Machine Learning, Vol. 119. 7220--7229.
[35]
Sven Oesau, Florent Lafarge, and Pierre Alliez. 2016. Planar Shape Detection and Regularization in Tandem. Computer Graphics Forum 35, 1 (2016), 203--215.
[36]
Ruwen Schnabel, Roland Wahl, and Reinhard Klein. 2007. Efficient RANSAC for point-cloud shape detection. Computer Graphics Forum 26, 2 (2007), 214--226.
[37]
Gopal Sharma, Difan Liu, Subhransu Maji, Evangelos Kalogerakis, Siddhartha Chaudhuri, and Radomír Měch. 2020. ParSeNet: A Parametric Surface Fitting Network for 3D Point Clouds. In Proc. Euro. Conf. on Computer Vision, Vol. 12352. 261--276.
[38]
Yawar Siddiqui, Antonio Alliegro, Alexey Artemov, Tatiana Tommasi, Daniele Sirigatti, Vladislav Rosov, Angela Dai, and Matthias Nießner. 2023. MeshGPT: Generating Triangle Meshes with Decoder-Only Transformers. arXiv:2311.15475 [cs.CV]
[39]
Martin Skrodzki, Eric Zimmermann, and Konrad Polthier. 2020. Variational shape approximation of point set surfaces. Computer Aided Geometric Design 80 (2020), 101875.
[40]
Ningna Wang, Bin Wang, Wenping Wang, and Xiaohu Guo. 2022. Computing medial axis transform with feature preservation via restricted power diagram. ACM Trans. on Graphics (Proc. SIGGRAPH) 41, 6 (2022), 188:1--188:18.
[41]
Francis Williams, Jerome Parent-Levesque, Derek Nowrouzezahrai, Daniele Panozzo, Kwang Moo Yi, and Andrea Tagliasacchi. 2020. Voronoinet: General functional approximators with local support. In Proc. IEEE/CVF Conf. on Computer Vision & Pattern Recognition Workshops. 264--265.
[42]
Xianghao Xu, Wenzhe Peng, Chin-Yi Cheng, Karl D. D. Willis, and Daniel Ritchie. 2021. Inferring CAD Modeling Sequences Using Zone Graphs. In Proc. IEEE/CVF Conf. on Computer Vision & Pattern Recognition. 6062--6070.
[43]
Dong-Ming Yan, Wenping Wang, Yang Liu, and Zhouwang Yang. 2012. Variational mesh segmentation via quadric surface fitting. Computer-Aided Design 44, 11 (2012), 1072--1082.
[44]
Siming Yan, Zhenpei Yang, Chongyang Ma, Haibin Huang, Etienne Vouga, and Qixing Huang. 2021. HPNet: Deep Primitive Segmentation Using Hybrid Representations. In Proc. Int. Conf. on Computer Vision. 2733--2742.
[45]
Fenggen Yu, Qimin Chen, Maham Tanveer, Ali Mahdavi Amiri, and Hao Zhang. 2023. D2CSG: Unsupervised Learning of Compact CSG Trees with Dual Complements and Dropouts. In Proc. Conf. on Neural Information Processing Systems.
[46]
Fenggen Yu, Zhiqin Chen, Manyi Li, Aditya Sanghi, Hooman Shayani, Ali Mahdavi-Amiri, and Hao Zhang. 2022. CAPRI-Net: Learning Compact CAD Shapes with Adaptive Primitive Assembly. In Proc. IEEE/CVF Conf. on Computer Vision & Pattern Recognition. 11758--11768.
[47]
Wenni Zheng, Pengbo Bo, Yang Liu, and Wenping Wang. 2012. Fast B-spline Curve Fitting by L-BFGS. Computer Aided Geometric Design 29, 7 (2012), 448--462.
[48]
Xiangyu Zhu, Dong Du, Weikai Chen, Zhiyou Zhao, Yinyu Nie, and Xiaoguang Han. 2023. NerVE: Neural Volumetric Edges for Parametric Curve Extraction From Point Cloud. In Proc. IEEE/CVF Conf. on Computer Vision & Pattern Recognition. 13601--13610.
Index Terms
- Split-and-Fit: Learning B-Reps via Structure-Aware Voronoi Partitioning
Recommendations
Automatic unstructured all-hexahedral mesh generation from B-Reps for non-manifold CAD assemblies
This paper describes an automatic and robust approach to convert non-manifold CAD assemblies into unstructured all-hexahedral meshes conformal to the given B-Reps (boundary-representations) and with sharp feature preservation. In previous works, we ...
Automatic surface repairing, defeaturing and meshing algorithms based on an extended B-rep
A new data structure that combines the continuous and discrete surface representations is proposed.A sequence of repairing, defeaturing and meshing algorithms that can exploit the strengths of both representations is developed.The repairing algorithm is ...
Exploiting Triangulated Surface Extraction Using Tetrahedral Decomposition
Beginning with digitized volumetric data, we wish to rapidly and efficiently extract and represent surfaces defined as isosurfaces in the interpolated data. The Marching Cubes algorithm is a standard approach to this problem. We instead perform a ...
Comments
Information & Contributors
Information
Published In
Copyright © 2024 Copyright is held by the owner/author(s). Publication rights licensed to ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 19 July 2024
Published in TOG Volume 43, Issue 4
Check for updates
Author Tags
Qualifiers
- Research-article
Funding Sources
- NSFC
- Guangdong Basic and Applied Basic Research Foundation
- DEGP Innovation Team
- Shenzhen Science and Technology Program
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 330Total Downloads
- Downloads (Last 12 months)330
- Downloads (Last 6 weeks)53
Reflects downloads up to 18 Feb 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in