Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3446132.3446139acmotherconferencesArticle/Chapter ViewAbstractPublication PagesacaiConference Proceedingsconference-collections
research-article

Deep Learning on Superpoint Generation with Iterative Clustering Network

Published: 09 March 2021 Publication History

Abstract

In 3D point clouds, superpoint is a set of points that share common characteristics. Semantically pure superpoints can greatly reduce the number of points while ensuring that the points located in the same superpoint have common semantic information. In this paper, we propose an end-to-end method for generating semantically pure superpoints. Specifically, we first use a light PointNet-liked network to embed low-dimensional point clouds into feature space to obtain semantic information. Next, we use farthest point sampling (FPS) to sample K points as the initial cluster centers. For each center, we cluster the points by jointly considering spatial and feature space. After clustering, we update the feature of each cluster center by simply averaging the point feature in the same cluster. By iteratively clustering and updating the feature of clusters, we obtain coarse superpoints, which contain a few points incorrectly clustered. Finally, to eliminate incorrectly clustered points, we leverage the breadth-first-search (BFS) to find and fuse them to obtain fine superpoints, leading to improvement on semantically pure superpoints. Extensive experiments conducted on S3DIS and ScanNet demonstrate the effectiveness of the proposed method. Furthermore, we achieve the state-of-the-art on both two datasets.

References

[1]
Radhakrishna Achanta, Appu Shaji, Kevin Smith, Aurelien Lucchi, Pascal Fua, and Sabine Süsstrunk. 2012. SLIC superpixels compared to state-of-the-art superpixel methods. IEEE Transactions on Pattern Analysis and Machine Intelligence 34, 11(2012), 2274–2282.
[2]
Iro Armeni, Ozan Sener, Amir R Zamir, Helen Jiang, Ioannis Brilakis, Martin Fischer, and Silvio Savarese. 2016. 3d semantic parsing of large-scale indoor spaces. In CVPR.
[3]
Christopher Choy, JunYoung Gwak, and Silvio Savarese. 2019. 4d spatio-temporal convnets: Minkowski convolutional neural networks. In CVPR.
[4]
Angela Dai, Angel X Chang, Manolis Savva, Maciej Halber, Thomas Funkhouser, and Matthias Nießner. 2017. Scannet: Richly-annotated 3d reconstructions of indoor scenes. In CVPR.
[5]
Michael Van Den Bergh, Xavier Boix, Gemma Roig, Benjamin De Capitani, and Luc Van Gool. 2012. SEEDS: superpixels extracted via energy-driven sampling. (2012).
[6]
Pedro F Felzenszwalb and Daniel P Huttenlocher. 2004. Efficient graph-based image segmentation. International Journal of Computer Vision 59, 2 (2004), 167–181.
[7]
Matthias Grundmann, Vivek Kwatra, Mei Han, and Irfan Essa. 2010. Efficient hierarchical graph-based video segmentation. In CVPR.
[8]
Qingyong Hu, Bo Yang, Linhai Xie, Stefano Rosa, Yulan Guo, Zhihua Wang, Niki Trigoni, and Andrew Markham. 2020. RandLA-Net: Efficient semantic segmentation of large-scale point clouds. In CVPR.
[9]
Varun Jampani, Deqing Sun, Ming-Yu Liu, Ming-Hsuan Yang, and Jan Kautz. 2018. Superpixel sampling networks. In ECCV.
[10]
Li Jiang, Hengshuang Zhao, Shu Liu, Xiaoyong Shen, Chi-Wing Fu, and Jiaya Jia. 2019. Hierarchical point-edge interaction network for point cloud semantic segmentation. In ICCV.
[11]
Loic Landrieu and Mohamed Boussaha. 2019. Point cloud oversegmentation with graph-structured deep metric learning. In CVPR.
[12]
Loic Landrieu and Guillaume Obozinski. 2017. Cut pursuit: Fast algorithms to learn piecewise constant functions on general weighted graphs. SIAM Journal on Imaging Sciences 10, 4 (2017), 1724–1766.
[13]
Loic Landrieu and Martin Simonovsky. 2018. Large-scale Point Cloud Semantic Segmentation with Superpoint Graphs. In CVPR.
[14]
Alex Levinshtein, A Stere, Kiriakos N Kutulakos, David J Fleet, Sven Dickinson, and Kaleem Siddiqi. 2009. TurboPixels: Fast Superpixels Using Geometric Flows. IEEE Transactions on Pattern Analysis and Machine Intelligence 31, 12(2009), 2290–2297.
[15]
Yangyan Li, Rui Bu, Mingchao Sun, Wei Wu, Xinhan Di, and Baoquan Chen. 2018. PointCNN: Convolution On Math 11-Transformed Points. In NeurIPS.
[16]
Yangbin Lin, Cheng Wang, Dawei Zhai, Wei Li, and Jonathan Li. 2018. Toward better boundary preserved supervoxel segmentation for 3D point clouds. ISPRS journal of photogrammetry and remote sensing 143 (2018), 39–47.
[17]
Ming-Yu Liu, Oncel Tuzel, Srikumar Ramalingam, and Rama Chellappa. 2011. Entropy rate superpixel segmentation. In CVPR.
[18]
Jeremie Papon, Alexey Abramov, Markus Schoeler, and Florentin Worgotter. 2013. Voxel cloud connectivity segmentation-supervoxels for point clouds. In CVPR.
[19]
Charles R Qi, Hao Su, Kaichun Mo, and Leonidas J Guibas. 2017. PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation. In CVPR.
[20]
Charles Ruizhongtai Qi, Li Yi, Hao Su, and Leonidas J Guibas. 2017. PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Space. In NeurIPS.
[21]
David Stutz, Alexander Hermans, and Bastian Leibe. 2018. Superpixels: An evaluation of the state-of-the-art. Computer Vision and Image Understanding 166 (2018), 1–27.
[22]
Hugues Thomas, Charles R Qi, Jean-Emmanuel Deschaud, Beatriz Marcotegui, François Goulette, and Leonidas J Guibas. 2019. Kpconv: Flexible and deformable convolution for point clouds. In ICCV.
[23]
Wei-Chih Tu, Ming-Yu Liu, Varun Jampani, Deqing Sun, Shao-Yi Chien, Ming-Hsuan Yang, and Jan Kautz. 2018. Learning superpixels with segmentation-aware affinity loss. In CVPR.
[24]
Yue Wang, Yongbin Sun, Ziwei Liu, Sanjay E Sarma, Michael M Bronstein, and Justin M Solomon. 2018. Dynamic Graph CNN for Learning on Point Clouds. arXiv preprint arXiv:1801.07829(2018).
[25]
Wenxuan Wu, Zhongang Qi, and Li Fuxin. 2019. Pointconv: Deep convolutional networks on 3d point clouds. In CVPR.
[26]
Jian Yao, Marko Boben, Sanja Fidler, and Raquel Urtasun. 2015. Real-time coarse-to-fine topologically preserving segmentation. In CVPR.

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
ACAI '20: Proceedings of the 2020 3rd International Conference on Algorithms, Computing and Artificial Intelligence
December 2020
576 pages
ISBN:9781450388115
DOI:10.1145/3446132
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 09 March 2021

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. deep learning
  2. point cloud over-segmentation
  3. superpoints

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Conference

ACAI 2020

Acceptance Rates

Overall Acceptance Rate 173 of 395 submissions, 44%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 120
    Total Downloads
  • Downloads (Last 12 months)14
  • Downloads (Last 6 weeks)0
Reflects downloads up to 03 Oct 2024

Other Metrics

Citations

View Options

Get Access

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media