Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
Skip to main content

Advertisement

SpringerLink
Log in

An Automatic Method for Tree Species Point Cloud Segmentation Based on Deep Learning

  • Research Article
  • Published:
Journal of the Indian Society of Remote Sensing Aims and scope Submit manuscript

Abstract

Tree species segmentation is an essential condition for research forestry and has a large impact on forest resource monitoring, sustainable forest management, and biodiversity research. Recently, the development of hardware and software has been rapidly increasing. Regarding hardware, the active remote sensing system LiDAR can be used to obtain many point clouds and can significantly improve the tree segmentation accuracy compared with traditional optical remote sensing hardware. With respect to software, deep learning theory is effectively utilized to process 3D point clouds, such as extracting the features of data. However, deep learning-based methods are underutilized in tree species point cloud segmentation. Therefore, it is extremely important to combine current technological advantages for this application. In this article, we construct a point cloud processing dataset that comprises substantial tree information and 5 tree species, including willow, fir, bamboo, palm, and rubber. The novel representation of point clouds via a superpoint graph is utilized to pre-process the point clouds in a large outdoor scene. We propose to apply state-of-the-art deep learning frameworks, including PointNet network and graph convolution networks, to process tree species point clouds in complex forest scenes. We also discuss the effectiveness of the method and the situations influenced by different parameters. The experimental results finally verify the effectiveness of the framework in tree species segmentation.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

References

  • Boulch, A., Guerry, J., Saux, B. L., & Audebert, N. (2017). SnapNet: 3D point cloud semantic labeling with 2D deep segmentation networks. Computers & Graphics, 71, S0097849317301942.

    Google Scholar 

  • Charles, R. Q., Hao, S., Mo, K., & Guibas, L. J. (2017). PointNet: Deep learning on point sets for 3D classification and segmentation. In 2017 IEEE conference on computer vision and pattern recognition (CVPR), 2017 (pp. 77–85)

  • Demantké, J., Mallet, C., David, N., & Vallet, B. (2012). Dimensionality based scale selection in 3D lidar point clouds. ISPRS International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, 3812(5), 97–102.

    Article  Google Scholar 

  • Guan, H., Yu, Y., Zheng, J., Li, J., & Zhang, Q. (2015). Deep learning-based tree classification using mobile LiDAR data. Remote Sensing Letters, 6(11), 864–873.

    Article  Google Scholar 

  • Guerrero, P., Kleiman, Y., Ovsjanikov, M., & Mitra, N. J. (2017). PCPNET: Learning local shape properties from raw point clouds. Computer Graphics Forum, 37(2), 75–85.

    Article  Google Scholar 

  • Guinard, S., & Landrieu, L. (2017). Weakly supervised segmentation-aided classification of urban scenes from 3D lidar point clouds. International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, XLII-1/W1, 151–157. https://doi.org/10.5194/isprs-archives-XLII-1-W1-151-2017

    Article  Google Scholar 

  • Hackel, T., Savinov, N., Ladicky, L., Wegner, J. D., Schindler, K., & Pollefeys, M. (2017). Semantic3d.net: A new large-scale point cloud classification benchmark . ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, IV-1/W1, 91–98. https://doi.org/10.5194/isprs-annals-IV-1-W1-91-2017

    Article  Google Scholar 

  • Hu, X., & Yuan, Y. (2016). Deep-learning-based classification for DTM extraction from ALS point cloud. Remote Sensing, 8(9), 730.

    Article  Google Scholar 

  • Ioffe, S., & Szegedy, C. (2015). Batch normalization: Accelerating deep network training by reducing internal covariate shift. Paper presented in International Conference on Machine Learning, Lille, pp. 448–456.

  • Landrieu, L., & Boussaha, M. (2019). Point cloud oversegmentation with graph-structured deep metric learning. Paper presented at the 2019 The IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

  • Landrieu, L., & Obozinski, G. (2017). Cut pursuit: Fast algorithms to learn piecewise constant functions. Siam Journal on Imaging Sciences, 10(4), 1724–1766.

    Article  Google Scholar 

  • Landrieu, L., & Simonovsky, M. (2018). Large-scale point cloud semantic segmentation with superpoint graphs. Paper presented at the 2018 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

  • Li, Y., Guibas, L., Kim, V. G., Ceylan, D., Shen, I. C., Yan, M., et al. (2016a). A scalable active framework for region annotation in 3D shape collections. Acm Transactions on Graphics, 35(6), 1–12.

    Article  Google Scholar 

  • Li, Y., Tarlow, D., Brockschmidt, M., & Zemel, R. (2016b). Gated graph sequence neural networks. Paper presented in 4th International conference on learning representations (ICLR).

  • Maturana, D., & Scherer, S. (2015). VoxNet: A 3D convolutional neural network for real-time object recognition. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2015, 922–928.

    Google Scholar 

  • Munoz, D., Bagnell, J. A., Vandapel, N., & Hebert, M. (2009). Contextual classification with functional Max-Margin Markov Networks. In 2009 IEEE conference on computer vision and pattern recognition, 20–25 June 2009 2009 (pp. 975–982). doi:https://doi.org/10.1109/CVPR.2009.5206590.

  • Qi, C. R., Li, Y., Hao, S., & Guibas, L. J. (2017a). PointNet++: Deep hierarchical feature learning on point sets in a metric space. Paper presented at the 2017 Conference on Neural Information Processing Systems(NIPS).

  • Qi, C. R., Wei, L., Wu, C., Hao, S., & Guibas, L. J. (2017b). Frustum PointNets for 3D object detection from RGB-D data. Paper presented at the 2018 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

  • Simonovsky, M., & Komodakis, N. (2017). Dynamic edge-conditioned filters in convolutional neural networks on graphs. In 2017 IEEE conference on computer vision and pattern recognition (CVPR), 21–26 July 2017 2017 (pp. 29–38). doi:https://doi.org/10.1109/CVPR.2017.11.

  • Tchapmi, L. P., Choy, C. B., Armeni, I., Gwak, J., & Savarese, S. (2017). SEGCloud: Semantic segmentation of 3D point clouds. arXiv e-prints.

  • Vallet, B., Brédif, M., Serna, A., Marcotegui, B., & Paparoditis, N. (2015). TerraMobilita/iQmulus urban point cloud analysis benchmark. Computers & Graphics, 49(C), 126–133.

    Article  Google Scholar 

  • Vosselman, G., Coenen, M., & Rottensteiner, F. (2017). Contextual segment-based classification of airborne laser scanner data. Isprs Journal of Photogrammetry & Remote Sensing, 128, 354–371.

    Article  Google Scholar 

  • Wang, W., Yu, R., Huang, Q., & Neumann, U. (2018). SGPN: Similarity group proposal network for 3D point cloud instance segmentation. Paper presented at the 2018 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

  • Wu, Z., Song, S., Khosla, A., Yu, F., Zhang, L., Tang, X., et al. (2015). 3D ShapeNets: A deep representation for volumetric shapes. Paper presented at the 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

  • Xiangyu, C., Ting, Y., Lianfeng, X., & Yingan, L. (2019). Classification of tree species using LiDAR point cloud data. Laser & Optoelectronics Progress, 56(12), 203–214.

    Google Scholar 

  • Yin, Z., & Tuzel, O. (2017). VoxelNet: End-to-end learning for point cloud based 3D object detection. Paper presented at the 2018 The IEEE Conference on Computer Vision and Pattern Recognition (CVPR),

  • Zhang, L., Li, Z., Li, A., & Liu, F. (2018). Large-scale urban point cloud labeling and reconstruction. ISPRS Journal of Photogrammetry & Remote Sensing, 138, 86–100.

    Article  Google Scholar 

  • Zheng, S., Jayasumana, S., Romera-Paredes, B., Vineet, V., Su, Z., Du, D., et al. (2015). Conditional random fields as recurrent neural networks. In 2015 IEEE international conference on computer vision (ICCV), 7–13 Dec. 2015 2015 (pp. 1529–1537). doi:https://doi.org/10.1109/ICCV.2015.179.

  • Zou, X., Ming, C., Cheng, W., Yan, X., & Li, J. (2017). Tree classification in complex forest point clouds based on deep learning. IEEE Geoscience & Remote Sensing Letters, 14(12), 2360–2364.

    Article  Google Scholar 

Download references

Acknowledgements

We would like to thank the College of Information Science and Technology, Nanjing Forestry University for providing the data.

Funding

This research was funded by the Open Fund of Key Laboratory of Urban Land Resources Monitoring and Simulation, Ministry of Land and Resources (No. KF-2018-03-025).

Author information

Authors and Affiliations

  1. School of Geodesy and Geomatics, Wuhan University, Wuhan, 430079, China

    Lin Pu, Jiabin Xv & Fei Deng

  2. Key Laboratory of Urban Land Resources Monitoring and Simulation, Ministry of Land and Resources, Shenzhen, 518000, China

    Lin Pu, Jiabin Xv & Fei Deng

  3. Collaborative Innovation Center for Territorial Sovereignty and Maritime Rights, Wuhan University, Wuhan, 430079, China

    Fei Deng

Authors
  1. Lin Pu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jiabin Xv
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Fei Deng
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

FD contributed to conceptualization, funding acquisition, resources, project administration, and supervision; LP were involved in formal analysis, investigation, validation, visualization, writing—original draft; LP, JX contributed to methodology; LP, JX, FD were involved in writing—review and editing.

Corresponding author

Correspondence to Fei Deng.

Ethics declarations

Conflict of interest

The authors declare no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

We confirm that this work is original and has not been published elsewhere nor is it currently under consideration for publication elsewhere.

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Pu, L., Xv, J. & Deng, F. An Automatic Method for Tree Species Point Cloud Segmentation Based on Deep Learning. J Indian Soc Remote Sens 49, 2163–2172 (2021). https://doi.org/10.1007/s12524-021-01358-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12524-021-01358-x

Keywords

Search

Navigation