Abstract
Recent applications of deep learning (DL) architectures for semantic segmentation had led to a significant development in autonomous driving systems (ADS). Most of the semantic segmentation applications for ADS consider a plethora of classes. Nevertheless, we believe that focusing only on the segmentation of drivable roads, sidewalks, traffic signs, and cars, can drive the improvement of navigation and control techniques in autonomous vehicles. In this study, some state-of-the-art topologies are analyzed to find a strategy that can achieve a uniform performance for the four classes. We propose a multiple objective evaluation method with the purpose of finding the non-dominated solutions in different DL architectures. Numerical results are shown using CityScapes, SYNTHIA, and CamVid datasets.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Woensel, L., Archer, G.: Ten Technologies Which Could Change Our Lives. EPRS—European Parliamentary Research Services (2015)
Kukkala, V., Tunnell, J., Pasricha, S., et al.: Advanced driver-assistance systems: a path toward autonomous vehicles. IEEE Consum. Electron. Mag. 7(5), 18–25 (2018)
Zhang, X., Chen, Z., Wu, Q., et al.: Fast semantic segmentation for scene perception. IEEE Trans. Industr. Inf. 15(2), 1183–1192 (2019)
Zhang, Y., Chen, H., He, Y., et al.: Road segmentation for all-day outdoor robot navigation. Neurocomputing 314, 316–325 (2018)
Çiçek, Ö., Abdulkadir, A., Lienkamp, S. et al.: 3D U-Net: learning dense volumetric segmentation from sparse annotation. In: International Conference on Medical Image Computing and Computer-Assisted Intervention, 424–432 (2016)
Jiang, F., Grigorev, A., Rho, S., et al.: Medical image semantic segmentation based on deep learning. NeuralComput. Appl. 29(5), 1257–1265 (2018)
Kemker, R., Salvaggio, C., Kanan, C.: Algorithms for semantic segmentation of multispectral remote sensing imagery using deep learning. ISPRS J. Photogramm. Remote Sens. (2018)
Oberweger, M., Wohlhart, P., Lepetit, V.: Hands deep in deep learning for hand pose estimation. arXiv:1502.06807 (2015)
Geiger, A., Lenz, P., Stiller, C., et al.: Vision meets robotics: the KITTI dataset. In: Int. J. Robot. Res. 32(11), 1231 (2013)
Brostow, G., Fauqueur, J., Cipolla, R.: Semantic object classes in video: a high-definition ground truth database. Pattern Recognit. Lett. 30(2), 88–97 (2009)
Cordts, M., Omran, M., Ramos, S., et al.: The Cityscapes dataset for semantic urban scene understanding. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2016)
Ros, G., Sellart, L., Materzynska, J., et al.: The SYNTHIA dataset: a large collection of synthetic images for semantic segmentation of urban scenes. In: The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 4321–4330 (2016)
Shelhamer, E., Long, J., Darrell, T.: Fully convolutional networks for semantic segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 39, 640–651 (2017)
Badrinarayanan, V., Kendall, A., Cipolla, R.: SegNet: a deep convolutional encoder-decoder architecture for image segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 39, 2481–2495 (2017)
Noh, H., Hong, S., Han, B.: Learning deconvolution network for semantic segmentation. In: Proceedings of the IEEE International Conference on Computer Vision, pp 1520–1528 (2015)
Chen, B., Gong, C., Yang, J.: Importance-aware semantic segmentation for autonomous vehicles. IEEE Trans. Intell. Transp. Syst. 20(1), 137–148 (2018)
Krizhevsky, A., Sutskever, I., Hinton, G.: Imagenet classification with deep convolutional neural networks. In: Proceedings of the Neural Information Processing Systems, pp 1106–1114 (2012)
Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. In: Proceedings of the International Conference Learning Representation (2015)
Szegedy, C., Wei, L., Jia, Y., et al.: Going deeper with convolutions. In: Proceedings of the Computer Vision Pattern Recognition, pp. 1–9 (2015)
Girshick, R., Donahue, J., Darrell, T., et al.: Region-based convolutional networks for accurate object detection and segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 38(1), 142–158 (2015)
Sermanet, P., Eigen, D., Zhang, X., et al.: OverFeat: integrated recognition, localization and detection using convolutional networks. arXiv:1312.6229 (2013)
Farabet, C., Couprie, C., Najman, L., et al.: Learning hierarchical features for scene labeling. IEEE Trans. Pattern Anal. Mach. Intell. 35(8), 1915–1929 (2013)
Chen, L., Papandreou, G., Kokkinos, I., et al.: Semantic image segmentation with deep convolutional nets and fully connected crfs. arXiv:1412.7062 (2014)
Siam, M., Elkerdawy, S., Jagersand, M., et al.: Deep semantic segmentation for automated driving: taxonomy, roadmap and challenges. In: 2017 IEEE 20th International Conference on Intelligent Transportation Systems (ITSC), pp 1–8 (2017)
Kendall, A., Badrinarayanan, V., Cipolla, R.: Bayesian segnet: model uncertainty in deep convolutional encoder-decoder architectures for scene understanding. CoRR abs/1511.02680 (2015)
Ronneberger, O., Fischer, P., Brox, T.: U-Net: convolutional networks for biomedical image segmentation. In: International Conference on Medical Image Computing and Computer-Assisted Intervention, pp. 234–241 (2015)
Siam, M., Gamal, M., Abdel-Razek, M., et al.: A comparative study of real-time semantic segmentation for autonomous driving. In: 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp 700–710. Salt Lake City, UT (2018)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this chapter
Cite this chapter
Olvera, C., Rubio, Y., Montiel, O. (2020). Multi-objective Evaluation of Deep Learning Based Semantic Segmentation for Autonomous Driving Systems. In: Castillo, O., Melin, P., Kacprzyk, J. (eds) Intuitionistic and Type-2 Fuzzy Logic Enhancements in Neural and Optimization Algorithms: Theory and Applications. Studies in Computational Intelligence, vol 862. Springer, Cham. https://doi.org/10.1007/978-3-030-35445-9_23
Download citation
DOI: https://doi.org/10.1007/978-3-030-35445-9_23
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-35444-2
Online ISBN: 978-3-030-35445-9
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)