Abstract
Semantic segmentation plays a crucial role in understanding the surroundings of a vehicle in the context of autonomous driving. Nevertheless, segmentation networks are typically trained on a closed-set of inliers, leading to misclassification of anomalies as in-distribution objects. This is especially dangerous for obstacles on roads, such as stones, that usually are small and blend well with the background. Numerous frameworks have been proposed to detect out-of-distribution objects in driving scenes. Some of these frameworks use softmax cross-entropy measurements as an attention mechanism for a dissimilarity network to find anomalies. However, a significant limitation arises from the segmentation network’s tendency toward overconfidence in its predictions, resulting in low cross-entropy in regions where anomalies are present. This suggests that normal cross-entropy is a low-quality prior for anomaly detection. Therefore, for the task of detecting stones on roads, we propose utilizing a fined-tuned segmentation network with a changed target, from semantic segmentation to maximize the cross-entropy in anomalous areas. With this, we feed the dissimilarity network with a better prior image. Furthermore, due to the lack of datasets with enough samples of stones for pixel-wise detection, we synthetically added stones on images of driving scenes to create a dataset for fine-tuning and training. The results of our comparative experiments showed that our model attains the highest average precision while having the lowest false positive rate at 95% true positive rate when evaluating on a real-stone image dataset.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Rottmann, M., et al.: Prediction error meta classification in semantic segmentation: detection via aggregated dispersion measures of Softmax probabilities. In: 2020 International Joint Conference on Neural Networks (IJCNN), Glasgow, UK, pp. 1–9 (2020)
Lis, K., Nakka, K.K., Fua, P., Salzmann, M.: Detecting the unexpected via image resynthesis. In: 2019 IEEE/CVF International Conference on Computer Vision (ICCV), Seoul, South Korea, pp. 2152–2161 (2019)
Di Biase, G., Blum, H., Siegwart, R., Cadena, C.: Pixel-wise anomaly detection in complex driving scenes. In: 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, TN, USA, pp. 16913–16922 (2021)
Chan, R., Rottmann, M., Gottschalk, H.: Entropy maximization and meta classification for out-of- distribution detection in semantic segmentation. In: 2021 IEEE/CVF International Conference on Computer Vision (ICCV), Montreal, QC, Canada, pp. 5108–5117 (2021)
Cordts, M. et al.: The cityscapes dataset for semantic urban scene understanding. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA, pp. 3213–3223 (2016)
Zhu, Y. et al.: Improving semantic segmentation via video propagation and label relaxation. In: 2019 IEEE/ CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA, pp. 8848–8857 (2019)
Liu, X., Yin, G., Shao, J., Wang, X.: Learning to predict layout-to-image conditional convolutions for semantic image synthesis. In: Advances in Neural Information Processing Systems, Red Hook, NY, USA (2019)
Bogdoll, D., Uhlemeyer, S., Kowol, K., Zollner, M.: Perception datasets for anomaly detection in autonomous driving: a survey. In: 2023 IEEE Intelligent Vehicles Symposium (IV), Anchorage, AK, USA, pp. 1–8 (2023)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Ardon Munoz, C.D., Nishiyama, M., Iwai, Y. (2023). Pixel-Wise Detection of Road Obstacles on Drivable Areas by Introducing Maximized Entropy to Synboost Framework. In: Lu, H., Blumenstein, M., Cho, SB., Liu, CL., Yagi, Y., Kamiya, T. (eds) Pattern Recognition. ACPR 2023. Lecture Notes in Computer Science, vol 14408. Springer, Cham. https://doi.org/10.1007/978-3-031-47665-5_13
Download citation
DOI: https://doi.org/10.1007/978-3-031-47665-5_13
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-47664-8
Online ISBN: 978-3-031-47665-5
eBook Packages: Computer ScienceComputer Science (R0)