Abstract
The objects of fine-grained image categories (e.g., bird species) are various subclass under different categories. Because the differences between subclass are very subtle and most of them are concentrated in multiple local areas, the task of fine-grained image recognition is very challenging. At the same time, some fine-grained networks tend to focus on a certain region when judging the target category, resulting in the lack of other auxiliary regional features. To this end, Inception V3 is used as the backbone network, and an enhanced and complementary fine-grained image classification network is designed. While adopting the method of reinforcement learning to obtain more detailed fine grain image features, the complementary network can obtain the complementary discriminant area of the target through the method of attention erasure to increase the network’s perception of the overall target. Finally, experiments are conducted on CUB-200–2011, FGVC Aircraft and Stanford dogs three open datasets. The experimental results show that the proposed model has better performance.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Zhang, N., Donahue, J., Girshick, R., et al.: Part-based R-CNNs for fine grained category detection. In: ECCV European Conference on Computer Vision (ECCV), pp. 834–849 (2014)
On, S., Van Horn, G., Belongie, S., et al.: Bird species categorization using pose normalized deep convolutional nets[EB/OL]. (2014–06–11) [2021–09–15]. https://arxiv.org/ahttps://arxiv.org/abs/1406.2952
Lin, T.Y., Roychowdhurya, Maji, S.: Bilinear CNN models for fine-grained visual recognition. In: ICCV Proceedings of the 15th IEEE International Conference on Computer Vision (IEEE), Santiago, Chile, pp. 1449–1457 (2015)
Donahue, J., Jia, Y.Q., Vinyals, O., et al.: DeCAF A deep convolutional activation feature for generic visual recognition. In: Proceedings of the 31st International Conference on Machine Learning. New York JMLR. org2014647–655
Fu, J., Zheng, H., Tao, M.: Look closer to see better: recurrent attention convolutional neural network for fine-grained image recognition. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 4438–4446 (2017)
Zheng, H., Fu, J., Tao, M., et al.: Learning multi-attention convolutional neural network for fine-grained image recognition. In: ICCV International Conference on Computer Vision (ICCV), pp. 5209−5217 (2017)
Sun, M., Yuan, Y., Zhou, F., et al.: Multi attention multi-class constraint for fine grained image recognition. In: ECCV Proceedings of the European Conference on Computer Vision (ECCV), pp. 805–821 (2018)
Wang, Y., Morariu, V.I., Davis, L.S.: Learning a discriminative filter bank within a CNN for fine-grained recognition. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 4148–4157 (2018 )
Huang, Z., Xu, D., Tao, D., Zhang, Y.: Part-stacked CNN for fine-grained visual categorization. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1173–1182 (2016)
Ge, W., Lin, X., Yu, Y.: Weakly supervised complementary parts models for fine grained image classification from the bottom up. In: IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3029–3038 (2019)
Lin, T., Roychowdhury, A., Maji, S.: Bilinear S.CNN models for fine-grained visual recognition. In: IEEE International Conference on Computer Vision (ICCV), pp. 1449–1457 (2015)
Shu, K., Fowlkes, C.: Low-rank bilinear pooling for fine-grained classification. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 365–374 (2017)
Gao, Y., Beijbom, O., Zhang, N., et al.: Compact bilinear pooling. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 317–326 (2016)
Dubey, A., Gupta, O., Raskar, R., et al.: Maximum entropy fine grained classification. ArXiv Preprint ArXiv,2018:1809.05934
Gao, Y., Eijbom, O., Hang, N., et al.: Compact bilinear pooling. In: 2016 IEEE Computer Vision and Pattern Recognition(CVPR), pp. 317–326 (2016)
Zheng, H., Fu, J., Zha, Z., et al.: Looking for the devil in the details: learning trilinear attention sampling network for fine-grained image recognition. In: 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 5007–5016 (2019)
Liu, X., Xia, T., Wang, J., et al.: Fully convolutional attention networks for finegrainedrecognitionEB/OL. 2017–03–212021–11–11. https//arxiv. org/pdf/1603. 06765. pdf
Zheng, H.L., Fu, J.L., Mei, T., et al.: Learning multiattention convolutional neural network for fine grained image recognition. In: Proceedings of the 2017 IEEE International Conference on Computer Vision. Piscataway IEEE, pp. 5219–5227 (2017)
Zhang, L., Huang, S., Liu, W., et al.: Learning a mixture of granularity-specific experts for fine-grained categorization. In: 2019 IEEE/CVF International Conference on Computer Vision (ICCV), pp. 8330–8339 (2019)
Szegedy, C., Vanhoucke, V., Ioffe, S., et al.: Rethinking the inception architecture for computer vision. In: 2016 CVPR Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2818–2826 (2016)
Wei, Y., Feng, J., Liang, X., et al.: Object region mining with adversarial erasing: a simple classification to semantic segmentation approach. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1568–1576 (2017)
Selvaraju, R.R., Cogswell, M., Das, A., et al.: Grad-cam: Visual explanations from deep networks via gradient-based localization. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 618–626 (2017)
DFL-CNN: Yang, Z., Luo, T.G., Wang, D., et al.: Learning to navigate for fine-grained classification. In: Proceedings of the 15th European Conference on Computer Vision. Cham: Springer, p. 420435 (2018)
DCL Chen, Y., Bai, Y., Zhang, W., et al.: Destruction and construction learning for fine-grained image recognition. In: IEEE/ CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 5152–5161 (2019)
Sung, D.B., Cholakkal, H., Khan, S., et al.: Fine-grained recognition: accounting for subtle differences between similar classes. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 34, no. 1, pp. 12047–12054 (2020)
FDL, Liu, C., Xie, H., Zhaz, J., et al.: Filtration and distillation: enhancing region attention for fine-grained visual categorization. In: AAAI Conference on Artificial Intelligence, pp. 11555–11562 (2020)
Luo, W., Zhang, H., Li, J., et al.: Learning semantically enhanced feature for fine-grained image classification. In: 2020 IEEE Signal Processing Letters (IEEE), vol. 27, pp. 1545–1549 (2020)
Zhao, B., Wu, X., Feng, J., et al.: Diversified visual attention networks for fine grained object classification. IEEE Trans. Multimedia, 19(6), 1245−1256 (2017)
Dubey, A., Gupta, O., Guo, P., et al.: Pairwise confusion for fine-grained visual classification. In: European Conference on Computer Vision(ECCV), pp. 71–88 (2018)
Chen, Y., Bai, Y., Zhang, W., et al.: Destruction and construction learning for fine grained image recognition. In: IEEE/CVF Conference on Computer Vision and Pattern Recognition(CVPR), pp. 5152–5161 (2019)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Shi, X., Liu, J., Song, Y. (2024). Fine-Grained Image Classification Network Based on Complementary Learning. In: Jin, H., Pan, Y., Lu, J. (eds) Data Science and Information Security. IAIC 2023. Communications in Computer and Information Science, vol 2059. Springer, Singapore. https://doi.org/10.1007/978-981-97-1280-9_19
Download citation
DOI: https://doi.org/10.1007/978-981-97-1280-9_19
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-97-1279-3
Online ISBN: 978-981-97-1280-9
eBook Packages: Computer ScienceComputer Science (R0)