Abstract
High distortion and complex marine environment pose severe challenges to underwater tracking. In this paper, we propose a simple, template-free Adaptive Euclidean Tracking (AET) approach for underwater fish tracking by regarding tracking as a specific case of instance detection. The proposed method exploits the advanced detection framework to track the fish in underwater imagery without any image enhancement techniques. The proposed method achieves comparable performance on the DeepFish dataset, with 22% and 14% improvement in precision and success over state-of-art trackers.
D. Velayudhan and A. Ghimire—Authors make equal contributions to this work.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Bay, H., Ess, A., Tuytelaars, T., Van Gool, L.: Speeded-up robust features (SURF). Comput. Vis. Image Underst. 110(3), 346–359 (2008)
Bhat, G., Danelljan, M., Gool, L.V., Timofte, R.: Learning discriminative model prediction for tracking. In: Proceedings of the IEEE/Cvf International Conference on Computer Vision, pp. 6182–6191 (2019)
Boudiaf, A., et al.: Underwater image enhancement using pre-trained transformer. In: Sclaroff, S., Distante, C., Leo, M., Farinella, G.M., Tombari, F. (eds.) ICIAP 2022. LNCS, vol. 13233. pp. 480–488. Springer, Cham (2022). https://doi.org/10.1007/978-3-031-06433-3_41
Chuang, M.C., Hwang, J.N., Ye, J.H., Huang, S.C., Williams, K.: Underwater fish tracking for moving cameras based on deformable multiple kernels. IEEE Trans. Syst. Man Cybern. Syst. 47(9), 2467–2477 (2016)
Danelljan, M., Bhat, G., Khan, F.S., Felsberg, M.: Atom: accurate tracking by overlap maximization. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 4660–4669 (2019)
Ditria, E.M., Connolly, R.M., Jinks, E.L., Lopez-Marcano, S.: Annotated video footage for automated identification and counting of fish in unconstrained seagrass habitats. Front. Mar. Sci. 8, 160 (2021)
Fabbri, C., Islam, M.J., Sattar, J.: Enhancing underwater imagery using generative adversarial networks. In: 2018 IEEE International Conference on Robotics and Automation (ICRA), pp. 7159–7165. IEEE (2018)
Gerlai, R., Lee, V., Blaser, R.: Effects of acute and chronic ethanol exposure on the behavior of adult zebrafish (Danio Rerio). Pharmacol. Biochem. Behav. 85(4), 752–761 (2006)
Guo, Y., Li, H., Zhuang, P.: Underwater image enhancement using a multiscale dense generative adversarial network. IEEE J. Oceanic Eng. 45(3), 862–870 (2019)
Hossain, E., Alam, S.S., Ali, A.A., Amin, M.A.: Fish activity tracking and species identification in underwater video. In: 2016 5th International Conference on Informatics, Electronics and Vision (ICIEV), pp. 62–66. IEEE (2016)
Huang, L., Zhao, X., Huang, K.: Bridging the gap between detection and tracking: a unified approach. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 3999–4009 (2019)
Huang, R.J., Lai, Y.C., Tsao, C.Y., Kuo, Y.P., Wang, J.H., Chang, C.C.: Applying convolutional networks to underwater tracking without training. In: 2018 IEEE International Conference on Applied System Invention (ICASI), pp. 342–345. IEEE (2018)
Jäger, J., Wolff, V., Fricke-Neuderth, K., Mothes, O., Denzler, J.: Visual fish tracking: combining a two-stage graph approach with CNN-features. In: OCEANS 2017-Aberdeen, pp. 1–6. IEEE (2017)
Jesus, A., Zito, C., Tortorici, C., Roura, E., De Masi, G.: Underwater object classification and detection: first results and open challenges. arXiv preprint arXiv:2201.00977 (2022)
Jung, I., Son, J., Baek, M., Han, B.: Real-Time MDNet. In: Ferrari, V., Hebert, M., Sminchisescu, C., Weiss, Y. (eds.) ECCV 2018. LNCS, vol. 11208, pp. 89–104. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-01225-0_6
Lantsova, E., Voitiuk, T., Zudilova, T., Kaarna, A.: Using low-quality video sequences for fish detection and tracking. In: 2016 SAI Computing Conference (SAI), pp. 426–433. IEEE (2016)
Li, B., Yan, J., Wu, W., Zhu, Z., Hu, X.: High performance visual tracking with siamese region proposal network. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 8971–8980 (2018)
Li, D., Du, L.: Recent advances of deep learning algorithms for aquacultural machine vision systems with emphasis on fish. Artif. Intell. Rev. 55, 1–40 (2021)
Martija, M.A.M., Naval, P.C.: SynDHN: multi-object fish tracker trained on synthetic underwater videos. In: 2020 25th International Conference on Pattern Recognition (ICPR), pp. 8841–8848. IEEE (2021)
Masud, S., Singh, I., Ram, R.: Behavioural and hematological responses of cyprinus carpio exposed to mercurial chloride. J. Environ. Biol. 26(2 Suppl), 393–397 (2005)
Müller, M., Bibi, A., Giancola, S., Alsubaihi, S., Ghanem, B.: TrackingNet: a large-scale dataset and benchmark for object tracking in the wild. In: Ferrari, V., Hebert, M., Sminchisescu, C., Weiss, Y. (eds.) ECCV 2018. LNCS, vol. 11205, pp. 310–327. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-01246-5_19
Panetta, K., Kezebou, L., Oludare, V., Agaian, S.: Comprehensive underwater object tracking benchmark dataset and underwater image enhancement with GAN. IEEE J. Oceanic Eng. 47, 59–75 (2021)
Rasmussen, C.: The infinite gaussian mixture model. In: Advances in Neural Information Processing Systems 12 (1999)
Ren, S., He, K., Girshick, R., Sun, J.: Faster R-CNN: towards real-time object detection with region proposal networks. In: Advances in Neural Information Processing Systems 28 (2015)
Saleh, A., Laradji, I.H., Konovalov, D.A., Bradley, M., Vazquez, D., Sheaves, M.: A realistic fish-habitat dataset to evaluate algorithms for underwater visual analysis. Sci. Rep. 10(1), 1–10 (2020)
Sharif, M.H., Galip, F., Guler, A., Uyaver, S.: A simple approach to count and track underwater fishes from videos. In: 2015 18th International Conference on Computer and Information Technology (ICCIT), pp. 347–352. IEEE (2015)
Shiau, Y.H., Chen, C.C., Lin, S.I.: Using bounding-surrounding boxes method for fish tracking in real world underwater observation. Int. J. Adv. Rob. Syst. 10(7), 298 (2013)
Spampinato, C., Palazzo, S., Giordano, D., Kavasidis, I., Lin, F.P., Lin, Y.T.: Covariance based fish tracking in real-life underwater environment. In: VISAPP (2), pp. 409–414 (2012)
Wang, G., Luo, C., Sun, X., Xiong, Z., Zeng, W.: Tracking by instance detection: a meta-learning approach. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 6288–6297 (2020)
Welch, G., Bishop, G., et al.: An Introduction to the Kalman Filter. University of North Carolina at Chapel Hill, Chapel Hill (1995)
Wu, Y., Lim, J., Yang, M.H.: Object tracking benchmark. IEEE Trans. Pattern Anal. Mach. Intell. 37(9), 1834–1848 (2015). https://doi.org/10.1109/tpami.2014.2388226
Xia, C., Fu, L., Liu, Z., Liu, H., Chen, L., Liu, Y.: Aquatic toxic analysis by monitoring fish behavior using computer vision: a recent progress. J. Toxicol. 2018 (2018)
Xu, Y., Osep, A., Ban, Y., Horaud, R., Leal-Taixé, L., Alameda-Pineda, X.: How to train your deep multi-object tracker. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 6787–6796 (2020)
Yang, L., et al.: Computer vision models in intelligent aquaculture with emphasis on fish detection and behavior analysis: a review. Arch. Comput. Meth. Eng. 28(4), 2785–2816 (2021)
Zhao, M., Okada, K., Inaba, M.: TRTR: Visual tracking with transformer. arXiv preprint arXiv:2105.03817 (2021)
Acknowledgments
This publication acknowledges the support provided by the Khalifa University of Science and Technology under Faculty Start Up grants FSU-2022-003 Award No. 84740 0 0401.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 Springer Nature Switzerland AG
About this paper
Cite this paper
Velayudhan, D., Ghimire, A., Dias, J., Werghi, N., Javed, S. (2023). Underwater Fish Tracking-by-Detection: An Adaptive Tracking Approach. In: Rousseau, JJ., Kapralos, B. (eds) Pattern Recognition, Computer Vision, and Image Processing. ICPR 2022 International Workshops and Challenges. ICPR 2022. Lecture Notes in Computer Science, vol 13645. Springer, Cham. https://doi.org/10.1007/978-3-031-37731-0_37
Download citation
DOI: https://doi.org/10.1007/978-3-031-37731-0_37
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-37730-3
Online ISBN: 978-3-031-37731-0
eBook Packages: Computer ScienceComputer Science (R0)