Abstract
Situation awareness provides crucial yet instant information to maritime traffic participants, and significant attentions are paid to implement traffic situation awareness task via various maritime data source (e.g., automatic identification system, maritime surveillance video, radar, etc.). The study aims to analyze traffic situation with the support of ship imaging trajectory. First, we employ the dark channel prior model to remove fog in maritime videos to obtain high-resolution ship images (i.e., fog-free maritime images). Second, we track ships in each maritime image with the scale adaptive kernel correlation filter (SAMF), and thus obtain raw ship imaging trajectories. Third, we cleanse abnormal ship trajectory samples via curve-fitting and down sampling method, and thus further maritime traffic situation analysis is implemented. We analyze maritime traffic situation in three typical videos (i.e., three typical maritime traffic scenarios), and experimental results suggested that the proposed framework can extract high-resolution ship imaging trajectory for fulfilling the task of accurate maritime traffic situation awareness.
Similar content being viewed by others
Data availability
Data sharing not applicable to this article as no datasets were generated or analysed during the current study.
References
Yu Y, Chen L, Shu Y, Zhu W (2021) Evaluation model and management strategy for reducing pollution caused by ship collision in coastal waters. Ocean Coast Manag 203:105446. https://doi.org/10.1016/j.ocecoaman.2020.105446
Liu RW, Yuan W, Chen X, Lu Y (2021) An enhanced CNN-enabled learning method for promoting ship detection in maritime surveillance system. Ocean Eng 235:109435. https://doi.org/10.1016/j.oceaneng.2021.109435
Chen X, Wang Z, Hua Q, Shang W, Luo Q, Yu K (2022) AI-Empowered speed extraction via Port-like videos for vehicular trajectory analysis. IEEE Trans Intell Transp Syst vol Preprint 1–12. https://doi.org/10.1109/TITS.2022.3167650
Chen X et al (2020) Sensing data supported traffic flow prediction via denoising schemes and ANN: A Comparison. IEEE Sens J 20:14317–14328. https://doi.org/10.1109/JSEN.2020.3007809
Prasad DK, Rajan D, Rachmawati L, Rajabally E, Quek C (2017) Video processing from electro-optical sensors for object detection and tracking in a maritime environment: a survey. IEEE Trans Intell Transp Syst 18(8):1993–2016. https://doi.org/10.1109/TITS.2016.2634580
Li M, Mou J, Chen L, He Y, Huang Y (2021) A rule-aware time-varying conflict risk measure for mass considering maritime practice. Reliab Eng Syst Saf 107816. https://doi.org/10.1016/j.ress.2021.107816
Murray B, Perera LP (2021) Ship behavior prediction via trajectory extraction-based clustering for maritime situation awareness. J Ocean Eng Sci. https://doi.org/10.1016/j.joes.2021.03.001
Murray B, Perera LP (2020) A dual linear autoencoder approach for vessel trajectory prediction using historical AIS data. Ocean Eng 209:107478. https://doi.org/10.1016/j.oceaneng.2020.107478
Shu Y, Daamen W, Ligteringen H, Wang M, Hoogendoorn S (2018) Calibration and validation for the vessel maneuvering prediction (VMP) model using AIS data of vessel encounters. Ocean Eng 169:529–538. https://doi.org/10.1016/j.oceaneng.2018.09.022
Shu Y, Daamen W, Ligteringen H, Hoogendoorn SP (2017) Influence of external conditions and vessel encounters on vessel behavior in ports and waterways using automatic identification system data. Ocean Eng 131:1–14. https://doi.org/10.1016/j.oceaneng.2016.12.027
Chen X et al (2020) Ship trajectory reconstruction from AIS sensory data via data quality control and prediction. Math Problems Eng 2020:1–9. https://doi.org/10.1155/2020/7191296
Chen X, Liu S, Liu RW, Wu H, Han B, Zhao J (2022) Quantifying Arctic oil spilling event risk by integrating an analytic network process and a fuzzy comprehensive evaluation model. Ocean Coast Manag 228:106326. https://doi.org/10.1016/j.ocecoaman.2022.106326
Guo S, Mou J, Chen L, Chen P (2021) Improved kinematic interpolation for AIS trajectory reconstruction. Ocean Eng 234:109256. https://doi.org/10.1016/j.oceaneng.2021.109256
Chen JS, Dao DT, Chien H (2021) Ship echo identification based on norm-constrained adaptive beamforming for an arrayed high-frequency coastal radar. IEEE Trans Geosci Remote Sens 59(2):1143–1153. https://doi.org/10.1109/TGRS.2020.3000903
Shan Y, Zhou X, Liu S, Zhang Y, Huang K (2021) SiamFPN: a deep learning method for accurate and real-time maritime ship tracking. IEEE Trans Circuits Syst Video Technol 31(1):315–325. https://doi.org/10.1109/TCSVT.2020.2978194
Shao S, Zhang L, Liu H (2019) An optimal imaging time interval selection technique for marine targets ISAR imaging based on sea dynamic prior information. IEEE Sens J 19(13):4940–4953. https://doi.org/10.1109/JSEN.2019.2903399
Zhang W et al (2021) A robust deep affinity network for multiple ship tracking. IEEE Trans Instrum Meas 70:1–20. https://doi.org/10.1109/TIM.2021.3077679
Sui Z, Wen Y, Huang Y, Zhou C, Xiao C, Chen H (2020) Empirical analysis of complex network for marine traffic situation. Ocean Eng 214:107848. https://doi.org/10.1016/j.oceaneng.2020.107848
Szlapczynski R, Krata P (2018) Determining and visualizing safe motion parameters of a ship navigating in severe weather conditions. Ocean Eng 158:263–274. https://doi.org/10.1016/j.oceaneng.2018.03.092
Sharma A, Nazir S, Ernstsen J (2019) Situation awareness information requirements for maritime navigation: a goal directed task analysis. Saf Sci 120:745–752. https://doi.org/10.1016/j.ssci.2019.08.016
Du L, Goerlandt F, Valdez Banda OA, Huang Y, Wen Y, Kujala P (2020) Improving stand-on ship’s situational awareness by estimating the intention of the give-way ship. Ocean Eng 201:107110. https://doi.org/10.1016/j.oceaneng.2020.107110
Wu B, Zhang J, Yip TL, Guedes Soares C (2020) A quantitative decision-making model for emergency response to oil spill from ships. Marit Policy Manag 48(3):299–315. https://doi.org/10.1080/03088839.2020.1791994
Wu B, Tang Y, Yan X, Guedes Soares C (2021) Bayesian Network modelling for safety management of electric vehicles transported in RoPax ships. Reliab Eng Syst Saf 209:107466. https://doi.org/10.1016/j.ress.2021.107466
Xiao Z, Fu X, Zhang L, Goh RSM (2020) Traffic pattern mining and forecasting technologies in maritime traffic service networks: a comprehensive survey. IEEE Trans Intell Transp Syst 21(5):1796–1825. https://doi.org/10.1109/TITS.2019.2908191
Yang X et al. SCRDet: towards more robust detection for small, cluttered and rotated objects. In: International Conference on Computer Vision
Yang X, Yan J, Yang X, Tang J, Liao W, He T (2020) SCRDet++: detecting small, cluttered and rotated objects via instance-level feature denoising and rotation loss smoothing, IEEE Transactions on Pattern Analysis and Machine Intelligence. 45(2):2384–2399
Yang X, Yan J (2022) Correction to: on the arbitrary-oriented object detection: classification based approaches revisited. Int J Comput Vision 130(7):1873–1874
Hong Z, Yang T, Tong X, Zhang Y, Liu S (2021) Multi-scale ship detection from SAR and optical imagery via a more accurate YOLOv3. IEEE J Sel Top Appl Earth Obs Remote Sens PP(99):1–1
Shi J, Jiang Z, Zhang H (2021) Few-shot ship classification in optical remote sensing images using nearest neighbor prototype representation. IEEE J Sel Top Appl Earth Observ Remote Sens PP:1–1
Zhang M, Rong X, Yu X (2022) Light-SDNet: a lightweight CNN architecture for ship detection. IEEE Access 10:86647–86662. https://doi.org/10.1109/ACCESS.2022.3199352
Prasad DK, Dong H, Rajan D, Quek C (2020) Are object detection assessment criteria ready for maritime computer vision?,". IEEE Transactions on Intelligent Transportation Systems 21(12):5295–5304
Acknowledgements
This work was jointly supported by National Key R&D Program of China (2021YFC2801002), National Natural Science Foundation of China (52102397, 52071200, 62176150), China Postdoctoral Science Foundation (2022M712027), Fund of National Engineering Research Center for Water Transport Safety (A2022003).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
There was no conflict of interests for the manuscript submission, and the manuscript is approved by all authors for the publication.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Chen, X., Zheng, J., Li, C. et al. Maritime traffic situation awareness analysis via high-fidelity ship imaging trajectory. Multimed Tools Appl 83, 48907–48923 (2024). https://doi.org/10.1007/s11042-023-17456-6
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-023-17456-6