A comprehensive survey on the applications of machine learning techniques on maritime surveillance to detect abnormal maritime vessel behaviors
Tóm tắt
Automated surveillance systems are becoming a critical requirement in maritime domain, due to the continuous expansion of maritime security threats. Although several automated systems have been developed, detection of maritime threats is becoming more challenging due to the constantly changing tactics adopted by seafarers to evade detection. Machine learning algorithms are a popular choice when detecting maritime threats based on the abnormalities of vessels. This paper categorizes the security threats according to three processing levels: abnormal activities, behaviors, and intents, and presents available machine learning techniques to detect these threats, including several deep learning techniques which is the current trend in detecting abnormalities. Supervised learning and unsupervised learning techniques used in the literature are discussed in this paper, where the advantages and disadvantages of each approach in the context of maritime surveillance are discussed in detail. Supervised learning was used predominantly for detecting relatively simple abnormal behaviors and intents such as movement abnormalities. Such learning methods yielded higher accuracy values in comparison to unsupervised learning methods, which achieved 80–95% accuracy. Supervised learning methods perform between 93 and 99% accuracy, where the highest accuracy is achieved by SVM (support vector machine) and 91% accuracy by CNN (convolutional neural network) as the best among deep learning methods. Furthermore, this analysis reveals that supervised deep learning methods such as CNN and long short-term memory (LSTM) will be the future trends in developing high-accurate maritime surveillance systems with the ability to detect more maritime threats.
Tài liệu tham khảo
Anneken M, Fischer Y, Beyerer J (2015) Evaluation and comparison of anomaly detection algorithms in annotated datasets from the maritime domain. In: 2015 SAI Intelligent Systems Conference (IntelliSys), IEEE, pp 169–178
Arasteh S, Tayebi MA, Zohrevand Z, et al (2020) Fishing vessels activity detection from longitudinal AIS data. In: Proceedings of the 28th International Conference on Advances in Geographic Information Systems, pp 347–356
Arguedas VF, Mazzarella F, Vespe M (2015) Spatio-temporal data mining for maritime situational awareness. In: OCEANS 2015-Genova, IEEE, pp 1–8
Auslander B, Gupta KM, Aha DW (2012) Maritime threat detection using probabilistic graphical models. In: Twenty-Fifth International FLAIRS Conference
Awad M, Khanna R (2015) Support vector regression. In: Efficient learning machines. Springer, p 67–80
Bao K, Bi J, Gao M et al (2022) An improved ship trajectory prediction based on AIS data using MHA-BiGRU. Journal of Marine Science and Engineering 10(6):804
Barber D (2012) Bayesian reasoning and machine learning. Cambridge University Press
Bouejla A, Chaze X, Guarnieri F et al (2014) A Bayesian network to manage risks of maritime piracy against offshore oil fields. Safety Science 68:222–230
Bueger C (2015) What is maritime security? Marine Policy 53:159–164
Castaldo F, Palmieri FA, Bastani V, et al (2014) Abnormal vessel behavior detection in port areas based on dynamic Bayesian networks. In: 17th International Conference on Information Fusion (FUSION), IEEE, pp 1–7
Chen X, Liu Y, Achuthan K et al (2020) A ship movement classification based on automatic identification system (AIS) data using convolutional neural network. Ocean Engineering 218:108–182
Coraluppi S, Carthel C, Braca P, et al (2016) The mixed Ornstein-Uhlenbeck process and context exploitation in multi-target tracking. In: 2016 19th International Conference on Information Fusion (FUSION), IEEE, pp 217–224
Dabrowski JJ, De Villiers JP (2015) Maritime piracy situation modelling with dynamic Bayesian networks. Information fusion 23:116–130
d’Afflisio E, Braca P, Millefiori LM et al (2018) Detecting anomalous deviations from standard maritime routes using the Ornstein-Uhlenbeck process. IEEE Transactions on Signal Processing 66(24):6474–6487
Dogancay K, Tu Z, Ibal G (2021) Research into vessel behaviour pattern recognition in the maritime domain: past, present and future. Digital Signal Processing p 103191
Dogru N, Subasi A (2018) Traffic accident detection using random forest classifier. In: 2018 15th learning and technology conference (L &T), IEEE, pp 40–45
Du Toit J, Van Vuuren J (2014) Semi-automated maritime vessel activity detection using hidden Markov models. In: Proceedings of the 43rd annual conference of the operations research society of South Africa, Parys, pp 71–78
Ester M, Kriegel HP, Sander J, et al (1996) A density-based algorithm for discovering clusters in large spatial databases with noise. In: Kdd, pp 226–231
Ford JH, Peel D, Hardesty BD et al (2018) Loitering with intent-catching the outlier vessels at sea. Plos one 13(7):e0200,189
Ford JH, Peel D, Kroodsma D et al (2018) Detecting suspicious activities at sea based on anomalies in automatic identification systems transmissions. PloS one 13(8):e0201-640
Forti N, Millefiori LM, Braca P, et al (2020) Random finite set tracking for anomaly detection in the presence of clutter. In: 2020 IEEE Radar Conference (RadarConf20), IEEE, pp 1–6
Fournier M, Casey Hilliard R, Rezaee S et al (2018) Past, present, and future of the satellite-based automatic identification system: areas of applications (2004–2016). WMU journal of maritime affairs 17(3):311–345
Fraccaro M, Sønderby SK, Paquet U, et al (2016) Sequential neural models with stochastic layers. arXiv preprint arXiv:1605.07571
Fu P, Wang H, Liu K et al (2017) Finding abnormal vessel trajectories using feature learning. IEEE Access 5:7898–7909
Han H (2014) Introduction to pattern recognition, Hanbit Academy, Inc., Seoul. Korea
Handayani DOD, Sediono W, Shah A (2013) Anomaly detection in vessel tracking using support vector machines (SVMs). In: 2013 International Conference on Advanced Computer Science Applications and Technologies, IEEE, pp 213–217
Hoque X, Sharma SK (2020) Ensembled deep learning approach for maritime anomaly detection system. In: Proceedings of ICETIT 2019. Springer, p 862–869
Jiang X, Silver DL, Hu B, et al (2016) Fishing activity detection from AIS data using autoencoders. In: Canadian Conference on Artificial Intelligence, Springer, pp 33–39
Jiang X, de Souza EN, Liu X, et al (2017) Partition-wise recurrent neural networks for point-based AIS trajectory classification. In: ESANN
Kim DY, Kim KY, Park GK et al (2016) A study on the implementation of intelligent navigational risk assessment system for high-risk vessel using IoT sensor gateway. Journal of Korean Institute of Intelligent Systems 26(3):239–245
Kim JS, Jeong JS (2015) Pattern recognition of ship navigational data using support vector machine. International Journal of Fuzzy Logic and Intelligent Systems 15(4):268–276
Kim JS, Lee JS, Kim KI (2019) Anomalous vessel behavior detection based on SVR seaway model. International Journal of Fuzzy Logic and Intelligent Systems 19(1):18–27
Kowalska K, Peel L (2012) Maritime anomaly detection using Gaussian process active learning. In: 2012 15th International Conference on Information Fusion, IEEE, pp 1164–1171
Kroodsma DA, Mayorga J, Hochberg T et al (2018) Tracking the global footprint of fisheries. Science 359(6378):904–908
Lane RO, Nevell DA, Hayward SD, et al (2010) Maritime anomaly detection and threat assessment. In: 2010 13th International Conference on Information Fusion, IEEE, pp 1–8
Laxhammar R (2008) Anomaly detection for sea surveillance. In: 2008 11th international conference on information fusion, IEEE, pp 1–8
Li H, Liu J, Liu RW et al (2017) A dimensionality reduction-based multi-step clustering method for robust vessel trajectory analysis. Sensors 17(8):1792
Ljunggren H (2018) Using deep learning for classifying ship trajectories. In: 2018 21st International Conference on Information Fusion (FUSION), IEEE, pp 2158–2164
Maddison CJ, Lawson D, Tucker G, et al (2017) Filtering variational objectives. arXiv preprint arXiv:1705.09279
Malhotra P, Vig L, Shroff G, et al (2015) Long short term memory networks for anomaly detection in time series. In: Proceedings, Presses universitaires de Louvain, pp 89–94
Marzuki MI, Gaspar P, Garello R et al (2017) Fishing gear identification from vessel-monitoring-system-based fishing vessel trajectories. IEEE Journal of Oceanic Engineering 43(3):689–699
Mascaro S, Nicholso AE, Korb KB (2014) Anomaly detection in vessel tracks using Bayesian networks. International Journal of Approximate Reasoning 55(1):84–98
Mazzarella F, Vespe M, Alessandrini A et al (2017) A novel anomaly detection approach to identify intentional AIS on-off switching. Expert Systems with Applications 78:110–123
Milios A, Bereta K, Chatzikokolakis K, et al (2019) Automatic fusion of satellite imagery and AIS data for vessel detection. In: 2019 22th International Conference on Information Fusion (FUSION), IEEE, pp 1–5
Millefiori LM, Braca P, Bryan K et al (2016) Modeling vessel kinematics using a stochastic mean-reverting process for long-term prediction. IEEE Transactions on Aerospace and Electronic Systems 52(5):2313–2330
Mirghasemi S, Parand I (2013) A parallel approach to combine SVM, edge and corner detection methods for target detection. J Multim Process Technol 4(2):47–54
Nguyen D, Vadaine R, Hajduch G, et al (2018) A multi-task deep learning architecture for maritime surveillance using AIS data streams. In: 2018 IEEE 5th International Conference on Data Science and Advanced Analytics (DSAA), IEEE, pp 331–340
Nguyen D, Vadaine R, Hajduch G, et al (2021) GeoTrackNet–a maritime anomaly detector using probabilistic neural network representation of AIS tracks and a contrario detection. IEEE Transactions on Intelligent Transportation Systems
Pallotta G, Vespe M, Bryan K (2013) Traffic route extraction and anomaly detection from AIS data. In: International COST MOVE Workshop on Moving Objects at Sea, Brest, France
Patroumpas K, Alevizos E, Artikis A et al (2017) Online event recognition from moving vessel trajectories. GeoInformatica 21(2):389–427
Pimentel MA, Clifton DA, Clifton L et al (2014) A review of novelty detection. Signal Processing 99:215–249
Riveiro M, Pallotta G, Vespe M (2018) Maritime anomaly detection: a review. Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery 8(5)
Scholkopf B, Smola AJ (2018) Learning with kernels: support vector machines, regularization, optimization, and beyond. Adaptive Computation and Machine Learning series
Sfyridis A, Cheng T, Vespe M (2017) Detecting vessels carrying migrants using machine learning. ISPRS Annals of Photogrammetry, Remote Sensing & Spatial Information Sciences 4
Shahir AY, Tayebi MA, Glässer U, et al (2019) Mining vessel trajectories for illegal fishing detection. In: 2019 IEEE International Conference on Big Data (Big Data), IEEE, pp 1917–1927
Shahir HY, Glässer U, Nalbandyan N, et al (2014) Maritime situation analysis: a multi-vessel interaction and anomaly detection framework. In: 2014 IEEE Joint Intelligence and Security Informatics Conference, IEEE, pp 192–199
Shahir HY, Glasser U, Shahir AY, et al (2015) Maritime situation analysis framework: vessel interaction classification and anomaly detection. In: 2015 IEEE International Conference on Big Data (Big Data), IEEE, pp 1279–1289
Sidibé A, Shu G (2017) Study of automatic anomalous behaviour detection techniques for maritime vessels. The journal of Navigation 70(4):847
Singh A, Thakur N, Sharma A (2016) A review of supervised machine learning algorithms. In: 2016 3rd International Conference on Computing for Sustainable Global Development (INDIACom), Ieee, pp 1310–1315
Singh SK, Heymann F (2020) Machine learning-assisted anomaly detection in maritime navigation using AIS data. 2020 IEEE/ION Position. Location and Navigation Symposium (PLANS), IEEE, pp 832–838
de Souza EN, Boerder K, Matwin S et al (2016) Improving fishing pattern detection from satellite AIS using data mining and machine learning. PloS one 11(7):e0158-248
Stephenson TA (2000) An introduction to Bayesian network theory and usage. Tech. rep, IDIAP
Tang H, Yin Y, Shen H (2022) A model for vessel trajectory prediction based on long short-term memory neural network. Journal of Marine Engineering & Technology 21(3):136–145
Toloue KF, Jahan MV (2018) Anomalous behavior detection of marine vessels based on hidden Markov model. In: 2018 6th Iranian Joint Congress on Fuzzy and Intelligent Systems (CFIS), IEEE, pp 10–12
Van Loi N, Kien TT, Hop TV, et al (2020) Abnormal moving speed detection using combination of kernel density estimator and DBSCAN for coastal surveillance radars. In: 2020 7th International Conference on Signal Processing and Integrated Networks (SPIN), IEEE, pp 143–147
Varlamis I, Tserpes K, Etemad M, et al (2019) A network abstraction of multi-vessel trajectory data for detecting anomalies. In: EDBT/ICDT Workshops
Venskus J, Treigys P, Bernatavičienė J et al (2019) Real-time maritime traffic anomaly detection based on sensors and history data embedding. Sensors 19(17):3782
Wang G, Malik A, Yau C, etal (2017) TraSeer: a visual analytics tool for vessel movements in the coastal areas. In: 2017 IEEE International Symposium on Technologies for Homeland Security (HST), IEEE, pp 1–6
Woodill AJ, Kavanaugh M, Harte M, et al (2020) Predicting illegal fishing on the Patagonia Shelf from oceanographic seascapes. arXiv preprint arXiv:2007.05470
Xia Z, Gao S (2020) Analysis of vessel anomalous behavior based on Bayesian recurrent neural network. In: 2020 IEEE 5th International Conference on Cloud Computing and Big Data Analytics (ICCCBDA), IEEE, pp 393–397
Yang CH, Lin GC, Wu CH et al (2022) Deep learning for vessel trajectory prediction using clustered AIS data. Mathematics 10(16):2936
Young DL (2019) Deep nets spotlight illegal, unreported, unregulated (IUU) fishing. In: 2019 IEEE Applied Imagery Pattern Recognition Workshop (AIPR), IEEE, pp 1–7
Zhang M, Montewka J, Manderbacka T et al (2021) A big data analytics method for the evaluation of ship-ship collision risk reflecting hydrometeorological conditions. Reliability Engineering & System Safety 213:107–674
Zhang X, Fu X, Xiao Z, et al (2022) Vessel trajectory prediction in maritime transportation: current approaches and beyond. IEEE Transactions on Intelligent Transportation Systems
Zhang Y, Zheng Z, Xiang C (2020) Analysis of vessel abnormal behavior detection. In: 2020 2nd International Conference on Robotics Systems and Vehicle Technology, pp 45–53
Zhao L, Shi G (2019) Maritime anomaly detection using density-based clustering and recurrent neural network. The Journal of Navigation 72(4):894–916
Zhen R, Jin Y, Hu Q et al (2017) Maritime anomaly detection within coastal waters based on vessel trajectory clustering and naïve Bayes classifier. The Journal of Navigation 70(3):648–670