Underwater Target Detection Based on Reinforcement Learning and Ant Colony Optimization
Tóm tắt
Underwater optical imaging produces images with high resolution and abundant information and hence has outstanding advantages in short-distance underwater target detection. However, low-light and high-noise scenarios pose great challenges in underwater image and video analyses. To improve the accuracy and anti-noise performance of underwater target image edge detection, an underwater target edge detection method based on ant colony optimization and reinforcement learning is proposed in this paper. First, the reinforcement learning concept is integrated into artificial ants’ movements, and a variable radius sensing strategy is proposed to calculate the transition probability of each pixel. These methods aim to avoid undetection and misdetection of some pixels in image edges. Second, a double-population ant colony strategy is proposed, where the search process takes into account global search and local search abilities. Experimental results show that the algorithm can effectively extract the contour information of underwater targets and keep the image texture well and also has ideal anti-interference performance.
Tài liệu tham khảo
Bonin-Font, F., Oliver, G., Wirth, S., Massot, M., Negre, P., and Beltran, J., 2015. Visual sensing for autonomous underwater exploration and intervention tasks. Ocean Engineering, 93: 25–44.
Chuang, M., Hwang, J., and Williams, K., 2016. A feature learning and object recognition framework for underwater fish images. IEEE Transactions on Image Processing, 25 (4): 1862–1872.
Dawson, L., and Stewart, I., 2014. Accelerating ant colony optimization-based edge detection on the GPU using CUDA. 2014 IEEE Congress on Evolutionary Computation. Beijing, 1736–1743.
Deng, W., Xu, J. J., and Zhao, H. M., 2019. An improved ant colony optimization algorithm based on hybrid strategies for scheduling problem. IEEE Access, 7: 20281–20292.
Fatan, M., Daliri, M., and Shahri, A., 2016. Underwater cable detection in the images using edge classification based on texture information. Measurement, 91: 309–317.
Gao, Y. Q., Guan, H. B., Qi, Z. W., Hou, Y., and Liu, L., 2013. A multi-objective ant colony system algorithm for virtual machine placement in cloud computing. Journal of Computer and System Sciences, 79 (8): 1230–1242.
Kheirinejad, S., Hasheminejad, S., and Riahi, N., 2018. Maxmin ant colony optimization method for edge detection exploiting a new heuristic information function. International Conference on Computer and Knowledge Engineering. Mashhad, 12–15.
Kober, J., Bagnell, J., and Peters, J., 2013. Reinforcement learning in robotics: A survey. International Journal of Robotics Research, 32 (11): 1238–1274.
Lewis, F., and Vrabie, D., 2009. Reinforcement learning and adaptive dynamic programming for feedback control. IEEE Circuits and Systems Magazine, 9 (3): 32–50.
Li, Q., Sun, X., Dong, J. Y., Song, S. Q., Zhang, T. T., Liu, D., et al., 2020. Developing a microscopic image dataset in support of intelligent phytoplankton detection using deep learning. ICES Journal of Marine Science, 77 (4): 1427–1439.
Lin, Y. H., Chen, S. Y., and Tsou, C. H., 2019. Development of an image processing module for autonomous underwater vehicles through integration of visual recognition with stereoscopic image reconstruction. Marine Science and Engineering, 7 (4): 107–149.
Liu, F., Wei, Y., Han, P. L., Yang, K., Lu, B., and Shao, X. P., 2019. Polarization-based exploration for clear underwater vision in natural illumination. Optics Express, 27 (3): 3629–3641.
Liu, X. C., and Fang, S. P., 2015. A convenient and robust edge detection method based on ant colony optimization. Optics Communications, 353: 147–157.
Lu, D. S., and Chen, C. C., 2008. Edge detection improvement by ant colony optimization. Pattern Recongnition Letters, 29 (4): 416–425.
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., et al., 2015. Human-level control through deep reinforcement learning. Nature, 518 (7540): 529–533.
Montague, P., 1999. Reinforcement learning: An introduction, by Sutton, R. S., and Barto, A. G. Trends in Cognitive Sciences, 3 (9): 360–360.
Moreno, R., Puig, D., Julia, C., and Garcia, M., 2009. A new methodology for evaluation of edge detectors. IEEE International Conference on Image Processing. Cairo, 2157–2160.
Nasution, T., Zarlis, M., and Nasution, M., 2017. Optimizing robinson operator with ant colony optimization as a digital image edge detection method. International Conference on Information and Communication Technology. Medan, 930012034.
Nezamabadi-pour, H., Saryazdi, S., and Rashedi, E., 2006. Edge detection using ant algorithms. Soft Computing, 10 (7): 623–628.
Rafsanjani, M. K., and Varzaneh, Z. A., 2015. Edge detection in digital images using ant colony optimization. Computer Science Journal of Moldova, 23 (3): 343–359.
Silver, D., Hubert, T., Schrittwieser, J., Antonoglou, I., Lai, M., Guez, A., et al., 2018. A general reinforcement learning algorithm that masters chess, shogi, and Go through self-play. Science, 362 (6419): 1140–1144.
Singh, R., Vashishath, M., and Kumar, S., 2019. Ant colony optimization technique for edge detection using fuzzy triangular membership function. International Journal of Systems Assurance Engineering and Management, 10 (1): 91–96.
Sun, X., Shi, J. Y., Liu, L. P., Dong, J. Y., Plant, C., Wang, X. H., et al., 2018. Transferring deep knowledge for object recognition in low-quality underwater videos. Neurocomputing, 275: 897–908.
Tian, J., Yu, W. Y., and Me, S. L., 2008. An ant colony optimization algorithm for image edge detection. IEEE Congress on Evolutionary Computation. Hong Kong, 751–756.
Vinyals, O., Babuschkin, I., Czarnecki, W. M., Mathieu, M., Dudzik, A., Chung, J., et al., 2019. Grandmaster level in StarCraft II using multi-agent reinforcement learning. Nature, 575 (7782): 350–370.
Wang, X. H., Ouyang, J. H., Li, D. Y., and Zhang, G., 2019. Underwater object recognition based on deep encoding-decoding network. Journal of Ocean University of China, 18 (2): 376–382.