HVD-Net: A Hybrid Vehicle Detection Network for Vision-Based Vehicle Tracking and Speed Estimation

Abdulrahim, K., Salam, R.A., 2016, July. Cumulative frame differencing for urban vehicle detection. In First International Workshop on Pattern Recognition, SPIE, 10011, pp. 90-96. Abiyev, 2023, Vehicle detection systems for intelligent driving using deep convolutional neural networks, Discover Artif. Intelligence, 3, 16, 10.1007/s44163-023-00062-8 Administration, N., 2022. Speeding | NHTSA. [online] NHTSA. Available at: <https://www.nhtsa.gov/risky-driving/speeding> [Accessed 27 July 2022]. Anandhalli, 2022, Image projection method for vehicle speed estimation model in video system, Mach. Vis. Appl., 33, 1, 10.1007/s00138-021-01255-w Bell, D., Xiao, W., James, P., 2020. Accurate vehicle speed estimation from monocular camera footage. In: XXIV ISPRS Congress. Newcastle University, V-2-2020, pp. 419-426. Bewley, A., Ge, Z., Ott, L., Ramos, F., Upcroft, B., 2016, September. Simple online and realtime tracking. In: 2016 IEEE international conference on image processing (ICIP). IEEE, pp. 3464-3468. Bochinski, E., Senst, T., Sikora, T., 2018, November. Extending IOU based multi-object tracking by visual information. In: 2018 15th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), IEEE, pp. 1-6. Buch, 2011, A review of computer vision techniques for the analysis of urban traffic, IEEE Trans. Intell. Transp. Syst., 12, 920, 10.1109/TITS.2011.2119372 Cheng, G., Guo, Y., Cheng, X., Wang, D., Zhao, J., 2020, February. Real-time detection of vehicle speed based on video image. In: 2020 12th International Conference on Measuring Technology and Mechatronics Automation (ICMTMA), IEEE, pp. 313-317. Chu, 2019, Traffic climate, driver behaviour, and accidents involvement in China, Accid. Anal. Prev., 122, 119, 10.1016/j.aap.2018.09.007 Deshmukh, 2023, Swin transformer based vehicle detection in undisciplined traffic environment, Expert Syst. Appl., 213, 10.1016/j.eswa.2022.118992 Downtoearth.org.in., 2022. There will be an additional 1.2 billion cars on the road by 2030. [online] Available at: <https://www.downtoearth.org.in/news/air/it-is-time-the-world-quits-diesel-and-petrol-cars-58956> [Accessed 27 July 2022]. Dubey, A.K., Jain, V., 2019. Comparative study of convolution neural network’s relu and leaky-relu activation functions. In: Applications of Computing, Automation and Wireless Systems in Electrical Engineering. Springer, Singapore, pp. 873-880. Ec.europa.eu., 202Road accident fatalities - statistics by type of vehicle - Statistics Explained. [online] Available at: <https://ec.europa.eu/eurostat/statistics-explained/index.php?title=Road_accident_fatalities_-_statistics_by_type_of_vehicle&oldid=565401> [Accessed 27 July 2022]. El Bouziady, A., Thami, R.O.H., Ghogho, M., Bourja, O., El Fkihi, S., 2018, April. Vehicle speed estimation using extracted SURF features from stereo images. In: 2018 International Conference on Intelligent Systems and Computer Vision (ISCV), IEEE, pp. 1-6. Famouri, 2018, A novel motion plane-based approach to vehicle speed estimation, IEEE Trans. Intell. Transp. Syst., 20, 1237, 10.1109/TITS.2018.2847224 Feng, 2021, Magnetic sensor-based multi-vehicle data association, IEEE Sens. J., 21, 24709, 10.1109/JSEN.2021.3112161 Feng, 2022, MagMonitor: vehicle speed estimation and vehicle classification through a magnetic sensor, IEEE Trans. Intell. Transp. Syst., 23, 1311, 10.1109/TITS.2020.3024652 Fernández Llorca, 2021, Vision-based vehicle speed estimation: a survey, IET Intel. Transport Syst., 15, 987, 10.1049/itr2.12079 Garg, 2020, Rapid and robust background modeling technique for low-cost road traffic surveillance systems, IEEE Trans. Intell. Transp. Syst., 21, 2204, 10.1109/TITS.2019.2917560 Girshick, R., 2015. Fast r-cnn. In: Proceedings of the IEEE international conference on computer vision (pp. 1440-1448). Gunawan, 2019, Detection of vehicle position and speed using camera calibration and image projection methods, Procedia Comput. Sci., 157, 255, 10.1016/j.procs.2019.08.165 Hashemi, 2021, A new comparison framework to survey neural networks-based vehicle detection and classification approaches, Int. J. Commun Syst, 34, e4928, 10.1002/dac.4928 He, K., Gkioxari, G., Dollár, P., Girshick, R., 2017. Mask R-CNN. In: Proceedings of the IEEE international conference on computer vision, pp. 2961-2969. He, 2015, Spatial pyramid pooling in deep convolutional networks for visual recognition, IEEE Trans. Pattern Anal. Mach. Intell., 37, 1904, 10.1109/TPAMI.2015.2389824 Huang, G., Liu, Z., Van Der Maaten, L., Weinberger, K.Q., 2017. Densely connected convolutional networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, IEEE, pp. 4700-4708. Huang, T., 2018. Traffic speed estimation from surveillance video data. In: Proceedings of the IEEE conference on computer vision and pattern recognition workshops, pp. 161-165. Khoukhi, 2021, The Internet of vehicles and smart cities, Ann. Telecommun., 76, 545, 10.1007/s12243-021-00891-7 Kuhn, 1955, The Hungarian method for the assignment problem, Naval Res. Logistics Quart., 2, 83, 10.1002/nav.3800020109 Kumar, A., Khorramshahi, P., Lin, W.A., Dhar, P., Chen, J.C., Chellappa, R., 2018. A semi-automatic 2D solution for vehicle speed estimation from monocular videos. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp. 137-144. Kumar, 2017, Traffic surveillance and speed limit violation detection system, J. Intell. Fuzzy Syst., 32, 3761, 10.3233/JIFS-169308 Kurniawan, A., Ramadlan, A., Yuniarno, E.M., 2018, November. Speed monitoring for multiple vehicle using closed circuit television (CCTV) camera. In: 2018 International Conference on Computer Engineering, Network and Intelligent Multimedia (CENIM), IEEE, pp. 88-93. Leal-Taixé, L., Milan, A., Reid, I., Roth, S., Schindler, K., 2015. Motchallenge 2015: Towards a benchmark for multi-target tracking. arXiv preprint arXiv:1504.01942. Li, H., Feng, M., Wang, X., 2012, October. Inverse perspective mapping based urban road markings detection. In: 2012 IEEE 2nd international conference on cloud computing and intelligence systems, IEEE, 3, pp. 1178-1182. Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.Y., Berg, A.C., 2016, October. Ssd: Single shot multibox detector. In: European conference on computer vision. Springer, Cham, pp. 21-37. Liu, 2020, A vision-based pipeline for vehicle counting, speed estimation, and classification, IEEE Trans. Intell. Transp. Syst., 22, 7547, 10.1109/TITS.2020.3004066 Lu, 2020, A high accurate vehicle speed estimation method, Soft. Comput., 24, 1283, 10.1007/s00500-019-03965-w Lucas, B.D., Kanade, T., 1981. An iterative image registration technique with an application to stereo vision, 81, pp. 674-679. Luvizon, 2017, A video-based system for vehicle speed measurement in urban roadways, IEEE Trans. Intell. Transp. Syst., 18, 1393 Outay, 2019, V2V and V2I communications for traffic safety and CO2 emission reduction: a performance evaluation, Procedia Comput. Sci., 151, 353, 10.1016/j.procs.2019.04.049 Padilla, R., Netto, S.L., da Silva, E.A., 2020, July. A survey on performance metrics for object-detection algorithms. In: 2020 International Conference on Systems, Signals and Image Processing (IWSSIP), IEEE, pp. 237-242. PASCAL VOC 2007. [online] Available at: https://www.kaggle.com/zaraks/pascal-voc-2007 [Accessed 20 October 2021]. PASCAL VOC 2012. [online] Available at: https://www.kaggle.com/huanghanchina/pascal-voc-2012 [Accessed 20 October 2021]. Paul, 2016 Poddar, M., Giridhar, M.K., Prabhu, A.S., Umadevi, V., 2016, November. Automated traffic monitoring system using computer vision. In 2016 International Conference on ICT in Business Industry & Government (ICTBIG). IEEE, pp. 1-5. Redmon, J., Farhadi, A., 2017. YOLO9000: better, faster, stronger. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 7263-7271. Redmon, J., Divvala, S., Girshick, R., Farhadi, A., 2016. You only look once: Unified, real-time object detection. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 779-788. Ren, S., He, K., Girshick, R., Sun, J., 2015. Faster R-CNN: Towards real-time object detection with region proposal networks. Advances in neural information processing systems, 28. Road Safety Engineering Factsheet, The Royal Society for the Prevention of Accidents (RoSPA), https://www.rospa.com/media/documents/road-safety/speed-cameras-factsheet.pdf [Last accessed: August 6, 2022]. Santurkar, 2018, How does batch normalization help optimization?, Adv. Neural Inf. Proces. Syst., 31 Sheikh, 2019, A survey of security services, attacks, and applications for vehicular ad hoc networks (vanets), Sensors, 19, 3589, 10.3390/s19163589 Shokravi, 2020, A review on vehicle classification and potential use of smart vehicle-assisted techniques, Sensors, 20, 3274, 10.3390/s20113274 Sonth, A., Settibhaktini, H., Jahagirdar, A., 2020. Vehicle speed determination and license plate localization from monocular video streams. In: Proceedings of 3rd International Conference on Computer Vision and Image Processing (pp. 267-277). Springer, Singapore. Tang, Z., Wang, G., Xiao, H., Zheng, A., Hwang, J.N., 2018. Single-camera and inter-camera vehicle tracking and 3D speed estimation based on fusion of visual and semantic features. In: Proceedings of the IEEE conference on computer vision and pattern recognition workshops, pp. 108-115. Tourani, 2019, Motion-based vehicle speed measurement for intelligent transportation systems, Int. J. Image Graphics Signal Process., 10, 42, 10.5815/ijigsp.2019.04.04 Vehicle Speed Measurement. [online] Available at: http://www.dainf.ct.utfpr.edu.br/∼rminetto/projects/ vehicle-speed/ [Accessed 20 October 2020]. Wang, 2023, A high-precision vehicle detection and tracking method based on the attention mechanism, Sensors, 23, 724, 10.3390/s23020724 Wei, 2017, Adaptable vehicle detection and speed estimation for changeable urban traffic with anisotropic magnetoresistive sensors, IEEE Sens. J., 17, 2021, 10.1109/JSEN.2017.2654501 Wen, 2020, UA-DETRAC: a new benchmark and protocol for multi-object detection and tracking, Comput. Vis. Image Underst., 193, 10.1016/j.cviu.2020.102907 Who.int. 2022. New global advisory panel convenes for upcoming road safety report. [online] Available at: <https://www.who.int/news/item/19-04-2022-new-global-advisory-panel-convenes-for-upcoming-road-safety-report> [Accessed 27 July 2022]. Yohannes, 2023, An improved speed estimation using deep homography transformation regression network on monocular videos, IEEE Access, 11, 5955, 10.1109/ACCESS.2023.3236512 Zhai, 2023, FPGA-based vehicle detection and tracking accelerator, Sensors, 23, 2208, 10.3390/s23042208