People re-identification under occlusion and crowded background

Multimedia Tools and Applications - Tập 81 - Trang 22549-22569 - 2022
Zahra Mortezaie1, Hamid Hassanpour1, Azeddine Beghdadi2
1Faculty of Computer Engineering, Shahrood University of Technology, Shahrood, Iran
2Institut Galilée, Université Sorbonne Paris Nord, Villetaneuse, France

Tóm tắt

The performance of video surveillance systems with network cameras depends on their accuracy in people re-identification. Body occlusion, crowded background, and variations in scene illumination and pose are challenging issues in people re-identification. In this paper, a technique is proposed to improve the performance of re-identification approaches using (a) a pre-processing step; and (b) a proposed weighing mechanism. In this approach, first, the input image is segmented into the person’s body, background, and possible carried objects. Then, considering the image’s segments, the occluded parts of the body are retrieved using their neighboring pixels. The processed image is transformed into the log chromatically color space which is robust to scene illumination changes. Using the transformed images along with descriptors which are robust to appearance changes such as Gaussian of Gaussian (GOG) and Hierarchical Gaussian Descriptor (HGD) can improve performance of the descriptors. In this paper, the GOG and HGD are used in a weighed form to represent the pre-processed images considering the importance of each segment of the images in people re-identification. The proposed re-identification system is evaluated using VIPeR and PRID450s datasets, where it respectively achieves 61.9% and 83.4% rank-1 matching rates. Experimental results show that our proposed approach outperforms other existing approaches in people re-identification.

Tài liệu tham khảo

Berwick D, Lee S (1998) A chromaticity space for specularity, illumination color- and illumination pose-invariant 3-D object recognition. 6th International Conference on Computer Vision. Bombay, pp. 165–170 Bosch A, Zisserman A, Munoz X (2007) Representing shape with a spatial pyramid kernel. In Proceedings of the 6th ACM international conference on image and video retrieval. Amsterdam, pp. 401–408 Bromley J, Bentz JW, Bottou L, Guyon I, LeCun Y, Moore C, Sackinger E, Shah R (1993) Signature verification using a “Siamese” time delay neural network. Int J Pattern Recognit Artif Intell 7(4):669–688 Cao Z, Simon T, Wei SE, Sheikh Y (2017) Realtime multi-person 2d pose estimation using part affinity fields. In: Proceedings of the IEEE conference on computer vision and pattern recognition. Honolulu, pp 7291–7299 Chu H, Qi M, Liu H, Jiang J (2019) Local region partition for person re-identification. Multimed Tools Appl 78:27067–27083 Delac K, Grgic M, Grgic CS. (2005) Statistics in face recognition: analyzing probability distributions of PCA, ICA and LDA performance results. In: ISPA 2005. Proceedings of the 4th IEEE International Symposium on Image and Signal Processing and Analysis. Zagreb, pp. 289–294 Feizi A (2019) Convolutional gating network for object tracking. Int J Eng 32(7):931–939 Finlayson G, Drew M, Funt B (1993) Diagonal transforms suffice for color constancy. 4th International Conference on Computer Vision. Berlin, pp 164–171 Finlayson G, Drew M, Funt B (1994) Spectral sharpening: sensor transformations for improved color Constancy. J Optic Soc Am A 11(5):1553–1563 Gray D, Tao H (2008) Viewpoint invariant pedestrian recognition with an ensemble of localized features. In: European Conference on Computer Vision. Springer, Berlin, pp 262–275 Guo R, Li CG, Li Y, Lin J, Guo J (2020) Density-adaptive kernel based efficient reranking approaches for person reidentification. Neurocomputing 411:91–111 Harel J, Koch C, Perona P (2007) Graph-based visual saliency. In: Advances in neural information processing systems. Vancouver, pp 545–552 He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Las Vegas, pp. 770–778 Huang H, Li D, Zhang Z, Chen X, Huang K (2018) Adversarially occluded samples for person re-identification. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Salt Lake City, pp 5098–5107 Jia J, Ruan Q, Jin Y, An G, Ge S (2020) View-specific subspace learning and re-ranking for semi-supervised person re-identification. Pattern Recogn 108:107568 Kong J, Teng Z, Jiang M, Huo H (2020) Video-based person re-identification with parallel spatial–temporal attention module. J Electron Imaging 29(1):013001 Kviatkovsky I, Adam A, Rivlin E (2012) Color invariants for person reidentification. IEEE Trans Pattern Anal Mach Intell 35(7):1622–1634 Leng Q (2018) Co-metric learning for person re-identification. Adv Multimed. https://doi.org/10.1155/2018/3586191 Li P, Wang Q, Zhang L (2013) A novel earth mover’s distance methodology for image matching with gaussian mixture models. In: Proceedings of the IEEE International Conference on Computer Vision. Sydney, (pp 1689–1696) Liao S, Zhao G, Kellokumpu V, Pietikäinen M, Li SZ (2010) Modeling pixel process with scale invariant local patterns for background subtraction in complex scenes. In: 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. San Francisco, pp 1301–1306 Liao S, Hu Y, Zhu X, Li SZ (2015) Person re-identification by local maximal occurrence representation and metric learning. In: Proceedings of the IEEE conference on computer vision and pattern recognition. Boston, pp 2197–2206 Liu Y, Zhang Y, Coleman S, Bhanu B, Liu S (2020) A new patch selection method based on parsing and saliency detection for person re-identification. Neurocomputing 374:86–99 Lovri’c M, Min-Oo M, Ruh EA (2000) Multivariate normal distributions parametrized as a Riemannian symmetric space. J Multivar Anal 74(1):36–48 Matsukawa T, Suzuki E (2016) Person re-identification using CNN features learned from combination of attributes. In: 2016 23rd International Conference on Pattern Recognition (ICPR). Cancun, pp 2428–2433 Matsukawa T, Okabe T, Suzuki E, Sato Y (2016) Hierarchical gaussian descriptor for person re-identification. In: Proceedings of the IEEE conference on computer vision and pattern recognition. Las Vegas, pp. 1363–1372. Matsukawa T, Okabe T, Suzuki E, Sato Y (2019) Hierarchical gaussian descriptors with application to person re-identification. IEEE Trans Pattern Anal Mach Intell 42(9):2179–2194 Miao J, Wu Y, Liu P, Ding Y, Yang Y (2019) Pose-guided feature alignment for occluded person re-identification. In: Proceedings of the IEEE International Conference on Computer Vision. Seoul, pp 542–551 Mortezaie Z, Hassanpour H (2019) A survey on age-invariant face recognition methods. Jordan J Comput Inform Technol (JJCIT) 5(02):87–96 Prates R, Schwartz WR (2019) Kernel cross-view collaborative representation based classification for person re-identification. J Vis Commun Image Represent 58:304–315 Prates R, Schwartz WR (2019) Matching people across surveillance cameras. In: Anais Estendidos da XXXII Conference on Graphics, Patterns and Images. SBC, pp. 84–90 Ren QQ, Tian WD, Zhao ZQ (2019) Person re-identification based on feature fusion. In: International Conference on Intelligent Computing. Springer, Cham, pp 65–73 Roth PM, Hirzer M, Köstinger M, Beleznai C, Bischof H (2014) Mahalanobis distance learning for person re-identification. In: Advances in computer vision and pattern recognition. Springer, London, pp 247–267 Sadatnejad K, Shiry Ghidari S, Rahmati M (2018) A geometry preserving kernel over Riemannian manifolds. J AI Data Min 6(2):321–334 Tian M, Yi S, Li H, Li S, Zhang X, Shi J, Yan J, Wang X (2018) Eliminating background-bias for robust person re-identification. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Salt Lake City, pp. 5794–5803 Vishwakarma DK, Upadhyay S (2018) A deep structure of person re-identification using multi-level gaussian models. IEEE Trans Multi-Scale Comput Syst 4(4):513–521 Wang GA, Yang S, Liu H, Wang Z, Yang Y, Wang S, Yu G, Zhou E, Sun J (2020) High-order information matters: learning relation and topology for occluded person re-identification. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Seattle, pp 6449–6458 Xu Y, Fang X, Wu J, Li X, Zhang D (2015) Discriminative transfer subspace learning via low-rank and sparse representation. IEEE Trans Image Process 25(2):850–863 Yang Y, Yang J, Yan J, Liao S, Yi D, Li SZ (2014) Salient color names for person re-identification. In: European Conference on Computer Vision. Springer, Cham, pp 536–551 Yao H, Zhang S, Hong R, Zhang Y, Xu C, Tian Q (2019) Deep representation learning with part loss for person re-identification. IEEE Trans Image Process 28(6):2860–2871 Zhang X, Yan Y, Xue JH, Hua Y, Wang H (2020) Semantic-aware occlusion-robust network for occluded person re-identification. IEEE Trans Circ Syst Video Technol 31(7):2764–2778 Zhang Z, Lan C, Zeng W, Jin X, Chen Z (2020) Relation-aware global attention for person re-identification. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Seattle, pp. 3186–3195 Zhao R, Ouyang W, Wang X (2014) Learning mid-level filters for person re-identification. In: Proceedings of the IEEE conference on computer vision and pattern recognition. Columbus, pp. 144–151 Zhao R, Oyang W, Wang X (2016) Person re-identification by saliency learning. IEEE Trans Pattern Anal Mach Intell 39(2):356–370 Zhao H, Tian M, Sun S, Shao J, Yan J, Yi S, Wang X, Tang X (2017) Spindle net: person re-identification with human body region guided feature decomposition and fusion. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Honolulu, pp 1077–1085 Zhao C, Wang X, Zuo W, Shen F, Shao L, Miao D (2020) Similarity learning with joint transfer constraints for person re-identification. Pattern Recogn 97:107014 Zhou Q, Fan H, Zheng S, Su H, Li X, Wu S, Ling H (2018) Graph correspondence transfer for person re-identification. In: Thirty-second AAAI Conference on Artificial Intelligence (AAAI-18). New Orleans, pp 7599–7606 Zhou Q, Fan H, Yang H, Su H, Zheng S, Wu S, Ling H (2019) Robust and efficient graph correspondence transfer for person re-identification. IEEE Trans Image Process 30:1623–1638 Zhu J, Zeng H, Huang J, Zhu X, Lei Z, Cai C, Zheng L (2020) Body symmetry and part-locality-guided direct nonparametric deep feature enhancement for person reidentification. IEEE Internet Things J 7(3):2053–2065 Zhuo J, Chen Z, Lai J, Wang G (2018) Occluded person re-identification. In: IEEE International Conference on Multimedia and Expo (ICME). San Diego, pp 1–6 Megrhi S, Jmal M, Souidene W, Beghdadi A (2016) Spatio-temporal action localization and detection for human action recognition in big dataset, Journal of Visual Communication and Image Representation, 41:375–390 Bouttefroy PLM, Bouzerdoum A, Phung SL, Beghdadi A (2009) Vehicle Tracking Using Projective Particle Filter, 6th IEEE International Conference on Advanced Video and Signal Based Surveillance, pp 7–12 Mortezaie Z, Hassanpour H, Beghdadi A (2021) A Color-Based Re-Ranking Process for People Re-Identification: Paper ID 21. 9th IEEE European Workshop on Visual Information Processing (EUVIP), pp. 1–5 Chen LC, Zhu Y, Papandreou G, Schroff F, Adam H (2018) Encoder-decoder with atrous separable convolution for semantic image segmentation. In Proceedings of the European conference on computer vision (ECCV), pp. 801–818 Parraga CA, Akbarinia A (2016) NICE: A computational solution to close the gap from colour perception to colour categorization. PloS one, 11(3), p.e0149538