A novel clustering method for static video summarization
Tóm tắt
Static video summarization is recognized as an effective way for users to quickly browse and comprehend large numbers of videos. In this paper, we formulate static video summarization as a clustering problem. Inspired by the idea from high density peaks search clustering algorithm, we propose an effective clustering algorithm by integrating important properties of video to gather similar frames into clusters. Finally, all clusters’ center will be collected as static video summarization. Compared with existing clustering-based video summarization approaches, our work can detect frames which are highly relevant and generate representative clusters automatically. We evaluate our proposed work by comparing it with several state-of-the-art clustering-based video summarization methods and some classical clustering algorithms. The experimental results evidence that our proposed method has better performance and efficiency.
Tài liệu tham khảo
Almageed A, Online W (2008) Simultaneous shot boundary detection and key frame extraction for sports videos using rank tracing. In: Proceedings of IEEE International Conference of Image Processing pp. 3200–3203
Avila SEF, Lopes APB, Luz A Jr, Araújo AA (2011) Vsumm: a mechanism designed to produce static video summaries and a novel evaluation method. Pattern Recogn Lett 32:56–68
Ballan I, Bertini M, DelBimbo A, Seidenari L, Serra G (2011) Event detection and recognition for semantic annotation of video. Multimed Tools Appl 51:279–302
Chang IC, Chen KY (2007) Content-selection based video summarization. In: Proceeding of the Int Conf on Consumer Electronics pp. 1–2
Chang HS, Sull S, Lee SU (1999) Efficient video indexing scheme for content-based retrieval. IEEE T Circ Syst Vid 9:1269–1279
Chen YJ, Wu KS, Zhang Q (2015) From QoS to QoE: a tutorial on video quality assessment. IEEE Commun Surv Tutor 17:1126–1165
Chen L, Zhou YP, Chiu DM (2015) Analysis and detection of fake views in online video services. ACM T Multim Comput 23:1163–1175
Chen L, Zhou YP, Chiu DM (2015) Smart streaming for online video services. IEEE T Multimedia 17:485–497
Frey JB, Dueck D (2007) Clustering by passing messages between data points. Science 315:972–976
Gong Y, Liu X (2011) Video summarization with minimal visual content redundancies. In: Proceeding of the IEEE Int Conf on Image Processing pp. 362–365
Guan G, Wang Z, Lu S, Deng JD, Feng D (2013) Keypoint base keyframe selection. IEEE T Circ Syst Vid 23:729–734
Hanjalic A, Lagendijk RL, Biemond J (1998) A New Method for Key Frame based Video Content Representation. In: Proceeding of Image Databases and Multimedia Search
Liu JK, Au MH, Susilo W, Liang K, Lu RX, Srinivasan B (2015) Secure sharing and searching for real-time video data in mobile cloud. IEEE Netw 29:46–50
Liu C, Yuen J, Torralba A (2011) SIFT flow: dense correspondence across scenes and its applications. IEEE T Pattern Anal 33:978–994
Lowe DG (2004) Distinctive image features from scale-invariant key-points. Int J Comput Vision 60:91–110
Lu SY, Wang ZY, Mei T, Guan GL, Feng DD (2014) A bag-of-importance model with locality-constrained coding based feature learning for video summarization. IEEE T Multimedia 16:1497–1509
Luxburg UV (2007) A tutorial on spectral clustering. Stat Comput 4:395–416
MacQueen J (1967) Some methods for classification and analysis of multivariate observations. Proc Fifth Berkeley Symp Math Statistics Probability 1:281–297
Mei S, Guan G, Wang Z, Wan S, He M, Feng D (2015) Video summarization via minimum sparse reconstruction. Pattern Recogn 48:289–612
Mundur P, Rao Y, Yesha Y (2006) Keyframe-based video summarization using Delaunay clustering. Int J Digit Libr 6:219–232
Open video project. https://www.open-video.org
Ren TW, Qiu ZY, Liu Y, Yu T, Bei J (2015) Soft-assigned bag of features for object tracking. Multimedia Systems (MMSJ) 21(2):189–205
Rodriguez A, Laio A (2014) Clustering by fast search and find of density peaks. Science 344:1492–1496
Sivic J, Zisserman A (2009) Efficient visual search of videos cast as text retrieval. IEEE T Pattern Anal 31:591–605
Truong BT, Venkatesh S (2007) Video abstraction: a systematic review and classification. ACM T Multim Comput 3:1–37
YouTube statistics (2015). https://www.youtube.com/yt/press/statistics.html
Zhou YP, Chen L, Yang CF, Chiu DM (2015) Video popularity dynamics and its implication for replication. IEEE T Multimedia 17:1273–1285
Zhou YP, Fu TZJ, Chiu DM (2015) A unifying model and analysis of P2P VoD replication and scheduling. IEEE ACM T Network 23:1163–1175
Zhuang Y, Rui Y, Huang TS, Mehrotra S (1998) Adaptive keyframe extraction using unsupervised clustering. In: Proceedings of the International Conference on Image Processing pp. 866–870