A packet-layer video quality assessment model with spatiotemporal complexity estimation
Tóm tắt
A packet-layer video quality assessment (VQA) model is a lightweight model that predicts the video quality impacted by network conditions and coding configuration for application scenarios such as video system planning and in-service video quality monitoring. It is under standardization in ITU-T Study Group (SG) 12. In this article, we first differentiate the requirements for VQA model from the two application scenarios, and state the argument that the dataset for evaluating the quality monitoring model should be more challenging than that for system planning model. Correspondingly, different criteria and approaches are used for constructing the test datasets, for system planning (dataset-1) and for video quality monitoring (dataset-2), respectively. Further, we propose a novel video quality monitoring model by estimating the spatiotemporal complexity of video content. The model takes into account the interactions among content features, the error concealment effectiveness, and error propagation effects. Experiment results demonstrate that the proposed model achieves robust performance improvement compared with the existing peer VQA metrics on both dataset-1 and dataset-2. It is noted that on the more challenging dataset-2 for video quality monitoring, we obtain a large increase in Pearson correlation from 0.75 to 0.92 and a decrease in the modified RMSE from 0.41 to 0.19.
Tài liệu tham khảo
Takahashi A, Hands D, Barriac V: Standardization activities in the ITU for a QoE assessment of IPTV. IEEE Commun Mag 2008, 46(2):78-84.
ITU-T document, Draft terms of reference (ToR) for P.NAMS2009. [http://www.itu.int/md/meetingdoc.asp?lang=en%26;parent=T09-SG12-091103-TD-GEN-0146]
ITU-T document, Draft Terms of Reference (ToR) for P.NBAMS2009. [http://www.itu.int/md/T09-SG12-110118-TD-GEN-0521]
Rui H, Li C, Qiu S: Evaluation of packet loss impairment on streaming video. J Zhejiang Univ Sci 2006, A7: 131-136.
Reibman AR, Vaishampayan VA, Sermadevi Y: Quality monitoring of video over a packet network. IEEE Trans Multimedia 2004, 6(2):327-334. 10.1109/TMM.2003.822785
Yamagishi K, Hayashi T: Video-quality planning model for videophone services. Inf Media Technol 4(1):1-9.
Mohamed S, Rubino G: A study of real-time packet video quality using random neural networks. IEEE Trans Circ Syst Video Technol 2002, 12(12):1071-1083. 10.1109/TCSVT.2002.806808
Yamagishi K, Hayashi T: Parametric packet-layer model for monitoring video quality of IPTV services. IEEE International Conference on Communications 2008, 110-114.
Raake A, Garcia M-N, Moller S, Berger J, Kling F, List P, Johann J, Heidemann C: T-V-model: parameter-based prediction of IPTV quality. Proc ICASSP 2008, 1149-1152.
Kanumuri S, Cosman PC, Reibman AR, Vaishampayan VA: Modeling packet loss visibility in MPEG-2 video. IEEE Trans Multimedia 2006, 8(2):341-355.
Reibman AR, Poole D: Predicting packet-loss visibility using scene characteristics. Proceedings of the International Workshop in Packet Video 2007, 308-317.
Yamada T, Miyamoto Y, Serizawa M: No-reference video quality estimation based on error-concealment effectiveness. IEEE Packet Video Workshop 2007, 288-293.
Suresh N: Mean time between visible artifacts in visual communications. PhD thesis, Georgia Institute of Technology 2007.
Winkler S, Dufaux F: Video quality evaluation for mobile applications. Proc VCIP 2003, 593-603.
Winkler S, Mohandas P: The evolution of video quality measurement: from PSNR to hybrid metrics. IEEE Trans Broadcast 2008, 54(3):660-668.
ITU-T Rec. P.910, Subjective video quality assessment methods for multimedia applications Geneva; 2008.
Simone FD, Naccari M, Tagliasacchi M, Dufaux F, Tubaro S, Ebrahimi T: Subjective assessment of H.264/AVC video sequences transmitted over a noisy channel. Proc International Workshop on Quality of Multimedia Experience (QoMEx) 2009, 204-209. [http://mmspl.epfl.ch/]
ITU-T document, Qualification test plan for P.NAMS[http://www.itu.int/md/meetingdoc.asp?lang=en%26;parent=T09-SG12-091103-TD-GEN-0150]
ITU-R Rec. BT.500-10, Methodology for the subjective assessment of the quality of the television pictures 2000.
Clark A: Method and system for viewer quality estimation of packet video streams.2009. [http://www.freepatentsonline.com/y2009/0041114.html]
Hayashi T, Masuda M, Tominaga T, Yamagishi K: Non-intrusive QoS monitoring method for realtime telecommunication services. NTT Tech Rev 2006, 4(4):35-40.