No-reference image blur assessment using multiscale gradient
Tóm tắt
The increasing number of demanding consumer video applications, as exemplified by cell phone and other low-cost digital cameras, has boosted interest in no-reference objective image and video quality assessment (QA) algorithms. In this paper, we focus on no-reference image and video blur assessment. We consider natural scenes statistics models combined with multi-resolution decomposition methods to extract reliable features for QA. The algorithm is composed of three steps. First, a probabilistic support vector machine (SVM) is applied as a rough image quality evaluator. Then the detail image is used to refine the blur measurements. Finally, the blur information is pooled to predict the blur quality of images. The algorithm is tested on the LIVE Image Quality Database and the Real Blur Image Database; the results show that the algorithm has high correlation with human judgments when assessing blur distortion of images.
Tài liệu tham khảo
Wang Z, Bovik AC, Sheikh HR, Simoncelli EP: Image quality assessment: from error visibility to structural similarity. IEEE Trans Image Process 2004, 13(4):600-612. 10.1109/TIP.2003.819861
Wang Z, Simoncelli EP, Bovik AC: Multi-scale structural similarity for image quality assessment. IEEE Asilomar Conf. Signals, Systems, and Computers 2003, 1398-1402.
Sheikh HR, Bovik AC: Image information and visual quality. IEEE Trans Image Process 2006, 15(2):430-444.
Chandler DM, Hemami SS: VSNR: a wavelet-based visual signal-to-noise ratio for natural images. IEEE Trans Image Process 2007, 16(9):2284-2298.
Caviedes JE, Gurbuz S: No-reference sharpness metric based on local edge kurtosis. IEEE International Conference on Image Processing, Rochester, NY 2002.
Marziliano P, Dufaux F, Winkler S, Ebrahimi T: A no-reference perceptual blur metric. International Conference on Image Processing, Rochester, NY 2002.
Marziliano P, Dufaux F, Winkler S, Ebrahimi T: Perceptual blur and ringing metrics: application to JPEG2000. Signal Process Image Commun 2004, 19(2):163-172. 10.1016/j.image.2003.08.003
Chung Y, Wang J, Bailey R, Chen S, Chang S: A nonparametric blur measure based on edge analysis for image processing applications. IEEE Conf Cybern Intell Syst 2004, 1: 356-360.
Narvekar ND, Karam LJ: A no-reference perceptual image sharpness metric based on a cumulative probability of blur detection. International Workshop on Quality of Multimedia Experience 2009.
Narvekar ND, Karam LJ: A no-reference image blur metric based on the cumulative probability of blur detection (CPBD). IEEE Trans Image Process 2011, in press.
Ferzli R, Karam LJ: A human visual system based no-reference objective image sharpness metric. IEEE International Conference on Image Processing, Atlanta, GA 2006.
Ferzli R, Karam LJ: A no-reference objective mage sharpness metric based on just-noticeable blur and probability summation. IEEE International Conference on Image Processing, San Antonio, TX 2007.
Varadarajan S, Karam LJ: An improved perception-based no-reference objective image sharpness metric using iterative edge refinement. IEEE International Conference on Image Processing, Chicago, IL 1998.
Marichal X, Ma WY, Zhang H: Blur determination in the compressed domain using DCT information. IEEE International Conference on Image Processing, Kobe, Japan 1999.
Tong H, Li M, Zhang H, Zhang C: Blur detection for digital images using wavelet transform. IEEE International Conference on Multimedia and EXPO 2004, 1: 17-20.
Ciancio A, Targino AN, da Silva EAB, Said A, Obrador P, Samadani R: Objective no-reference image quality metric based on local phase coherence. IET Electron Lett 2009, 45(23):1162-1163. 10.1049/el.2009.1800
Wang Z, Simoncelli EP: Local phase coherence and the perception of blur. In Advances in Neural Information Processing Systems. MIT Press, Cambridge; 2004:786-792.
Chen Y, Geisler WS, Seidemann E: Optimal decoding of correlated neural population responses in the primate visual cortex. Nat. Neurosci 2006, 9: 1412-1420.
Narwaria M, Lin W: Objective image quality assessment based on support vector regression. IEEE Trans Neural Netw 2010, 21(3):515-519.
Ciancio A, Targino da Costa ALN, da Silva EAB, Said A, Samadani R, Obrador P: No-reference blur assessment of digital pictures based on multi-feature classifiers. IEEE Trans Image Process 2011, 20(1):64-75.
Simoncelli EP: Statistical models for images: compression, restoration and synthesis. Proceeding of the IEEE Asilomar Conference on Signals, Systems, and Computers 1997.
Sheikh HR, Bovik AC, Cormack LK: No-reference quality assessment using natural scene statistics: JPEG2000. IEEE Trans Image Process 2005, 14(11):1918-1927.
Ruderman DL: The statistics of natural images. Netw Comput Neural Syst 1994, 5(4):517-548. 10.1088/0954-898X/5/4/006
Field D: What is the goal of sensory coding? Neural Comput 1994, 6: 559-601. 10.1162/neco.1994.6.4.559
Liu R, Li Z, Jia J: Image partial blur detection and classification. IEEE International Conference on Computer Vision Pattern Recognition 2008, 1-8.
Levin A: Blind motion deblurring using image statistics. Neural Information Processing Systems (NIPS) 2006, 841-848.
LIBSVM[http://www.csie.ntu.edu.tw/~cjlin/libsvm/]
Abdelnour AF, Selesnick IW: Nearly symmetric orthogonal wavelet bases. IEEE International Conference on Acoustic, Speech, Signal Processing (ICASSP) 2001.
Teo PC, Heeger DJ: Perceptual image distortion. IEEE International Conference on Image Processing, Austin, TX 1994.
Taylor CC, Pizlo Z, Allebach JP, Bouman CA: Image quality assessment with a Gabor pyramid model of the human visual system. SPIE Conference on Human Vision and Electronic Imaging, San Jose, CA 1997.
Seshadrinathan K, Bovik AC: Motion tuned spatio-temporal quality assessment of natural videos. IEEE Trans Image Process 2010, 19(2):335-350.
Lee S, Pattichis MS, Bovik AC: Foveated video quality assessment. IEEE Trans Multimedia 2002, 4(1):129-132. 10.1109/6046.985561
Wang Z, Bovik AC, Lu L, Kouloheris J: Foveated wavelet image quality index. SPIE's 46th Annual Meeting, Proceedings of SPIE, Application of digital image processing 2001, XXIV: 4472.
Cormack LK: Computational models of early human vision. In The Handbook of Image and Video Processing. Edited by: Bovik AC. Academic Press; 2000.
Mark F: Color Appearance Models. Addison-Wesley, Boston; 1998:7.
Sheikh HR, Wang Z, Cormack LK, Bovik AC: LIVE image quality assessment database. Release 2 [http://live.ece.utexas.edu/research/quality/subjective.htm]
BID--blurred image database[http://www.lps.ufrj.br/profs/eduardo/ImageDatabase.htm]
Wang Z, Wu G, Sheikh HR, Simoncelli EP, Yang EH, Bovik AC: Quality-aware images. IEEE Trans Image Process 2006, 15(5):1680-1689.