Adaptive example-based super-resolution using kernel PCA with a novel classification approach

EURASIP Journal on Advances in Signal Processing - Tập 2011 - Trang 1-29 - 2011
Takahiro Ogawa1, Miki Haseyama1
1Graduate School of Information Science and Technology, Hokkaido University, Sapporo, Japan

Tóm tắt

An adaptive example-based super-resolution (SR) using kernel principal component analysis (PCA) with a novel classification approach is presented in this paper. In order to enable estimation of missing high-frequency components for each kind of texture in target low-resolution (LR) images, the proposed method performs clustering of high-resolution (HR) patches clipped from training HR images in advance. Based on two nonlinear eigenspaces, respectively, generated from HR patches and their corresponding low-frequency components in each cluster, an inverse map, which can estimate missing high-frequency components from only the known low-frequency components, is derived. Furthermore, by monitoring errors caused in the above estimation process, the proposed method enables adaptive selection of the optimal cluster for each target local patch, and this corresponds to the novel classification approach in our method. Then, by combining the above two approaches, the proposed method can adaptively estimate the missing high-frequency components, and successful reconstruction of the HR image is realized.

Tài liệu tham khảo

Park SC, Park MK, Kang MG: Super-resolution image reconstruction: A technical overview. IEEE Signal Proces Mag 2003,20(3):21-36. 10.1109/MSP.2003.1203207

Keys R: Cubic convolution interpolation for digital image processing. IEEE Trans Acoust Speech Signal Proces 1981,29(6):1153-1160. 10.1109/TASSP.1981.1163711

Oppenheim AV, Schafer RW: Discrete-Time Signal Processing. 2nd edition. Prentice Hall, New Jersey; 1999.

Baker S, Kanade S, Kanade T: Limits on super-resolution and how to break them. IEEE Trans Pattern Anal Mach Intell 2002,24(9):1167-1183. 10.1109/TPAMI.2002.1033210

Farsiu S, Robinson D, Elad M, Milanfar P: Advances and challenges in super-resolution. Int J Imaging Syst Technol 2004,14(2):47-57. 10.1002/ima.20007

van Ouwerkerk JD: Image super-resolution survey. Image Vis Comput 2006,24(10):1039-1052. 10.1016/j.imavis.2006.02.026

Jiji CV, Chaudhuri S, Chatterjee P: Single frame image super-resolution: should we process locally or globally? Multidimens Syst Signal Process 2007,18(2-3):123-125. 10.1007/s11045-007-0024-1

Hu Y, Shen T, Lam KM, Zhao S: A novel example-based super-resolution approach based on patch classification and the KPCA prior model. Comput Intell Secur 2008, 1: 6-11.

Hertzmann A, Jacobs CE, Oliver BC N, Salesin DH: Image analogies. Comput Graph (Proc Siggraph) 2001, 2001: 327-340.

Freeman WT, Pasztor EC, Carmichael OT: Learning low-level vision. Int J Comput Vis 2000, 40: 25-47. 10.1023/A:1026501619075

Freeman WT, Jones TR, Pasztor EC: Example-based super-resolution. IEEE Comput Graph Appl 2002,22(2):56-65. 10.1109/38.988747

Kanemura A, Maeda S, Ishii S: Sparse Bayesian learning of filters for efficient image expansion. IEEE Trans Image Process 2010,19(6):1480-1490.

Stephenson TA, Chen T: Adaptive Markov random fields for example-based super-resolution of faces. EURASIP J Appl Signal Process 2006, 2006: 225-225.

Wang Q, Tang X, Shum H: Patch based blind image super resolution. Proceedings of ICCV 2005 2005, 1: 709-716.

Li X, Lam KM, Qiu G, Shen L, Wang S: An efficient example-based approach for image super-resolution. Proceedings of ICNNSP 2008, 2008: 575-580.

Sun J, Zheng N, Tao H, Shum H: Image hallucination with primal sketch priors. Proceedings of IEEE CVPR '03 2003, 2: 729-736.

Jiji CV, Joshi MV, Chaudhuri S: Single-frame image super-resolution using learned wavelet coefficients. Int J Imaging Syst Technol 2004,14(3):105-112. 10.1002/ima.20013

Jiji CV, Chaudhuri S: Single-frame image super-resolution through contourlet learning. EURASIP J Appl Signal Process 2006,2006(10):1-11.

Wang X, Trang X: Hallucinating face by eigentransformation. IEEE Trans Syst Man Cybern 2005,35(3):425-434. 10.1109/TSMCC.2005.848171

Chakrabarti A, Rajagopalan AN, Chellappa R: Super-resolution of face images using kernel PCA-based prior. IEEE Trans Multimedia 2007,9(4):888-892.

Schölkopf B, Smola A, Müller KR: Nonlinear principal component analysis as a kernel eigen value problem. Neural Comput 1998, 10: 1299-1319. 10.1162/089976698300017467

Schölkoph B, Mika S, Burges C, Knirsch P, Müller KR, Rätsch G, Smola A: Input space versus feature space in kernel-based methods. IEEE Trans Neural Netw 1999,10(5):1000-1017. 10.1109/72.788641

Chaudhuri S, Joshi MV: Motion-Free Super-Resolution. Springer, New York; 2005.

Turk M, Pentland A: Eigenfaces for recognition. J Cogn Neurosci 1991, 3: 71-86. 10.1162/jocn.1991.3.1.71

Bishop C, Blake A, Marthi B: Super-resolution enhancement of video. In Proceedings of 9th International Workshop on Artificial Intelligence and Statistics (AISTATS '03). Key West; 2003.

Kim KI, Kwon Y: Example-based learning for single-image super-resolution. Proceedings of the 30th DAGM Symposium on Pattern Recognition. Lecture Notes in Computer Science 2008, 456-465.

Kim KI, Schölkopf B: Iterative kernel principal component analysis for image modeling. IEEE Trans Pattern Anal Mach Intell 2005,27(9):1351-1366.

Ogawa T, Haseyama M: Missing intensity interpolation using a kernel PCA-based POCS algorithm and its applications. IEEE Trans Image Process 2011,20(2):417-432.

Datsenko D, Elad M: Example-based single document image super-resolution: a global MAP approach with outlier rejection. Multidimens Syst Signal Process 2007,18(2-3):103-121. 10.1007/s11045-007-0018-z

Elad M, Datsenko D: Example-based regularization deployed to super-resolution reconstruction of a single image. Comput J 2009, 52: 15-30.

Kwok JTY, Tsang IWH: The pre-image problem in kernel methods. IEEE Trans Neural Netw 2004,15(6):1517-1525. 10.1109/TNN.2004.837781

Wang Z, Bovik AC, Sheikh HR, Simoncelli EP: Image quality assessment: from error visibility to structural similarity. IEEE Trans Image Process 2004,13(4):600-612. 10.1109/TIP.2003.819861

Avcbas I, Sankur B, Sayood K: Statistical evaluation of image quality measures. J Elec Imaging 2003,11(2):206-223.

Staelin C, Greig D, Fischer M, Maurer R: Neural network image scaling using spatial errors. Technical Report (HP Laboratories, Israel) 2003.

Thông tin
Thông tin xuất bản

EURASIP Journal on Advances in Signal Processing

Tập 2011

1-29

Thông tin tác giả