Removal of achromatic reflections from a single color image
Tóm tắt
In this paper we consider the problem of removing achromatic reflections from a picture of a scene taken through a semi-transparent medium, assuming that the reflection pattern is due to a light source or another object located in front of the object of interest. While other works assume the availability of multiple observations, we consider the more challenging problem of having as data a single color image. We suppose a data model where the virtual reflected image combines additively with the real transmitted image of the object, through unknown coefficients. This highly underdetermined problem is handled by means of a blind estimation technique that exploits the strict dependence of the gradients of the three color channels of the ideal image, and their independence from the gradient of the grayscale reflected image. The model parameters are estimated through independent component analysis, and then the component images are estimated through a regularization technique. The whole algorithm is very fast, and its performance is quantitatively evaluated on numerically generated images, and qualitatively tested on real images.
Tài liệu tham khảo
T. Cronin, N. Shashar, and L. Wolff, “Portable imaging polarimeters,” in Proc. ICPR (1994), Vol. A, pp. 606–609.
K. Nayar, X. Fang, and T. Boult, “Separation of reection components using color and polarization,” Int. J. Comput. Vis. 21, 163–186 (1997).
H. Fujikake, K. Takizawa, T. Aida, H. Kikuchi, T. Fujii, and M. Kawakita, “Electrically-controllable liquid crystal polarizing filter for eliminating reected light,” Opt. Rev. 5, 93–98 (1998).
Y. Schechner, J. Shamir, and N. Kiryati, “Polarizationbased decorrelation of transparent layers: the inclination angle of an invisible surface,” in Proc. Int. Conf. on Computer Vision (Kerkyra, 1999), pp. 814–819.
“Polarization and statistical analysis of scenes containing a semireector,” J. Opt. Soc. Am. A 17, 276–284 (2000).
M. Born and E. Wolf, Principles of Optics (Pergamon, London, 1965).
H. Farid and E. Adelson, “Separating reections and lighting using independent components analysis,” in Proc. CVPR (Ft. Collins, CO, 1999), Vol. 1, pp. 262–267.
A. Bronstein, M. Bronstein, M. Zibulevsky, and Y. Zeevi, “Sparse ICA for blind separation of transmitted and reected images,” Int. J. Imag. Syst. Technol. 15, 84–91 (2005).
E. Beery and A. Yeredor, “Blind separation of reections with relative spatial shifts,” in Proc. ICASSP (Toulouse, 2006), Vol. 5, pp. 625–628.
K. Gai, Z. Shi, and C. Zhang, “Blindly separating mixtures of multiple layers with spatial shifts,” in Proc. CVPR 2008 (Anchorage, 2008), pp. 1–8.
“Blind separation of superimposed images with unknown motions,” in Proc. CVPR 2009 (Miami, 2009), pp. 1881–1888.
X. Guo, X. Cao, and Y. Ma, “Robust separation of reection from multiple images,” in Proc. Int. Conf. on Computer Vision and Pattern Recognition (CVPR) (Columbus, OH, 2014).
N. Kong, Y.-W. Tai, and J. Shin, “A physically-based approach to reection-separation: from physical modeling to constrained optimization,” IEEE Trans. Pattern Anal. Mach. Intellig. 36, 209–221 (2014).
Y. Shih, D. Krishnan, F. Durand, and W. Freeman, “Reection removal using ghosting cues,” in Proc. IEEE Conf. on Computer Vision and Pattern Recognition (CVPR) (Boston, MA, June 2015).
A. Levin, A. Zomet, and Y. Weiss, “Separating reections from a single image using local features,” in Proc. ECCV 2004 (Prague, 2004), pp. 306–313.
A. Levin and Y. Weiss, “User assisted separation of reections from a single image using a sparsity prior,” IEEE Trans. Pattern Anal. Mach. Intellig. 29, 1647–1655 (2007).
K. Kayabol, E. Kuruoglu, and B. Sankur, “Image source separation using color channel dependencies,” in Proc. 8th Int. Conf. on Independent Component Analysis and Signal Separation (Paraty, 2009), pp. 499–506.
B. Sarel and M. Irani, “Separating transparent layers through layer information exchange,” in Proc. ECCV 2004, Ser. LNCS, Ed. by T. Pajdla and J(G.) Matas (Springer, Heidelberg, 2004), Vol. LNCS 3024, pp. 328–341.
Q. Yan, E. E. Kuruoglu, X. Yang, Y. Xu, and K. Kayabol, “Separating reections from a single image using spatial smoothness and structure information,” in Proc. LVA/ICA 2010, Ser. Lecture Notes in Computer Science, (Springer, 2010), Vol. LNCS 6365, pp. 637–644.
L. Bedini, P. Savino, and A. Tonazzini, “Removing achromatic reections from color images with application to artwork imaging,” in Proc. 9th IEEE Int. Symp. on Image and Signal Processing and Analysis (ISPA 2015) (Zagreb, 2015), pp. 126–130.
A. Hyvärinen, “Fast and robust fixed-point algorithms for independent component analysis,” IEEE Trans. Neural Networks 10 (3), 626–634 (1999).