Model-assisted content adaptive detail enhancement and quadtree decomposition for image visibility enhancement
Tóm tắt
In this work, a simple and unique, yet effective framework for visibility enhancement, using image decomposition, adaptive boundary constraint and quadtree-based dehazing, detail enhancement and fusion is proposed. The input image firstly undergoes image decomposition, to be split into its its ambient illumination and reflex lightness components. For increasing brightness and contrast, contrast-based enhancement algorithm is applied to the reflex lightness component and the ambient illumination component is dehazed through the application of atmospheric scattering model. In order to estimate the airlight, instead of using the whole image, a simple and efficient method based on quadtree decomposition is used. The transmission map is computed through contextual regularization using adaptive boundary constraints. The dehazed ambient illumination component is passed through detail enhancement for enhancement of sharp edges. The resultant image and the enhanced reflex lightness component are then combined together through fusion to obtain the final, artifact free, enhanced image with preserved colors and details. The proposed methodology is evaluated using numerous images and compared with 8 different state-of-the-art techniques. Visual and quantitative comparison of the proposed methodology with existing state-of-the-art techniques demonstrates the effectiveness of the proposed technique.
Tài liệu tham khảo
Cosar, S., Donatiello, G., Bogorny, V., Garate, C., Alvares, L., Bremond, F.: Toward abnormal trajectory and event detection in video surveillance. IEEE Trans. Circuits Syst. Video Technol. 27(3), 683–695 (2017)
Rosolia, U., Bruyne, S., Alleyne, A.: Autonomous vehicle control: a nonconvex approach for obstacle avoidance. IEEE Trans. Control Syst. Technol. 25(2), 469–484 (2017)
Lee, S., Yun, S., Nam, J.H., Won, C.S., Jung, S.W.: A review on dark channel prior based image dehazing algorithms. EURASIP J. Image Video Process. 2016(1), 5–23 (2016)
Xu, H., Zhai, G., Wu, X., Yang, X.: Generalized equalization model for image enhancement. IEEE Trans. Multimed. 16(1), 68–82 (2014)
Cai, W., Liu, Y., Li, M., Cheng, L., Zhang, C.: A self adaptive homomorphic filter method for removing thin cloud. In: International Conference on Geoinformatics, China, 24–26 June (2011)
Xu, Z., Liu, X., Chen, X.: Fog removal from video sequences using contrast limited adaptive histogram equalization.’ In: International Conference on Computational Intelligence and Software Engineering, China, pp. 11–13 (2009)
Thanh, L.T., Thanh, D.N., Hue, N.M., Prasath, V.B.: Single image dehazing based on adaptive histogram equalization and linearization of gamma correction. In: Asia Pacific Conference on Communications, Vietnam, 6–8 November (2019)
Schechner, Y., Narasimhan, S., Nayar, S.: Polarization-based vision through haze. Appl. opt. 42(3), 511–525 (2003)
Fattal, R.: Single image dehazing. ACM Trans on Graphics 27(3), 1–10 (2008)
Liu, W., Duan, J., Qiu, Z., Pan, Z., Liu, R., Bai, L.: Implementation of high order variational models made easy for image processing. Math. Methods Appl. Sci. 39(14), 4208–4233 (2016)
Liu, R.W., Xiong, S., Wu, H.: A second order variational framework for depth estimation and image dehazing. In: IEEE International Conference on Acoustics, Speech and Signal Processing, Canada, 15–20 April (2018)
Shu, Q., Wu, C., Zhong, Q., Liu, R.W.: Alternating minimization algorithm for hybrid regularized variational image dehazing. Optik 185, 943–956 (2019)
Colores, S.S., Aceves, I.C.: Single image dehazing using a multilayer perceptron. J. Electron. Imaging 27(4), 1 (2018)
Ren, W., Ma, L., Zhang, J., Pan, J., Cao, X., Liu, W., Yang, M.H.: Gated fusion network for single image dehazing. In: IEEE Conference on Computer Vision and Pattern Recognition, USA, 18–23 June (2018)
Kaul, K., Sehgal, S.: Single image dehazing using neural network. In: International Conference on Cloud Computing Data Science and Engineering, India, 29–31 January (2020)
Yuan, K., Wei, J., Lu, W., Xiong, N.: Single image dehazing via NIN-DehazeNet. IEEE Access 7, 181348–181356 (2019)
Li, B., Peng, X., Wang, Z., Xu, J., Feng, D.: Aod-net: All-in-one dehazing network. In: IEEE International Conference on Computer Vision, Italy, 22–29 October (2017)
Golts, A., Freedman, D., Elad, M.: Unsupervised single image dehazing using dark channel prior loss (2018). arXiv preprint arXiv:1812.07051
He, K., Sun, J., Tang, X.: Single image haze removal using dark channel prior. IEEE Trans. Pattern Anal. Mach. Intell. 33(12), 2341–2353 (2011)
Zhu, X., Li, Y., Qiao, Y.: Fast single image dehazing through edge guided interpolated filter. In: IAPR International Conference on Machine Vision Applications, Japan, 18–22 May (2015)
Meng, G., Wang, Y., Duan, J., Xiang, S., Pan, C.: Efficient image dehazing with boundary constraint and contextual regularization. In: IEEE International Conference on Computer Vision, Australia, 1–8 Dec (2013)
Lai, Y., Chen, Y., Chiou, C., Hsu, C.: Single-image dehazing via optimal transmission map under scene priors. IEEE Trans. Circuits Syst. Video Technol. 25(1), 1–14 (2015)
Long, J., Shi, Z., Tang, W., Zhang, C.: Single remote sensing image dehazing. IEEE Geo Sci. Remote Sens. Lett. 11(1), 59–63 (2014)
Ancuti, C.O., Ancuti, C.: Single image dehazing by multi-scale fusion. IEEE Trans. Image Process. 22(8), 3271–3282 (2013)
Wencheng, W., Yuan, X., Wu, X., Liu, Y.: Fast image dehazing method based on linear transformation. IEEE Trans. Multimed. 19(6), 2349–2362 (2017)
Baig, N., Riaz, M.M., Ghafoor, A., Siddiqui, A.M.: Image dehazing using quadtree decomposition and entropy-based contextual regularization. IEEE Signal Process. Lett. 23(6), 853–857 (2016)
Ding, M., Wei, L.: Single image haze removal using the mean vector l2-norm of RGB image sample window. Optik Int. J. Light Electron Opt. 126(3), 3522–3528 (2015)
Li, Z., Zheng, J.: Edge preserving decomposition based single image haze removal. IEEE Trans. Image Process. 24(12), 5432–5441 (2015)
Long, J., Shi, Z., Tang, W., Zhang, C.: Single remote sensing image dehazing. IEEE Geosci. Remote Sens. Lett. 11(1), 59–63 (2014)
Colores, S., Arreguin, J., Echeverri, C., Yepez, E., Ortega, J., Resendiz, J.: Image dehazing using morphological opening, dilation and Gaussian filtering. Signal Image Video Process. 12(7), 1329–1335 (2018)
Hassan, N., Ullah, S., Bhatti, N., Mahmood, H., Zia, M.: A cascaded approach for image defogging based on physical and enhancement models. Signal Image Video Process. 14, 867–875 (2020)
Chaudhry, A.M., Riaz, M.M., Ghafoor, A.: A framework for outdoor RGB image enhancement and dehazing. IEEE Geosci. Remote Sens. Lett. 15(6), 932–936 (2018)
He, R., Wang, Z., Xiong, H., Feng, D.: Single image dehazing with white balance correction and image decomposition. In: International Conference on Digital Image Computing Techniques and Applications (DICTA), Australia, 3–5 December (2012)
Li, B., Wang, S., Geng, Y.: Image enhancement based on retinex and lightness decomposition. In: IEEE International Conference on Image Processing, Belgium, 11–14 September (2011)
Singh, K., Kapoor, R.: Image enhancement using exposure based sub image histogram equalization. Pattern Recognit. Lett. 36, 10–14 (2014)
Kou, F., Chen, W., Li, Z., Wen, C.: Content adaptive image detail enhancement. IEEE Signal Process. Lett. 22(2), 211–215 (2015)
Hayat, N., Imran, M.: Ghost free multi exposure image fusion technique using dense SIFT descriptor and guided filter. J. Vis. Commun. Image Represent. 62, 295–308 (2019)
Galdran, A.: Image dehazing by artificial multiple-exposure image fusion. Signal Process. 149, 135–147 (2018)
Dhara, S.K., Roy, M., Sen, D., Biswas, P.K.: Color cast dependent image dehazing via adaptive airlight refinement and non-linear color balancing. IEEE Trans. Circuits Syst. Video Technol. 31(5), 2076–2081 (2020)
Lu, Z., Long, B., Yang, S.: Saturation based iterative approach for single image dehazing. IEEE Signal Process. Lett. 27, 665–669 (2020)
Zhao, X.: Single image dehazing using bounded channel difference prior. In: IEEE Conference on Computer Vision and Pattern Recognition, USA, 19–25 June (2021)
Matkovic, K., Neumann, L., Neumann, A., Psik, T., Purgathofer, W.: Global contrast factor-a new approach to image contrast. In; Computational Aesthetics in Graphics, Visualization and Imaging, Spain, 18–20 May (2005)
Mittal, A., Soundararajan, R., Bovik, A.C.: Making a completely blind image quality analyzer. IEEE Signal process. Lett. 22(3), 209–212 (2013)
Ni, W., Gao, X., Wang, Y.: Single satellite image dehazing via linear intensity transformation and local property analysis. Neurocomputing 175, 25–39 (2016)
Wang, Z., Bovik, A.C., Sheikh, H.R., Simoncelli, E.P.: Image quality assessment: from error visibility to structural similarity. IEEE Trans. Image Process. 13(4), 600–612 (2004)