PEN-DS: progressive enhancement network based on detail supplementation for low-light image enhancement
International Journal of Machine Learning and Cybernetics - Trang 1-16 - 2023
Tóm tắt
Images captured in low-light environments suffer from severe degradation, which can be unfavorable for human observation and subsequent computer vision tasks. Although many enhancement methods based on deep learning have been proposed, the obtained enhancement images still suffer from drawbacks such as color distortion, noise, and blur. To solve these problems, we propose a progressive enhancement network based on detail supplementation (PEN-DS), which is implemented by building two modules: an image preprocessing module (IPM) and a progressive image enhancement module (PIEM). The IPM can obtain low-light images and low-detail maps at different scales by building an image pyramid structure. PIEM can enhance images at different scales progressively based on detail supplementation and luminance enhancement. In addition, to better train the network, the proposed method employs a multi-supervised joint loss function for the enhanced images of different scales. Experimental results show that the proposed method outperforms state-of-the-art approaches in terms of visual observation and objective evaluation.
Tài liệu tham khảo
Wang W, Peng Y, Cao G, Guo X, Kwok N (2021) Low-illumination image enhancement for night-time UAV pedestrian detection. IEEE Trans Industr Inf 17(8):5208–5217
Lore KG, Akintayo A, Sarkar S (2017) LLNet: A deep autoencoder approach to natural low-light image enhancement. Pattern Recogn 61:650–662
Wei C, Wang W, Yang W, Liu J (2018) Deep retinex decomposition for low-light enhancement. In: British Machine Vision Conference
Jiang Y, Gong X, Liu D (2021) EnlightenGAN: deep light enhancement without paired supervision. IEEE Trans Image Process 30:2340–2349
Wang L, Liu Z, Siu W, Lun DPK (2020) Lightening network for low-light image enhancement. IEEE Trans Image Process 29:7984–7996
Liu M, Tang L, Zhong S, Luo H, Peng J (2021) Learning noise-decoupled affine models for extreme low-light image enhancement. Neurocomputing 448:21–29
Jiang Z, Li H, Liu L, Men A, Wang H (2021) A switched view of Retinex: deep self-regularized low-light image enhancement. Neurocomputing 454:361–372
Zamir SW, Arora A, Khan S, Khan FS, Shao L (2021) Learning digital camera pipeline for extreme low-light imaging. Neurocomputing 452:37–47
Yang W, Wang S, Fang Y, Wang Y, Liu J (2021) Band representation-based semi-supervised low-light image enhancement: bridging the gap between signal fidelity and perceptual quality. IEEE Trans Image Process 30:3461–3473
Thomas G, Flores-Tapia D, Pistorius S (2011) Histogram specification: a fast and flexible method to process digital images. IEEE Trans Instrum Meas 60(5):1565–1578
Celik T, Tjahjadi T (2011) Contextual and variational contrast enhancement. IEEE Trans Image Process 20(12):3431–3441
Huang S, Cheng F, Chiu Y (2013) Efficient contrast enhancement using adaptive gamma correction with weighting distribution. IEEE Trans Image Process 22(3):1032–1041
Lee C, Lee C, Kim C (2013) Contrast enhancement based on layered difference representation of 2D histograms. IEEE Trans Image Process 22(12):5372–5384
Abdullah-Al-Wadud M, Kabir MH, Dewan MAA, Chae O (2007) A dynamic histogram equalization for image contrast enhancement. IEEE Trans Consum Electr 53(2)
Ren W, Liu S, Ma L (2019) Low-light image enhancement via a deep hybrid network. IEEE Trans Image Process 28(9):4364–4375
Wang J, Lu K, Xue J, He N, Shao L (2018) Single image dehazing based on the physical model and MSRCR algorithm. IEEE Trans Circuits Syst Video Technol 28(9):2190–2199
Jobson DJ, Rahman Z, Woodell GA (1997) Properties and performance of a center/surround retinex. IEEE Trans Image Process 6(3):451–462
Jobson DJ, Rahman Z, Woodell GA (1997) A multiscale retinex for bridging the gap between color images and the human observation of scenes. IEEE Trans Image Process 6(7):965–976
Rahman Z, Jobson DJ, Woodell GA (1996) Multi-scale retinex for color image enhancement, In: Proceedings of 3rd IEEE International Conference on Image Processing, pp 1003–1006
Guo X, Li Y, Ling H (2017) LIME: Low-light image enhancement via illumination map estimation. IEEE Trans Image Process 26(2):982–993
Li C, Guo C, Han L (2021) Low-light image and video enhancement using deep learning: a survey. IEEE Trans Pattern Anal Mach Intell. https://doi.org/10.1109/TPAMI.2021.3126387
Guo C, Li C, Guo J (2020) Zero-reference deep curve estimation for low-light image enhancement. IEEE/CVF Confer Comp Vis Pattern Recogn (CVPR) 2020:1777–1786
Woo S, Park J, Lee JY, Kweon IS (2018) CBAM: convolutional block attention module. In: European Conference on Computer Vision (ECCV), pp 3–19
Hu J, Shen L, Albanie S, Sun G, Wu E (2020) Squeeze-and-excitation networks. IEEE Trans Pattern Anal Mach Intell 42(8):2011–2023
Girshick R (2015) Fast R-CNN. In: 2015 IEEE International Conference on Computer Vision (ICCV), pp 1440–1448
Lim S, Kim W (2021) DSLR: deep stacked laplacian restorer for low-light image enhancement. IEEE Trans Multimedia 23:4272–4284
Lv F, Li Y, Lu F (2021) Attention guided low-light image enhancement with a large scale low-light simulation dataset. Int J Comput Vision 129(7):2175–2193
Johnson J, Alahi A, Fei-Fei L (2016) Perceptual losses for real-time style transfer and super-resolution. In: Proceedings of the European Conference on Computer Vision (ECCV), pp 694–711
Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. arXiv:1409.1556
Wang Z, Bovik AC, Sheikh HR, Simoncelli EP (2004) Image quality assessment: from error visibility to structural similarity. IEEE Trans Image Process 13(4):600–612
Wang S, Zheng J, Hu H-M, Li B (2013) Naturalness preserved enhancement algorithm for non-uniform illumination images. IEEE Trans Image Process 22(9):3538–3548
Ying Z, Li G, Gao W (2017) A bio-inspired multi-exposure fusion framework for low-light image enhancement. arXiv:1711.00591
Dong X, Wang G, Pang Y, Li W, Wen J, Meng W, Lu Y (2011) Fast efficient algorithm for enhancement of low lighting video. In: Proceedings of the IEEE International Conference on Multimedia and Expo, pp 1–6
Fu X, Zeng D, Huang Y, Liao Y, Ding X, Paisley J (2016) A fusion-based enhancing method for weakly illuminated images. Signal Process 129:82–96
Fu X, Zeng D, Huang Y, Zhang XP, Ding X (2016) A weighted variational model for simultaneous reflectance and illumination estimation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 2782–2790
Wang W, Wei C, Yang W, Liu J (2018) Gladnet: low-light enhancement network with global awareness. In: 2018 13th IEEE International Conference on Automatic Face & Gestur Recognition (FG 2018), pp 751–755
Zhang Y, Zhang J, Guo X (2019) Kindling the darkness: a practical low-light image enhancer. In: Proceedings of the 27th ACM International Conference on Multimedia, pp 1632–1640
Yang W, Wang W, Huang H, Wang S, Liu J (2021) Sparse gradient regularized deep retinex network for robust low-light image enhancement. IEEE Trans Image Process 30:2072–2086
Horé A, Ziou D (2010) Image quality metrics: PSNR vs. SSIM. In: 2010 20th International Conference on Pattern Recognition, pp 2366–2369
Ma L, Liu R, Wang Y, Fan X, Luo Z (2022) Low-light image enhancement via self-reinforced retinex projection model. IEEE Trans Multimedia. https://doi.org/10.1109/TMM.2022.3162493
Zhang L, Zhang L, Mou X, Zhang D (2011) FSIM: a feature similarity index for image quality assessment. IEEE Trans Image Process 20(8):2378–2386
Zhang R, Isola P, Efros AA, Shechtman E, Wang O (2018) The unreasonable effectiveness of deep features as a perceptual metric. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp 586–595
Kaiming H, Georgia G, Piotr D, Ross G (2017) Mask R-CNN. In: IEEE International Conference on Computer Vision (ICCV), pp 2961–2969