Quality assessment of multi-exposure image fusion by synthesizing local and global intermediate references

Reinhard, 2006, High Dynamic Range Imaging: Acquisition, 367 Yonesaka, 2016, High dynamic range digital holography and its demonstration by off-axis configuration, IEEE Trans. Ind. Inf., 12, 1658, 10.1109/TII.2016.2542023 Yue, 2020, Referenceless quality evaluation of tone-mapped hdr and multiexposure fused images, IEEE Trans. Ind. Inf., 16, 1764, 10.1109/TII.2019.2927527 Li, 2014, Visual-salience-based tone mapping for high dynamic range images, IEEE Trans. Ind. Electron., 61, 7076, 10.1109/TIE.2014.2314066 Khan, 2018, A tone-mapping technique based on histogram using a sensitivity model of the human visual system, IEEE Trans. Ind. Electron., 65, 3469, 10.1109/TIE.2017.2760247 Gu, 2016, Blind quality assessment of tone-mapped images via analysis of information, naturalness, and structure, IEEE Trans. Multimedia, 18, 432, 10.1109/TMM.2016.2518868 P.J. Burt, The pyramid as a structure for efficient computation, in: Multi-resolution image processing and analysis, Springer, 1984, pp. 6–35. T. Mertens, J. Kautz, F. Van Reeth, Exposure fusion: A simple and practical alternative to high dynamic range photography, in: Computer Graphics Forum, vol. 28, 2009, pp. 161–171. Raman, 2009, Bilateral filter based compositing for variable exposure photography, Proc. Eurographics Gu, 2012, Gradient field multi-exposure images fusion for high dynamic range image visualization, J. Vis. Commun. Image Represent., 23, 604, 10.1016/j.jvcir.2012.02.009 Li, 2012, Detail-enhanced exposure fusion, IEEE Trans. Image Process., 21, 4672, 10.1109/TIP.2012.2207396 Li, 2012, Fast multi-exposure image fusion with median filter and recursive filter, IEEE Trans. Consum. Electron., 58, 626, 10.1109/TCE.2012.6227469 Li, 2013, Image fusion with guided filtering, IEEE Trans. Image Process., 22, 2864, 10.1109/TIP.2013.2244222 X. Zhang, Benchmarking and comparing multi-exposure image fusion algorithms, Information Fusion. Wang, 2011, Applications of objective image quality assessment methods, IEEE Signal Process Mag., 28, 137, 10.1109/MSP.2011.942295 Zhai, 2012, A psychovisual quality metric in free-energy principle, IEEE Trans. Image Process., 21, 41, 10.1109/TIP.2011.2161092 Gu, 2016, Saliency guided quality assessment of screen content images, IEEE Trans. Multimedia, 18, 1098, 10.1109/TMM.2016.2547343 Min, 2019, Objective quality evaluation of dehazed images, IEEE Trans. Intell. Transp. Syst., 20, 2879, 10.1109/TITS.2018.2868771 Li, 2021, Subjective and objective quality assessment of compressed screen content videos, IEEE Trans. Broadcast., 67, 438, 10.1109/TBC.2020.3028335 Min, 2017, Unified blind quality assessment of compressed natural, graphic, and screen content images, IEEE Trans. Image Process., 26, 5462, 10.1109/TIP.2017.2735192 H. Duan, G. Zhai, X. Min, Y. Zhu, Y. Fang, X. Yang, Perceptual quality assessment of omnidirectional images, in: 2018 IEEE international symposium on circuits and systems (ISCAS), IEEE, 2018, pp. 1–5. Zhai, 2021, Perceptual quality assessment of low-light image enhancement, ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM), 17, 1 Z. Peng, Q. Jiang, F. Shao, W. Gao, W. Lin, Lggd+: Image retargeting quality assessment by measuring local and global geometric distortions, IEEE Trans. Circuits Syst. Video Technol., doi: 10.1109/TCSVT.2021.3112933. Q. Jiang, Z. Peng, F. Shao, K. Gu, Y. Zhang, W. Zhang, W. Lin, Stereoars: Quality evaluation for stereoscopic image retargeting with binocular inconsistency detection, IEEE Trans. Broadcast., doi:10.1109/TBC. 460 2021.3113280. Jiang, 2020, A full-reference stereoscopic image quality measurement via hierarchical deep feature de-gradation fusion, IEEE Trans. Instrum. Meas., 69, 9784, 10.1109/TIM.2020.3005111 Liu, 2017, Perceptual reduced reference visual quality assessment for contrast alteration, IEEE Trans. Broadcasting, 63, 71, 10.1109/TBC.2016.2597545 Liu, 2018, Reduced-reference image quality assessment in free-energy principle and sparse representation, IEEE Trans. Multimedia, 20, 379, 10.1109/TMM.2017.2729020 Zhai, 2021, Comparative perceptual assessment of visual signals using free energy features, IEEE Trans. Multimedia, 23, 3700, 10.1109/TMM.2020.3029891 Sun, 2019, Ma, Mc360iqa: A multi-channel cnn for blind 360-degree image quality assessment, IEEE J. Sel. Top. Signal Process., 14, 64, 10.1109/JSTSP.2019.2955024 Z. Zhang, W. Sun, X. Min, W. Zhu, T. Wang, W. Lu, G. Zhai, A no-reference evaluation metric for low-light image enhancement, in: 2021 IEEE Interna- tional Conference on Multimedia and Expo (ICME), IEEE, 2021, pp. 1–6. ur Rehman, 2022, Deeprpn-biqa: Deep architectures with region proposal network for natural-scene and screen-content blind image quality assessment, Displays, 71, 102101, 10.1016/j.displa.2021.102101 Huang, 2021, Ye, Image quality evaluation for oled-based smart-phone displays at various lighting conditions, Displays, 70, 102115, 10.1016/j.displa.2021.102115 Hu, 2021, Blind quality assessment of night-time image, Displays, 69, 102045, 10.1016/j.displa.2021.102045 Xu, 2016, Pairwise comparison and rank learning for image quality assessment, Displays, 44, 21, 10.1016/j.displa.2016.06.002 Li, 2021, No-reference screen content video quality assessment, Displays, 69, 102030, 10.1016/j.displa.2021.102030 Gu, 2020, Learning a unified blind image quality metric via on-line and off-line big training instances, IEEE Trans. Big Data, 6, 780, 10.1109/TBDATA.2019.2895605 Jiang, 2021, No-reference image contrast evaluation by generating bidirectional pseudoreferences, IEEE Trans. Ind. Inf., 17, 6062, 10.1109/TII.2020.3035448 Jiang, 2019, Blique-tmi: Blind quality evaluator for tone-mapped images based on local and global feature analyses, IEEE Trans. Circuits Syst. Video Technol., 29, 323, 10.1109/TCSVT.2017.2783938 Wang, 2021, Exploiting local degradation characteristics and global statistical properties for blind quality assessment of tone-mapped hdr images, IEEE Trans. Multimedia, 23, 692, 10.1109/TMM.2020.2986583 Athar, 2019, A comprehensive performance evaluation of image quality assessment algorithms, IEEE Access, 7, 140030, 10.1109/ACCESS.2019.2943319 Ma, 2015, Perceptual quality assessment for multi-exposure image fusion, IEEE Trans. Image Process., 24, 3345, 10.1109/TIP.2015.2442920 P. J. Burt, R. J. Kolczynski, Enhanced image capture through fusion, in: 1993 (4th) international Conference on Computer Vision, IEEE, 1993, pp. 173–182. Wang, 2020, Detail-enhanced multi-scale exposure fusion in yuv color space, IEEE Trans. Circuits Syst. Video Technol., 30, 2418, 10.1109/TCSVT.2019.2919310 Goshtasby, 2005, Fusion of multi-exposure images, Image Vis. Comput., 23, 611, 10.1016/j.imavis.2005.02.004 Zhang, 2012, Gradient-directed multiexposure composition, IEEE Trans. Image Process., 21, 2318, 10.1109/TIP.2011.2170079 Ma, 2017, Robust multi-exposure image fusion: a structural patch decomposition approach, IEEE Trans. Image Process., 26, 2519, 10.1109/TIP.2017.2671921 H. Duan, G. Zhai, X. Yang, D. Li, W. Zhu, Ivqad 2017: An immersive video quality assessment database, in: 2017 International Conference on Systems, Signals and Image Processing (IWSSIP), IEEE, 2017, pp. 1–5. Qu, 2002, Information measure for performance of image fusion, Electron. Lett., 38, 313, 10.1049/el:20020212 C. S. Xydeas, V. S. Petrovic, Objective pixel-level image fusion performance measure, in: Sensor Fusion: Architectures, Algorithms, and Applications IV, vol. 4051, SPIE, 2000, pp. 89–98. G. Piella, H. Heijmans, A new quality metric for image fusion, in: International Conference on Image Processing, 2003. S. Di Zenzo, A note on the gradient of a multi-image, Computer vision, graphics, and image processing 33 (1) (1986) 116–125. Marr, 1980, Theory of edge detection, Proc. R. Soc. Lond. B Biol. Sci., 207, 187, 10.1098/rspb.1980.0020 J.K.T. Mertens, F.V. Reeth, Exposure fusion, in: 15th Pacific Conference on Computer Graphics and Applications, IEEE, 2007, pp. 382–390. Hughes, 1996, Global precedence, spatial frequency channels, and the statistics of natural images, J. Cognitive Neuro-science, 8, 197, 10.1162/jocn.1996.8.3.197 Gu, 2015, Quality assessment considering viewing distance and image resolution, IEEE Trans. Broadcast., 61, 520, 10.1109/TBC.2015.2459851 Chang, 2011, LIBSVM: A library for support vector machines, ACM Trans. Intell. Syst. Technol., 2, 1, 10.1145/1961189.1961199 Xydeas, 2000, Objective image fusion performance measure, Elec-tronics Letters, 36, 308, 10.1049/el:20000267 P.-W. Wang, B. Liu, A novel image fusion metric based on multi-scale analysis, in: International Conference on Signal Processing, 2008, pp. 965–968. Chen, 2009, A new automated quality assessment algorithm for image fusion, Image Vis. Comput., 27, 1421, 10.1016/j.imavis.2007.12.002 Kundu, 2017, No-reference quality assessment of tone-mapped HDR pictures, IEEE Trans. Image Process., 26, 2957, 10.1109/TIP.2017.2685941 Cvejic, 2006, Image fusion metric based on mutual information and tsallis entropy, Electron. Lett., 42, 626, 10.1049/el:20060693 Zheng, 2007, A new metric based on extended spatial frequency and its application to DWT based fusion algorithms, Information Fusion, 8, 177, 10.1016/j.inffus.2005.04.003