Image fusion-based contrast enhancement
Tóm tắt
The goal of contrast enhancement is to improve visibility of image details without introducing unrealistic visual appearances and/or unwanted artefacts. While global contrast-enhancement techniques enhance the overall contrast, their dependences on the global content of the image limit their ability to enhance local details. They also result in significant change in image brightness and introduce saturation artefacts. Local enhancement methods, on the other hand, improve image details but can produce block discontinuities, noise amplification and unnatural image modifications. To remedy these shortcomings, this article presents a fusion-based contrast-enhancement technique which integrates information to overcome the limitations of different contrast-enhancement algorithms. The proposed method balances the requirement of local and global contrast enhancements and a faithful representation of the original image appearance, an objective that is difficult to achieve using traditional enhancement methods. Fusion is performed in a multi-resolution fashion using Laplacian pyramid decomposition to account for the multi-channel properties of the human visual system. For this purpose, metrics are defined for contrast, image brightness and saturation. The performance of the proposed method is evaluated using visual assessment and quantitative measures for contrast, luminance and saturation. The results show the efficiency of the method in enhancing details without affecting the colour balance or introducing saturation artefacts and illustrate the usefulness of fusion techniques for image enhancement applications.
Tài liệu tham khảo
Beghdadi A, Negrate AL: Contrast enhancement technique based on local detection of edges. Comput Visual Graph Image Process 1989, 46: 162-274. 10.1016/0734-189X(89)90166-7
Peli E: Contrast in complex images. J Opt Soc Am A 1990, 7(10):2030-2040.
Beghdadi A, Dauphin G, Bouzerdoum A: Image analysis using local band directional contrast. In Proc of the International Symposium on Intelligent Multimedia, Video and Speech Processing, ISIMP'04. Hong Kong; 2004.
Michelson A: Studies in Optics. Univeristy of Chicago Press, Chicago, IL; 1927.
Tang J, Peli E, Acton S: Image enhancement using a contrast measure in the compressed domain. IEEE Signal Process Lett 2003, 10(10):289-292.
Tang J, Kim J, Peli E: Image enhancement in the JPEG domain for people with vision impairment. IEEE Trans Biomed Eng 2004, 51(11):2013-2023. 10.1109/TBME.2004.834264
Agaian SS: Visual morphology. In Proceedings of SPIE, Nonlinear Image Processing X. Volume 3304. San Jose, CA; 1999:139-150.
Agaian SS, Panetta K, Grigoryan A: Transform based image enhancement with performance measure. IEEE Trans Image Process 2001, 10(3):367-381. 10.1109/83.908502
Agaian SS, Panetta K, Grigoryan AM: A new measure of image enhancement. In Proc 2000 IASTED International Conference on Signal Processing & Communication. Marbella, Spain; 2000.
Agaian SS, Silver B, Panetta K: Transform coefficient histogram based image enhancement algorithms using contrast entropy. IEEE Trans Image Process 2007, 16(3):751-758.
Gonzalez RC, Woods RE: Digital Image Processing. Prentice Hall, Upper Saddle River, NJ; 2002.
Gordon R, Rangayyan RM: Feature enhancement of film mammograms using fixed and adaptive neighborhood. Appl Opt 1984, 23(4):560-564. 10.1364/AO.23.000560
Dhawan AP, Belloni G, Gordon R: Enhancement of mammographic features by optimal adaptive neighbourhood image processing. IEEE Trans Med Imag 1986, MI-5(1):8-15.
Chang DC, Wu WR: Image contrast enhancement based on a histogram transformation of local standard deviation. IEEE Trans Med Imag 1998, 17: 518-531. 10.1109/42.730397
Zimmerman JB, Pizer SM, Staab EV, Perry JR, McCartney W, Brenton BC: An evaluation of the effectiveness of adaptive histogram equalization for contrast enhancement. IEEE Trans Med Imag 1988, 7: 304-312. 10.1109/42.14513
Agaian SS: Advances and problems of fast orthogonal transform for signal/image processing applications. (Part 1), Pattern Recognition, Classification, Forecasting. Volume 4. The Russian Academy of Sciences, Nauka, Moscow; 1990:146-215.
Aghagolzadeh S, Ersoy OK: Transform image enhancement. Opt Eng 1992, 31: 614-626. 10.1117/12.56095
Jain AK: Fundamentals of Digital Image Processing. Prentice Hall, Englewood Cliffs, NJ; 1989.
Wang D, Vagnucci AH: Digital image enhancement. Comput Vis Graph Image Process 1981, 24: 363-381.
Kim JY, Kim LS, Hwang SH: An advanced contrast enhancement using partially overlapped sub-block histogram equalization. IEEE Trans Circ Syst Video Technol 2001, 11(4):475-484. 10.1109/76.915354
Sun C, Ruan SJ, Shie MC, Pai TW: Dynamic contrast enhancement based on histogram specification. IEEE Trans Consum Electron 2005, 51(4):1300-1305. 10.1109/TCE.2005.1561859
Ji TL, Sundareshan MK, Roehrig H: Adaptive image contrast enhancement based on human visual properties. IEEE Trans Med Imag 1994, 13: 573-586. 10.1109/42.363111
Hummel R: Image enhancement by histogram transformation. Comput Vis Graph Image Process 1977, 6(2):184-195. 10.1016/S0146-664X(77)80011-7
Kim YT: Contrast enhancement using brightness preserving bi-histogram equalization. IEEE Trans Consum Electron 1997, 43(1):1-8. 10.1109/30.580378
Wan Y, Chen Q, Zhang BM: Image enhancement based on equal area dualistic sub-image histogram equalization method. IEEE Trans Consum Electron 1999, 45(1):68-75. 10.1109/30.754419
Chen SD, Rahman Ramli A: Contrast enhancement using recursive mean-separate histogram equalization for scalable brightness preservation. IEEE Trans Consum Electron 2003, 49(4):1301-1309. 10.1109/TCE.2003.1261233
Lamberti F, Montrucchio B, Sanna A: CMBFHE--a novel contrast enhancement technique based on cascaded multistep binomial filtering histogram equalization. IEEE Trans Consum Electron 2006, 52(3):966-974. 10.1109/TCE.2006.1706495
Venetsanopoulos AN, Trahanias PE: Color image enhancement through 3-D histogram equalization. Proceedings of 11th International Conference on Image, Speech and Signal Analysis 1992, 3: 545-548.
Weeks AR, Hague GE, Myler HR: Histogram equalization of 24-bit color images in the color difference (CY) color space. J Electron Imag 1995, 4(1):15-22. 10.1117/12.191335
Faugeras O: Digital color image processing within the framework of a human visual model. IEEE Trans Acoust Speech Signal Process 1979, 27(4):380-393. 10.1109/TASSP.1979.1163262
Jobsen DJ, Rahman Z, Woodell GA: Properties and performance of a center/surround Retinex. IEEE Trans Image Process 1997, 6(3):81-96.
Rahman Z, Jobson D, Woodell GA: Multiscale retinex for color image enhancement. Proceedings of the IEEE International Conference on Image Processing 1996.
Cherifi D, Beghdadi A, Belbachir AH: Color contrast enhancement method using steerable pyramid transform. Signal Image Video Process 2010, 4(2):247-262. 10.1007/s11760-009-0115-6
Velde KV: Multi-scale color image enhancement. Proc Int Conf Image Processing 1999, 3: 584-587.
Starck JL, Murtagh F, Candes EJ, Donoho DL: Gray and color image enhancement using the curvelet transform. IEEE Trans Image Process 2003, 12(6):706-717. 10.1109/TIP.2003.813140
Kim K, Han Y, Hahn H: Contrast enhancement scheme integrating global and local contrast equalization approaches. Third International IEEE Conference on Signal-Image Technologies and Internet-Based System, SITIS '07 2007, 493-500.
Mertens T, Kautz J, Van Reeth F: Exposure fusion: a simple and practical alternative to high dynamic range photography. Comput Graph Forum 2009, 28(1):161-171. 10.1111/j.1467-8659.2008.01171.x
Lin W, Kuo CCJ: Perceptual visual quality metrics: a survey. J Vis Commun Image Represent 2011, 22(4):297-312. 10.1016/j.jvcir.2011.01.005
Kim JK, Park JM, Song KS, Park HW: Adaptive mammographic image enhancement using first derivative and local statistics. IEEE Trans Med Imag 1997, 16: 495-502. 10.1109/42.640739
Morrow WM, Paranjape RB, Rangayyan RM, Desautels JEL: Region-based contrast enhancement of mammograms. IEEE Trans Med Imag 1992, 11(3):392-406. 10.1109/42.158944
Saghri JA, Cheatham PS, Habibi H: Image quality measure based on a human visual system model. Opt Eng 1989, 28(7):813-818.
Rizzi A, Algeri T, Medeghini G, Marini D: A proposal for contrast measure in digital images. In IS&T Second European Conference on Color in Graphics, Imaging and Vision. Aachen, Germany; 2004.
Jourlin M, Pinoli JC: Contrast definition and contour detection for logarithmic images. J Microsc 1989, 156(1):33-40. 10.1111/j.1365-2818.1989.tb02904.x
Deng G: An entropy interpretation of the logarithmic image processing model with application to contrast enhancement. IEEE Trans Image Process 2009, 18(5):1135-1140.
Agarwala A, Dontcheva M, Agrawala M, Drucker SM, Colburn A, Curless B, Salesin D, Cohen MF: Interactive digital photomontage. ACM Trans Graph 2004, 23(3):294-302. 10.1145/1015706.1015718
Pérez P, Gangnet M, Blake A: Poisson image editing. In SIGGRAPH '03: ACM SIGGRAPH 2003 Papers. New York, NY, ACM Press; 2003:313-318.
Raskar R, Ilie A, Yu J: Image fusion for context enhancement and video surrealism. Proceedings of the 3rd Symposium on Non-Photorealistic Animation and Rendering 2004, 85-152.
Burt PJ, Adelson EH: A multiresolution spline with application to image mosaics. ACM Trans Graph 1983, 2(4):217-236. 10.1145/245.247
Burt P, Adelson T: The laplacian pyramid as a compact image code. IEEE Trans Commun 1983, COM-31: 532-540.
Lallier E: Real-time pixel-level image fusion through adaptive weight averaging. Royal Military College of Canada, Kingston, Ontario; 1999.
Bethune SD, Mulle F, Binard M: Adaptive intensity matching fillters: a new tool for multi-resolution data fusion. Proceedings of the Sensor and Propagation Panel's 7th Symposium on Multi-Sensor Systems and Data Fusion for Telecommunications, Remote Sensing and Radar 1997, 28: 1-15.
Pun T: A new method for gray-level picture thresholding using the entropy of the histogram. Signal Process 1980, 2: 223-237. 10.1016/0165-1684(80)90020-1
Kapur JN, Sahoo PK, Wong AKC: A new method for gray level picture thresholding using the entropy of the histogram. Comput Graph Vis Image Process 1985, 29: 273-285. 10.1016/0734-189X(85)90125-2
Pal NR, Pal SK: Entropy thresholding. Signal Process 1989, 16: 97-108. 10.1016/0165-1684(89)90090-X
Ginsburg AP, Arthur P: Visual information processing based on spatial filters constrained by biological data. In PhD Dissertation. University of Cambridge; 1978.
Turiel A, Parga N: The multifractal structure of contrast changes in natural images: from sharp edges to textures. J Neural Comput Arch 2000, 12(4):763-793. 10.1162/089976600300015583
Saleem A, Beghdadi A, Boashash B: Image quality metrics based multifocus image fusion. 3rd European Workshop on Visual Information Processing (EUVIP) 2011.
Chen SD, Ramli AR: Minimum mean brightness error bi-histogram equalization in contrast enhancement. IEEE Trans Consum Electron 2003, 49(4):1310-1319. 10.1109/TCE.2003.1261234
Hautiere N, Tarel JP, Aubert D, Dumont E: Blind contrast enhancement assessment by gradient ratioing at visible edges. Img Anal Stereol 2008, 27(2):87-95. 10.5566/ias.v27.p87-95
Rosenman J, Roe CA, Cromartie R, Muller KE, Pizer SM: Portal film enhancement: technique and clinical utility. Int J Radiat Oncol Biol Phys 1993, 25: 333-338. 10.1016/0360-3016(93)90357-2
Gonzalez RC, Woods RE, Eddins SL: Digital Image Processing using Matlab. Pearson Education, Inc. Upper Saddle River, NJ; 2004.
Reza AM: Realization of the contrast limited adaptive histogram equalization (CLAHE) for real-time image enhancement. VLSI Signal Process 2004, 38(1):35-44.
Stark JA: Adaptive image contrast enhancement using generalizations of histogram equalization. IEEE Trans Image Process 2000, 9(5):889-896. 10.1109/83.841534
Max-Planck-Institut für Informatik[http://www.mpi-inf.mpg.de/]
Larson W, Rushmeier H, Piatko C: A visibility matching tone reproduction operator for high dynamic range scenes. IEEE Trans Visual Comput Graph 1997, 3(4):291-306. 10.1109/2945.646233
Tumblin J, Rushmeier H: Tone reproduction for realistic images. IEEE Comput Graph Appl 1993, 13(6):42-48.
Reinhard E, Stark M, Shirley P, Ferwerda J: Photographic tone reproduction for digital images. ACM Trans Graph 2002, 21(3):267-276.
Yoshida A, Blanz V, Myszkowski K, Seidel H: Perceptual evaluation of toe mapping operators with real world scenes. Human Vision and Electronic Imaging X. Proceedings of the SPIE 2005, 5666: 192-203.
Boashash B, Boubchir L, Azemi G: Time-frequency signal and image processing of non-stationary signals with application to the classification of newborn eeg abnormalities and seizures. In The 12th IEEE International Symposium on Signal Processing and InformationTechnology (IEEE ISSPIT'2011). Bilbao, Spain; 2011:120-129.
Boashash B (Ed): Time-Frequency Signal Analysis and Processing--A Comprehensive Reference. Elsevier Science, Oxford; 2003.