Edge-preserving decompositions for multi-scale tone and detail manipulation

ACM Transactions on Graphics - Tập 27 Số 3 - Trang 1-10 - 2008
Zeev Farbman1, Raanan Fattal1, Dani Lischinski1, Richard Szeliski2
1The Hebrew University,
2Microsoft Research

Tóm tắt

Many recent computational photography techniques decompose an image into a piecewise smooth base layer, containing large scale variations in intensity, and a residual detail layer capturing the smaller scale details in the image. In many of these applications, it is important to control the spatial scale of the extracted details, and it is often desirable to manipulate details at multiple scales, while avoiding visual artifacts.

In this paper we introduce a new way to construct edge-preserving multi-scale image decompositions. We show that current basedetail decomposition techniques, based on the bilateral filter, are limited in their ability to extract detail at arbitrary scales. Instead, we advocate the use of an alternative edge-preserving smoothing operator, based on the weighted least squares optimization framework, which is particularly well suited for progressive coarsening of images and for multi-scale detail extraction. After describing this operator, we show how to use it to construct edge-preserving multi-scale decompositions, and compare it to the bilateral filter, as well as to other schemes. Finally, we demonstrate the effectiveness of our edge-preserving decompositions in the context of LDR and HDR tone mapping, detail enhancement, and other applications.

Từ khóa


Tài liệu tham khảo

10.1137/0729052

10.5555/1209021

10.1145/1141911.1141935

10.1109/TPAMI.2002.1008390

10.1109/83.661192

10.1109/TIP.2006.871137

Buatois , L. , Caumon , G. , and Levy , B . 2007. Concurrent number cruncher: An efficient sparse linear solver on the GPU . In High Performance Computation Conference (HPCC), Springer. Buatois, L., Caumon, G., and Levy, B. 2007. Concurrent number cruncher: An efficient sparse linear solver on the GPU. In High Performance Computation Conference (HPCC), Springer.

10.1109/TCOM.1983.1095851

10.1145/1276377.1276506

Choudhury , P. , and Tumblin , J . 2003. The trilateral filter for high contrast images and meshes . In Proc. EGSR 2003 , Eurographics, 186--196. Choudhury, P., and Tumblin, J. 2003. The trilateral filter for high contrast images and meshes. In Proc. EGSR 2003, Eurographics, 186--196.

10.1109/34.1000236

10.1145/566654.566650

10.1145/566654.566574

10.1145/1015706.1015778

10.1109/TIP.2002.801126

10.1145/566654.566573

10.1145/1276377.1276441

10.1109/83.597272

10.1145/1141911.1141937

Lagendijk , R. L. , Biemond , J. , and Boekee , D. E. 1988 . Regularized iterative image restoration with ringing reduction . IEEE Trans. Acoustics, Speech, and Signal Proc., Speech, Signal Proc. 36 , 12 (December), 1874--1888. Lagendijk, R. L., Biemond, J., and Boekee, D. E. 1988. Regularized iterative image restoration with ringing reduction. IEEE Trans. Acoustics, Speech, and Signal Proc., Speech, Signal Proc. 36, 12 (December), 1874--1888.

10.1145/1015706.1015780

10.1145/1276377.1276464

10.1145/1073204.1073271

10.1145/1141911.1141936

10.1145/1166087.1166095

Mrázek P. Weickert J. and Bruhn A. 2006. On robust estimation and smoothing with spatial and tonal kernels. In Geometric Properties from Incomplete Data R. Klette R. Kozera L. Noakes and J. Weickert Eds. Springer Dordrecht 335--352. Mrázek P. Weickert J. and Bruhn A. 2006. On robust estimation and smoothing with spatial and tonal kernels. In Geometric Properties from Incomplete Data R. Klette R. Kozera L. Noakes and J. Weickert Eds. Springer Dordrecht 335--352.

10.1145/383259.383310

Oppenheim A. V. and Schafer R. W. 1989. Discrete-Time Signal Processing. Prentice Hall. Oppenheim A. V. and Schafer R. W. 1989. Discrete-Time Signal Processing . Prentice Hall.

10.1007/11744085_44

10.1145/1281500.1281602

10.1145/280814.280922

10.1109/34.56205

10.1145/1015706.1015777

10.1145/566654.566575

Saad , Y. 2003. Iterative Methods for Sparse Linear Systems , second ed. SIAM. Saad, Y. 2003. Iterative Methods for Sparse Linear Systems, second ed. SIAM.

10.1088/0266-5611/4/4/010

10.1023/A:1008344608808

Schlick C. 1994. Quantization techniques for visualization of high dynamic range pictures. In Photorealistic Rendering Techniques Springer-Verlag P. Shirley G. Sakas and S. Müller Eds. 7--20. Schlick C. 1994. Quantization techniques for visualization of high dynamic range pictures. In Photorealistic Rendering Techniques Springer-Verlag P. Shirley G. Sakas and S. Müller Eds. 7--20.

Tomasi , C. , and Manduchi , R . 1998. Bilateral filtering for gray and color images . In Proc. ICCV '98 , IEEE Computer Society, 839--846. Tomasi, C., and Manduchi, R. 1998. Bilateral filtering for gray and color images. In Proc. ICCV '98, IEEE Computer Society, 839--846.

10.1145/311535.311544

10.1145/1141911.1141918

10.1145/1141911.1142018