Domain transform for edge-aware image and video processing

ACM Transactions on Graphics - Tập 30 Số 4 - Trang 1-12 - 2011
Eduardo S. L. Gastal1, Manuel M. Oliveira1
1Instituto de Informática -- UFRGS

Tóm tắt

We present a new approach for performing high-quality edge-preserving filtering of images and videos in real time. Our solution is based on a transform that defines an isometry between curves on the 2D image manifold in 5D and the real line. This transform preserves the geodesic distance between points on these curves, adaptively warping the input signal so that 1D edge-preserving filtering can be efficiently performed in linear time. We demonstrate three realizations of 1D edge-preserving filters, show how to produce high-quality 2D edge-preserving filters by iterating 1D-filtering operations, and empirically analyze the convergence of this process. Our approach has several desirable features: the use of 1D operations leads to considerable speedups over existing techniques and potential memory savings; its computational cost is not affected by the choice of the filter parameters; and it is the first edge-preserving filter to work on color images at arbitrary scales in real time, without resorting to subsampling or quantization. We demonstrate the versatility of our domain transform and edge-preserving filters on several real-time image and video processing tasks including edge-preserving filtering, depth-of-field effects, stylization, recoloring, colorization, detail enhancement, and tone mapping.

Từ khóa


Tài liệu tham khảo

Adams A. Gelfand N. Dolson J. and Levoy M. 2009. . . . In SIGGRAPH. 10.1145/1576246.1531327 Adams A. Gelfand N. Dolson J. and Levoy M. 2009. Gaussian kd-trees for fast high-dimensional filtering. In SIGGRAPH . 10.1145/1576246.1531327

10.1111/j.1467-8659.2009.01645.x

Adobe Systems Inc. 2010. Photoshop CS5. Computer software. Adobe Systems Inc. 2010. Photoshop CS5. Computer software.

10.1109/TPAMI.2002.1008390

10.1162/089976603321780317

Black M., 1998, Robust anisotropic diffusion, IEEE TIP, 7, 421

10.1145/1276377.1276506

10.1145/1857907.1857910

D'Almeida F. 2004. Nonlinear Diff. Toolbox (mathworks.com/matlabcentral/fileexchange/3710-nonlinear-diffusion-toolbox). D'Almeida F. 2004. Nonlinear Diff. Toolbox (mathworks.com/matlabcentral/fileexchange/3710-nonlinear-diffusion-toolbox).

Dougherty E. 1994. Digital Image Processing Methods. Optical engineering. CRC Press. Dougherty E. 1994. Digital Image Processing Methods . Optical engineering. CRC Press.

Durand F., SIGGRAPH '02

10.1145/1360612.1360666

10.1145/1882261.1866171

10.1145/1531326.1531328

10.1111/j.1467-8659.2009.01627.x

Grewenig S. Weickert J. and Bruhn A. 2010. . . . Pattern Recognition 533--542. Grewenig S. Weickert J. and Bruhn A. 2010. From box filtering to fast explicit diffusion. Pattern Recognition 533--542.

Kimball S. Mattis P. and GIMP Development Team 2011. GNU Image Manipulation Program. Computer software. Kimball S. Mattis P. and GIMP Development Team 2011. GNU Image Manipulation Program. Computer software.

Kimmel R. Sochen N. A. and Malladi R. 1997. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Springer-Verlag 236--247. Kimmel R. Sochen N. A. and Malladi R. 1997. From high energy physics to low level vision. In Scale-Space Theory in Computer Vision Springer-Verlag 236--247.

Knutsson H. and Westin C.-F. 1993. . . . . . . . . . . . . . . . In CVPR 515--523. Knutsson H. and Westin C.-F. 1993. Normalized and differential convolution: Methods for interpolation and filtering of incomplete and uncertain data. In CVPR 515--523.

Lee J. and Verleysen M. 2010. . . . Springer. Lee J. and Verleysen M. 2010. Nonlinear Dimensionality Reduction . Springer.

10.1145/1015706.1015780

Lévy B. Petitjean S. Ray N. and Maillo t J. 2002. Least squares conformal maps for automatic texture atlas generation. In ACM SIGGRAPH 362--371. 10.1145/566570.566590 Lévy B. Petitjean S. Ray N. and Maillo t J. 2002. Least squares conformal maps for automatic texture atlas generation. In ACM SIGGRAPH 362--371. 10.1145/566570.566590

10.1145/1141911.1141936

Loeve M. 1977. Probability Theory vol. 1. Springer. Loeve M. 1977. Probability Theory vol. 1. Springer.

Oliveira M. M. Bishop G. and McAllister D. 2000. Relief texture mapping. In ACM SIGGRAPH 359--368. 10.1145/344779.344947 Oliveira M. M. Bishop G. and McAllister D. 2000. Relief texture mapping. In ACM SIGGRAPH 359--368. 10.1145/344779.344947

O'Neill B. 2006. Elementary Differential Geometry. AP. O'Neill B. 2006. Elementary Differential Geometry . AP.

10.1007/s11263-007-0110-8

10.1109/34.56205

Pham T., IEEE Intl. Conf. on Multimedia and Expo 0, 4

10.1016/S1076-5670(04)32003-3

Porikli F. 2008. Constant time O(1) bilateral filtering. In CVPR 1--8. Porikli F. 2008. Constant time O(1) bilateral filtering. In CVPR 1--8.

10.1145/37402.37433

Smith J. O. 2007. Introduction to Digital Filters with Audio Applications. W3K Publishing. Smith J. O. 2007. Introduction to Digital Filters with Audio Applications . W3K Publishing.

10.1023/A:1011277827470

Subr K. Soler C. and Durand F. 2009. . . . ACM TOG 28 147:1--147:9. 10.1145/1618452.1618493 Subr K. Soler C. and Durand F. 2009. Edge-preserving multiscale image decomposition based on local extrema. ACM TOG 28 147:1--147:9. 10.1145/1618452.1618493

Tomasi C. and Manduchi R. 1998. . . . In ICCV 839--846. Tomasi C. and Manduchi R. 1998. Bilateral filtering for gray and color images. In ICCV 839--846.

10.1109/TIP.2003.819861

Weickert J., 1998, Efficient and reliable schemes for nonlinear diffusion filtering, IEEE TIP, 7, 398

Yang Q. Tan K. H. and Ahuja N. 2009. . . . In CVPR 557--564. Yang Q. Tan K. H. and Ahuja N. 2009. Real-time O(1) bilateral filtering. In CVPR 557--564.

Thông tin
Thông tin xuất bản

ACM Transactions on Graphics

Tập 30 Số 4

1-12

Thông tin tác giả