Domain transform for edge-aware image and video processing
Tóm tắt
We present a new approach for performing high-quality edge-preserving filtering of images and videos in real time. Our solution is based on a transform that defines an isometry between curves on the 2D image manifold in 5D and the real line. This transform preserves the geodesic distance between points on these curves, adaptively warping the input signal so that 1D edge-preserving filtering can be efficiently performed in linear time. We demonstrate three realizations of 1D edge-preserving filters, show how to produce high-quality 2D edge-preserving filters by iterating 1D-filtering operations, and empirically analyze the convergence of this process. Our approach has several desirable features: the use of 1D operations leads to considerable speedups over existing techniques and potential memory savings; its computational cost is not affected by the choice of the filter parameters; and it is the first edge-preserving filter to work on color images at arbitrary scales in real time, without resorting to subsampling or quantization. We demonstrate the versatility of our domain transform and edge-preserving filters on several real-time image and video processing tasks including edge-preserving filtering, depth-of-field effects, stylization, recoloring, colorization, detail enhancement, and tone mapping.
Từ khóa
Tài liệu tham khảo
Adams A. Gelfand N. Dolson J. and Levoy M. 2009. . . . In SIGGRAPH. 10.1145/1576246.1531327 Adams A. Gelfand N. Dolson J. and Levoy M. 2009. Gaussian kd-trees for fast high-dimensional filtering. In SIGGRAPH . 10.1145/1576246.1531327
Adobe Systems Inc. 2010. Photoshop CS5. Computer software. Adobe Systems Inc. 2010. Photoshop CS5. Computer software.
Black M., 1998, Robust anisotropic diffusion, IEEE TIP, 7, 421
D'Almeida F. 2004. Nonlinear Diff. Toolbox (mathworks.com/matlabcentral/fileexchange/3710-nonlinear-diffusion-toolbox). D'Almeida F. 2004. Nonlinear Diff. Toolbox (mathworks.com/matlabcentral/fileexchange/3710-nonlinear-diffusion-toolbox).
Dougherty E. 1994. Digital Image Processing Methods. Optical engineering. CRC Press. Dougherty E. 1994. Digital Image Processing Methods . Optical engineering. CRC Press.
Durand F., SIGGRAPH '02
Grewenig S. Weickert J. and Bruhn A. 2010. . . . Pattern Recognition 533--542. Grewenig S. Weickert J. and Bruhn A. 2010. From box filtering to fast explicit diffusion. Pattern Recognition 533--542.
Kimball S. Mattis P. and GIMP Development Team 2011. GNU Image Manipulation Program. Computer software. Kimball S. Mattis P. and GIMP Development Team 2011. GNU Image Manipulation Program. Computer software.
Kimmel R. Sochen N. A. and Malladi R. 1997. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Springer-Verlag 236--247. Kimmel R. Sochen N. A. and Malladi R. 1997. From high energy physics to low level vision. In Scale-Space Theory in Computer Vision Springer-Verlag 236--247.
Knutsson H. and Westin C.-F. 1993. . . . . . . . . . . . . . . . In CVPR 515--523. Knutsson H. and Westin C.-F. 1993. Normalized and differential convolution: Methods for interpolation and filtering of incomplete and uncertain data. In CVPR 515--523.
Lee J. and Verleysen M. 2010. . . . Springer. Lee J. and Verleysen M. 2010. Nonlinear Dimensionality Reduction . Springer.
Lévy B. Petitjean S. Ray N. and Maillo t J. 2002. Least squares conformal maps for automatic texture atlas generation. In ACM SIGGRAPH 362--371. 10.1145/566570.566590 Lévy B. Petitjean S. Ray N. and Maillo t J. 2002. Least squares conformal maps for automatic texture atlas generation. In ACM SIGGRAPH 362--371. 10.1145/566570.566590
Loeve M. 1977. Probability Theory vol. 1. Springer. Loeve M. 1977. Probability Theory vol. 1. Springer.
Oliveira M. M. Bishop G. and McAllister D. 2000. Relief texture mapping. In ACM SIGGRAPH 359--368. 10.1145/344779.344947 Oliveira M. M. Bishop G. and McAllister D. 2000. Relief texture mapping. In ACM SIGGRAPH 359--368. 10.1145/344779.344947
O'Neill B. 2006. Elementary Differential Geometry. AP. O'Neill B. 2006. Elementary Differential Geometry . AP.
Pham T., IEEE Intl. Conf. on Multimedia and Expo 0, 4
Porikli F. 2008. Constant time O(1) bilateral filtering. In CVPR 1--8. Porikli F. 2008. Constant time O(1) bilateral filtering. In CVPR 1--8.
Smith J. O. 2007. Introduction to Digital Filters with Audio Applications. W3K Publishing. Smith J. O. 2007. Introduction to Digital Filters with Audio Applications . W3K Publishing.
Subr K. Soler C. and Durand F. 2009. . . . ACM TOG 28 147:1--147:9. 10.1145/1618452.1618493 Subr K. Soler C. and Durand F. 2009. Edge-preserving multiscale image decomposition based on local extrema. ACM TOG 28 147:1--147:9. 10.1145/1618452.1618493
Tomasi C. and Manduchi R. 1998. . . . In ICCV 839--846. Tomasi C. and Manduchi R. 1998. Bilateral filtering for gray and color images. In ICCV 839--846.
Weickert J., 1998, Efficient and reliable schemes for nonlinear diffusion filtering, IEEE TIP, 7, 398