A Novel Euler’s Elastica-Based Segmentation Approach for Noisy Images Using the Progressive Hedging Algorithm

Journal of Mathematical Imaging and Vision - Tập 62 - Trang 98-119 - 2019
Lu Tan1, Ling Li1, Wanquan Liu1, Jie Sun2, Min Zhang3,4
1Computing Discipline, School of EECMS, Curtin University, Perth, Australia
2Mathematics and Statistics Discipline, School of EECMS, Curtin University, Perth, Australia
3State Key Laboratory of Desert and Oasis Ecology, Xinjiang Institute of Ecology and Geography, Chinese Academy of Sciences, Ürümqi, China
4University of Chinese Academy of Sciences, Beijing, China

Tóm tắt

Euler’s elastica-based unsupervised segmentation models have strong capability of completing the missing boundaries for existing objects in a clean image, but they are not working well for noisy images. This paper aims to establish a Euler’s elastica-based approach that can properly deal with the random noises to improve the segmentation performance for noisy images. The corresponding formulation of stochastic optimization is solved via the progressive hedging algorithm (PHA), and the description of each individual scenario is obtained by the alternating direction method of multipliers. Technically, all the sub-problems derived from the framework of PHA can be solved by using the curvature-weighted approach and the convex relaxation method. Then, an alternating optimization strategy is applied by using some powerful accelerating techniques including the fast Fourier transform and generalized soft threshold formulas. Extensive experiments have been conducted on both synthetic and real images, which displayed significant gains of the proposed segmentation models and demonstrated the advantages of the developed algorithms.

Tài liệu tham khảo

Mumford, D., Shah, J.: Optimal approximations by piecewise smooth functions and associated variational problems. Commun. Pure Appl. Math. 42(5), 577–685 (1989) Chan, T.F., Vese, L.A.: Active contours without edges. IEEE Trans. Image Process. 10(2), 266–277 (2001) Li, F., et al.: A multiphase image segmentation method based on fuzzy region competition. SIAM J. Imaging Sci. 3(3), 277–299 (2010) Yu, H., Wang, W.W., Feng, X.C.: A new fast multiphase image segmentation algorithm based on nonconvex regularizer. Pattern Recognit. 45(1), 363–372 (2012) Wang, B., Yuan, X., Gao, X., et al.: A hybrid level set with semantic shape constraint for object segmentation. IEEE Trans. Cybern. 49, 1558–1569 (2018) Tan, L., Pan, Z., Liu, W., Duan, J., Wei, W., Wang, G.: Image segmentation with depth information via simplified variational level set formulation. J. Math. Imaging Vis. 60(1), 1–17 (2018) Zhu, W., Chan, T.F., Esedoglu, S.: Segmentation with depth: a level set approach. SIAM J. Sci. Comput. 28(5), 1957–1973 (2006) Tan, L., Liu, W., Li, L., et al.: A fast computational approach for illusory contour reconstruction. Multimed. Tools Appl. 78(8), 10449–10472 (2019) Vese, L.A., Chan, T.F.: A multiphase level set framework for image segmentation using the Mumford and Shah model. Int. J. Comput. Vis. 50(3), 271–293 (2002) Paragios, N., Deriche, R.: Geodesic active regions: a new framework to deal with frame partition problems in computer vision. J. Vis. Commun. Image Represent. 13(1–2), 249–268 (2002) Martin, P., Réfrégier, P., Goudail, F., Guérault, F.: Influence of the noise model on level set active contour segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 26, 799–803 (2004) Sawatzky, A., et al.: A variational framework for region-based segmentation incorporating physical noise models. J. Math. Imaging Vis. 47(3), 179–209 (2013) Zhu, W., Tai, X.C., Chan, T.F.: Image segmentation using Euler’s elastica as the regularization. J. Sci. Comput. 57(2), 414–438 (2013) Tai, X.C., Duan, J.M.: A simple fast algorithm for minimization of the elasitica energy combining binary and level set representations. Int. J. Numer. Anal. Model. 14(6), 809–821 (2017) Nitzberg, M., Mumford, D., Shiota, T.: Filtering, Segmentation, and Depth, Lecture Notesin Computer Sciences, 662. Springer, Berlin (1993) Kang, S.H., Zhu, W., Shen, J.H.: Illusory shapes via corner fusion. SIAM J. Imaging Sci. 7(4), 1907–1936 (2014) Zhu, W., Tai, X.C., Chan, T.F.: Augmented Lagrangian method for a mean curvature based image denoising model. Inverse Problems Imaging 7(4), 1409–1432 (2013) Tan, L., Liu, W., Pan, Z.: Color image restoration and inpainting via multi-channel total curvature. Appl. Math. Model. 61, 280–299 (2018) Tan, L., Liang, A., Li, L., et al.: Automatic prostate segmentation based on fusion between deep network and variational methods. J. X-ray Sci. Technol. (2019). https://doi.org/10.3233/XST-190524 Yashtini, M., Kang, S.H.: A fast relaxed normal two split method and an effective weighted tv approach for Euler’s elastica image inpainting. SIAM J. Imaging Sci. 9(4), 1552–1581 (2016) Yan, Y., Nie, F., Li, W., et al.: Image classification by cross-media active learning with privileged information. IEEE Trans. Multimed. 18(12), 2494–2502 (2016) Rockafellar, R.T., Wets, R.J.B.: Stochastic variational inequalities: single-stage to multistage. Math. Program. 165(1), 331–360 (2017) Rockafellar, R.T., Sun, J.: Solving monotone stochastic variational inequalities and complementarity problems by progressive hedging. Math. Program. 174, 453–471 (2019) Glowinski, R., Pan, T.W., Tai, X.C.: Some Facts About Operator-splitting and Alternating Direction Methods. Splitting Methods in Communication, Imaging, Science, and Engineering, pp. 19–94. Springer, Cham (2016) Bae, E., Shi, J., Tai, X.C.: Graph cuts for curvature based image denoising. IEEE Trans. Image Process. 20(5), 1199–1210 (2011) Deng, L.J., Glowinski, R., Tai, X.C.: A New Operator Splitting Method for Euler’s Elastica Model. arXiv preprint arXiv:1811.07091 (2018) Morel, J.M., Petro, A.B., Sbert, C.: Screened Poisson equation for image contrast enhancement. Image Process. Line 4, 16–29 (2014) Kellman, P., et al.: Classification images reveal that deep learning networks fail to perceive illusory contours. J. Vis. 17(10), 569–569 (2017) Poscoliero, T., Girelli, M.: Electrophysiological modulation in an effort to complete illusory figures: configuration, illusory contour and closure effects. Brain Topogr. 31(2), 202–217 (2018) Rockafellar, R.T., Wets, R.J.-B.: Scenarios and policy aggregation in optimization under uncertainty. Math. Oper. Res. 16, 119–147 (1991) Sun, J., Xu, H.L., Zhang, M.: A new interpretation of the progressive hedging algorithm for multistage stochastic minimization problems. J. Ind. Manag. Optim. 2, 1–2 (2019). https://doi.org/10.3934/jimo.2019022 Chan, T.F., Sandberg, B.Y., Vese, L.A.: Active contours without edges for vector-valued images. J. Vis. Commun. Image Represent. 11(2), 130–141 (2000) Rudin, L., Osher, S., Fatemi, E.: Nonlinear total variation based noise removal algorithms. Phys. D Nonlinear Phenom. 60(1–4), 259–268 (1992) Chan, T.F., Esedoglu, S., Nikolova, M.: Algorithms for finding global minimizers of image segmentation and denoising models. SIAM J. Appl. Math. 66(5), 1632–1648 (2006) Yuan, J., Bae, E., Tai, X.C.: A Study on Continuous Max-Flow and Min-Cut Approaches. In:CVPR, USA, San Francisco (2010) Bae, E., et al.: A Fast Continuous Max-Flow Approach to Non-convex Multi-labeling Problems. Efficient Algorithms for Global Optimization Methods in Computer Vision, pp. 134–154. Springer, Berlin (2014) Hong, M., Luo, Z.Q.: On the linear convergence of the alternating direction method of multipliers. Math. Program. 162(1–2), 165–199 (2017) Liu, Q., Shen, X., Gu, Y.: Linearized ADMM for Non-convex Non-smooth Optimization with Convergence Analysis. arXiv preprint arXiv:1705.02502 (2017) Myllykoski, M., Glowinski, R., Karkkainen, T., Rossi, T.: A new augmented Lagrangian approach for L1-mean curvature image denoising. SIAM J. Imaging Sci. 8(1), 95–125 (2015) Yashtini, M.: Alternating Direction Method of Multiplier for Euler’s Elastica-Based Denoising, Scale Space and Variational Methods in Computer Vision, pp. 690–701. Springer, Berlin (2015) Bae, E., Tai, X.C., Zhu, W.: Augmented Lagrangian method for an Euler’s elastica based segmentation model that promotes convex contours. Inverse Problems Imaging 11(1), 1–23 (2017)