Abstract
The Chan-Vese model using variational level set method (VSLM) has been widely used in image segmentation, but its efficiency is a challenge problem due to high computation costs of curvature as well as the Eiknal equation constraint. In this paper, we propose a continuous Max-Flow (CMF) method based on discrete graph cut approach to solve the VSLM for image segmentation. Firstly, we recast the original Chan-Vese model to a continuous max-flow problem via the primal-dual method and solve it using the alternating direction method of multipliers (ADMM). Then, we use the projection method to recover the continuous level set function for image segmentation expressed as a signed distance function. Finally, some numerical examples are presented to demonstrate the efficiency and accuracy of the proposed method.
Access provided by CONRICYT-eBooks. Download conference paper PDF
Similar content being viewed by others
Keywords
1 Introduction
Image segmentation is of great importance in image analysis, which has found a lot of applications in the fields of computer vision, medical imaging processing, remote sensing imaging analysis, etc. Its task is to divide an image into different parts according to image features without vacuum and overlapping. It can be accomplished by variational methods through minimizing a specific energy functional. Among of the existing approaches, the Mumford-Shah model [1] is a fundamental approach, but it is difficult to solve due to different space definitions of variables. The Chan-Vese model [2] can overcome this problem based on a reduced Mumford-Shah model and variational level set method (VLSM) [3, 4] with the concept of total variation (TV) [5].
The Chan-Vese model not only can solve a lot of problems of two-phase image segmentation, but also has become fundamental approach to various variational multi-phase image segmentation models [6]. Moreover, its idea can be extended to solve the related variational multi-phase image segmentation models, thus have received a lot of attentions recently. For the problem of two-phase segmentation \( \Omega =\Omega _{1} \, \cup \,\Omega _{2} \), \( \Omega _{1} \, \cap \,\Omega _{2} \, = \,\emptyset \), the Chan-Vese model based on the reduced Mumford-Shah model can be described as
where, \( Q_{1} = \alpha_{1} \left( {c_{1} - f} \right)^{2} \), \( Q_{2} = \alpha_{2} \left( {c_{2} - f} \right)^{2} \), \( c_{1} \) and \( c_{2} \) represent piecewise constant approximations of the original image \( f \) in regions \( \Omega _{1} \) and \( \Omega _{2} \) respectively. The function \( \phi \left( x \right) \) denotes a level set function. \( H\left( \phi \right) \), \( \delta \left( \phi \right) \) are Heaviside function and Dirac function of \( \phi \left( x \right) \). \( H\left( \phi \right) \), \( 1 - H\left( \phi \right) \) are characteristic functions of \( \Omega _{1} \) and \( \Omega _{2} \) respectively. If \( \phi \left( x \right) \) is defined as a signed distance function, it must fulfill the following Eiknal equation
Equations (1) and (2) constitute a constrained optimization problem. After \( c_{1} \) and \( c_{2} \) are estimated, \( \phi \left( x \right) \) can be obtained by solving the following gradient descent equation [2]
In order to avoid the re-initialization process of (4), [7] has augmented the constraint (2) into (1) via the penalty function method as below:
Thus, (3), (4) can be replaced with
But the computation of the curvature in (6) using finite difference scheme is highly complex. The Split Bregman projection (SBP) method designed by [8] can circumvent this difficulty by making use of a generalized thresholding formula and projection method in the alternating optimization process. The alternating iterative formulation can be presented as below.
A similar alternating direction method of multipliers projection (ADMMP) method is proposed in [8], which is given by
The SBP method and ADMMP method are motivated by the SB method and ADMM method for the equivalent model of Chan-Vese model [9]
After \( c \) is estimated, \( \lambda \) can be obtained via the fast SB method [10], and ADMM method [11] which were originally proposed to solve TV models for image restoration.
Another fast method to solve (9) is the graph cut approach [12] which recasts it to a Max-Flow/Min-Cut problem on a graph [13]. Also its continuous Max-Flow counterpart was proposed by [14,15,16] to avoid graph construction and complex data structures. In this paper, we will design the Continuous Max-Flow (CMF) method for (1) to provide a new fast implementation of it and lay the foundation for multi-phase image segmentation, 3D image segmentation, etc.
The paper is organized as follows. Section 2 briefly introduces the Continuous Max-Flow method for Chan-Vese model of convex optimization. The CMF method for classic Chan-Vese model under VSLM framework is designed in Sect. 3. In Sect. 4, the numerical experiments are conducted to compare the proposed method with some current fast approaches. Finally, concluding remarks and outlook are given in Sect. 5.
2 The Continuous Max-Flow Method for Equivalent Chan-Vese Model
As one can see that (9) is a minimization problem with two variables, it can be tackled using the alternating optimization strategy. After \( c \) is estimated, another sub-problem of minimization on \( \lambda \) is as follows.
The procedure of convex optimization to solve it is based on the relaxation of \( \lambda \in \left\{ {0,1} \right\} \) to \( \lambda \in \left[ {0,1} \right] \), and the thresholding formula for the final results. The relaxified version of (10) can be transformed into the Max-Min problem [14,15,16,17] as below.
Due to the following dual formulas
Then, (11) can become the following Continuous Max-Flow optimization problem
which can be solved via the ADMM method as given by
where \( \mu \) is a penalty parameter, \( \lambda \) is a Lagrangian multiplier.
3 The Continuous Max-Flow Method for the Chan-Vese Model
For the classic Chan-Vese model (1), (2) under the VLSM, after \( c \) has been estimated, it can be transformed into the following constrained optimization problem
In order to solve it, [2] has introduced the regularized Heaviside function \( H_{\varepsilon } \left( \phi \right) \) and the regularized Dirac function \( \delta_{\varepsilon } \left( \phi \right) \) as
Here \( \varepsilon \) is a small positive parameter and \( H_{\varepsilon } \left( \phi \right) \in \left[ {0,1} \right] \). Let \( \lambda = H_{\varepsilon } \left( \phi \right) \), then (15) becomes
The first formulation is just the relaxified version of (10), so its solution can be obtained via the CMF method as (14a), (14b) i.e.
In fact, (18a) can be divided into the following sub-problems of minimization in terms of alternating optimization respectively,
And their solutions are given by
Also, the solution of (18b) is given by
One can see that the constraints in (17) can recast the continuous level set function as a signed distance function. It can be implemented by the ADMMP method as
Now, by applying the alternating optimization strategy to (22a), we can obtain \( \phi^{k + 1} \) using the standard variational method while fixing \( \vec{w}^{k} \) as
Finally, (23) can be solved through Gauss-Seidel scheme approximately. Then, we can get \( \vec{w}^{k + 1} \) while fixing \( \phi^{k} \) as
Now we summarize the algorithm introduced in this section as follows.
4 Numerical Experiments
In this section, we present some numerical experiments to compare the effectiveness and efficiency of our proposed continuous max-flow method with the current fast algorithms (SBP, ADMMP) through the segmentation of three classic images. The experiments are implemented on PC (Intel (R) Core (TM) i5 Duo CPU @3.30 GHz 3.30 GHz; memory: 4 GB; code running environment: Matlab R2010b). Figure 1 shows the three images for segmentation. The segmentation results using SBP, ADMMP and the CMF method are shown in Figs. 2, 3, and 4. Here, we draw a red outline to represent the segmented contour.
One can observe from Fig. 2 that the blood vessels of liver are more accurately separated by the proposed CMF method than SBP, ADMMP (see the middle blood vessels of liver). Figure 3 demonstrates that the cameraman and the background are separated more clearly by the proposed CMF than the SBP, ADMMP (see the right of the cameraman image). The results in Fig. 4 shows that the CMF method provides better segmentation of irregular picture components than the SBP and ADMMP methods (see the edge of the irregular graphic picture).
To further illustrate the effectiveness of CMF method, the processing result using level set function of the three tested images are compared, as shown in Figs. 5, 6 and 7, respectively. It can be seen that all the three method achieve good performance on liver image, cameraman image and irregular graphic picture.
In order to compare the efficiency of the proposed CMF with the SBP and ADMMP, we list the numbers of iterations and CPU time of them in Table 1. It can be seen that our proposed method CMF needs much fewer iterations and CPU time, which proves that the computational efficiency of CMF method is faster than the current fast SBP method and ADMMP method.
5 Conclusions and Future Topics
Graph cut is a fast algorithm for the min-cut on graphs in computer vision, it is dual to the max-flow method on networks. The continuous max flow method inspired by its discrete counterpart has been proposed to solve some variational model in image processing. In this paper, we design the continuous max flow method for classic Chan-Vese model for image segmentation under the framework of variational level set with constraints of Eiknal equations. Firstly, the Chan-Vese model is transformed into a max-min problem by using dual formulations, based on it, the continuous max flow method is proposed using the alternating direction method of multipliers. Then, the Eiknal equation is solved by introducing an auxiliary variable and ADMM method. Numerical experiments demonstrate that this method is better than the current fast methods in efficiency and accuracy. The investigations in this paper can be extended to the problems of multiphase image segmentation and 3D image segmentation naturally.
References
Mumford, D., Shah, J.: Optimal approximations by piecewise smooth functions and associated variational problems. Commun. Pure Appl. Math. 42, 577–685 (1989). http://onlinelibrary.wiley.com/journal/10.1002/(ISSN)1097-0312
Chan, T.F., Vese, L.A.: Active contours without edges. IEEE Trans. Image Process. 10, 266–277 (2001)
Zhao, H.K., Chan, T.F., Merriman, B., Osher, S.: A variational level set approach to multiphase motion. J. Comput. Phys. 127, 179–195 (1996)
Osher, S., Sethian, J.A.: Fronts propagating with curvature-dependent speed: algorithms based on Hamilton-Jacobi formulations. J. Comput. Phys. 79, 12–49 (1988)
Rudin, L.I., Osher, S., Fatemi, E.: Nonlinear total variation based noise removal algorithms. Physica D 60, 259–268 (1992)
Vese, L.A., Chan, T.F.: A multiphase level set framework for image segmentation using the Mumford and Shah model. Int. J. Comput. Vision 50, 271–293 (2002)
Li, C., Xu, C., Gui, C., Fox, M.D.: Distance regularized level set evolution and its application to image segmentation. IEEE Trans. Image Process. 19, 3243–3254 (2010). http://www.imagecomputing.org/~cmli/paper/DRLSE.pdf
Duan, J., Pan, Z., Yin, X., Wei, W., Wang, G.: Some fast projection methods based on Chan-Vese model for image segmentation. Eurasip J. Image Video Process. 2014, 1–16 (2014)
Chan, T.F., Esedoglu, S., Nikolova, M.: Algorithms for finding global minimizers of image segmentation and denoising models. SIAM J. Appl. Math. 66, 1632–1648 (2006)
Goldstein, T., Osher, S.: The Split Bregman method for L1 regularized problems. SIAM J. Imaging Sci. 2, 323–343 (2009)
Goldstein, T., O’Donoghue, B., Setzer, S., Baraniuk, R.: Fast alternating direction optimization methods. SIAM J. Imaging Sci. 7, 1588–1623 (2014)
Boykov, Y., Veksler, O., Zabih, R.: Fast approximate energy minimization via graph cuts. IEEE Trans. Pattern Anal. Mach. Intell. 23, 1222–1239 (2001)
Strang, G.: Maximum flows and minimum cuts in the plane. Adv. Mech. Math. 3, 1–11 (2008)
Yuan, J., Bae, E., Tai, X.-C.: A study on continuous max-flow and min-cut approaches. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), San Francisco, USA, pp. 2217–2224 (2010)
Bae, E., Tai, X.-C., Yuan, J.: Maximizing flows with message-passing: computing spatially continuous min-cuts. In: Tai, X.-C., Bae, E., Chan, T.F., Lysaker, M. (eds.) EMMCVPR 2015. LNCS, vol. 8932, pp. 15–28. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-14612-6_2
Yuan, J., Bae, E., Tai, X.-C., Boykov, Y.: A spatially continuous max-flow and min-cut framework for binary labeling problems. Numer. Math. 126, 559–587 (2014)
Wei, K., Tai, X.-C., Chan, T.F., Leung, S.: Primal-dual method for continuous max-flow approaches. In: Computational Vision and Medical Image Processing V - Proceedings of 5th ECCOMAS Thematic Conference on Computational Vision and Medical Image Processing, VipIMAGE 2015, pp. 17–24 (2016)
Merkurjev, E., Bae, E., Bertozzi, A.L., Tai, X.-C.: Global binary optimization on graphs for classification of high-dimensional data. J. Math. Imaging Vis. 52, 414–435 (2015). https://springerlink.bibliotecabuap.elogim.com/journal/10851
Bae, E., Merkurjev, E.: Convex variational methods on graphs for multiclass segmentation of high-dimensional data and point clouds. J. Math. Imaging Vis. 58, 468–493 (2017)
Acknowledgments
The work has been partially supported by China Postdoctoral Science Foundation (2017M612204, 2015M571993), and the National Natural Science Foundation of China (61602269). Authors thank Prof. Xue-Cheng Tai, Department of Mathematics at University of Bergen, Prof. Xianfeng David Gu, Department of Computer Science, State University of New York at Stony Brook for their instructions and discussions.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Hou, G., Pan, H., Zhao, R., Hao, Z., Liu, W. (2018). Image Segmentation via the Continuous Max-Flow Method Based on Chan-Vese Model. In: Wang, Y., et al. Advances in Image and Graphics Technologies. IGTA 2017. Communications in Computer and Information Science, vol 757. Springer, Singapore. https://doi.org/10.1007/978-981-10-7389-2_23
Download citation
DOI: https://doi.org/10.1007/978-981-10-7389-2_23
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-10-7388-5
Online ISBN: 978-981-10-7389-2
eBook Packages: Computer ScienceComputer Science (R0)