Abstract
Numerous problems in signal processing and imaging, statistical learning and data mining, or computer vision can be formulated as optimization problems which consist in minimizing a sum of convex functions, not necessarily differentiable, possibly composed with linear operators and that in turn can be transformed to split feasibility problems (SFP); see for example Censor and Elfving (Numer. Algorithms 8, 221–239 1994). Each function is typically either a data fidelity term or a regularization term enforcing some properties on the solution; see for example Chaux et al. (SIAM J. Imag. Sci. 2, 730–762 2009) and references therein. In this paper, we are interested in split feasibility problems which can be seen as a general form of Q-Lasso introduced in Alghamdi et al. (2013) that extended the well-known Lasso of Tibshirani (J. R. Stat. Soc. Ser. B 58, 267–288 1996). Q is a closed convex subset of a Euclidean m-space, for some integer m ≥ 1, that can be interpreted as the set of errors within given tolerance level when linear measurements are taken to recover a signal/image via the Lasso. Inspired by recent works by Lou and Yan (2016), Xu (IEEE Trans. Neural Netw. Learn. Syst. 23, 1013–1027 2012), we are interested in a nonconvex regularization of SFP and propose three split algorithms for solving this general case. The first one is based on the DC (difference of convex) algorithm (DCA) introduced by Pham Dinh Tao, the second one is nothing else than the celebrate forward-backward algorithm, and the third one uses a method introduced by Mine and Fukushima. It is worth mentioning that the SFP model a number of applied problems arising from signal/image processing and specially optimization problems for intensity-modulated radiation therapy (IMRT) treatment planning; see for example Censor et al. (Phys. Med. Biol. 51, 2353–2365, 2006).
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
Alghamdi, M.A., Ali Alghamdi, M., Shahzad, N., Naseer, H.-K. X.: Properties and Iterative Methods for the Q-Lasso, Abstract and Applied Analysis. Article ID 250943, 8 pages (2013)
Byrne, C.: Iterative oblique projection onto convex sets and the split feasibility problem. Inverse Prob. 18, 441–453 (2002)
Byrne, C.: A unified treatment of some iterative algorithms in signal processing and image reconstruction. Inverse Prob. 20, 103–120 (2004)
Censor, Y., Bortfeld, T., Martin, B., Trofimov, A.: A unified approach for inversion problems in intensity-modulated radiation therapy. Phys. Med. Biol. 51, 2353–2365 (2006)
Censor, Y., Elfving, T.: A multiprojection algorithm using Bregman projections in a product space. Numer. Algorithms 8, 221–239 (1994)
Censor, Y., Gibali, A., Lenzen, F., Schnorr, Ch.: The implicit convex feasibility problem and its application to adaptive image denoising. J. Comput. Math. 34, 610–625 (2016)
Chartrand, R.: Exact reconstruction of sparse signals via nonconvex minimization. IEEE Signal Process Lett. 14, 707–710 (2007)
Chen, S., Donoho, D., Saunders, M.: Atomic decomposition by basis pursuit. SIAM J. Comput. 20, 33–61 (1998)
Chaux, C., Pesquet, J.-C., Pustelnik, N.: Nested iterative algorithms for convex constrained image recovery problems. SIAM J. Imag. Sci. 2, 730–762 (2009)
Chen, S.S., Donoho, D.L., Saunders, M.A.: Atomic decomposition by basis pursuit. SIAM J. Sci. Comput. 20, 33–61 (1998)
Combettes, P.L., Pesquet, J.-C.: A Douglas-Rachford splitting approach to nonsmooth convex variational signal recovery. IEEE J. Sel. Top. Sign. Proces. 1, 564–574 (2007)
Condat, L.: A generic proximal algorithm for convex optimization: application to total variation minimization. IEEE Signal Process Lett. 21, 985–989 (2014)
Donoho, D.: Compressed sensing. IEEE Trans. Inf. Theory 52, 1289–1306 (2006)
Esser, E., Lou, Y., Xin, J.: A method for finding structured sparse solutions to non-negative least squares problems with applications. SIAM J. Imag. Sci. 6, 2010–2046 (2013)
Lou, Y., Yan, M.: Fast l 1 − l 2 Minimization via a proximal operator. arXiv:1609.09530 (2017)
Micchelli, Ch.A., Shen, L., Xu, Y., Zeng, X.: Proximity algorithms for the L 1/TV image denoising model. Adv. Comput. Math. 38, 401–426 (2013)
Mine, H., Fukushima, M.: A minimization method for the sum of a convex function and a continuously differentiable function. J. Optim. Theory Appl. 33, 9–23 (1981)
Moudafi, A.: About proximal algorithms for Q-Lasso, Thai Mathematical Journal (2016)
Natarajan, B.K.: Sparse approximate solutions to linear systems. SIAM J. Comput. 24, 227–234 (1995)
Qu, B., Xiu, N.: A note on the CQ algorithm for the split feasibility problem. Inverse Prob. 21, 1655–1665 (2005)
Tang, Y.-C., Liu, L.-W., Gibali, A.: Note on the modified relaxation CQ algorithm for the split feasibility problem. Optim. Lett., 1–14. https://doi.org/10.1007/s11590-017-1148-3 (2017)
Tibshirani, R.: Regression Shrinkage and selection via the Lasso. J. R. Stat. Soc. Ser. B 58, 267–288 (1996)
Yin, P., Lou, Y., He, Q., Xin, J.: Minimization of l 1−2 for compressed sensing. SIAM J. Sci. Comput. 37, 536–563 (2015)
Xu, Z., Chang, X., Xu, F., Zhang, H.: L 1−2 regularization: a thresholding representation theory and a fast solver. IEEE Trans. Neural Netw. Learn. Syst. 23, 1013–1027 (2012)
Zeng, X., Figueiredo, M.A.-T.: Solving OSCAR regularization problems by fast approximate proximal splittings algorithms. Digital Signal Process. 31, 124–135 (2014)
Acknowledgments
We wish to thank the anonymous referee for the thorough analysis and review; all the comments and suggestions helped tremendously in improving the quality of this paper and made it suitable for publication. The first author wish to thank his team “Image & Modèle” and the Computer Science and System Laboratory (L.I.S) of Aix-Marseille University. The second author work is supported by the EU FP7 IRSES program STREVCOMS, grant no. PIRSES-GA-2013-612669.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Moudafi, A., Gibali, A. l 1-l 2 regularization of split feasibility problems. Numer Algor 78, 739–757 (2018). https://doi.org/10.1007/s11075-017-0398-6
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11075-017-0398-6
Keywords
- Q-Lasso
- Split feasibility
- Soft-thresholding
- Regularization
- DCA algorithm
- Forward-backward iterations
- Mine-Fukushima algorithm
- Douglas-Rachford algorithm