Abstract
In this paper we propose the forward–backward splitting methods with linesearches for solving nonsmooth optimization problems without the standard assumption of the Lipschitz continuity of the gradient in Banach spaces. We prove the weak convergence of the iterative sequence generated by these methods, and further prove convergence with asymptotic rate \(\frac{1}{n}\) to the optimal value under the assumption of the boundedness of the iterative sequence.
Similar content being viewed by others
References
Albert, Y.: Decomposition theorem in Banach spaces. Field Inst. Commun. 25, 77–93 (2000)
Albert, Y., Ryazantseva, I.: Nonlinear Ill-Posed Problems of Monotone Type. Springer, New York (2006)
Attouch, H., Czarnecki, M.O., Peypouquet, J.: Coupling forward–backward with penalty schemes and parallel splitting for constrained variational inequalities. SIAM J. Optim. 21(4), 1251–1274 (2011)
Bauschke, H.H., Combettes, P.L.: Convex Analysis and Monotone Operator Theory in Hilbert Spaces. Springer, New York (2011)
Bauschke, H.H., Bolte, J., Teboulle, M.: A descent lemma beyond Lipschitz gradient continuity: first order methods revisited and applications. Math. Oper. Res. 42, 330–348 (2016)
Beck, A., Teboulle, M.: Gradient-based algorithms with applications to signal recovery problems. In: Palomar, D., Eldar, Y. (eds.) Convex Optimization in Signal Processing and Communications, pp. 42–88. University Press, Cambridge (2010)
Bello Cruz, J.Y., Nghia, T.T.: On the convergence of the forward–backward splitting method with linesearches. Optim. Method Softw. 7, 1–30 (2016)
Bolte, J., Sabach, S., Teboulle, M., Vaisbourd, Y.: First order methods beyond convexity and Lipschitz gradient continuity with applications to quadratic inverse problems. SIAM J. Optim. 28, 2131–2151 (2018)
Bonnans, J.F., Shapiro, A.: Perturbation Analysis of Optimization Problems. Springer, New York (2000)
Bredies, K.: A forward–backward splitting algorithm for the minimization of nonsmooth convex functionals in Banach space. Inverse Probl. 25, 015005 (2009)
Cioranescu, I.: Geometry of Banach Spaces, Duality Mappings and Nonlinear Problems. Mathematics and Its Applications, vol. 62. Kluwer Academic Publishers, Dordrecht, The Netherlands (1990)
Combettes, P.L.: Inconsistent signal feasibility problems: least-squares solutions in a product space. IEEE Trans. Signal Process. 42, 2955–2966 (1994)
Combettes, P.L., Dũng, D., Vũ, B.C.: Dualization of signal recovery problems. Set-Valued Anal. 18, 373–404 (2010)
Combettes, P.L., Wajs, V.R.: Signal recovery by proximal forward–backward splitting. Multiscale Model. Simul. 4, 1168–1200 (2005)
Combettes, P.L., Pesquet, J.C.: A Douglas–Rachford splitting approach to nonsmooth convex variational signal recovery. IEEE J. Sel. Top. Signal Process. 1, 564–574 (2007)
Guan, W.B., Song, W.: The generalized forward–backward splitting method for the minimization of the sum of two functions in Banach spaces. Numer. Funct. Anal. Optim. 7, 867–886 (2015)
Guan, W.B., Song, W.: The forward–backward splitting method and its convergence rate for the minimization of the sum of two functions in Banach space. Optim. Lett. 2, 1–24 (2020)
Kankam, K., Pholasa, N., Cholamjiak, P.: Hybrid forward–backward algorithms using linesearch rule for minimization problem. Thai J. Math. 17(3), 607–625 (2019)
Kankam, K., Pholasa, N., Cholamjiak, P.: On convergence and complexity of the modified forward–backward method involving new linesearches for convex minimization. Math. Meth. Appl. Sci. 42(5), 1352–1362 (2019)
Lions, P.L., Mercier, B.: Splitting algorithms for the sum of two nonlinear operators. SIAM J. Numer. Anal. 16, 964–979 (1979)
salzo, S.: The variable metric forward–backward splitting algorithm under mild differentiability assumptions. SIAM J. Optim. 4, 2153–2181 (2017)
Suantai, S., Noor, M.A., Kankam, K., Cholamjiak, P.: Novel forward–backward algorithms for optimization and applications to compressive sensing and image inpainting. Adv. Differ. Equ-ny. 2021, 265 (2021)
Takahashi, W.: Convex Analysis and Approximation of Fixed Points. Mathematical Analysis Series, vol. 2. Yokohama Publishers, Yokohama, Japan (2000)
Acknowledgements
The work was supported by PHD research startup foundation of Harbin Normal University(No. XKB201804) and the National Natural Sciences Grant(No. 11871182)
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Guan, WB., Song, W. The forward–backward splitting method for non-Lipschitz continuous minimization problems in Banach spaces. Optim Lett 16, 2435–2456 (2022). https://doi.org/10.1007/s11590-021-01840-y
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11590-021-01840-y