Abstract
The proximal point algorithm is classical and popular in the community of optimization. In practice, inexact proximal point algorithms which solve the involved proximal subproblems approximately subject to certain inexact criteria are truly implementable. In this paper, we first propose an inexact proximal point algorithm with a new inexact criterion for solving convex minimization, and show its O(1/k) iteration-complexity. Then we show that this inexact proximal point algorithm is eligible for being accelerated by some influential acceleration schemes proposed by Nesterov. Accordingly, an accelerated inexact proximal point algorithm with an iteration-complexity of O(1/k 2) is proposed.
Similar content being viewed by others
References
Moreau, J.J.: Proximaté et dualité dans un espace Hilbertien. Bull. Soc. Math. Fr. 93, 273–299 (1965)
Martinet, B.: Regularisation, d’inéquations variationelles par approximations succesives. Rev. Fra. Inform. Rech. Opér. 4, 154–159 (1970)
Rockafellar, R.T.: Monotone operators and the proximal point algorithm. SIAM J. Control Optim. 14, 877–898 (1976)
Burke, J.V., Qian, M.J.: A variable metric proximal point algorithm for monotone operators. SIAM J. Control Optim. 37, 353–375 (1998)
Eckstein, J.: Approximate iterations in Bregman-function-based proximal algorithms. Math. Program. 83, 113–123 (1998)
Güler, O.: On the convergence of the proximal point algorithm for convex minimization. SIAM J. Control Optim. 29, 403–419 (1991)
Monteiro, R.D.C., Svaiter, B.F.: Convergence rate of inexact proximal point methods with relative error criteria for convex optimization. Manuscript (2010)
Güler, O.: New proximal point algorithms for convex minimization. SIAM J. Optim. 2, 649–664 (1992)
Nesterov, Y.E.: A method for solving the convex programming problem with convergence rate O(1/k 2). Dokl. Akad. Nauk SSSR 269, 543–547 (1983)
Nesterov, Y.E.: On an approach to the construction of optimal methods of minimization of smooth convex functions. Èkon. Mat. Metody 24, 509–517 (1988)
Beck, A., Teboulle, M.: A fast iterative shrinkage-thresholding algorithm for linear inverse problems. SIAM J. Imaging Sci. 2, 183–202 (2009)
Author information
Authors and Affiliations
Corresponding author
Additional information
Communicated by Jen-Chih Yao.
Rights and permissions
About this article
Cite this article
He, B., Yuan, X. An Accelerated Inexact Proximal Point Algorithm for Convex Minimization. J Optim Theory Appl 154, 536–548 (2012). https://doi.org/10.1007/s10957-011-9948-6
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10957-011-9948-6