Title:The proximal augmented Lagrangian method for nonsmooth composite optimization

Abstract:We develop a customized proximal augmented Lagrangian method to efficiently solve a class of nonsmooth composite optimization problems. We introduce an auxiliary variable to split the objective function into the sum of a differentiable but possibly nonconvex component and a nondifferentiable convex regularization term. By utilizing the Moreau envelope of the regularization function, we transform the associated augmented Lagrangian into a continuously differentiable form that can be efficiently minimized using a variety of techniques. Our algorithm applies to a broader class of problems than proximal gradient methods and has stronger convergence guarantees and a more refined step size update than the alternating direction method of multipliers. These features make it an attractive option for solving structured optimal control problems. Furthermore, when the differentiable component of the objective function is strictly convex and the regularization function is convex, we prove asymptotic convergence of continuous-time gradient flow dynamics to the optimal solution. Finally, we apply our approach to the problem of edge addition in directed consensus networks.