Generalized Forward-Backward Splitting

نویسندگان

  • Hugo Raguet
  • Jalal Fadili
  • Gabriel Peyré
چکیده

This paper introduces the generalized forward-backward splitting algorithm for minimizing convex functions of the form F + ∑i=1Gi, where F has a Lipschitzcontinuous gradient and the Gi’s are simple in the sense that their Moreau proximity operators are easy to compute. While the forward-backward algorithm cannot deal with more than n = 1 non-smooth function, our method generalizes it to the case of arbitrary n. Our method makes an explicit use of the regularity of F in the forward step, and the proximity operators of the Gi’s are applied in parallel in the backward step. This allows the generalized forward-backward to efficiently address an important class of convex problems. We prove its convergence in infinite dimension, and its robustness to errors on the computation of the proximity operators and of the gradient of F . Examples on inverse problems in imaging demonstrate the advantage of the proposed methods in comparison to other splitting algorithms.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Projected-gradient algorithms for generalized equilibrium seeking in Aggregative Games are preconditioned Forward-Backward methods

We show that projected-gradient methods for the distributed computation of generalized Nash equilibria in aggregative games are preconditioned forward-backward splitting methods applied to the KKT operator of the game. Specifically, we adopt the preconditioned forward-backward design, recently conceived by Yi and Pavel in the manuscript “A distributed primal-dual algorithm for computation of ge...

متن کامل

A Generalized Forward-Backward Splitting

This paper introduces a generalized forward-backward splitting algorithm for finding a zero of a sum of maximal monotone operators B + ∑n i=1 Ai, where B is cocoercive. It involves the computation of B in an explicit (forward) step and of the parallel computation of the resolvents of the Ai’s in a subsequent implicit (backward) step. We prove its convergence in infinite dimension, and robustnes...

متن کامل

Joint Segmentation and Shape Regularization With a Generalized Forward-Backward Algorithm

This paper presents a method for the simultaneous segmentation and regularization of a series of shapes from a corresponding sequence of images. Such series arise as time series of 2D images when considering video data, or as stacks of 2D images obtained by slicewise tomographic reconstruction. We first derive a model where the regularization of the shape signal is achieved by a total variation...

متن کامل

FASTA: A Generalized Implementation of Forward-Backward Splitting

where | · | denotes the `1 norm, ‖·‖ denotes the `2 norm, A is a matrix, b is a vector, and μ is a scalar parameter. This problem is of the form (1) with g(z) = μ|z|, and f(z) = 12‖z− b‖ . More generally, any problem of the form (1) can be solved by FASTA, provided the user can provide function handles to f, g, A and A . The solver FASTA contains numerous enhancements of FBS to improve converge...

متن کامل

A Field Guide to Forward-Backward Splitting with a FASTA Implementation

Non-differentiable and constrained optimization play a key role in machine learning, signal and image processing, communications, and beyond. For highdimensional minimization problems involving large datasets or many unknowns, the forward-backward splitting method (also known as the proximal gradient method) provides a simple, yet practical solver. Despite its apparent simplicity, the performan...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2011