A block coordinate variable metric forward–backward algorithm
نویسندگان
چکیده
منابع مشابه
A block coordinate variable metric forward-backward algorithm
A number of recent works have emphasized the prominent role played by the KurdykaLojasiewicz inequality for proving the convergence of iterative algorithms solving possibly nonsmooth/nonconvex optimization problems. In this work, we consider the minimization of an objective function satisfying this property, which is a sum of a non necessarily convex differentiable function and a non necessaril...
متن کاملUnifying abstract inexact convergence theorems for descent methods and block coordinate variable metric iPiano
An abstract convergence theorem for a class of descent method that explicitly models relative errors is proved. The convergence theorem generalizes and unifies several recent abstract convergence theorems, and is applicable to possibly non-smooth and non-convex lower semi-continuous functions that satisfy the Kurdyka– Lojasiewicz inequality, which comprises a huge class of problems. The descent...
متن کاملA Self-Correcting Variable-Metric Algorithm for Stochastic Optimization
An algorithm for stochastic (convex or nonconvex) optimization is presented. The algorithm is variable-metric in the sense that, in each iteration, the step is computed through the product of a symmetric positive definite scaling matrix and a stochastic (mini-batch) gradient of the objective function, where the sequence of scaling matrices is updated dynamically by the algorithm. A key feature ...
متن کاملRobust Block Coordinate Descent
In this paper we present a novel randomized block coordinate descent method for the minimization of a convex composite objective function. The method uses (approximate) partial second-order (curvature) information, so that the algorithm performance is more robust when applied to highly nonseparable or ill conditioned problems. We call the method Robust Coordinate Descent (RCD). At each iteratio...
متن کاملOn the Convergence of the Variable Metric Algorithm
The variable metric algorithm is a frequently used method for calculating the least value of a function of several variables. However it has been proved only that the method is successful if the objective function is quadratic, although in practice it treats many types of objective functions successfully. This paper extends the theory, for it proves that successful convergence is obtained provi...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Journal of Global Optimization
سال: 2016
ISSN: 0925-5001,1573-2916
DOI: 10.1007/s10898-016-0405-9