Spectral Projected Gradient Method for the Procrustes Problem
نویسنده
چکیده
We study and analyze a nonmonotone globally convergent method for minimization on closed sets. This method is based on the ideas from trust-region and Levenberg-Marquardt methods. Thus, the subproblems consists in minimizing a quadratic model of the objective function subject to a given constraint set. We incorporate concepts of bidiagonalization and calculation of the SVD “with inaccuracy” to improve the performance of the algorithm, since the solution of the subproblem by traditional techniques, which is required in each iteration, is computationally expensive. Other feasible methods are mentioned, including a curvilinear search algorithm and a minimization along geodesics algorithm. Finally, we illustrate the numerical performance of the methods when applied to the Orthogonal Procrustes Problem.
منابع مشابه
The Orthogonally Constrained Regression Revisited
Two data analysis problems the orthonormal Procrustes problem and the Penrose regression problem are reconsidered in this paper These problems are known in the literature for their importance as well as di culty This work presents a way to calculate the projected gradient and the projected Hessian explicitly One immediate result of this calculation is the complete characterization of the rst or...
متن کاملSpectral projected gradient method for stochastic optimization
We consider the Spectral Projected Gradient method for solving constrained optimization porblems with the objective function in the form of mathematical expectation. It is assumed that the feasible set is convex, closed and easy to project on. The objective function is approximated by a sequence of Sample Average Approximation functions with different sample sizes. The sample size update is bas...
متن کاملInexact Spectral Projected Gradient Methods on Convex Sets
A new method is introduced for large scale convex constrained optimization. The general model algorithm involves, at each iteration, the approximate minimization of a convex quadratic on the feasible set of the original problem and global convergence is obtained by means of nonmonotone line searches. A specific algorithm, the Inexact Spectral Projected Gradient method (ISPG), is implemented usi...
متن کاملThe Projected Gradient Method for Least Squares Matrix Approximations with Spectral Constraints
The problems of computing least squares approximations for various types of real and symmetric matrices subject to spectral constraints share a common structure. This paper describes a general procedure in using the projected gradient method. It is shown that the projected gradient of the objective function on the manifold of constraints usually can be formulated explicitly. This gives rise to ...
متن کاملUniversidad Central de Venezuela
A study of the convergence properties of spectral projected subgradient method is presented and the convergence is shown. The convergence is based on spectral projected gradient approach. Some updates of the spectral projected subgradient are described.
متن کامل