Nonlinear least squares and regularization
نویسنده
چکیده
I present and discuss some general ideas about iterative nonlinear output least-squares methods. The main result is that, if it is possible to do forward modeling on a physical problem in a way that permits the output (i.e., the predicted values of some physical parameter that could be measured) and the rst derivative of the same output with respect to the model parameters (whatever they may be) to be calculated numerically, then it is possible (at least in principle) to solve the inverse problem using the method described. The main trick learned in this analysis comes from the realization that the steps in the model updates may have to be quite small in some cases for the implied guarantees of convergence to be realized.
منابع مشابه
A numerical approach for solving a nonlinear inverse diusion problem by Tikhonov regularization
In this paper, we propose an algorithm for numerical solving an inverse non-linear diusion problem. In additional, the least-squares method is adopted tond the solution. To regularize the resultant ill-conditioned linear system ofequations, we apply the Tikhonov regularization method to obtain the stablenumerical approximation to the solution. Some numerical experiments con-rm the utility of th...
متن کاملAn Iterative Method for the Solution of Nonlinear Regularization Problems with Regularization Parameter Estimation
Ill posed problems constitute the mathematical model of a large variety of applications. Aim of this paper is to define an iterative algorithm finding the solution of a regularization problem. The method minimizes a function constituted by a least squares term and a generally nonlinear regularization term, weighted by a regularization parameter. The proposed method computes a sequence of iterat...
متن کاملNonlinear Least Squares and Super Resolution
Digital super resolution is a term used to describe the inverse problem of reconstructing a high resolution image from a set of known low resolution images, each of which is shifted by subpixel displacements. Simple models assume the subpixel displacements are known, but if the displacements are not known, then nonlinear approaches must be used to jointly find the displacements and the reconstr...
متن کاملOn the Evaluation Complexity of Cubic Regularization Methods for Potentially Rank-Deficient Nonlinear Least-Squares Problems and Its Relevance to Constrained Nonlinear Optimization
We propose a new termination criteria suitable for potentially singular, zero or non-zero residual, least-squares problems, with which cubic regularization variants take at most O(ǫ) residualand Jacobian-evaluations to drive either the Euclidean norm of the residual or its gradient below ǫ; this is the best-known bound for potentially rank-deficient nonlinear least-squares problems. We then app...
متن کاملAn Efficient Iterative Approach for Large-Scale Separable Nonlinear Inverse Problems
This paper considers an efficient iterative approach to solve separable nonlinear least squares problems that arise in large scale inverse problems. A variable projection GaussNewton method is used to solve the nonlinear least squares problem, and Tikhonov regularization is incorporated using an iterative Lanczos hybrid scheme. Regularization parameters are chosen automatically using a weighted...
متن کاملA Curvilinear Search for Systems of Nonlinear Equations
We propose a curvilinear search for nonlinear systems of equations and path-following methods that are very nonlinear with the dominant part in the tangent space. The curvilinear search is very easy to implement and should be used with the (Gauss-)Newton method. At the cost of one function evaluation the curvature along the search direction can be reduced. For zero residual nonlinear least squa...
متن کامل