On Tikhonov regularization, bias and variance in nonlinear system identification
نویسنده
چکیده
Regularization is a general method for solving ill-posed and ill-conditioned problems. Traditionally, ill-conditioning in system identiication problems is usually approached using regularization methods such as ridge regression and principal component regression. In this work it is argued that the Tikhonov regularization method is a powerful alternative for regulariza-tion of non-linear system identiication problems by introducing smoothness of the model as a prior. Its properties is discussed in terms of an analysis of bias and variance, and illustrated by a semi-realistic simulation example.
منابع مشابه
A numerical approach for solving a nonlinear inverse diusion problem by Tikhonov regularization
In this paper, we propose an algorithm for numerical solving an inverse non-linear diusion problem. In additional, the least-squares method is adopted tond the solution. To regularize the resultant ill-conditioned linear system ofequations, we apply the Tikhonov regularization method to obtain the stablenumerical approximation to the solution. Some numerical experiments con-rm the utility of th...
متن کاملA new approach to convergence rate analysis of Tikhonov regularization for parameter identification in heat conduction
In this paper we investigate the stability and convergence rates of the widely used output least-squares method with Tikhonov regularization for the identification of the conductivity distribution in a heat conduction system. Due to the rather restrictive source conditions and regularity assumptions on the nonlinear parameter-to-solution operator concerned, the existing Tikhonov regularization ...
متن کاملSolving a nonlinear inverse system of Burgers equations
By applying finite difference formula to time discretization and the cubic B-splines for spatial variable, a numerical method for solving the inverse system of Burgers equations is presented. Also, the convergence analysis and stability for this problem are investigated and the order of convergence is obtained. By using two test problems, the accuracy of presented method is verified. Additional...
متن کاملA convergence analysis for Tikhonov regularization of nonlinear ill-posed problems
In this paper we consider the a posteriori parameter choice strategy proposed by Scherzer et al in 1993 for the Tikhonov regularization of nonlinear ill-posed problems and obtain some results on the convergence and convergence rate of Tikhonov regularized solutions under suitable assumptions. Finally we present some illustrative examples.
متن کاملStability and Convergence Analysis of Tikhonov Regularization for Parameter Identiication in a Parabolic Equation
In this paper we investigate stability and convergence rates of the Tikhonov regularization method for the identiication of the diiusion parameter in a multi{dimensional parabolic equation. By choosing a problem{adapted approach, we obtain much better results than by applying the general theory of Tikhonov regularization of nonlinear inverse problems.
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- Automatica
دوره 33 شماره
صفحات -
تاریخ انتشار 1997