This paper proposes a new regularized transform domain normalized LMS (R-TDNLMS) algorithm and studies its mean and mean square convergence performances. The proposed algorithm extends the conventional TDNLMS algorithm by imposing a regularization term on the filter coefficients to reduce the variance of estimators due to the lacking of excitation in a certain frequency band or in the presence ...

In the present draft, we propose the computational approach to generalized ratio type estimator of population mean of the main variable under study using auxiliary information. The expressions for the bias and mean square errors (MSE) have been obtained up to the first order of approximation. The minimum value of the MSE of the proposed estimator is also obtained for the optimum value of the ch...

This paper proposes a novel linear estimator named stochastic MV-PURE estimator, developed for the stochastic linear model, and designed to provide improved performance over the linear minimum mean square error (MMSE) Wiener estimator in cases prevailing in practical, real-world settings, where at least some of the second-order statistics of the random vectors under consideration are only imper...

We consider observations of a random process (or a random field), which is modeled by a nonlinear regression with a parametrized mean (or trend) and a parametrized covariance function. Optimality criteria for parameter estimation are to be based here on the mean square errors (MSE) of estimators. We mention briefly expressions obtained for very small samples via probability densities of estimat...

In the present paper we compute the geometric minimum mean square error for the vector linear estimation problem. We do this by proving that the vector linear estimator that minimizes the mean square error (MSE) also minimizes the geometric MSE.

An analysis of two LMS-Newton adaptive filtering algorithms with variable convergence factor is presented. The relations of these algorithms with the conventional recursive least-squares algorithm are first addressed. Their performance in stationary and nonstationary environments is then studied and closed-form formulas for the excess mean-square error (MSE) are derived. The paper deals, in add...

This paper considers the quantification of the prediction performance in Gaussian process regression. The standard approach is to base the prediction error bars on the theoretical predictive variance, which is a lower bound on the mean square-error (MSE). This approach, however, does not take into account that the statistical model is learned from the data. We show that this omission leads to a...