Penalized Likelihood Functional Regression
نویسندگان
چکیده
This paper studies the generalized functional linear model with a scalar response and a functional predictor. The response given the functional predictor is assumed to come from the distribution of an exponential family. A penalized likelihood approach is proposed to estimate the unknown intercept and coefficient function in the model. Inference tools such as point-wise confidence intervals of the coefficient function and prediction intervals are derived. The minimax rate of convergence for the error in predicting the mean response is established. It is shown that the penalized likelihood estimator attains the optimal rate of convergence. Our simulations demonstrate a competitive performance against the existing approach. The method is further illustrated in the use of the DTI tractography to distinguish corpus callosum tracts with multiple sclerosis from normal tracts.
منابع مشابه
Penalized Bregman Divergence Estimation via Coordinate Descent
Variable selection via penalized estimation is appealing for dimension reduction. For penalized linear regression, Efron, et al. (2004) introduced the LARS algorithm. Recently, the coordinate descent (CD) algorithm was developed by Friedman, et al. (2007) for penalized linear regression and penalized logistic regression and was shown to gain computational superiority. This paper explores...
متن کاملPenalized Likelihood Regression in Reproducing Kernel Hilbert Spaces with Randomized Covariate Data
Penalized likelihood regression consists of a category of commonly used regularization methods, including regression splines with RKHS penalty and the LASSO. When the observed data comes from a non-Gaussian exponential family distribution, a penalized log-likelihood is commonly used to estimate of the regression function. This technique allows a flexible form of the estimator and aims at an app...
متن کاملEstimation in Generalized Linear Models for Functional Data via Penalized Likelihood
We analyze in a regression setting the link between a scalar response and a functional predictor by means of a Functional Generalized Linear Model. We first give a theoretical framework and then discuss identifiability of the model. The functional coefficient of the model is estimated via penalized likelihood with spline approximation. The L2 rate of convergence of this estimator is given under...
متن کاملAsymptotic properties of a double penalized maximum likelihood estimator in logistic regression
Maximum likelihood estimates in logistic regression may encounter serious bias or even non-existence with many covariates or with highly correlated covariates. In this paper, we show that a double penalized maximum likelihood estimator is asymptotically consistent in large samples. r 2007 Elsevier B.V. All rights reserved.
متن کاملAvoiding infinite estimates in logistic regression – theory, solutions, examples
In logistic regression analyses of small or sparse data sets, results obtained by maximum likelihood methods cannot be generally trusted. In such analyses, although the likelihood meets the convergence criterion, at least one parameter may diverge to plus or minus infinity. This situation has been termed ’separation’. Examples of two studies are given, where the phenomenon of separation occurre...
متن کامل