Estimating Those Transformations That Produce the Best-fitting Additive Model: Smoothers Versus Universal Approximators
نویسنده
چکیده
When estimating a generalized additive model, a crucial decision that must be made is the choice of underlying technique that will be used to estimate those transformations that produce the best-fitting model. Data smoothers and universal approximators are two opposing techniques that seem to hold the most promise. ACE (alternating conditional expectations) was developed by Breiman and Friedman and utilizes a super-smoother to determine conditional expectation estimates. It was intended to be used as a tool to estimate the optimal transformations for multiple regression problems. Generalized additive neural networks on the other hand depend on the use of universal approximators to compute the nonlinear univariate transformations for the independent variables. These two approaches are compared and illustrated with a suitable example from
منابع مشابه
Estimating Binary Monotonic Regression Models and Their Uncertainty by Incorporating Kernel Smoothers
Monotonic regression (MR) is a method that is used for fitting a model to multivariate data in which a response is increasing or decreasing with respect to several explanatory variables. Recently, MR methods were substantially improved, and a group of algorithms can now produce monotonic fits to multivariate datasets containing over a million observations. It is demonstrated here that the accur...
متن کاملREACT Scatterplot Smoothers: Superefficiency through Basis Economy
REACT estimators for the mean of a linear model involve three steps: transforming the model to a canonical form that provides an economical representation of the unknown mean vector, estimating the risks of a class of candidate linear shrinkage estimators, and adaptively selecting the candidate estimator that minimizes estimated risk. Applied to oneor higherway layouts, the REACT method generat...
متن کاملFitting Generalized Additive Models with the GAM Procedure in SAS 9 . 2
Generalized additive models are useful in finding predictor-response relationships in many kinds of data without using a specific model. They combine the ability to explore many nonparametric relationships simultaneously with the distributional flexibility of generalized linear models. The approach often brings to light nonlinear dependency structures in your data. This paper discusses an examp...
متن کاملAdditive Models with Trend Filtering
We consider additive models built with trend filtering, i.e., additive models whose components are each regularized by the (discrete) total variation of their (k+1)st (discrete) derivative, for a chosen integer k ≥ 0. This results in kth degree piecewise polynomial components, (e.g., k = 0 gives piecewise constant components, k = 1 gives piecewise linear, k = 2 gives piecewise quadratic, etc.)....
متن کاملA Semi-Automatic Algorithm for Estimating Cobb Angle
Background: Scoliosis is the most common type of spinal deformity. A universal and standard method for evaluating scoliosis is Cobb angle measurement, but several studies have shown that there is intra- and inter- observer variation in measuring cobb angle manually.Objective: Develop a computer- assisted system to decrease operator-dependent errors in Cobb angle measurement.Methods: The spinal ...
متن کامل