Adaptive Sparse Grid Classification Using Grid Environments

نویسندگان

  • Dirk Pflüger
  • Ioan Lucian Muntean
  • Hans-Joachim Bungartz
چکیده

Common techniques tackling the task of classification in data mining employ ansatz functions associated to training data points to fit the data as well as possible. Instead, the feature space can be discretized and ansatz functions centered on grid points can be used. This allows for classification algorithms scaling only linearly in the number of training data points, enabling to learn from data sets with millions of data points. As the curse of dimensionality prohibits the use of standard grids, sparse grids have to be used. Adaptive sparse grids allow to get a trade-off between both worlds by refining in rough regions of the target function rather than in smooth ones. We present new results for some typical classification tasks and show first observations of dimension adaptivity. As the study of the critical parameters during development involves many computations for different parameter values, we used a grid environment which we present.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Adaptive Sparse Grid Techniques for Data Mining

It was shown in [1] that the task of classification in data mining can be tackled by employing ansatz functions associated to grid points in the (often high dimensional) feature-space rather than using data-centered ansatz functions. To cope with the curse of dimensionality, sparse grids have been used. The problem obtained by regularisation was solved using the combination technique for sparse...

متن کامل

A Sparse-grid Method for Multi-dimensional Backward Stochastic Differential Equations

A sparse-grid method for solving multi-dimensional backward stochastic differential equations (BSDEs) based on a multi-step time discretization scheme [31] is presented. In the multi-dimensional spatial domain, i.e. the Brownian space, the conditional mathematical expectations derived from the original equation are approximated using sparse-grid Gauss-Hermite quadrature rule and (adaptive) hier...

متن کامل

A dimension adaptive sparse grid combination technique for machine learning

We introduce a dimension adaptive sparse grid combination technique for the machine learning problems of classification and regression. A function over a d-dimensional space, which assumedly describes the relationship between the features and the response variable, is reconstructed using a linear combination of partial functions who possibly depend only on a subset of all features. The partial ...

متن کامل

Adaptive Unstructured Grid Generation Scheme for Solution of the Heat Equation

An adaptive unstructured grid generation scheme is introduced to use finite volume (FV) and finite element (FE) formulation to solve the heat equation with singular boundary conditions. Regular grids could not acheive accurate solution to this problem. The grid generation scheme uses an optimal time complexity frontal method for the automatic generation and delaunay triangulation of the grid po...

متن کامل

Adaptive sparse grids

Sparse grids, as studied by Zenger and Griebel in the last 10 years have been very successful in the solution of partial differential equations, integral equations and classification problems. Adaptive sparse grid functions are elements of a function space lattice. It is seen that such lattices allow the generalisation of sparse grid techniques to the fitting of very high-dimensional functions ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2007