We present attribute bagging (AB), a technique for improving the accuracy and stability of classi#er ensembles induced using random subsets of features. AB is a wrapper method that can be used with any learning algorithm. It establishes an appropriate attribute subset size and then randomly selects subsets of features, creating projections of the training set on which the ensemble classi#ers ar...

We study the problem of learning using combinations of machines. In particular we present new theoretical bounds on the generalization performance of voting ensembles of kernel machines. Special cases considered are bagging and support vector machines. We present experimental results supporting the theoretical bounds, and describe characteristics of kernel machines ensembles suggested from the ...

I propose a nonparametric iid bootstrap that achieves asymptotic refinements for t tests and confidence intervals based on the generalized method of moments (GMM) estimators even when the model is misspecified. In addition, my bootstrap does not require recentering the bootstrap moment function, which has been considered as a critical procedure for bootstrapping GMM. The elimination of the rece...

Sampling variability results in uncertainties of measures. The nonparametric twosample bootstrap method has been used to compute uncertainties of measures in receiver operating characteristic (ROC) analysis on large datasets, such as the standard error (SE) of the equal error rate in biometrics, the SE of a detection cost function in speaker recognition evaluation, and others. Specifically, the...

Background: Bootstrap is a computer simulation-based method that provides estimation accuracy in estimating inferential statistical parameters. Purpose: This article describes a research using secondary data (n = 30) aimed to elucidate bootstrap method as the estimator of linear regression test based on the computer programs MINITAB 13, SPSS 13, and MacroMINITAB. Methods: Bootstrap regression m...

This paper combines the least squaress estimate, least absolute deviation estimate, least median estimate with Bootstrap method. When the overall error distribution is unknown or it is not the normal distribution, we estimate the regression coefficient and confidence interval of coefficient, and through data simulation, obtain Bootstrap method, which can improve stability of regression coeffici...

Abstract: The bootstrap is a simple and straightforward method for calculating approximated biases, standard deviations, confidence intervals, testing statistical hypotheses, and so forth, in almost any nonparametric estimation problem. In this paper we describe a bootstrap method for variance that is designed directly for hypothesis testing in case of fuzzy data based on Yao-Wu signed distance.

Since the early 1980s, a bewildering array of methods for constructing bootstrap con"dence intervals have been proposed. In this article, we address the following questions. First, when should bootstrap con"dence intervals be used. Secondly, which method should be chosen, and thirdly, how should it be implemented. In order to do this, we review the common algorithms for resampling and methods f...

This paper considers the block selection problem for a block bootstrap variance estimator applied to spatial data on a regular grid. We develop precise formulae for the optimal block sizes that minimize the mean squared error of the bootstrap variance estimator. We then describe practical methods for estimating these spatial block sizes and prove the consistency of a block selection method by H...