Efron, Hastie, Johnstone and Tibshirani (2004) proposed Least Angle Regression (LAR), a solution path algorithm for the least squares regression. They pointed out that a slight modification of the LAR gives the LASSO (Tibshirani, 1996) solution path. However it is largely unknown how to extend this solution path algorithm to models beyond the least squares regression. In this work, we propose a...

Given the rapid proliferation of advanced information technologies, including the Internet, modern humans can easily access vast amount of socially transmitted information. Intuitively, this situation is isomorphic to some eusocial insects that are known to solve the exploration-exploitation dilemma collectively through information transfer (e.g., honeybees [Seeley et al., 1991]; and ants [Shaf...

Inside the Juror (Hastie 1994) was, in a sense, a point of arrival for research developing formalisms that describe judicial decision making. Meter-based models of various kinds were mature, and even ready for giving way to such models that would concern themselves with the narrative content of the cases at hand, that a court is called to decide upon. Moreover, excessive emphasis was placed on ...

We consider the generic regularized optimization problem β̂(λ) = arg minβ L(y,Xβ) + λJ (β). Efron, Hastie, Johnstone and Tibshirani [Ann. Statist. 32 (2004) 407–499] have shown that for the LASSO—that is, if L is squared error loss and J (β)= ‖β‖1 is the 1 norm of β—the optimal coefficient path is piecewise linear, that is, ∂β̂(λ)/∂λ is piecewise constant. We derive a general characterization of ...

This paper examines the Asymmetric AdaBoost algorithm introduced by Viola and Jones for cascaded face detection. The Viola and Jones face detector uses cascaded classifiers to successively filter, or reject, non-faces. In this approach most non-faces are easily rejected by the earlier classifiers in the cascade, thus reducing the overall number of computations. This requires earlier cascade cla...

Analytic results for the stability of resistive ballooning modes (RBMs) and electron inertial ballooning modes are obtained using a two-scale analysis. This work generalizes previous calculations used for axisymmetric ŝ− geometry [R.H. Hastie, J.J. Ramos and F. Porcelli Phys.Plasmas 10, 4405 (2003)] to general three-dimensional geometry. A unified theory is developed for RBMs and inertial ballo...

To overcome the problem of invariant pattern recognition, Simard, LeCun, and Denker (1993) proposed a successful nearest-neighbor approach based on tangent distance, attaining state-of-the-art accuracy. Since this approach needs great computational and memory effort, Hastie, Simard, and Säckinger (1995) proposed an algorithm (HSS) based on singular value decomposition (SVD), for the generation ...

We study statistical methods to detect cancer genes that are over- or down-expressed in some but not all samples in a disease group. This has proven useful in cancer studies where oncogenes are activated only in a small subset of samples. We propose the outlier robust t-statistic (ORT), which is intuitively motivated from the t-statistic, the most commonly used differential gene expression dete...

An important problem for tting local linear regression is the choice of the smoothing parameter. As the smoothing parameter becomes large, the estimator tends to a straight line, which is the least squares t in the ordinary linear regression setting. This property may be used to assess the adequacy of a simple linear model. Motivated by Silverman's (1981) work for testing multimodality in kerne...

Much research (e.g., Keil, 1989; Murphy & Medin, 1985; Rips, 1989) has emphasized the critical role that domain knowledge plays in categorization judgments. Recent instantiations of this view (e.g., Ahn, et al., 2000; Rehder & Hastie, 2001) have focused on characterizing how causal knowledge supports categorization decisions. We suggest that a more satisfactory account of categorization can be ...