We compare EM, SEM, and MCMC algorithms to estimate the parameters of the Gaussian mixture model. We focus on problems in estimation arising from the likelihood function having a sharp ridge or saddle points. We use both synthetic and empirical data with those features. The comparison includes Bayesian approaches with different prior specifications and various procedures to deal with label swit...

Penalized splines have gained much popularity as a flexible tool for smoothing and semi-parametric models. Two approaches have been advocated: 1) use a B-spline basis, equally-spaced knots and difference penalties (Eilers and Marx, 1996) and 2) use truncated power functions, knots based on quantiles of the independent variable and a ridge penalty (Ruppert, Wand and Carroll, 2003). We compare th...

We develop fast algorithms for estimation of generalized linear models with convex penalties. The models include linear regression, two-class logistic regression, and multinomial regression problems while the penalties include ℓ(1) (the lasso), ℓ(2) (ridge regression) and mixtures of the two (the elastic net). The algorithms use cyclical coordinate descent, computed along a regularization path....

Corner measurement is of main concern within the following tasks: camera calibration, image matching, object tracking, recognition and reconstruction. This paper presents a hybrid evolutionary ridge regression approach for the problem of corner modeling. We search model parameters characterizing L-corner models by means of fitting the model to the image data. As the model fitting relies on an i...

This paper describes a novel application of Statistical Learning Theory (SLT) to control model complexity in flow estimation. SLT provides analytical generalization bounds suitable for practical model selection from small and noisy data sets of image measurements (normal flow). The method addresses the aperture problem by using the penalized risk (ridge regression). We demonstrate an applicatio...

Logistic regression analysis of high-dimensional data, such as natural language text, poses computational and statistical challenges. Maximum likelihood estimation often fails in these applications. We present a simple Bayesian logistic regression approach that uses a Laplace prior to avoid overfitting and produces sparse predictive models for text data. We apply this approach to a range of doc...

Automatic feature extraction in latent fingerprints is a challenging problem due to poor quality of most latents, such as unclear ridge structures, overlapped lines and letters, and overlapped fingerprints. We proposed a latent fingerprint enhancement algorithm which requires manually marked region of interest (ROI) and singular points. The core of the proposed enhancement algorithm is a novel ...

This paper considers ridge-type shrinkage estimation of a large dimensional precision matrix. The asymptotic optimal shrinkage coefficients and the theoretical loss are derived. Data-driven estimators for the shrinkage coefficients are also conducted based on the asymptotic results from random matrix theory. The new method is distribution-free and no assumption on the structure of the covarianc...

The homeobox-containing genes GHox-7 and GHox-8 have been proposed to play fundamental roles in limb development. The expression of GHox-8, by the apical ridge cells, and GHox-7, in the subridge mesoderm, suggests the involvement of these two genes in limb outgrowth and proximo-distal pattern formation. A straightforward way to test this is to remove the apical ridge. Here we report the relatio...

Outgrowth of normal chick limb bud mesoderm is dependent on the presence of a specialized epithelium called the apical ectodermal ridge. This ectodermal ridge is induced by the mesoderm at about the time of limb bud formation. The limbless mutation in the chick affects apical ectodermal ridge formation in the limb buds of homozygotes. The initial formation of the limb bud appears to be unaffect...