Automatic extraction of eye and mouth fields from a face image using eigenfeatures and multilayer perceptrons

This paper presents a novel algorithm for the extraction of the eye and mouth (facial features) "elds from 2-D gray-level face images. The fundamental philosophy is that eigenfeatures, derived from the eigenvalues and eigenvectors of the binary edge data set constructed from the eye and mouth "elds, are very good features to locate these "elds e$ciently. The eigenfeatures extracted from the positive and negative training samples of the facial features are used to train a multilayer perceptron whose output indicates the degree to which a particular image window contains an eye or a mouth. It turns out that only a small number of frontal faces are su$cient to train the networks. Furthermore, they lend themselves to good generalization to non-frontal pose and even other people's faces. It has been experimentally veri"ed that the proposed algorithm is robust against facial size and slight variations of pose. 2001 Pattern Recognition Society. Published by Elsevier Science Ltd. All rights reserved.