ARAN - Access to Research at NUI Galway

Advances in the Modelling of Facial Sub-Regions and Facial Expressions using Active Appearance Techniques

ARAN - Access to Research at NUI Galway

Show simple item record

dc.contributor.advisor Corcoran, Peter en
dc.contributor.author Bacivarov, Ioana en
dc.date.accessioned 2010-12-06T13:44:30Z en
dc.date.available 2010-12-06T13:44:30Z en
dc.date.issued 2009-05-01 en
dc.identifier.uri http://hdl.handle.net/10379/1482 en
dc.description.abstract Advances are presented in the modeling of facial sub-regions, in the use of enhanced whole face-models, and based on these sub-region models, in the determination of facial expressions. Models are derived using techniques from the field of active appearance modelling (AAM). A technical description and review of such techniques and a number of additional state-of-art techniques for face detection and face region analysis are provided. A detailed literature review covering a range of topics relating to facial expression analysis is provided. In particular the prior use of AAM techniques for facial feature extraction is reviewed. A range of methodologies for classifying facial expressions are also reviewed. Improved eye-region and lips region models are presented. These models employ the concept of overlapping landmark points, enabling the resulting models to handle eye-gaze, different degrees of closure of the eye, and texture variations in the lips due to the appearance of teeth when the mouth opens in a smile. The eye model is further improved by providing a component-AAM implementation enabling independent modelling of the state of each eye. Initialisation of the lips model is improved using a hue-based pre-filter. A whole-face component-AAM model is provided, combining the improved eye and lips models in an overall framework which significantly increases the accuracy of fitting of the AAM to facial expressions. A range of experiments are performed to tune and test this model for the purpose of the accurate classification of facial expressions in unseen images. Both nearest neighbour (NN) and support vector machine (SVM) classification methodologies are used. Testing of the system to classify the six universal emotions and the neutral face state shows that an accuracy of 83% can be achieved when using SVM classification. Preliminary investigations on additional enhancements to improve on this performance are provided, including the use of (i) pre-filters for gender, race, and age, (ii) person-specific AAM models, and (iii) expression tracking across multiple images in a video sequence. All of these techniques are shown to have potential to further enhance the accuracy of expression recognition of the underlying component-AAM face model with eye and lips subregional models. en
dc.subject Active appearance modelling en
dc.subject Face modelling en
dc.subject Eye model en
dc.subject Lips model en
dc.subject Facial expressions modelling en
dc.title Advances in the Modelling of Facial Sub-Regions and Facial Expressions using Active Appearance Techniques en
dc.type Thesis en

Files in this item

This item appears in the following Collection(s)

Show simple item record