Advances in the Modelling of Facial Sub-Regions and Facial Expressions using Active Appearance Techniques
MetadataShow full item record
This item's downloads: 2112 (view details)
Advances are presented in the modeling of facial sub-regions, in the use of enhanced whole face-models, and based on these sub-region models, in the determination of facial expressions. Models are derived using techniques from the field of active appearance modelling (AAM). A technical description and review of such techniques and a number of additional state-of-art techniques for face detection and face region analysis are provided. A detailed literature review covering a range of topics relating to facial expression analysis is provided. In particular the prior use of AAM techniques for facial feature extraction is reviewed. A range of methodologies for classifying facial expressions are also reviewed. Improved eye-region and lips region models are presented. These models employ the concept of overlapping landmark points, enabling the resulting models to handle eye-gaze, different degrees of closure of the eye, and texture variations in the lips due to the appearance of teeth when the mouth opens in a smile. The eye model is further improved by providing a component-AAM implementation enabling independent modelling of the state of each eye. Initialisation of the lips model is improved using a hue-based pre-filter. A whole-face component-AAM model is provided, combining the improved eye and lips models in an overall framework which significantly increases the accuracy of fitting of the AAM to facial expressions. A range of experiments are performed to tune and test this model for the purpose of the accurate classification of facial expressions in unseen images. Both nearest neighbour (NN) and support vector machine (SVM) classification methodologies are used. Testing of the system to classify the six universal emotions and the neutral face state shows that an accuracy of 83% can be achieved when using SVM classification. Preliminary investigations on additional enhancements to improve on this performance are provided, including the use of (i) pre-filters for gender, race, and age, (ii) person-specific AAM models, and (iii) expression tracking across multiple images in a video sequence. All of these techniques are shown to have potential to further enhance the accuracy of expression recognition of the underlying component-AAM face model with eye and lips subregional models.
This item is available under the Attribution-NonCommercial-NoDerivs 3.0 Ireland. No item may be reproduced for commercial purposes. Please refer to the publisher's URL where this is made available, or to notes contained in the item itself. Other terms may apply.
The following license files are associated with this item:
Showing items related by title, author, creator and subject.
Bacivarov, Ioana; Corcoran, Peter (IEEE, 2009-10-23)In this paper we provide preliminary results on a new modeling approach for improved determination of facial expressions from a low-resolution video stream. An initial proof-of-concept using an extension of an Active ...
Measuring the opportunity cost of time in recreation demand modelling: an application to a random utility model of whitewater kayaking in Ireland Hanley, Nick; O'Donoghue, Cathal (National University of Ireland, Galway, 2004)The treatment of the opportunity cost of travel time and the measurement of travel costs in recreational demand modelling has been a contentious issue for many decades. This paper demonstrates how a potential wage rate ...
Salawdeh, Suhaib; Goggins, Jamie (2013)The aim of this paper is to develop a robust numerical model for cold-formed steel square and rectangular structural hollow sections for use as axial loaded members in earthquake engineering applications. Pseudo-static ...