In this paper, a novel representation for facial expressions in
two-dimensional image sequences is presented. We apply a variation of
two-dimensional heteroscedastic linear discriminant analysis (2DHLDA)
algorithm, as an efficient dimensionality reduction technique, to Gabor
representation of the input sequence. 2DHLDA is an extension of the
two-dimensional linear discriminant analysis (2DLDA) approach and removes the
equal within-class covariance. By applying 2DHLDA in two directions, we
eliminate the correlations between both image columns and image rows.
Facial Action Coding System consists of 44 action units (AUs) and more than
7000 combinations. Hidden Markov models (HMMs) classifier has been used
successfully to recognize facial action units (AUs) and expressions due to its
ability to deal with AU dynamics. However, a separate HMM is necessary for each
single AU and each AU combination. Since combinations of AU numbering in
thousands, a more efficient method will be needed. In this paper an accurate
real-time sequence-based system for representation and recognition of facial
AUs is presented.