Reconstruction and Recognition of Occluded Facial Expressions Using PCA

摘要

Descriptions of three methods for reconstructing incomplete facial expressions using principal component analysis are given, projection to the model plane, single component projection and replacement by the conditional mean - the facial expressions being represented by feature points. It is established that one method gives better reconstruction accuracy than the others. This method is used on a systematic reconstruction problem, the reconstruction of occluded top and bottom halves of faces. The results indicate that occluded-top expressions can be reconstructed with little loss of expression recognition - occluded-bottom expressions are reconstructed less accurately but still give comparable performance to human rates of facial expression recognition.