Interactive Region-Based Linear 3D Face Models

J. Rafael Tena 1        Fernando De la Torre 2        Iain Matthews 1,2

1 Disney Research
Pittsburgh

2 The Robotics Institute
Carnegie Mellon University

Abstract

Linear models, particularly those based on principal component analysis (PCA), have been used successfully on a broad range of human face-related applications. Although PCA models achieve high compression, they have not been widely used for animation in a production environment because their bases lack a semantic interpretation. Their parameters are not a natural set for animators to work with. In this paper we present a linear face modelling approach that allows intuitive click-and-drag interaction for animation. Our model is composed of a collection of PCA sub-models that are independently trained but share boundaries. Boundary consistency and user-given constraints are enforced in a soft least mean squares sense to give flexibility to the model while maintaining coherence. Our results also show that the region-based model generalises better than its holistic counterpart when describing previously unseen motion capture data from multiple subjects. The decomposition of the face into several regions, which we determine automatically from training data, gives the user localised manipulation control. This allows the model to be used for face posing and animation in a natural and intuitive style.

J. Rafael Tena, Fernando De la Torre, and Iain Matthews

Interactive Region-Based Linear 3D Face Models

ACM Transactions on Graphics (Proc. ACM SIGGRAPH), Aug. 2011 (to appear)

[Paper PDF (36 MB)]  [BiBTeX]  [Movie MOV (94 MB)]  [Small Movie MOV (40 MB)]

Copyright Notice

The documents contained in these directories are included by the contributing authors as a means to ensure timely dissemination of scholarly and technical work on a non-commercial basis. Copyright and all rights therein are maintained by the authors or by other copyright holders, notwithstanding that they have offered their works here electronically. It is understood that all persons copying this information will adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.