Multi-Scale Capture of Facial Geometry and Motion

 

Bernd Bickel , Mario Botsch, Roland Angst (ETH Zurich), Wojciech Matusik (MERL), Miguel Otaduy (ETH Zurich), Hanspeter Pfister (MERL), and Markus Gross (ETH Zurich).

 
SIGGRAPH 2007

 

Animation of a high-resolution face scan using marker-based motion capture and a video-driven wrinkle model. From left to right: video frame, large-scale animation without wrinkles, synthesis of medium-scale wrinkles, realistic skin-rendering, different expression.

 

Abstract

 

We present a novel multi-scale representation and acquisition method for the animation of high-resolution facial geometry and wrinkles. We first acquire a static scan of the face including reflectance data at the highest possible quality. We then augment a traditional marker-based facial motion-capture system by two synchronized video cameras to track expression wrinkles. The resulting model consists of high-resolution geometry, motion-capture data, and expression wrinkles in 2D parametric form. This combination represents the facial shape and its salient features at multiple scales. During motion synthesis the motion-capture data deforms the high-resolution geometry using a linear shell-based mesh-deformation method. The wrinkle geometry is added to the facial base mesh using nonlinear energy optimization. We present the results of our approach for performance replay as well as for wrinkle editing.

 

Citation

Bernd Bickel, Mario Botsch, Roland Angst, Wojciech Matusik, Miguel Otaduy, Hanspeter Pfister, and Markus Gross. Multi-Scale Capture of Facial Geometry and Motion. ACM Transactions on Graphics. 26(3) August 2007.

Paper

PDF (5 MB)

Video

Quicktime (64 MB)

Presentation

PPT (not available yet)