Abstract
We describe a method for the acquisition of deformable human geometry from silhouettes. Our technique uses a commercial tracking system to determine the motion of the skeleton, then estimates geometry for each bone using constraints provided by the silhouettes from one or more cameras. These silhouettes do not give a complete characterization of the geometry for a particular point in time, but when the subject moves, many observations of the same local geometries allow the construction of a complete model. Our reconstruction algorithm provides a simple mechanism for solving the problems of view aggregation, occlusion handling, hole filling, noise removal, and deformation modeling. The resulting model is parameterized to synthesize geometry for new poses of the skeleton. We demonstrate this capability by rendering the geometry for motion sequences that were not included in the original datasets.Full Citation
Peter Sand, Leonard McMillan, and Jovan Popovic. 2003. Continuous Capture of Skin Deformation. ACM Transactions on Graphics (TOG) 22, 3, 578-586.More Information
Paper (PDF, 4.6MB)Video (MPEG1, 21.5MB)
Video (Windows Media 9, 13.0MB)
ACM Web Page