Inferring 3D Body Pose from Uncalibrated Video

Abstract

Recovery of 3D body pose is a fundamental problem for human motion analysis in many applications such as motion capture, vision interface, visual surveillance, and gesture recognition. In this paper, we present a new image-based approach to infer 3D human structure parameters from uncalibrated video. The estimation is example based. First, we acquire a special motion database through an off-line motion capture process. Second, given uncalibrated motion video, we abstract the extrinsic parameters and then silhouettes database associated with 3D poses is built by projecting each data of the 3D motion database into 2D plane with the extrinsic parameters. Next, with the image silhouettes abstracted from video, the unknown structure parameters are inferred by performs a similarity search in the database of silhouettes using approach based on shape matching. That is, the 3D structure parameters whose 2D projective silhouette is the most similar to the 2D image silhouette are took as the 3D reconstruction structure. We use trampoline sport motion, an example of complex human motion, to demonstrate the effectiveness of our approach.

These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.