Back to results
US 8,014,565 B2Granted
Labeling used in motion capture
AssigneesSony Corporation, Sony Pictures Entertainment Inc.
InventorsDemian Gordon, Dennis J. Hauck, Jr.
Life of this patent
Estimating the term…
Abstract
Labeling motion capture volume data includes: receiving a motion capture beat, the motion capture beat including unlabeled body points and unlabeled face points; labeling the unlabeled body points which have a valid fit to a predetermined body model template; verifying the labeled body points using stretch analysis; labeling unlabeled body points using a kinematic skeleton analysis; isolating the unlabeled face points; stabilizing the unlabeled face points; labeling the unlabeled face points; and merging the labeled face points and labeled body points.
Claims12
A non-transitory computer readable medium storing a computer program for motion capture labeling, the computer program comprising:
- a body labeling module to receive a sequence of frames of motion capture volume data, and to generate labeled body data for providing identification information for points in the sequence of frames of motion capture volume data,
- said body labeling module including:
- (1) a first module configured to generate initial data of the motion capture volume data by directing an actor to perform a series of poses;
- (2) a second module configured to receive the initial data of the motion capture volume data and to determine the labeled body data by fitting the received initial data of the motion capture volume data to a predetermined body model template of the series of poses of the actor;
- (3) a third module configured to label the motion capture volume data having a valid fit to said predetermined body model template by tagging frames of the motion capture volume data having the valid fit and labeling body points in the tagged frames;
- and
- a relative labeling module configured to receive said motion capture volume data including said labeled body data and unlabeled face data, and to generate labeled motion capture volume data including said labeled body data and labeled face data,
- wherein labeling points on a body and face provides identification information to aid in determining motion of each point of the points in the sequence of frames and in associating the motion to the actor,
- wherein said relative labeling module further comprises:
- a face isolation module configured to isolate unlabeled face data corresponding to marker points on a face in said motion capture volume data;
- a face stabilization module configured to remove a kinematic effect including a translation velocity from said unlabeled face data;
- a labeling module configured to receive and label said unlabeled face data to generate labeled face data;
- and
- a merging module configured to merge said labeled face data with said labeled body data.
11 more elements
A computer-implemented method of motion capture labeling, wherein a computer is programmed to:
- receive a medium containing a motion capture beat, said motion capture beat including unlabeled body points and unlabeled face points;
- generate labeled body points for providing identification information for points in the motion capture beat;
- generate initial data of the motion capture beat by directing an actor to perform a series of poses;
- receive the initial data of the motion capture beat;
- determine the labeled body points by fitting the received initial data of the motion capture beat to a predetermined body model template of the series of poses of the actor;
- create labeled body points by labeling said unlabeled body points which have a valid fit to the predetermined body model template by tagging frames of the motion capture volume data having the valid fit and labeling body points in the tagged frames, and updating the medium containing the motion capture beat with the labeled body points;
- verify said labeled body points using a stretch analysis;
- create additional labeled body points by labeling unlabeled body points using a kinematic skeleton analysis;
- isolate said unlabeled face points corresponding to marker points on a face in said motion capture beat;
- stabilize said unlabeled face points by removing a kinematic effect including a translation velocity from the unlabeled face points;
- label said unlabeled face points to generate labeled face points;
- and
- merge said labeled face points and said labeled body points.
10 more elements
A non-transitory storage medium storing a computer program for motion capture labeling, the computer program comprising executable instructions that cause a computer to:
- receive a motion capture beat, said motion capture beat including unlabeled body points and unlabeled face points;
- generate labeled body points for providing identification information for points in the motion capture beat;
- generate initial data of the motion capture beat by directing an actor to perform a series of poses;
- receive the initial data of the motion capture beat;
- determine the labeled body points by fitting the received initial data of the motion capture beat to a predetermined body model template of the series of poses of the actor;
- create labeled body points by labeling said unlabeled body points which have a valid fit to the predetermined body model template by tagging frames of the motion capture volume data having the valid fit and labeling body points in the tagged frames;
- verify said labeled body points using a stretch analysis;
- create additional labeled body points by labeling unlabeled body points using a kinematic skeleton analysis;
- isolate said unlabeled face points corresponding to marker points on a face in said motion capture beat;
- stabilize said unlabeled face points by removing a kinematic effect including a translation velocity from the unlabeled face points;
- label said unlabeled face points to generate labeled face points;
- and
- merge said labeled face points and said labeled body points.
10 more elements
An apparatus for motion capture labeling, the apparatus comprising:
- means for receiving a motion capture beat, said motion capture beat including unlabeled body points and unlabeled face points;
- means for generating labeled body points for providing identification information for points in the motion capture beat;
- means for generating initial data of the motion capture beat by directing an actor to perform a series of poses;
- means for receiving the initial data of the motion capture beat;
- means for determining the labeled body points by fitting the received initial data of the motion capture beat to a predetermined body model template of the series of poses of the actor;
- means for creating labeled body points by labeling said unlabeled body points which have a valid fit to a predetermined body model template by tagging frames of the motion capture volume data having the valid fit and labeling body points in the tagged frames;
- means for verifying said labeled body points using a stretch analysis;
- means for creating labeled body points by labeling unlabeled body points using a kinematic skeleton analysis;
- means for isolating said unlabeled face points corresponding to marker points on a face in said motion capture beat;
- means for stabilizing said unlabeled face points by removing a kinematic effect including a translation velocity from the unlabeled face points;
- means for labeling said unlabeled face points to generate labeled face points;
- and
- means for merging said labeled face points and said labeled body points.
10 more elements
Dependencies are inferred from the claim text.