Motion Retargeting with Kinematic Constraints
AssigneeAdobe Inc.
InventorsRuben Eduardo Villegas, Jun Saito, Jimei Yang, Duygu Ceylan Aksit
Life of this patent
Estimating the term…
Abstract
Motion retargeting with kinematic constraints is implemented in a digital medium environment. Generally, the described techniques provide for retargeting motion data from a source motion sequence to a target visual object. Accordingly, the described techniques position a target visual object in a defined visual environment to identify kinematic constraints of the target object relative to the visual environment. Further, the described techniques utilize an iterative optimization process that fine tunes the conformance of retargeted motion of a target object to the identified kinematic constraints.
Claims20
A method for retargeting an animation implemented by at least one computing device, the method comprising:
- processing, by the at least one computing device, a source motion object by inputting the source motion object to a neural network to generate target joint coordinates for target joints of a target visual object, and a target root velocity for a target root joint of the target visual object;
- animating, by the at least one computing device, the target visual object by positioning the target joints based on the target joint coordinates and the target root joint based on the target root velocity;
- and
- implementing, by the at least one computing device, a supervision operation for the neural network for tuning animation of the target visual object, the supervision operation utilizing root motion data from the source motion object as scaled based on a ratio of a leg height of the source visual object, and a leg height of the target visual object.
A system for retargeting an animation implemented, the system comprising:
- a retargeting model implemented at least partially in hardware of at least one computing device to take source motion data from a source motion object as input and output target animation data to be applied to animate a target object, the target animation data including joint coordinates for joints of a target visual object, and a root velocity for a root joint of the target visual object;
- a positioning module implemented at least partially in the hardware of the at least one computing device to position the target visual object including to position, based on the root velocity, the joint coordinates to animate the target visual object;
- and
- a training module implemented at least partially in the hardware of the at least one computing device to use joint rotation data and root motion data from the source motion data to perform supervision to tune the animation of the target visual object, including to use the root motion data as scaled based on a ratio of a leg height of the source visual object animated in the source motion data, and a leg height of the target visual object.
A system for retargeting animation, the system comprising:
- one or more processors;
- and
- one or more computer-readable storage media storing instructions that are executable by the one or more processors to:
- invoke a neural network to take a source motion sequence as input and output target animation data to be applied to animate a target object, the target animation data including joint coordinates for joints of a target visual object, and a root velocity for a root joint of the target visual object;
- animate the target visual object including to position the target joints based on the target joint coordinates and the target root joint based on the target root velocity;
- and
- implement a supervision operation for the neural network to tune animation of the target visual object, the supervision operation including to utilize root motion data from the source motion object as scaled based on a ratio of a leg height of the source visual object, and a leg height of the target visual object.
Dependencies are inferred from the claim text.