# US 2023/0410399 A1 · Skeletal animation in embodied agents

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0410399 A1
- Document ID: US20230410399A1
- Status: Published application
- Kind: A1
- Application number: 18/035,534
- Filed: 2021-11-22
- Published: 2023-12-21
- Earliest claimed: 2020-11-20
- Assignees: Soul Machines Limited
- Applicants: Soul Machines Limited
- Inventors: Mark Sagar; Jo Hutton; Tim Wu; Tiago Ribeiro; Pavel Sumetc
- Web page: https://patentgrep.com/patent/US20230410399A1

## CPC

- G06T 13/40: of characters, e.g. humans, animals or virtual beings
- G06F 3/04845: for image manipulation, e.g. dragging, rotation, expansion or change of colour
- G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80)
- G06T 19/20: Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts
- G06N 20/00: Machine learning
- G06T 2200/24: involving graphical user interfaces [GUIs]
- G06T 2219/2004: Aligning objects, relative positioning of parts
- G06T 2219/2016: Rotation, translation, scaling
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

Skeletal Animation is improved using an Actuation System for animating a Virtual Character or Digital Entity including a plurality of Joints associated with a Skeleton of the Virtual Character or Digital Entity and at least one Actuation Unit Descriptor defining a Skeletal Pose with respect to a first Skeletal Pose. The Actuation Unit Descriptors are represented using Rotation Parameters and one or more of the Joints of the Skeleton are driven using corresponding Actuation Unit Descriptors.

## Claims

### Claim at position 1

1-24. (canceled)

### Claim 25

An Actuation System for animating a Virtual Character or Digital Entity comprising:
a processor;
a memory communicatively coupled to the processor, wherein the memory stores:
values defining a plurality of Joints associated with a Skeleton of the Virtual Character or Digital Entity, and
at least one Actuation Unit Descriptor defining respective Skeletal Poses with respect to a first Skeletal Pose; and
program instructions stored in the memory and that, upon execution by the processor, cause the processor to:
drive the Actuation Unit Descriptor using Rotation Parameters and one or more of the Joints of the Skeleton using corresponding Actuation Unit Descriptors multiplied by corresponding Activation Weights.

### Claim 26 (depends on 25)

The Actuation System of claim 25, wherein the first Skeletal Pose is a Skeletal Base Pose.

### Claim 27 (depends on 26)

The Actuation System of claim 26, wherein Rotation Parameters are representations of rotation configured to combine linearly.

### Claim 28 (depends on 27)

The Actuation System of claim 27, wherein each Actuation Unit Descriptor is configured to drive a single Joint.

### Claim 29 (depends on 27)

The Actuation System of claim 27, wherein each Actuation Unit Descriptor is configured to drive multiple Joints.

### Claim 30 (depends on 29)

The Actuation System of claim 29, wherein applying a rotation transformation of each Actuation Unit Descriptor to the skeleton produces a motion of skeleton parts reflective of contraction or relaxing one or more muscles in a biological system having a skeletal topology similar to the skeletal topology of the Virtual Character or Digital Entity.

### Claim 31 (depends on 30)

The Actuation System of claim 30 further comprising an Actuation Unit Descriptor Combiner for controlling Virtual Character or Digital Entity animation, wherein the Actuation Unit Descriptor Combiner is configured to combine a plurality of Actuation Unit Descriptors using a linear equation.

### Claim 32 (depends on 31)

The Actuation System of claim 31 further comprising an Actuation Unit Descriptor Mapper for estimating parameter values for the Actuation Unit Descriptor Combiner for a given pose parameterized in terms of joint angles, which comprises:
converting given pose parameters to a set of rotation vector values associated with rotation of skeleton parts around particular joints,
constructing a structure containing the rotation parameters associated with each joint of the skeleton, and
obtaining Actuation Unit Descriptor weights through solving a least squares problem.

### Claim 33

A method of generating an animation of a Skeleton of a Virtual Character or Digital Entity comprising:
defining a plurality of Actuation Unit Descriptors as animation controls configured to change rotation and/or translation values of one or more Joints of the Skeleton;
converting the plurality of Actuation Unit Descriptors into Rotation Parameters;
using the Rotation Parameters to blend and convert two or more input animations to an Actuation Unit Descriptor space to generate one or more animations; and
composing and playing back the one or more animations on a joint-driven skeleton using any rotation representation.

### Claim 34

A method for animating arm reaching in a Virtual Character or Digital Entity comprising:
receiving a desired location of an end effector of an arm of a Virtual Character or Digital Entity in a parameter space;
retrieving example poses, each associated with a coordinate of an end effector and pose Actuation Unit Descriptors;
generating interpolated poses by interpolating poses using the example poses as interpolation nodes, wherein interpolation is performed in parameter space with a coordinate of an end effector as a parameter and pose Actuation Unit Descriptors as values; and
animating the arm reaching using the interpolated poses.

### Claim 35 (depends on 34)

The method of claim 34 wherein interpolation uses a meshless or mesh base technique that represents solutions through a weighted combination of interpolation node values.
