# US 2026/0094338 A1 · Face and body tracking api for extended reality (xr) media communication sessions

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0094338 A1
- Document ID: US20260094338A1
- Status: Published application
- Kind: A1
- Application number: 19/339,999
- Filed: 2025-09-25
- Published: 2026-04-02
- Earliest claimed: 2024-09-27
- Assignees: QUALCOMM Incorporated
- Applicants: QUALCOMM Incorporated
- Inventors: Imed Bouazizi; Nikolai Konrad Leung; Thomas Stockhammer
- Web page: https://patentgrep.com/patent/US20260094338A1

## CPC

- G06T 13/40: of characters, e.g. humans, animals or virtual beings
- G02B 27/0093: {with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking}
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

An example device for communicating augmented reality (AR) media data includes: a memory configured to store AR media data; and a processing system implemented in circuitry and configured to: invoke a function of an application programming interface (API) to determine one or more supported tracking schemes of an augmented reality (AR) runtime; send data representative of the one or more supported tracking schemes to a receiving device with which an AR media communication session is to be performed; receive, from the receiving device, data representative of a selected one of the one or more supported tracking schemes; create a tracking session with the AR runtime using the selected one of the one or more supported tracking schemes; and send an animation stream representing tracking information conforming to the selected one of the one or more supported tracking schemes to the receiving device.

## Claims

### Claim 1

A method of communicating augmented reality (AR) media data, the method comprising:
invoking a function of an application programming interface (API) to determine one or more supported tracking schemes of an augmented reality (AR) runtime;
sending data representative of the one or more supported tracking schemes to a receiving device with which an AR media communication session is to be performed;
receiving, from the receiving device, data representative of a selected one of the one or more supported tracking schemes;
creating a tracking session with the AR runtime using the selected one of the one or more supported tracking schemes; and
sending an animation stream representing tracking information conforming to the selected one of the one or more supported tracking schemes to the receiving device.

### Claim 2 (depends on 1)

The method of claim 1, wherein the one or more supported tracking schemes include one or more facial tracking schemes.

### Claim 3 (depends on 2)

The method of claim 2, wherein invoking the function of the API to determine the one or more supported tracking schemes further comprises receiving data of an enumerated facial expression schemes data structure representing one or more supported facial tracking schemes.

### Claim 4 (depends on 3)

The method of claim 3, wherein the enumerated facial expression schemes data structure comprises:
typedef struct xrFacialExpressionScheme {
XrStructureType type;
const void* next;
XrFacialSchemeType facialExpressionSchemeId;
char schemeName[XR_MAX_SCHEME_NAME_SIZE];
const XrBool32 isNative;
} XrFacialExpressionScheme.

### Claim 5 (depends on 2)

The method of claim 2, wherein creating the tracking session comprises creating a facial tracking session using a facial tracking function of the API.

### Claim 6 (depends on 5)

The method of claim 5, wherein the facial tracking function comprises XrResult xrCreateFaceTracker (XrSession session, const XrFaceTrackerCreateInfo* createInfo, XrFaceTracker* faceTracker).

### Claim 7 (depends on 1)

The method of claim 1, wherein the one or more supported tracking schemes include one or more hand tracking schemes.

### Claim 8 (depends on 1)

The method of claim 1, wherein the one or more supported tracking schemes include one or more body tracking schemes.

### Claim 9 (depends on 8)

The method of claim 8, wherein invoking the function of the API to determine the one or more supported tracking schemes further comprises receiving data of an enumerated skeleton scheme data structure representing one or more supported body or hand tracking schemes.

### Claim 10 (depends on 9)

The method of claim 9, wherein the enumerated skeleton schemes data structure comprises:
typedef struct xrSkeletonScheme {
XrStructureType type;
const void* next;
XrSkeletonSchemeType skeletonSchemeId;
char schemeName[XR_MAX_SCHEME_NAME_SIZE];
const XrBool32 isNative;
const uint32_t supportedJoints[XR_MAX_JOINT_COUNT];
} XrSkeletonScheme.

### Claim 11 (depends on 9)

The method of claim 9, wherein creating the tracking session comprises creating a body tracking session using a skeleton tracking function of the API.

### Claim 12 (depends on 11)

The method of claim 11, wherein the skeleton tracking function of the API comprises XrResult xrCreateBodyTracker (XrSession session, const XrBodyTrackerCreateInfo* createInfo, XrBodyTracker* bodyTracker).

### Claim 13

A device for communicating augmented reality (AR) media data, the device comprising:
a memory configured to store AR media data; and
a processing system implemented in circuitry and configured to:
invoke a function of an application programming interface (API) to determine one or more supported tracking schemes of an augmented reality (AR) runtime;
send data representative of the one or more supported tracking schemes to a receiving device with which an AR media communication session is to be performed;
receive, from the receiving device, data representative of a selected one of the one or more supported tracking schemes;
create a tracking session with the AR runtime using the selected one of the one or more supported tracking schemes; and
send an animation stream representing tracking information conforming to the selected one of the one or more supported tracking schemes to the receiving device.

### Claim 14 (depends on 13)

The device of claim 13, wherein the one or more supported tracking schemes include one or more facial tracking schemes, one or more hand tracking schemes, or one or more body tracking schemes.

### Claim 15 (depends on 14)

The device of claim 14, wherein to invoke the function of the API to determine the one or more supported tracking schemes, the processing system is further configured to receive data of at least one of an enumerated facial expression schemes data structure representing one or more supported facial tracking schemes or an enumerated skeleton scheme data structure representing one or more supported body or hand tracking schemes.

### Claim 16 (depends on 15)

The device of claim 15, wherein the enumerated facial expression schemes data structure comprises:
typedef struct xrFacialExpressionScheme {
XrStructureType type;
const void* next;
XrFacialSchemeType facialExpressionSchemeId;
char schemeName[XR_MAX_SCHEME_NAME_SIZE];
const XrBool32 isNative;
} XrFacialExpressionScheme.

### Claim 17 (depends on 15)

The device of claim 15, wherein the enumerated skeleton schemes data structure comprises:
typedef struct xrSkeletonScheme {
XrStructureType type;
const void* next;
XrSkeletonSchemeType skeletonSchemeId;
char schemeName[XR_MAX_SCHEME_NAME_SIZE];
const XrBool32 isNative;
const uint32_t supportedJoints[XR_MAX_JOINT_COUNT];
} XrSkeletonScheme.

### Claim 18 (depends on 14)

The device of claim 14, wherein to create the tracking session, the processing system is configured to create a facial tracking session using a facial tracking function of the API.

### Claim 19 (depends on 18)

The device of claim 18, wherein the facial tracking function comprises XrResult xrCreateFaceTracker (XrSession session, const XrFaceTrackerCreateInfo* createInfo, XrFaceTracker* faceTracker).

### Claim 20 (depends on 14)

The device of claim 14, wherein to create the tracking session, the processing system is configured to create a body tracking session using a skeleton tracking function of the API.

### Claim 21 (depends on 20)

The device of claim 20, wherein the skeleton tracking function of the API comprises XrResult xrCreateBodyTracker (XrSession session, const XrBodyTrackerCreateInfo* createInfo, XrBodyTracker* bodyTracker).

### Claim 22

A method of communicating augmented reality (AR) media data, the method comprising:
establishing an augmented reality (AR) media communication session with a sending device;
receiving data representative of one or more supported tracking schemes from the sending device;
selecting one of the one or more supported tracking schemes to be used for the AR media communication session;
sending data representing the selected one of the one or more supported tracking schemes to the sending device;
receiving an animation stream representing tracking data conforming to the selected one of the one or more supported tracking schemes from the sending device; and
animating an avatar of a user of the sending device using the animation stream.

### Claim 23 (depends on 22)

The method of claim 22, wherein the one or more supported tracking schemes include one or more facial tracking schemes.

### Claim 24 (depends on 22)

The method of claim 22, wherein the one or more supported tracking schemes include one or more body tracking schemes.

### Claim 25 (depends on 22)

The method of claim 22, wherein the one or more supported tracking schemes include one or more hand tracking schemes.

### Claim 26 (depends on 22)

The method of claim 22, wherein selecting the one of the one or more supported tracking schemes comprises selecting the one of the one or more supported tracking schemes based on animation capabilities.

### Claim 27 (depends on 22)

The method of claim 22, further comprising retrieving data for the avatar from an avatar repository.

### Claim 28

A device for communicating augmented reality (AR) media data, the device comprising:
a memory configured to store AR media data; and
a processing system implemented in circuitry and configured to:
establish an augmented reality (AR) media communication session with a sending device;
receive data representative of one or more supported tracking schemes from the sending device;
select one of the one or more supported tracking schemes to be used for the AR media communication session;
send data representing the selected one of the one or more supported tracking schemes to the sending device;
receive an animation stream representing tracking data conforming to the selected one of the one or more supported tracking schemes from the sending device; and
animate an avatar of a user of the sending device using the animation stream.

### Claim 29 (depends on 28)

The device of claim 28, wherein the one or more supported tracking schemes include one or more facial tracking schemes, one or more hand tracking schemes, or one or more body tracking schemes.

### Claim 30 (depends on 28)

The device of claim 28, wherein to select the one of the one or more supported tracking schemes, the processing system is configured to select the one of the one or more supported tracking schemes based on animation capabilities.
