# US 2026/0094359 A1 · Gaussian splats for user representations

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0094359 A1
- Document ID: US20260094359A1
- Status: Published application
- Kind: A1
- Application number: 19/331,351
- Filed: 2025-09-17
- Published: 2026-04-02
- Earliest claimed: 2024-09-27
- Assignees: Apple Inc.
- Applicants: Apple Inc.
- Inventors: Peter Kaufmann; Brian Amberg; Jan Rüegg; Sebastian Martin; Evangelos Ntavelis; Fabio Maninchedda; Stefan Brugger
- Web page: https://patentgrep.com/patent/US20260094359A1

## CPC

- G06T 15/20: Perspective computation
- G06T 15/205: {Image-based rendering}
- G06T 15/08: Volume rendering
- G06T 17/00: Three-dimensional [3D] modelling for computer graphics
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

Various implementations disclosed herein include devices, systems, and methods that generate a user representation based on splat parameter data. For example, a process may include obtaining user representation data of at least a portion of a user. The user representation data may be based on a first set of sensor data including two-dimensional images of the user obtained during an enrollment process and the user representation data includes splat parameter data corresponding to a plurality of three-dimensional (3D) positions. The process may further include modifying the user representation data based on a second set of sensor data obtained after the enrollment process. The process may further include providing a view of a user representation based on the modified user representation data, wherein providing the view comprises generating a plurality of splats based on the splat parameter data of the modified user representation data.

## Claims

### Claim 1

A method comprising:
at a processor of a device:
obtaining user representation data of at least a portion of a user, wherein the user representation data is based on a first set of sensor data comprising images of the user obtained during an enrollment process and the user representation data comprises splat parameter data corresponding to a plurality of three-dimensional (3D) positions;
modifying the user representation data based on a second set of sensor data obtained after the enrollment process; and
providing a view of a user representation based on the modified user representation data, wherein providing the view comprises generating a plurality of splats based on the splat parameter data of the modified user representation data.

### Claim 2 (depends on 1)

The method of claim 1, wherein the at least the portion of the user comprises a face portion and an additional portion of the user.

### Claim 3 (depends on 1)

The method of claim 1, wherein the user representation data is based on UV maps and 3D point cloud points associated with distribution data defining sizes and shapes for rendering the 3D point cloud points as splats corresponding to each point of the UV maps.

### Claim 4 (depends on 1)

The method of claim 1, wherein the splat parameter data comprises 3D Gaussian parameters for each 3D position.

### Claim 5 (depends on 4)

The method of claim 4, wherein the 3D Gaussian parameters comprises at least one of position information, color information, covariance information, transparency information, an orientation, opacity information, extent information in each axis, rotation data, a scale, and semantic information.

### Claim 6 (depends on 1)

The method of claim 1, wherein the user representation data comprises 3D mapping information that includes feature values and position information for each map point.

### Claim 7 (depends on 1)

The method of claim 1, wherein the user representation data is modified based on body pose data obtained during the enrollment process, during a communication session with another device, or a combination thereof.

### Claim 8 (depends on 1)

The method of claim 1, wherein the device is a viewer's device, wherein the user representation data is modified based on an additional set of sensor data obtained during a communication session with a sender's device associated with the user representation.

### Claim 9 (depends on 1)

The method of claim 1, wherein the user representation data is generated and updated during the enrollment process based on images of a face of the user captured while the user is expressing a plurality of different facial expressions.

### Claim 10 (depends on 1)

The method of claim 1, wherein a technique generates the user representation data via a machine learning model trained using training data obtained via one or more sensors in one or more environments.

### Claim 11 (depends on 1)

The method of claim 1, wherein providing the view of the user representation based on the modified user representation data comprises displaying the user representation an extended reality (XR) environment.

### Claim 12 (depends on 1)

The method of claim 1, further comprising:
modifying the view of the user representation by adjusting the user representation based on at least one color attribute of a plurality of color attributes of an environment, at least one light attribute of a plurality of light attributes of the environment, or a combination thereof.

### Claim 13 (depends on 1)

The method of claim 1, wherein the user representation data is obtained in a first physical environment, and the user representation is displayed in a view of a second physical environment that is different than the first physical environment.

### Claim 14 (depends on 1)

The method of claim 1, wherein the user representation is a 3D user representation.

### Claim 15

A device comprising:
a non-transitory computer-readable storage medium; and
one or more processors coupled to the non-transitory computer-readable storage medium, wherein the non-transitory computer-readable storage medium comprises program instructions that, when executed on the one or more processors, cause the one or more processors to perform operations comprising:
obtaining user representation data of at least a portion of a user, wherein the user representation data is based on a first set of sensor data comprising images of the user obtained during an enrollment process and the user representation data comprises splat parameter data corresponding to a plurality of three-dimensional (3D) positions;
modifying the user representation data based on a second set of sensor data obtained after the enrollment process; and
providing a view of a user representation based on the modified user representation data, wherein providing the view comprises generating a plurality of splats based on the splat parameter data of the modified user representation data.

### Claim 16 (depends on 15)

The device of claim 15, wherein the user representation data is based on UV maps and 3D point cloud points associated with distribution data defining sizes and shapes for rendering the 3D point cloud points as splats corresponding to each point of the UV maps.

### Claim 17 (depends on 15)

The device of claim 15, wherein the splat parameter data comprises 3D Gaussian parameters for each 3D position, wherein the 3D Gaussian parameters comprises at least one of position information, color information, covariance information, transparency information, an orientation, opacity information, extent information in each axis, rotation data, a scale, and semantic information.

### Claim 18 (depends on 15)

The device of claim 15, wherein the user representation data is modified based on body pose data obtained during the enrollment process, during a communication session with another device, or a combination thereof.

### Claim 19 (depends on 15)

The device of claim 15, wherein the device is a viewer's device, wherein the user representation data is modified based on an additional set of sensor data obtained during a communication session with a sender's device associated with the user representation.

### Claim 20

A non-transitory computer-readable storage medium, storing program instructions executable on a device to perform operations comprising:
obtaining user representation data of at least a portion of a user, wherein the user representation data is based on a first set of sensor data comprising images of the user obtained during an enrollment process and the user representation data comprises splat parameter data corresponding to a plurality of three-dimensional (3D) positions;
modifying the user representation data based on a second set of sensor data obtained after the enrollment process; and
providing a view of a user representation based on the modified user representation data, wherein providing the view comprises generating a plurality of splats based on the splat parameter data of the modified user representation data.
