# US 2025/0097402 A1 · Interpolation of reprojected content

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0097402 A1
- Document ID: US20250097402A1
- Status: Published application
- Kind: A1
- Application number: 18/661,535
- Filed: 2024-05-10
- Published: 2025-03-20
- Earliest claimed: 2023-09-15
- Assignees: Apple Inc.
- Applicants: Apple Inc.
- Inventors: Nathan P. ROWE; Shruti SINGHAL
- Web page: https://patentgrep.com/patent/US20250097402A1

## CPC

- G06T 3/4007: based on interpolation, e.g. bilinear interpolation (image demosaicing G06T3/4015; edge-driven or edge-based scaling G06T3/403)
- H04N 13/366: using viewer tracking
- G06T 7/20: Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51)
- H04N 13/117: the virtual viewpoint locations being selected by the viewers or determined by viewer tracking
- H04N 13/139: Format conversion, e.g. of frame-rate or size
- H04N 13/156: Mixing image signals
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Aspects of the subject technology provide for linear interpolation of reprojected blurred content. A system may reproject a first frame comprising a first blurred texture into a first reprojected frame using a first transformation associated with a viewing perspective of a user. The system also can reproject a second frame comprising a second blurred texture into a second reprojected frame using a second transformation associated with the viewing perspective of the user. The system can determine a motion approximation between the first reprojected frame and the second reprojected frame. The system also can render an intermediate frame based at least in part on the motion approximation, the intermediate frame being rendered between the first reprojected frame and the second reprojected frame.

## Claims

### Claim 1

A method comprising:
reprojecting a first frame comprising a first blurred texture into a first reprojected frame using a first transformation associated with a viewing perspective of a user;
reprojecting a second frame comprising a second blurred texture into a second reprojected frame using a second transformation associated with the viewing perspective of the user;
determining a motion approximation between the first reprojected frame and the second reprojected frame; and
rendering an intermediate frame based at least in part on the motion approximation, the intermediate frame being rendered between the first reprojected frame and the second reprojected frame.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
generating the first blurred texture by applying a first convolution filter to the first frame based on a first kernel; and
generating the second blurred texture by applying a second convolution filter to the second frame based on a second kernel.

### Claim 3 (depends on 1)

The method of claim 1, wherein the determining the motion approximation comprises applying linear interpolation between the first reprojected frame and the second reprojected frame.

### Claim 4 (depends on 3)

The method of claim 3, wherein the applying the linear interpolation comprises interpolating between a first Gaussian distribution corresponding to the first reprojected frame and a second Gaussian distribution corresponding to the second reprojected frame.

### Claim 5 (depends on 4)

The method of claim 4, wherein the first Gaussian distribution and the second Gaussian distribution are each located at a mean that corresponds to an offset value.

### Claim 6 (depends on 5)

The method of claim 5, wherein the offset value is in a range of 0 to 1*σ, where σ represents a standard deviation of at least one of the first Gaussian distribution or the second Gaussian distribution.

### Claim 7 (depends on 4)

The method of claim 4, wherein the determining the motion approximation comprises determining a translated Gaussian distribution representing a result of the applied linear interpolation between the first Gaussian distribution and the second Gaussian distribution, the translated Gaussian distribution indicating the motion approximation.

### Claim 8 (depends on 1)

The method of claim 1, wherein the determining the motion approximation comprises applying extrapolation between the first reprojected frame and the second reprojected frame.

### Claim 9 (depends on 8)

The method of claim 8, wherein the applying the extrapolation comprises extrapolating between a first Gaussian distribution corresponding to the first reprojected frame and a second Gaussian distribution corresponding to the second reprojected frame, wherein the first Gaussian distribution is offset by a first offset value and the second Gaussian distribution is offset by a second offset value different from the first offset value.

### Claim 10 (depends on 9)

The method of claim 9, wherein the first offset value and the second offset value correspond to offset values in a range of 0 to 0.5*σ, where σ represents a standard deviation of at least one of the first Gaussian distribution or the second Gaussian distribution.

### Claim 11 (depends on 1)

The method of claim 1, wherein one or more of the first frame or the second frame is rendered at a first frame rate and the intermediate frame is rendered at a second frame rate corresponding to the first frame rate.

### Claim 12

A device, comprising:
a memory; and
one or more processors configured to:
reproject a plurality of previous frames having blurred textures into respective ones of a plurality of reprojected blurred frames using one or more transformations associated with a viewing perspective of a user;
determine a motion approximation between the plurality of reprojected blurred frames by applying interpolation between a plurality of kernel distributions associated with respective ones of the plurality of reprojected blurred frames; and
render an intermediate frame based at least in part on the motion approximation, the intermediate frame being rendered between two reprojected blurred frames of the plurality of reprojected blurred frames.

### Claim 13 (depends on 12)

The device of claim 12, further comprising:
generating a first blurred texture in a first frame of the plurality of previous frames by applying a first convolution filter to the first frame based on a first kernel; and
generating a second blurred texture in a second frame of the plurality of previous frames by applying a second convolution filter to the second frame based on a second kernel.

### Claim 14 (depends on 12)

The device of claim 12, wherein the determining the motion approximation comprises applying linear interpolation between a first reprojected blurred frame of the plurality of reprojected blurred frames and a second reprojected blurred frame of the plurality of reprojected blurred frames, wherein the applying the linear interpolation comprises interpolating between a first Gaussian distribution corresponding to the first reprojected blurred frame and a second Gaussian distribution corresponding to the second reprojected blurred frame.

### Claim 15 (depends on 14)

The device of claim 14, wherein the first Gaussian distribution and the second Gaussian distribution are each located at a mean that corresponds to an offset value, wherein the offset value is in a range of 0 to 1*σ, where σ represents a standard deviation of at least one of the first Gaussian distribution or the second Gaussian distribution.

### Claim 16 (depends on 14)

The device of claim 14, wherein the determining the motion approximation comprises determining a translated Gaussian distribution representing a result of the applied linear interpolation between the first Gaussian distribution and the second Gaussian distribution, the translated Gaussian distribution indicating the motion approximation.

### Claim 17 (depends on 12)

The device of claim 12, wherein the determining the motion approximation comprises applying extrapolation between a first reprojected blurred frame of the plurality of reprojected blurred frames and a second reprojected frame of the plurality of reprojected blurred frames, wherein the applying the extrapolation comprises extrapolating between a first Gaussian distribution corresponding to the first reprojected blurred frame and a second Gaussian distribution corresponding to the second reprojected blurred frame, wherein the first Gaussian distribution is offset by a first offset value and the second Gaussian distribution is offset by a second offset value different from the first offset value.

### Claim 18 (depends on 17)

The device of claim 17, wherein the first offset value and the second offset value correspond to offset values in a range of 0 to 0.5*σ, where σ represents a standard deviation of at least one of the first Gaussian distribution or the second Gaussian distribution.

### Claim 19 (depends on 12)

The device of claim 12, wherein the motion approximation is determined based on a difference between at least two of the plurality of kernel distributions being within two standard deviations.

### Claim 20

A non-transitory computer-readable medium storing instructions that, when executed by one or more processors, cause the one or more processors to perform operations comprising:
reprojecting a first frame comprising a first blurred texture into a first reprojected frame using a first transformation associated with a viewing perspective of a user;
reprojecting a second frame comprising a second blurred texture into a second reprojected frame using a second transformation associated with the viewing perspective of the user;
determining a motion approximation between the first reprojected frame and the second reprojected frame; and
rendering an intermediate frame based at least in part on the motion approximation, the intermediate frame being rendered between the first reprojected frame and the second reprojected frame.
