# US 2026/0094283 A1 · Selective masking in optical flow block matching

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0094283 A1
- Document ID: US20260094283A1
- Status: Published application
- Kind: A1
- Application number: 18/902,600
- Filed: 2024-09-30
- Published: 2026-04-02
- Earliest claimed: 2024-09-30
- Assignees: Arm Limited
- Applicants: Arm Limited
- Inventors: Liam James O’Neil; Yanxiang Wang; Carlos Barragán del Rey; Joshua James Sowerby; Samuel James Edward Martin
- Web page: https://patentgrep.com/patent/US20260094283A1

## CPC

- G06T 7/223: using block-matching
- G06T 3/40: Scaling of whole images or parts thereof, e.g. expanding or contracting
- G06T 7/248: {involving reference images or patches}
- G06T 2200/24: involving graphical user interfaces [GUIs]
- G06T 2207/10016: Video; Image sequence
- G06T 2207/10024: Color image
- G06T 2207/20016: Hierarchical, coarse-to-fine, multiscale or multiresolution image processing; Pyramid transform
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

An optical flow mask is generated based, at least in part, on a calculated degree of confidence of one or more motion vectors relating a prior frame and a current frame in a rendered image sequence. A pyramidal block matching algorithm is applied to calculate an optical flow relating the prior image frame and the current image frame, where applying the pyramidal block matching excludes portions of an image sequence masked by the generated optical flow mask.

## Claims

### Claim 1

A method, comprising:
generating an optical flow mask based, at least in part, on a calculated degree of confidence of one or more motion vectors relating a prior frame and a current frame in a rendered image sequence; and
applying a pyramidal block matching to calculate an optical flow relating the prior image frame and the current image frame, wherein applying the pyramidal block matching comprises applying the pyramidal block matching differently for portions of an image sequence masked by the generated optical flow mask.

### Claim 2 (depends on 1)

The method of claim 1, wherein applying the pyramidal block matching differently for portions of an image sequence masked by the generated optical flow mask comprises excluding the portions of the image sequence masked by the generated optical flow mask from applying pyramidal block matching.

### Claim 3 (depends on 1)

The method of claim 1, wherein the calculated degree of confidence expresses a lower degree of confidence for lighting effects, particle effects, animated textures, or a combination thereof.

### Claim 4 (depends on 1)

The method of claim 1, wherein generating the optical flow mask further comprises masking one or more areas of the rendered image sequence comprising user interface graphics.

### Claim 5 (depends on 1)

The method of claim 1, wherein generating the optical flow mask further comprises:
warping color parameters and depth parameters from the prior frame into the current frame;
creating a color difference mask based, at least in part, on differences between warped color parameters from the prior frame and color parameters from the current frame;
creating a depth difference mask based, at least in part, on differences between the warped depth parameters from the prior frame and depth parameters from the current frame;
converting the depth difference mask and the color difference mask to binary masks; and
calculating a difference between the depth difference mask and the color difference mask to generate the optical flow mask.

### Claim 6 (depends on 1)

The method of claim 1, wherein the pyramidal block matching comprises:
creating a pyramid of consecutively downsampled prior image frames;
creating a pyramid of consecutively downsampled current image frames corresponding to the pyramid of consecutively downsampled prior image frames;
block matching a lowest resolution downsampled prior image frame and a lowest resolution downsampled current image frame; and
iteratively block matching consecutively higher resolution downsampled prior image frames and current image frames using block matching over corresponding smaller block matching search spaces not covered by prior lower resolution block matching iterations.

### Claim 7 (depends on 6)

The method of claim 6, wherein a number of pyramid layers, a number of tiles to search or a size of a search tile, or a combination thereof, are configurable parameters that may be selected to achieve a desired compute time, a maximum detectable optical flow vector length, or a confidence level in optical flow matches, or a combination thereof.

### Claim 8 (depends on 7)

The method of claim 7, wherein the number of pyramid layers, the number of tiles to search or the size of a search tile, or a combination thereof, may be varied across different areas of the current frame or across different levels of the pyramid of image frames used in pyramidal block matching, or a combination thereof.

### Claim 9 (depends on 1)

The method of claim 1, further comprising generating an optical flow mask for each level of a rendered image pyramid in pyramidal block matching, and using the optical flow mask corresponding to each level of the rendered image pyramid to applying the pyramidal block matching differently for portions of an image sequence masked by the generated optical flow mask.

### Claim 10

A computing device, comprising:
a memory comprising one more storage devices; and
one or more processors coupled to the memory, the one or more processors operable to execute instructions stored in the memory to, for a rendered image sequence:
generate an optical flow mask based, at least in part, on a calculated degree of confidence of one or more motion vectors relating a prior frame and a current frame in a rendered image sequence;
applying a pyramidal block matching to calculate an optical flow relating the prior frame and the current frame, wherein applying the pyramidal block matching comprises applying the pyramidal block matching differently for portions of an image sequence masked by the generated optical flow mask.

### Claim 11 (depends on 10)

The computing device of claim 10, wherein applying the pyramidal block matching differently for portions of an image sequence masked by the generated optical flow mask comprises excluding the portions of the image sequence masked by the generated optical flow mask from applying pyramidal block matching.

### Claim 12 (depends on 10)

The computing device of claim 10, wherein the calculated degree of confidence expresses a lower degree of confidence for lighting effects or particle effects, or a combination thereof.

### Claim 13 (depends on 10)

The computing device of claim 10, wherein generating the optical flow mask further comprises masking one or more areas of the rendered image sequence comprising user interface graphics.

### Claim 14 (depends on 10)

The computing device of claim 10, wherein the optical flow mask is further generated by:
warping color parameters and depth parameters from the prior frame into the current frame;
creating a color difference mask based, at least in part, on differences between warped color parameters from the prior frame and color parameters from the current frame;
creating a depth difference mask based, at least in part, on differences between the warped depth parameters from the prior frame and depth parameters from the current frame;
converting the depth difference mask and the color difference mask to binary masks; and
calculating a difference between the depth difference mask and the color difference mask to generate the optical flow mask.

### Claim 15 (depends on 10)

The computing device of claim 10, wherein pyramidal block matching comprises:
creating a pyramid of consecutively downsampled prior image frames;
creating a pyramid of consecutively downsampled current image frames corresponding to the pyramid of consecutively downsampled prior image frames;
block matching a lowest resolution downsampled prior image frame and a lowest resolution downsampled current image frame; and
iteratively block matching consecutively higher resolution downsampled prior image frames and current image frames using block matching over corresponding smaller block matching search spaces not covered by prior lower resolution block matching iterations.

### Claim 16 (depends on 15)

The computing device of claim 15, wherein at least one of a number of pyramid layers, a number of tiles to search, or a size of a search tile, or a combination thereof, are configurable parameters that may be selected to achieve a desired compute time, a maximum detectable optical flow vector length, or a confidence level in optical flow matches, or a combination thereof.

### Claim 17 (depends on 16)

The computing device of claim 16, wherein the number of pyramid layers, the number of tiles to search, or the size of a search tile, or a combination thereof, may be varied across different areas of the current frame, or across different levels of the pyramid layers used in pyramidal block matching, or a combination thereof.

### Claim 18 (depends on 10)

The computing device of claim 10, further comprising generating an optical flow mask for each level of a rendered image pyramid in pyramidal block matching, and using the optical flow mask corresponding to each level of the rendered image pyramid to apply the pyramidal block matching differently for portions of an image sequence masked by the generated optical flow mask.

### Claim 19

A method of generating an optical flow mask for use in indicating areas of an image for which optical flow is to be calculated by:
warping color parameters and depth parameters from a prior frame into a current frame;
creating a color difference mask based, at least in part, on differences between warped color parameters from the prior frame and color parameters from the current frame;
creating a depth difference mask based, at least in part, on differences between the warped depth parameters from the prior frame and depth parameters from the current frame;
converting the depth difference mask and the color difference mask to binary masks; and
calculating a difference between the depth difference mask and the color difference mask to generate the optical flow mask.

### Claim 20 (depends on 19)

The method of claim 19, further comprising using the optical flow mask to selectively mask one or more layers of pyramidal block matching in an optical flow computation by:
creating a pyramid of consecutively downsampled prior image frames;
creating a pyramid of consecutively downsampled current image frames corresponding to the pyramid of consecutively downsampled prior image frames;
block matching a lowest resolution downsampled prior image frame and a lowest resolution downsampled current image frame; and
iteratively block matching consecutively higher resolution downsampled prior image frames and current image frames using block matching over corresponding smaller block matching search spaces not covered by prior lower resolution block matching iterations.
