# US 2024/0202862 A1 · Graphics and compute api extension for cache auto tiling

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0202862 A1
- Document ID: US20240202862A1
- Status: Published application
- Kind: A1
- Application number: 18/085,356
- Filed: 2022-12-20
- Published: 2024-06-20
- Earliest claimed: 2022-12-20
- Assignees: Advanced Micro Devices, Inc.; ATI Technologies ULC
- Applicants: Advanced Micro Devices, Inc.; ATI Technologies ULC
- Inventors: Guennadi Riguer; Mark Satterthwaite; Jeremy Lukacs; Zhuo Chen; Gareth Havard Thomas
- Web page: https://patentgrep.com/patent/US20240202862A1

## CPC

- G06T 1/60: Memory management
- G06F 9/4881: {Scheduling strategies for dispatcher, e.g. round robin, multi-level priority queues}
- G06T 1/20: Processor architectures; Processor configuration, e.g. pipelining
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A processing device and a method of auto-tiled workload processing is provided. The processing device includes memory and a processor. The processor is configured to store instructions for operations to be executed on an image to be divided into a plurality of tiles, store information associated with the operations, select one of the operations for execution and execute an auto-tiling plan for the operation based on the information associated with the operations. The auto-tiling plan comprises, for example, determining a number of tiles used to divide the image and determining a size of one or more of the tiles of the image.

## Claims

### Claim 1

A method of auto-tiled workload processing comprising;
storing instructions for operations to be executed on an image to be divided into a plurality of tiles;
storing information associated with the operations;
selecting one of the operations for execution; and
executing the one operation according to an auto-tiling plan based on the information associated with the one operation.

### Claim 2 (depends on 1)

The method of claim 1, wherein the auto-tiling plan comprises determining a number of tiles used to divide the image.

### Claim 3 (depends on 2)

The method of claim 2, further comprising estimating an amount of data used to execute the one operation on the image,
wherein the number of tiles is determined based on the estimated amount of data.

### Claim 4 (depends on 2)

The method of claim 2, wherein the number of tiles is determined such that data, resulting from the execution of the one operation, fits into a local cache.

### Claim 5 (depends on 1)

The method of claim 1, wherein the auto-tiling plan comprises determining a size of one or more of the tiles of the image.

### Claim 6 (depends on 5)

The method of claim 5, further comprising estimating a tile dilation size of the one or more tiles to execute the one operation on the image,
wherein the size of the one or more tiles is determined based on the estimated tile dilation size.

### Claim 7 (depends on 6)

The method of claim 6, wherein the tile dilation size is expressed as maximum distance relative to a location indicated by a thread identifier.

### Claim 8 (depends on 1)

The method of claim 1, further comprising storing the information when the instructions for the operations are stored.

### Claim 9 (depends on 1)

The method of claim 1, further comprising
storing an auto-tiling command list in an application programming interface comprising operations to be selected for auto-tiling execution; and
selecting the one operation for auto-tiling execution from the auto-tiling command list.

### Claim 10 (depends on 1)

The method of claim 1, further comprising
storing, a single time, the instructions for each of the operations to be executed on the image; and
executing one or more of the operations multiple times on the image.

### Claim 11

A processing device used for auto-tiled workload processing comprising:
memory comprising cache memory; and
a processor configured to:
store instructions for operations to be executed on an image to be divided into a plurality of tiles;
store information associated with the operations;
select one of the operations for execution; and
execute the one operation according to an auto-tiling plan based on the information associated with the one operation.

### Claim 12 (depends on 11)

The processing device of claim 11, wherein the processor is configured to execute the auto-tiling plan by determining a number of tiles used to divide the image.

### Claim 13 (depends on 12)

The processing device of claim 12, wherein the processor is configured to estimate an amount of data used to execute the one operation on the image,
wherein the number of tiles is determined based on the estimated amount of data.

### Claim 14 (depends on 12)

The processing device of claim 12, wherein the processor is configured to determine the number of tiles such that data, resulting from the execution of the operation, fits into the cache memory local to the processor.

### Claim 15 (depends on 11)

The processing device of claim 11, wherein the processor is configured to execute the auto-tiling plan by determining a size of one or more of the tiles of the image.

### Claim 16 (depends on 15)

The processing device of claim 15, wherein the processor is configured to estimate a tile dilation size of the one or more tiles to execute the one operation on the image,
wherein the size of the one or more tiles is determined based on the estimated tile dilation size.

### Claim 17 (depends on 16)

The processing device of claim 16, wherein the tile dilation size is expressed as maximum distance relative to a location indicated by a thread identifier.

### Claim 18 (depends on 11)

The processing device of claim 11, further comprising a display device, wherein the image is provided for display on the display device.

### Claim 19 (depends on 11)

The processing device of claim 11, further comprising
storing an auto-tiling command list in an application programming interface comprising operations to be selected for auto-tiling execution; and
selecting the one operation for auto-tiling execution from the auto-tiling command list.

### Claim 20

A non-transitory computer-readable storage medium having instructions thereon for causing a computer to execute a method of auto-tiled workload processing comprising:
storing instructions for operations to be executed on an image to be divided into a plurality of tiles;
storing information associated with the operations;
selecting one of the operations for execution; and
executing the one operation according to an auto-tiling plan based on the information associated with the one operation.
