# US 2026/0094231 A1 · Cache traffic based reduction of ray tracing hardware state

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0094231 A1
- Document ID: US20260094231A1
- Status: Published application
- Kind: A1
- Application number: 18/898,876
- Filed: 2024-09-27
- Published: 2026-04-02
- Earliest claimed: 2024-09-27
- Assignees: Advanced Micro Devices, Inc.
- Applicants: Advanced Micro Devices, Inc.
- Inventors: Carsten Benthin; Michael John Livesley
- Web page: https://patentgrep.com/patent/US20260094231A1

## CPC

- G06F 12/0842: for multiprocessing or multitasking
- G06T 1/60: Memory management
- G06F 12/0875: with dedicated cache, e.g. instruction or stack
- G06T 15/06: Ray-tracing
- G06F 2212/1024: Latency reduction
- G06F 2212/455: Image or video data
- G06F 2212/502: using adaptive policy
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

An apparatus and method for efficiently managing ray tracing to reduce cache contention are contemplated. In various implementations, a computing system includes a host processing circuit sending commands of a video graphics application to a parallel data processing circuit. The cache memory subsystem of the parallel data processing circuit stores copies of data used for ray tracing operations. A cache access monitor tracks cache access metrics such as cache misses, cache evictions, and cache access latencies of the cache memory subsystem. A control circuit controls a number of rays that can be sent to the ray tracing circuit from compute circuits of the parallel data processing circuit. The control circuit uses the monitored cache access metrics to reduce or increase the number of rays being processed or serviced at any given time.

## Claims

### Claim 1

An apparatus comprising:
circuitry configured to:
convey a plurality of data items for processing by processing circuitry; and
responsive to an indication of cache contention during processing by the processing circuitry, reduce a number of data items conveyed for processing by the processing circuitry.

### Claim 2 (depends on 1)

The apparatus as recited in claim 1, wherein each of the plurality of data items corresponds to a different task or thread of execution.

### Claim 3 (depends on 1)

The apparatus as recited in claim 1, wherein each of the plurality of data items corresponds to a ray generated based on image data.

### Claim 4 (depends on 3)

The apparatus as recited in claim 3, wherein the circuitry is configured to progressively reduce a number of rays conveyed for processing, responsive to continued cache contention.

### Claim 5 (depends on 3)

The apparatus as recited in claim 3, wherein the circuitry is configured to increase a number of rays conveyed for processing, responsive to cache contention falling below a threshold.

### Claim 6 (depends on 3)

The apparatus as recited in claim 3, wherein responsive to the indication of cache contention, the circuitry is configured to reduce a number of rays concurrently processed by ray tracing circuitry to no more than a given threshold.

### Claim 7 (depends on 1)

The apparatus as recited in claim 1, wherein the circuitry is configured to:
measure the cache contention by comparing one or more cache access metrics to a corresponding threshold; and
increase at least one threshold used to measure the cache contention based on performance of the processing circuitry exceeding a performance threshold.

### Claim 8

A method, comprising:
accessing, by control circuitry, a cache memory subsystem for data of a workload;
conveying, by the control circuitry, a plurality of data items for processing by processing circuitry; and
responsive to an indication of cache contention during processing by the processing circuitry, reducing, by the control circuitry, a number of data items conveyed for processing by the processing circuitry.

### Claim 9 (depends on 8)

The method as recited in claim 8, wherein each of the plurality of data items corresponds to a different task or thread of execution.

### Claim 10 (depends on 8)

The method as recited in claim 8, wherein each of the plurality of data items corresponds to a ray generated based on image data.

### Claim 11 (depends on 10)

The method as recited in claim 10, further comprising progressively reducing a number of rays conveyed for processing, responsive to continued cache contention.

### Claim 12 (depends on 10)

The method as recited in claim 10, further comprising increasing a number of rays conveyed for processing, responsive to cache contention falling below a threshold.

### Claim 13 (depends on 10)

The method as recited in claim 10, wherein responsive to the indication of cache contention, the method further comprises reducing a number of rays concurrently processed by ray tracing circuitry to no more than a given threshold.

### Claim 14 (depends on 8)

The method as recited in claim 8, further comprising:
measuring the cache contention by comparing one or more cache access metrics to a corresponding threshold; and
increasing at least one threshold used to measure the cache contention based on performance of the processing circuitry exceeding a performance threshold.

### Claim 15

A computing system comprising:
a cache memory subsystem comprising circuitry configured to store data of one or more workloads; and
processing circuitry; and
control circuitry configured to:
convey a plurality of data items for processing by the processing circuitry;
monitor cache access metrics during accesses of the cache memory subsystem; and
based at least in part on the cache access metrics, change a number of data items conveyed for processing by the processing circuitry.

### Claim 16 (depends on 15)

The computing system as recited in claim 15, wherein each of the plurality of data items corresponds to a different task or thread of execution.

### Claim 17 (depends on 15)

The computing system as recited in claim 15, wherein each of the plurality of data items corresponds to a ray generated based on image data.

### Claim 18 (depends on 17)

The computing system as recited in claim 17, wherein the control circuitry is configured to progressively reduce a number of rays conveyed for processing, responsive to continued cache contention indicated by measurements of the cache access metrics.

### Claim 19 (depends on 17)

The computing system as recited in claim 17, wherein the control circuitry is configured to increase a number of rays conveyed for processing, responsive to cache contention falling below a threshold, wherein the cache contention is indicated by measurements of the cache access metrics.

### Claim 20 (depends on 17)

The computing system as recited in claim 17, wherein responsive to an indication of cache contention indicated by measurements of the cache access metrics, the control circuitry is configured to reduce a number of rays concurrently processed by ray tracing circuitry to no more than a given threshold.
