# US 2025/0085973 A1 · Kernel launch dependencies

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0085973 A1
- Document ID: US20250085973A1
- Status: Published application
- Kind: A1
- Application number: 18/244,675
- Filed: 2023-09-11
- Published: 2025-03-13
- Earliest claimed: 2023-09-11
- Assignees: NVIDIA Corporation
- Applicants: NVIDIA Corporation
- Inventors: Ze Long; Stephen Anthony Bernard Jones; Pradeep Moorthy; Mark Theng
- Web page: https://patentgrep.com/patent/US20250085973A1

## CPC

- G06F 9/3838: {Dependency mechanisms, e.g. register scoreboarding}
- G06F 9/3851: {from multiple instruction streams, e.g. multistreaming}
- G06F 9/3888: {controlled by a single instruction for multiple threads [SIMT] in parallel}
- G06F 9/46: Multiprogramming arrangements
- G06F 9/4881: {Scheduling strategies for dispatcher, e.g. round robin, multi-level priority queues}
- G06F 9/5038: {considering the execution order of a plurality of tasks, e.g. taking priority or time dependency constraints into consideration (scheduling strategies G06F9/4881 and subgroups)}
- G06T 1/20: Processor architectures; Processor configuration, e.g. pipelining
- G06F 2209/484: Precedence
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

Apparatuses, systems, and techniques to execute CUDA programs. In at least one embodiment, one or more software kernels are caused to indicate one or more dependencies among two or more software kernels. In at least one embodiment, one or more software kernels are performed based on one or more kernel dependencies.

## Claims

### Claim 1

A processor comprising:
one or more circuits to cause one or more first software kernels to indicate one or more dependencies of one or more second software kernels on the one or more first software kernels.

### Claim 2 (depends on 1)

The processor of claim 1, wherein the one or more dependencies indicate that the one or more first software kernels are to be performed before one or more second software kernels.

### Claim 3 (depends on 1)

The processor of claim 1, wherein the one or more first software kernels are parent kernels and the one or more second software kernels comprise one or more child kernels.

### Claim 4 (depends on 1)

The processor of claim 1, wherein the one or more circuits are to further cause the one or more first software kernels and the one or more second software kernels to be performed based, at least in part, on the one or more dependencies.

### Claim 5 (depends on 1)

The processor of claim 1, wherein the one or more first software kernels and the one or more second software kernels are associated with two or more grids comprising one or more threads to perform the one or more first software kernels and the one or more second software kernels based, at least in part, on the one or more dependencies.

### Claim 6 (depends on 1)

The processor of claim 1, wherein the one or more circuits are to cause the one or more first software kernels to indicate one or more dependencies of the one or more second software kernels using one or more graphics processing units (GPUs).

### Claim 7 (depends on 1)

The processor of claim 1, wherein the one or more circuits are to cause the one or more first software kernels and the one or more second software kernels to be scheduled to be performed in an order based, at least in part, on the one or more dependencies.

### Claim 8

A method comprising:
causing one or more first software kernels to indicate one or more dependencies of one or more second software kernels on the one or more first software kernels.

### Claim 9 (depends on 8)

The method of claim 8, wherein the one or more dependencies indicate that the one or more first software kernels are to be performed before one or more second software kernels.

### Claim 10 (depends on 8)

The method of claim 8, wherein the one or more first software kernels are parent kernels and the one or more second software kernels comprise one or more child kernels.

### Claim 11 (depends on 8)

The method of claim 8, further comprising causing the one or more first software kernels and the one or more second software kernels to be performed based, at least in part, on the one or more dependencies.

### Claim 12 (depends on 8)

The method of claim 8, wherein the one or more first software kernels and the one or more second software kernels are associated with two or more grids comprising one or more threads to perform the one or more first software kernels and the one or more second software kernels based, at least in part, on the one or more dependencies.

### Claim 13 (depends on 8)

The method of claim 8, wherein the one or more first software kernels are to indicate the one or more dependencies of the one or more second software kernels using one or more graphics processing units (GPUs).

### Claim 14 (depends on 8)

The method of claim 8, further comprising causing the one or more first software kernels and the one or more second software kernels to be scheduled to be performed in an order based, at least in part, on the one or more dependencies.

### Claim 15

A system comprising:
one or more processors to cause one or more first software kernels to indicate one or more dependencies of one or more second software kernels on the one or more first software kernels.

### Claim 16 (depends on 15)

The system of claim 15, wherein the one or more dependencies indicate that the one or more first software kernels are to be performed before one or more second software kernels.

### Claim 17 (depends on 15)

The system of claim 15, wherein the one or more first software kernels are parent kernels and the one or more second software kernels comprise one or more child kernels.

### Claim 18 (depends on 15)

The system of claim 15, wherein the one or more processors are to further cause the one or more first software kernels and the one or more second software kernels to be performed based, at least in part, on the one or more dependencies.

### Claim 19 (depends on 15)

The system of claim 15, wherein the one or more first software kernels and the one or more second software kernels are associated with two or more grids comprising one or more threads to perform the one or more first software kernels and the one or more second software kernels based, at least in part, on the one or more dependencies.

### Claim 20 (depends on 15)

The system of claim 15, wherein the one or more processors are to cause the one or more first software kernels and the one or more second software kernels to be scheduled to be performed in an order based, at least in part, on the one or more dependencies.
