# US 2008/0303835 A1 · Serializing command streams for graphics processors

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2008/0303835 A1
- Document ID: US20080303835A1
- Status: Published application
- Kind: A1
- Application number: 11/811,416
- Filed: 2007-06-07
- Published: 2008-12-11
- Earliest claimed: 2007-06-07
- Assignees: Apple Inc.
- Inventors: Michael James Elliott Swift; Kenneth Christian Dyke; Richard Schreyer
- Web page: https://patentgrep.com/patent/US20080303835A1

## CPC

- G06T 15/005: {General purpose rendering architectures}
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A method and an apparatus for determining a dependency relationship between graphics commands based on availability of graphics hardware resources to perform graphics processing operations according to the dependency relationship are described. The graphics commands may be received from graphics APIs (application programming interfaces) for rendering a graphics object. A graphics driver may transmit a portion or all of the received graphics commands to a graphics processing unit (GPU) or a media processor based on the determined dependency relationship between the graphics commands.

## Claims

### Claim 1

A computer-implemented method for processing graphics data, the method comprising:
in response to a first graphics command and a second graphics command received from a plurality of graphics APIs (application programming interfaces) for rendering a graphics object, a graphics driver determining a dependency relationship between the first and second graphics commands based on availability of graphics hardware resources; and
the graphics driver transmitting one or both of the first and second graphics commands to a graphics processing unit (GPU) based on the determined dependency relationship between the first and second graphics commands.

### Claim 2 (depends on 1)

The method of claim 1, wherein the graphics driver is configured to transmit the first and second graphics commands to the GPU without having to wait an execution result of a prior transmitted graphics command, if both of the first and second graphics commands are associated with a similar graphics category.

### Claim 3 (depends on 2)

The method of claim 2, wherein the GPU comprises a 2D (two-dimensional) core and a 3D (three-dimensional) core, and wherein the first and second graphics commands are transmitted to the GPU without having to wait if both the first and second graphics commands are to be processed by the 2D core.

### Claim 4 (depends on 1)

The method of claim 1, wherein the graphics driver is configured to transmit the first and second graphics commands to the GPU in serial in which the second graphics command is not transmitted until the first graphics command has been executed, if both of the first and second graphics commands are associated with different graphics categories.

### Claim 5 (depends on 4)

The method of claim 4, wherein the GPU comprises a 2D (two-dimensional) core and a 3D (three-dimensional) core, and wherein the first and second graphics commands are transmitted in serial depending upon an execution result of a prior graphics command if one of the first and second graphics commands is to be processed by the 3D core.

### Claim 6 (depends on 4)

The method of claim 4, further comprising:
the graphics driver receiving a notification originated from the GPU, the notification indicating that the first graphics command has been executed; and
in response to the notification, the graphics driver transmitting the second graphics command to the GPU for processing.

### Claim 7 (depends on 1)

The method of claim 1, further comprising:
storing the first and second graphics commands in a command stream buffer by the plurality of graphics APIs; and
the graphics driver fetching and examining the first and second graphics commands in the command stream buffer to determine the dependency of the first and second graphics commands.

### Claim 8 (depends on 1)

The method of claim 1, wherein the plurality of graphics API comprises at least two of a 2D graphics API, a 3D graphics API, and a frame buffer API.

### Claim 9

A machine-readable medium having instructions stored therein which, when executed by a system, cause the system to perform a method for processing graphics data, the method comprising:
in response to a first graphics command and a second graphics command received from a plurality of graphics APIs (application programming interfaces) for rendering a graphics object, a graphics driver determining a dependency relationship between the first and second graphics commands based on availability of graphics hardware resources; and
the graphics driver transmitting one or both of the first and second graphics commands to a graphics processing unit (GPU) based on the determined dependency relationship between the first and second graphics commands.

### Claim 10 (depends on 9)

The machine-readable medium of claim 9, wherein the graphics driver is configured to transmit the first and second graphics commands to the GPU without having to wait an execution result of a prior transmitted graphics command, if both of the first and second graphics commands are associated with a similar graphics category.

### Claim 11 (depends on 10)

The machine-readable medium of claim 10, wherein the GPU comprises a 2D (two-dimensional) core and a 3D (three-dimensional) core, and wherein the first and second graphics commands are transmitted to the GPU without having to wait if both the first and second graphics commands are to be processed by the 2D core.

### Claim 12 (depends on 9)

The machine-readable medium of claim 9, wherein the graphics driver is configured to transmit the first and second graphics commands to the GPU in serial in which the second graphics command is not transmitted until the first graphics command has been executed, if both of the first and second graphics commands are associated with different graphics categories.

### Claim 13 (depends on 12)

The machine-readable medium of claim 12, wherein the GPU comprises a 2D (two-dimensional) core and a 3D (three-dimensional) core, and wherein the first and second graphics commands are transmitted in serial depending upon an execution result of a prior graphics command if one of the first and second graphics commands is to be processed by the 3D core.

### Claim 14 (depends on 12)

The machine-readable medium of claim 12, wherein the method further comprises:
the graphics driver receiving a notification originated from the GPU, the notification indicating that the first graphics command has been executed; and
in response to the notification, the graphics driver transmitting the second graphics command to the GPU for processing.

### Claim 15 (depends on 9)

The machine-readable medium of claim 9, wherein the method further comprises:
storing the first and second graphics commands in a command stream buffer by the plurality of graphics APIs; and
the graphics driver fetching and examining the first and second graphics commands in the command stream buffer to determine the dependency of the first and second graphics commands.

### Claim 16 (depends on 9)

The machine-readable medium of claim 9, wherein the plurality of graphics API comprises at least two of a 2D graphics API, a 3D graphics API, and a frame buffer API.

### Claim 17

A data processing system, comprising:
a graphics processing unit (GPU);
a plurality of graphics APIs (application programming interfaces) to receive a first graphics command and a second graphics command from one or more applications; and
a graphics driver coupled to the graphics APIs to determine a dependency relationship between the first and second graphics commands based on available resources of the GPU and to transmit one or both of the first and second graphics commands to the GPU based on the determined dependency relationship of the first and second graphics commands.

### Claim 18 (depends on 17)

The system of claim 17, wherein the graphics driver is configured to transmit the first and second graphics commands to the GPU without having to wait an execution result of a prior transmitted graphics command, if both of the first and second graphics commands are associated with a similar graphics category.

### Claim 19 (depends on 18)

The system of claim 18, wherein the GPU comprises a 2D (two-dimensional) core and a 3D (three-dimensional) core, and wherein the first and second graphics commands are transmitted to the GPU without having to wait if both the first and second graphics commands are to be processed by the 2D core.

### Claim 20 (depends on 17)

The system of claim 17, wherein the graphics driver is configured to transmit the first and second graphics commands to the GPU in serial in which the second graphics command is not transmitted until the first graphics command has been executed, if both of the first and second graphics commands are associated with different graphics categories.

### Claim 21 (depends on 20)

The system of claim 20, wherein the GPU comprises a 2D (two-dimensional) core and a 3D (three-dimensional) core, and wherein the first and second graphics commands are transmitted in serial depending upon an execution result of a prior graphics command if one of the first and second graphics commands is to be processed by the 3D core.

### Claim 22 (depends on 20)

The system of claim 20, wherein the graphics driver is configured to:
receive a notification originated from the GPU, the notification indicating that the first graphics command has been executed; and
in response to the notification, to transmit the second graphics command to the GPU for processing.

### Claim 23 (depends on 17)

The system of claim 17, further comprising a command stream buffer coupled to the plurality of graphics APIs and the graphics driver, wherein at least one of the graphics APIs stores the first and second graphics commands in the command stream buffer, and the graphics driver fetches and examines the first and second graphics commands in the command stream buffer to determine the dependency of the first and second graphics commands.

### Claim 24 (depends on 17)

The system of claim 17, wherein the plurality of graphics API comprises at least two of a 2D graphics API, a 3D graphics API, and a frame buffer API.

### Claim 25

An apparatus for processing graphics data, comprising:
in response to a first graphics command and a second graphics command received from a plurality of graphics APIs (application programming interfaces) for rendering a graphics object, means for a graphics driver determining a dependency relationship between the first and second graphics commands based on availability of graphics hardware resources; and
means for the graphics driver transmitting one or both of the first and second graphics commands to a graphics processing unit (GPU) based on the determined dependency relationship between the first and second graphics commands.

### Claim 26

A computer-implemented method for processing graphics data, the method comprising:
in response to a first set of graphics commands from one or more applications, converting the first set of graphics commands into a second set of graphics commands in accordance with command formats required by a graphics processing unit (GPU), wherein the first set of graphics commands is compatible with a software standard implemented by the one or more applications; and
storing the second set of graphics commands in a command stream buffer, wherein the second set of graphics commands are fetched and examined by a graphics driver to determine a dependency relationship among the second set of graphics commands, and wherein the graphics driver transmits at least a portion of the second set of graphics commands to the GPU in a manner based on the determined dependency relationship.

### Claim 27 (depends on 26)

The method of claim 26, wherein the second set of graphics commands includes a first graphics command and a second graphics command, wherein the graphics driver is configured to transmit the first and second graphics commands to the GPU without having to wait an execution result of a prior transmitted graphics command, if both of the first and second graphics commands are associated with a similar graphics category.

### Claim 28 (depends on 27)

The method of claim 27, wherein the GPU comprises a 2D (two-dimensional) core and a 3D (three-dimensional) core, and wherein the first and second graphics commands are transmitted to the GPU without having to wait if both the first and second graphics commands are to be processed by the 2D core.

### Claim 29 (depends on 26)

The method of claim 26, wherein the second set of graphics commands includes a first graphics command and a second graphics command, wherein the graphics driver is configured to transmit the first and second graphics commands to the GPU in serial in which the second graphics command is not transmitted until the first graphics command has been executed, if both of the first and second graphics commands are associated with different graphics categories.

### Claim 30 (depends on 29)

The method of claim 29, wherein the GPU comprises a 2D (two-dimensional) core and a 3D (three-dimensional) core, and wherein the first and second graphics commands are transmitted in serial depending upon an execution result of a prior graphics command if one of the first and second graphics commands is to be processed by the 3D core.

### Claim 31 (depends on 29)

The method of claim 29, further comprising:
the graphics driver receiving a notification originated from the GPU, the notification indicating that the first graphics command has been executed; and
in response to the notification, the graphics driver transmitting the second graphics command to the GPU for processing.

### Claim 32

A machine-readable medium having instructions stored therein which, when executed by a processor, cause the processor to perform a method for processing graphics data, the method comprising:
in response to a first set of graphics commands from one or more applications, converting the first set of graphics commands into a second set of graphics commands in accordance with command formats required by a graphics processing unit (GPU), wherein the first set of graphics commands is compatible with a software standard implemented by the one or more applications; and
storing the second set of graphics commands in a command stream buffer, wherein the second set of graphics commands are fetched and examined by a graphics driver to determine a dependency relationship among the second set of graphics commands, and wherein the graphics driver transmits at least a portion of the second set of graphics commands to the GPU in a manner based on the determined dependency relationship.

### Claim 33 (depends on 32)

The machine-readable medium of claim 32, wherein the second set of graphics commands includes a first graphics command and a second graphics command, wherein the graphics driver is configured to transmit the first and second graphics commands to the GPU without having to wait an execution result of a prior transmitted graphics command, if both of the first and second graphics commands are associated with a similar graphics category.

### Claim 34 (depends on 33)

The machine-readable medium of claim 33, wherein the GPU comprises a 2D (two-dimensional) core and a 3D (three-dimensional) core, and wherein the first and second graphics commands are transmitted to the GPU without having to wait if both the first and second graphics commands are to be processed by the 2D core.

### Claim 35 (depends on 32)

The machine-readable medium of claim 32, wherein the second set of graphics commands includes a first graphics command and a second graphics command, wherein the graphics driver is configured to transmit the first and second graphics commands to the GPU in serial in which the second graphics command is not transmitted until the first graphics command has been executed, if both of the first and second graphics commands are associated with different graphics categories.

### Claim 36 (depends on 35)

The machine-readable medium of claim 35, wherein the GPU comprises a 2D (two-dimensional) core and a 3D (three-dimensional) core, and wherein the first and second graphics commands are transmitted in serial depending upon an execution result of a prior graphics command if one of the first and second graphics commands is to be processed by the 3D core.

### Claim 37 (depends on 35)

The machine-readable medium of claim 35, wherein the method further comprises:
the graphics driver receiving a notification originated from the GPU, the notification indicating that the first graphics command has been executed; and
in response to the notification, the graphics driver transmitting the second graphics command to the GPU for processing.

### Claim 38

An apparatus for processing graphics data, comprising:
in response to a first set of graphics commands from one or more applications, means for converting the first set of graphics commands into a second set of graphics commands in accordance with command formats required by a graphics processing unit (GPU), wherein the first set of graphics commands is compatible with a software standard implemented by the one or more applications; and
means for storing the second set of graphics commands in a command stream buffer, wherein the second set of graphics commands are fetched and examined by a graphics driver to determine a dependency relationship among the second set of graphics commands, and wherein the graphics driver transmits at least a portion of the second set of graphics commands to the GPU in a manner based on the determined dependency relationship.
