# US 2025/0061536 A1 · Task execution in a simd processing unit with parallel groups of processing lanes

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0061536 A1
- Document ID: US20250061536A1
- Status: Published application
- Kind: A1
- Application number: 18/907,801
- Filed: 2024-10-07
- Published: 2025-02-20
- Earliest claimed: 2013-12-18
- Assignees: Imagination Technologies Limited
- Applicants: Imagination Technologies Limited
- Inventors: John Howson; Jonathan Redshaw; Yoong Chert Foo
- Web page: https://patentgrep.com/patent/US20250061536A1

## CPC

- G06T 1/20: Processor architectures; Processor configuration, e.g. pipelining
- G06F 9/30036: {Instructions to perform operations on packed data, e.g. vector, tile or matrix operations}
- G06F 9/30038: {using a mask}
- G06F 9/3822: {Parallel decoding, e.g. parallel decode units}
- G06F 9/3836: {Instruction issuing, e.g. dynamic instruction scheduling or out of order instruction execution}
- G06F 9/3887: {controlled by a single instruction for multiple data lanes [SIMD]}
- G06F 9/38885: {Divergence aspects}
- G06F 15/8007: {single instruction multiple data [SIMD] multiprocessors}
- G06F 9/4881: {Scheduling strategies for dispatcher, e.g. round robin, multi-level priority queues}
- G06F 2209/507: Low-level
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A SIMD processing unit processes a plurality of tasks which each include up to a predetermined maximum number of work items. The work items of a task are arranged for executing a common sequence of instructions on respective data items. The data items are arranged into blocks, with some of the blocks including at least one invalid data item. Work items which relate to invalid data items are invalid work items. The SIMD processing unit comprises a group of processing lanes configured to execute instructions of work items of a particular task over a plurality of processing cycles. A control module assembles work items into the tasks based on the validity of the work items, so that invalid work items of the particular task are temporally aligned across the processing lanes. In this way the number of wasted processing slots due to invalid work items may be reduced.

## Claims

### Claim 1

A single instruction multiple data (SIMD) processing unit configured to process a group of tasks which each include a sequence of instructions to be executed in respect of data items, the SIMD processing unit comprising:
a group of processing lanes configured to execute instructions of the group of tasks over a plurality of processing cycles; and
logic configured to cause the group of processing lanes to execute the instructions of the group of tasks in sequence, such that an instruction from each task of the group of tasks is executed prior to executing a subsequent instruction from any one of the tasks of the group of tasks.

### Claim 2 (depends on 1)

The SIMD processing unit of claim 1, wherein each of the tasks includes one or more work items, wherein the work items of a task are arranged for executing a common sequence of the instructions on respective data items, wherein the logic is further configured to cause the group of processing lanes to skip a particular processing cycle if there are no valid work items scheduled for execution in any of the processing lanes of the group of processing lanes in the particular processing cycle.

### Claim 3 (depends on 2)

The SIMD processing unit of claim 2, wherein the number of tasks in the group of tasks is variable and dependent on the number of processing cycles which have been skipped in a given time period.

### Claim 4 (depends on 2)

The SIMD processing unit of claim 2, wherein in response to an increase in the number of processing cycles that have been skipped in a given time period, the number of tasks in the group of tasks is increased.

### Claim 5 (depends on 2)

The SIMD processing unit of claim 2, wherein the work items are divided into tasks such that each task includes up to a predetermined maximum number of work items.

### Claim 6 (depends on 1)

The SIMD processing unit of claim 1, wherein the logic is coupled to the group of processing lanes.

### Claim 7 (depends on 2)

The SIMD processing unit of claim 2, wherein the logic is configured to set indicators to indicate how the work items have been assembled into the tasks.

### Claim 8 (depends on 7)

The SIMD processing unit of claim 7, further comprising:
a store configured to store processed data items output from the group of processing lanes; and
storing logic configured to determine addresses for storing the processed data items in the store based on the indicators.

### Claim 9 (depends on 2)

The SIMD processing unit of claim 2, wherein the logic is configured to assemble the work items into the tasks such that work items of a block of work items relating to a block of data items are grouped together into the same task.

### Claim 10 (depends on 9)

The SIMD processing unit of claim 9, wherein the data items are pixel values and the block of data items is a pixel quad.

### Claim 11 (depends on 2)

The SIMD processing unit of claim 2, wherein the work items are assembled into blocks of work items such that each work item within a block of work items can be used to perform a pre-processing operation on the block of work items before it is passed to the group of processing lanes.

### Claim 12 (depends on 2)

The SIMD processing unit of claim 2, wherein there are no valid work items scheduled for execution over the group of processing lanes in the particular processing cycle if all of the work items which are scheduled for execution over the group of processing lanes in the particular processing cycle are invalid work items.

### Claim 13 (depends on 12)

The SIMD processing unit of claim 12, wherein the logic is configured to assemble the work items into tasks so that blocks of work items are grouped together into tasks based on the number of invalid work items in the respective blocks of work items.

### Claim 14 (depends on 12)

The SIMD processing unit of claim 12, wherein the logic is configured to assemble the work items into tasks so that work items within a block of work items are re-ordered to thereby align the invalid work items from different blocks of work items of the task across the group of processing lanes.

### Claim 15 (depends on 12)

The SIMD processing unit of claim 12, wherein there are more than two levels of validity for the work items, and wherein the logic is configured to assemble the work items into the tasks, based on the validity of the work items, so that work items of the particular task which have the same level of validity are temporally aligned across the particular group of processing lanes.

### Claim 16 (depends on 2)

The SIMD processing unit of claim 2, wherein there is not a valid work item scheduled for execution in a processing lane in a particular processing cycle if there is not a work item which is scheduled for execution in the processing lane in the particular processing cycle and wherein work items which are not ready for execution when the task is due to be sent to the group of parallel processing lanes are not scheduled for execution.

### Claim 17 (depends on 2)

The SIMD processing unit of claim 2, wherein the SIMD processing unit comprises a plurality of parallel groups of processing lanes, each group of processing lanes being configured to execute instructions of work items of a respective group of tasks over a plurality of processing cycles.

### Claim 18 (depends on 17)

The SIMD processing unit of claim 17, wherein the logic coupled to the groups of processing lanes is further configured to cause a particular group of processing lanes to skip a particular processing cycle, independently of the other groups of processing lanes, if there are no valid work items scheduled for execution in any of the processing lanes of the particular group in the particular processing cycle.

### Claim 19

A method of using a single instruction multiple data (SIMD) processing unit to process a group of tasks which each include a sequence of instructions to be executed in respect of data items, wherein the SIMD processing unit comprises a group of processing lanes configured to execute instructions of the group of tasks over a plurality of processing cycles, the method comprising:
executing instructions using the group of processing lanes; and
causing the group of processing lanes to execute the instructions of the group of tasks in sequence, such that an instruction from each task of the group of tasks is executed prior to executing a subsequent instruction from any one of the tasks of the group of tasks.

### Claim 20

A non-transitory computer readable storage medium having stored thereon an integrated circuit dataset description that when inputted causes an integrated circuit manufacturing system to generate a single instruction multiple data (SIMD) processing unit configured to process a group of tasks which each include a sequence of instructions to be executed in respect of data items, the SIMD processing unit comprising:
a group of processing lanes configured to execute instructions of the group of tasks over a plurality of processing cycles; and
logic configured to cause the group of processing lanes to execute the instructions of the group of tasks in sequence, such that an instruction from each task of the group of tasks is executed prior to executing a subsequent instruction from any one of the tasks of the group of tasks.
