# US 2019/0317802 A1 · Architecture for offload of linked work assignments

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0317802 A1
- Document ID: US20190317802A1
- Status: Published application
- Kind: A1
- Application number: 16/448,860
- Filed: 2019-06-21
- Published: 2019-10-17
- Earliest claimed: 2019-06-21
- Assignees: Intel Corporation
- Applicants: Intel Corporation
- Inventors: Alexander BACHMUTSKY; Andrew J. HERDRICH; Patrick CONNOR; Raghu KONDAPALLI; Francesc GUIM BERNAT; Scott P. DUBAL; James R. HEARN; Kapil SOOD; Niall D. MCDONNELL; Matthew J. ADILETTA
- Web page: https://patentgrep.com/patent/US20190317802A1

## CPC

- G06F 9/4843: {by program, e.g. task dispatcher, supervisor, operating system}
- G06F 9/5044: {considering hardware capabilities}
- G06F 9/5038: {considering the execution order of a plurality of tasks, e.g. taking priority or time dependency constraints into consideration (scheduling strategies G06F9/4881 and subgroups)}
- G06F 9/505: {considering the load}
- G06F 2209/501: Performance criteria
- G06F 2209/5017: Task decomposition
- G06F 2209/506: Constraint
- G06F 2209/509: Offload
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Examples are described herein that can be used to offload a sequence of work events to one or more accelerators to a work scheduler. An application can issue a universal work descriptor to a work scheduler. The universal work descriptor can specify a policy for scheduling and execution of one or more work events. The universal work descriptor can refer to one or more work events for execution. The work scheduler can, in some cases, perform translation of the universal work descriptor or a work event descriptor for compatibility and execution by an accelerator. The application can receive notice of completion of the sequence of work from the work scheduler or an accelerator.

## Claims

### Claim 1

A work scheduler apparatus comprising:
an input interface to receive a combined work descriptor, the combined work descriptor associated with at least one processing operation, the at least one processing operation to be managed by the work scheduler apparatus;
an ingress queue to receive a work request based on the combined work descriptor for performance by an accelerator;
an egress queue to store a work request assigned to a target accelerator;
a scheduler to assign a work request in an ingress queue to an egress queue, wherein a work request includes a reference to another work request; and
logic to provide an identifier of a result data to a requesting entity that requested operations based on the combined work descriptor, wherein performance and availability of data between work requests occur independent from oversight by the requesting entity.

### Claim 2 (depends on 1)

The work scheduler apparatus of claim 1, wherein the combined work descriptor is to refer to a first work request, the first work request to include a reference to a second work request to be performed by a target accelerator, and the work scheduler comprising a translator to translate a first work request to a format accepted by a target accelerator.

### Claim 3 (depends on 1)

The work scheduler apparatus of claim 1, wherein the combined work descriptor is to refer to a first work request and the first work request is in a format accepted by a target accelerator.

### Claim 4 (depends on 1)

The work scheduler apparatus of claim 1, wherein the work scheduler is to push work requests from the egress queue to a target accelerator.

### Claim 5 (depends on 1)

The work scheduler apparatus of claim 1, wherein a target accelerator is to pull a work request from the egress queue.

### Claim 6 (depends on 1)

The work scheduler apparatus of claim 1, wherein the work scheduler is to enqueue a work request to an egress queue to assign to a next accelerator after completion of a work request.

### Claim 7 (depends on 1)

The work scheduler apparatus of claim 1, wherein the scheduler is to:
assign a work request from an ingress queue to an egress queue based on quality of service (QoS) associated with the assigned work request.

### Claim 8 (depends on 1)

The work scheduler apparatus of claim 1, wherein the scheduler is to:
divide a work request in an ingress queue into multiple portions and
provide load balance of the divided work request to distribute work requests to different accelerators that perform a function specified in the work request.

### Claim 9 (depends on 1)

The work scheduler apparatus of claim 1, wherein after selection of an egress queue by the scheduler and based on a target accelerator sharing physical memory space but not virtual memory spaces with the entity that requested operations, the work scheduler is to receive a pointer to data from the entity that requested operations and perform pointer translation.

### Claim 10 (depends on 1)

The work scheduler apparatus of claim 1, wherein after selection of an egress queue by the scheduler and based on a target accelerator sharing virtual memory space with the entity that requested operations, the work scheduler is to receive a pointer to data from the entity that requested operations and perform pointer translation.

### Claim 11 (depends on 1)

The work scheduler apparatus of claim 1, wherein after selection of an egress queue by the scheduler and based on a target accelerator not sharing virtual or physical memory space with the entity that requested operations, the work scheduler is to use a data mover to copy data to memory accessible to the target accelerator.

### Claim 12 (depends on 1)

The work scheduler apparatus of claim 1, comprising at least two accelerators, an accelerator comprising one or more of: field programmable gate arrays (FPGAs), graphics processor units (GPUs), artificial intelligence (AI) inference engines, image recognition, object detection, speech recognition, memory, storage, central processing units (CPUs), software executed by a hardware device, or network interface.

### Claim 13 (depends on 1)

The work scheduler apparatus of claim 1, wherein the work request comprises a request to process data, decrypt data, encrypt data, store data, transfer data, parse data, copy data, perform an inference using data, or transform data.

### Claim 14

A computer-implemented method comprising:
receiving a combined work descriptor that identifies at least one work descriptor for performance by an accelerator and the combined work descriptor specifies a policy for managing work associated with the combined work descriptor;
allocating a work descriptor associated with the combined work descriptor to an egress queue based on a scheduling policy specified by the combined work descriptor;
receiving a queue entry in an ingress queue that identifies a next operation for an accelerator; and
providing a result from processing based on the combined work descriptor.

### Claim 15 (depends on 14)

The method of claim 14, wherein the combined work descriptor refers to a first work request, the first work request to include a reference to a second work request to be performed by a target accelerator and comprising translating the first work request to a format accepted by the target accelerator.

### Claim 16 (depends on 14)

The method of claim 14, wherein the combined work descriptor refers to a first work request and the first work request is in a format accepted by a target accelerator.

### Claim 17 (depends on 14)

The method of claim 14, wherein allocating a work descriptor associated with the combined work descriptor to an egress queue based on a scheduling policy specified by the combined work descriptor comprises assigning a work request from an ingress queue to an egress queue based on quality of service (QoS) associated with the work request.

### Claim 18 (depends on 14)

The method of claim 14, wherein allocating a work descriptor associated with the combined work descriptor to an egress queue based on a scheduling policy specified by the combined work descriptor comprises providing load balancing of work requests in an ingress queue to an accelerator to distribute work requests to different accelerators that perform a function specified in the distributed work requests.

### Claim 19 (depends on 14)

The method of claim 14, wherein an accelerator comprising one or more of: field programmable gate arrays (FPGAs), graphics processor units (GPUs), artificial intelligence (AI) inference engines, image recognition, object detection, speech recognition, memory, storage, central processing units (CPUs), software executed by a hardware device, or network interface.

### Claim 20 (depends on 14)

The method of claim 14, wherein the work request comprises a request to process data, decrypt data, encrypt data, store data, transfer data, parse data, copy data, perform an inference using data, or transform data.

### Claim 21

A system comprising:
a core;
a memory;
a work scheduler;
at least one accelerator; and
an interconnect to communicatively couple the core, the memory, the work scheduler, and the at least one accelerator, wherein:
the core is to execute an application that is to request performance of a sequence of work based on a combined work descriptor and provide the combined work descriptor to the work scheduler via the interconnect,
the work scheduler comprises a scheduler logic, ingress queues, egress queues, and a command translator,
the work scheduler is to access a work descriptor from the memory based on content of the combined work descriptor and allocate the work descriptor to an ingress queue for execution by an accelerator,
the scheduler logic is to determine an egress queue and position in an egress queue for the work descriptor based in part on a configuration,
the ingress queue is to receive another work descriptor after execution by the accelerator, and
the work scheduler is to indicate data is available from the sequence of work to the application.

### Claim 22 (depends on 21)

The system of claim 21, wherein the combined work descriptor is to refer to a first work request, the first work request to include a reference to a second work request to be performed by a target accelerator, and the command translator to translate a first work request to a format accepted by the target accelerator.

### Claim 23 (depends on 21)

The system of claim 21, wherein an accelerator comprising one or more of: field programmable gate arrays (FPGAs), graphics processor units (GPUs), artificial intelligence (AI) inference engines, image recognition, object detection, speech recognition, memory, storage, central processing units (CPUs), software executed by a hardware device, or network interface.
