# US 2013/0097350 A1 · Qos based dynamic execution engine selection

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2013/0097350 A1
- Document ID: US20130097350A1
- Status: Published application
- Kind: A1
- Application number: 13/272,975
- Filed: 2011-10-13
- Published: 2013-04-18
- Earliest claimed: 2011-10-13
- Assignees: Cavium, Inc.
- Inventors: Najeeb I. Ansari; Michael Carns; Jeffrey Schroeder; Bryan Chin
- Web page: https://patentgrep.com/patent/US20130097350A1

## CPC

- G06F 9/30181: {Instruction operation extension or modification}
- G06F 9/30: Arrangements for executing machine instructions, e.g. instruction decode (for executing microinstructions G06F9/22)
- G06F 9/30145: {Instruction analysis, e.g. decoding, instruction word fields}
- G06F 9/38: Concurrent instruction execution, e.g. pipeline or look ahead
- G06F 9/3836: {Instruction issuing, e.g. dynamic instruction scheduling or out of order instruction execution}
- G06F 9/46: Multiprogramming arrangements
- G06F 13/362: with centralised access control
- G06F 9/50: Allocation of resources, e.g. of the central processing unit [CPU]
- G06F 9/5044: {considering hardware capabilities}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

In one embodiment, a processor includes processing cores, and instruction stores storing instructions at least one instructions having a group number, each instruction store having a unique identifier. The processor also includes a group execution matrix having group execution masks and a store execution matrix having store execution masks. The processor further includes a core selection unit that, for each instruction, selects a store execution mask using the unique identifier as an index. The core selection unit for each instruction, selects at least one group execution mask using the group number as an index, and performs logic operations on the selected group execution mask and the store execution mask to create a core request mask. The processor also includes an arbitration unit that determines instruction priority, assigns an instruction for each available core, and signals the instruction store of the assigned instruction to send the assigned instruction to the available core.

## Claims

### Claim 1

A processor comprising:
a plurality of processing cores;
a plurality of instruction stores, each instruction store storing at least one instruction, each instruction having a corresponding group number, each instruction store having a unique identifier;
a group execution matrix comprising a plurality of group execution masks;
a store execution matrix comprising a plurality of store execution masks;
a core selection unit configured to
for each instruction within each instruction store:
select a store execution mask from the store execution matrix using the unique identifier of a selected instruction store as an index, select at least one group execution mask from the group execution matrix using the group number of at least one selected instruction from the selected instruction store as an index, and
for each selected group execution mask of the at least one group execution masks, perform logic operations on the selected group execution mask and the store execution mask to create a core request mask, the core request mask corresponding to the selected instruction store and indicating zero, one, or more candidate cores; and
an arbitration unit configured to determine instruction priority among each instruction, each instruction store having at least one corresponding core request mask, accordingly assign an instruction for each available core, where the core request mask corresponding to the instruction store of the instruction indicates candidate cores that intersect with the available cores, and signal the instruction store corresponding to the assigned instruction to send the assigned instruction to the available core.

### Claim 2 (depends on 1)

The processor of claim 1, wherein each instruction store includes a queue, and the core selection unit is configured to select one group number corresponding to the instruction at the front of the queue.

### Claim 3 (depends on 1)

The processor of claim 1, wherein each instruction store is further configured to dispatch an instruction to any of the plurality of cores.

### Claim 4 (depends on 1)

The processor of claim 1, wherein each instruction store is assigned to one of a plurality of virtual functions.

### Claim 5 (depends on 4)

The processor of claim 4, wherein the arbitration unit determines instruction priority among the virtual functions by a method of hardware arbitration.

### Claim 6 (depends on 4)

The processor of claim 4, further comprising a plurality of virtual function arbitration units configured to determine instruction priority within the virtual functions by a method of hardware arbitration.

### Claim 7 (depends on 6)

The processor of claim 6, wherein the plurality of virtual function arbitration units is configured to determine instruction priority among the instruction stores.

### Claim 8 (depends on 4)

The processor of claim 4, wherein the plurality of virtual functions is configured to interface with a host, receive instructions and distribute the instructions to its corresponding instruction stores.

### Claim 9 (depends on 1)

The processor of claim 1, wherein the arbitration unit is further configured to determine instruction priority by performing a method of hardware arbitration.

### Claim 10 (depends on 1)

The processor of claim 1, wherein the core selection unit is further configured to perform a bitwise and-operation on the selected group execution mask and the selected store execution mask to create the core request mask corresponding to the selected instruction store.

### Claim 11 (depends on 1)

The processor of claim 1, further comprising a core availability vector, wherein the core selection unit is further configured to perform a bitwise and-operation on the selected group execution mask, the selected store execution mask, and the core availability vector to create the core request mask corresponding to the selected instruction store.

### Claim 12 (depends on 1)

The processor of claim 1, further comprising a dispatch unit configured to receive a unique identifier of the selected instruction store and an identification number of an available core and produce a signal to the selected instruction store to issue an instruction to the available core indicated by the identification number.

### Claim 13 (depends on 1)

The processor of claim 1, wherein at least one of the group execution matrix and the store execution matrix is set to affect the quality of service of a physical function or a virtual function among the plurality of cores.

### Claim 14 (depends on 1)

The processor of claim 1, wherein the instruction stores are at least one of compression instruction stores, cryptography instruction stores, video processing instruction stores, image processing instruction stores, or general instruction stores.

### Claim 15 (depends on 1)

The processor of claim 1, wherein each instruction store is assigned to a physical function, and the arbitration unit is configured to determine instruction priority within the physical function by a method of hardware arbitration.

### Claim 16

A method comprising:
on the clock cycle of a processor with a plurality of cores and plurality of instruction stores, for each instruction within the instruction stores:
selecting a store execution mask from a store execution matrix using a unique identifier of a selected instruction store as an index;
selecting at least one group execution mask from a group execution matrix using a group number corresponding to an instruction of the selected instruction store as an index;
for each selected group execution mask of the selected group execution masks, performing logic operations on at least the selected group execution mask and the selected store execution mask to create a core request mask, the core request mask corresponding to the selected instruction store and indicating zero, one, or more candidate cores, each core request mask added to a core request matrix indexed by the unique identifier of each instruction store; and
on the clock cycle of the processor:
arbitrating to determine instruction priority among the individual instructions corresponding to the plurality of core request masks;
assigning an instruction to each available core, where a core request mask corresponding to the instruction store of the instruction indicates candidate cores that intersect with the available cores;
signaling the instruction store corresponding to the assigned instruction to send the assigned instruction to the available core.

### Claim 17 (depends on 16)

The method of claim 16, wherein each instruction store includes a queue, selecting at least one group execution mask from a group execution matrix selects only one group number corresponding to the instruction at the front of the queue.

### Claim 18 (depends on 16)

The method of claim 16 wherein the plurality of instruction stores are configured to dispatch instructions to the plurality of cores.

### Claim 19 (depends on 16)

The method of claim 16, wherein each instruction store is assigned to one of a plurality of virtual functions.

### Claim 20 (depends on 19)

The method of claim 19, wherein an arbitration unit arbitrates instruction priority among the virtual functions by a method of hardware arbitration.

### Claim 21 (depends on 19)

The method of claim 19, wherein a plurality of virtual function arbitration units arbitrate instruction priority within the virtual functions by a method of hardware arbitration.

### Claim 22 (depends on 16)

The method of claim 16, wherein performing logic operations comprises performing a bitwise and-operation on the selected group execution mask and the selected store execution mask to create the core request mask corresponding to the selected instruction store.

### Claim 23 (depends on 16)

The method of claim 16, wherein performing logic operations further comprises performing a bitwise and-operation on the selected group execution mask, the selected store execution mask, and a core availability vector, the core availability vector indicating which of the plurality of cores are available for processing, to create the core request mask corresponding to the selected instruction store.

### Claim 24 (depends on 16)

The method of claim 16, wherein arbitrating further comprises determining instruction priority by performing method of hardware arbitration.

### Claim 25 (depends on 16)

The method of claim 16, further comprising dispatching the assigned instruction to the selected core using a dispatch unit configured to receive a unique identifier of the selected instruction store, the selected instruction store and an identification number of an available core, and produce a signal to the selected instruction store an instruction to the available core.

### Claim 26 (depends on 16)

The method of claim 16, further comprising assigning each instruction store to one of a plurality of virtual functions, the plurality of virtual functions configured to interface with a host, receive instructions, and distribute the instructions to its assigned instruction stores.

### Claim 27 (depends on 16)

The method of claim 16, further comprising setting at least one of the group execution matrix and the store execution matrix to affect the quality of service of a physical function or a virtual function among the plurality of cores.

### Claim 28 (depends on 16)

The method of claim 16, wherein the instruction stores are at least one of compression instruction stores, cryptography instruction stores, video processing instruction stores, image processing instruction stores, or general instruction stores.

### Claim 29 (depends on 16)

The method of claim 16, further comprising assigning each instruction store to a physical function, wherein the arbitration unit is configured to determine instruction priority within the physical function by a method of hardware arbitration.
