# US 2012/0254480 A1 · Facilitating, at least in part, by circuitry, accessing of at least one controller command interface

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2012/0254480 A1
- Document ID: US20120254480A1
- Status: Published application
- Kind: A1
- Application number: 13/077,725
- Filed: 2011-03-31
- Published: 2012-10-04
- Earliest claimed: 2011-03-31
- Assignees: Intel Corporation
- Inventors: Eliezer Tamir; Ben-Zion Friedman; Theodore L. Willke; Eliel Louzoun; Matthew R. Wilcox; Donald E. Wood; Steven B. McGowan; Robert O. Sharp
- Web page: https://patentgrep.com/patent/US20120254480A1

## CPC

- G06F 15/17331: {Distributed shared memory [DSM], e.g. remote direct memory access [RDMA]}
- G06F 13/385: {for adaptation of a particular data processing system to different peripheral devices}
- G06F 15/167: using a common memory, e.g. mailbox
- H04L 67/1097: for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

An embodiment may include circuitry to facilitate, at least in part, a first network interface controller (NIC) in a client to be capable of accessing, via a second NIC in a server that is remote from the client and in a manner that is independent of an operating system environment in the server, at least one command interface of another controller of the server. The command interface may include at least one controller command queue. Such accessing may include writing at least one queue element to the at least one command queue to command the another controller to perform at least one operation associated with the another controller. The another controller may perform the at least one operation in response, at least in part, to the at least one queue element. Many alternatives, variations, and modifications are possible.

## Claims

### Claim 1

An apparatus comprising:
circuitry to facilitate, at least in part, a first network interface controller (NIC) in a client to be capable of accessing, via a second NIC in a server that is remote from the client and in a manner that is independent of an operating system environment in the server, at least one command interface of another controller of the server, the at least one command interface including at least one command queue of the another controller, the accessing including writing at least one queue element to the at least one command queue to command the another controller to perform at least one operation associated with the another controller, the another controller to perform the at least one operation in response, at least in part, to the at least one queue element.

### Claim 2 (depends on 1)

The apparatus of claim 1, wherein:
the at least one operation comprises at least one of a write operation and a read operation involving storage;
an integrated circuit chip comprises the second NIC, the another controller, and a central processing unit (CPU), the CPU being to execute the operating system environment; and
the storage comprises mass storage.

### Claim 3 (depends on 1)

The apparatus of claim 1, wherein:
the circuitry comprises, at least in part, the second NIC and the another controller;
the at least one command interface also includes at least one completion queue, at least one doorbell, and at least one data buffer;
the second NIC is to provide, at least in part, indicators to the first NIC to indicate, at least in part, where the at least one command queue, the at least one completion queue, the at least one doorbell, and the at least one data buffer are located; and
the first NIC is to use one or more of the indictors to access the at least one command interface.

### Claim 4 (depends on 3)

The apparatus of claim 3, wherein:
the first NIC is to write the at least one queue element to the at least one command queue to command the another controller to perform the at least one operation;
the first NIC is to ring the at least one doorbell;
in response, at least in part, to the at least one doorbell, the another controller is to read the at least one queue element and to perform, at least in part, the at least one operation;
after completion, at least in part, of the at least one operation, the another controller is to write at least one completion queue element to the at least one completion queue and to ring, after completion, at least in part, of the at least one operation, another doorbell associated with the second NIC; and
in response, at least in part, to the another doorbell, the second NIC is to provide, at least in part, the at least one completion queue element to the first NIC.

### Claim 5 (depends on 3)

The apparatus of claim 3, wherein:
at least one agent in the server is to establish, at least in part, one or more entries in one or more queues associated with the second NIC to permit copying of one or more other queue entries associated with the another controller;
the at least one agent is to update, at least in part, one or more pointers associated with one or more queue pairs associated with the another controller and the second NIC; and
the at least one agent is to indicate one or more buffers to be reused.

### Claim 6 (depends on 3)

The apparatus of claim 3, wherein:
the at least one queue element includes at least one command identifier;
the another controller is to write at least one completion queue element to at least one completion queue associated with the another controller after performing, at least in part, the at least one operation, the at least one completion queue element indicating, at least in part, the at least one command identifier; and
the second NIC is to execute, at least in part, at least one other command associated with at least one command queue element associated with the second NIC, the at least one command queue element being identified, at least in part, by the at least one command identifier.

### Claim 7 (depends on 6)

The apparatus of claim 6, wherein:
the at least one command queue element is stored in at least one entry in a table at an index indicated, at least in part, by the at least one command identifier, each respective entry in the table being associated with one or more respective buffers of a plurality of buffers that comprise the at least one buffer.

### Claim 8 (depends on 7)

The apparatus of claim 7, wherein:
the at least one operation comprises a read of storage;
prior, at least in part, to completion of the at least one operation, the another controller is to select, at least in part, the at least one command queue element from the table based at least in part upon the at least one command identifier; and
the another controller is to write the at least one command queue element to at least one other command queue associated with the second NIC, write to the at least one completion queue, and ring at least one other doorbell.

### Claim 9

A method comprising:
facilitating, at least in part, by circuitry, accessing by a first network interface controller (NIC) in a client, via a second NIC in a server that is remote from the client and in a manner that is independent of an operating system environment in the server, of at least one command interface of another controller of the server, the at least one command interface including at least one command queue of the another controller, the accessing including writing at least one queue element to the at least one command queue to command the another controller to perform at least one operation associated with the another controller, the another controller to perform the at least one operation in response, at least in part, to the at least one queue element.

### Claim 10 (depends on 9)

The method of claim 9, wherein:
the at least one operation comprises at least one of a write operation and a read operation involving storage;
an integrated circuit chip comprises the second NIC, the another controller, and a central processing unit (CPU), the CPU being to execute the operating system environment; and
the storage comprises mass storage.

### Claim 11 (depends on 9)

The method of claim 9, wherein:
the circuitry comprises, at least in part, the second NIC and the another controller;
the at least one command interface also includes at least one completion queue, at least one doorbell, and at least one data buffer;
the second NIC is to provide, at least in part, indicators to the first NIC to indicate, at least in part, where the at least one command queue, the at least one completion queue, the at least one doorbell, and the at least one data buffer are located; and
the first NIC is to use one or more of the indictors to access the at least one command interface.

### Claim 12 (depends on 11)

The method of claim 11, wherein:
the first NIC is to write the at least one queue element to the at least one command queue to command the another controller to perform the at least one operation;
the first NIC is to ring the at least one doorbell;
in response, at least in part, to the at least one doorbell, the another controller is to read the at least one queue element and to perform, at least in part, the at least one operation;
after completion, at least in part, of the at least one operation, the another controller is to write at least one completion queue element to the at least one completion queue and to ring, after completion, at least in part, of the at least one operation, another doorbell associated with the second NIC; and
in response, at least in part, to the another doorbell, the second NIC is to provide, at least in part, the at least one completion queue element to the first NIC.

### Claim 13 (depends on 11)

The method of claim 11, wherein:
at least one agent in the server is to establish, at least in part, one or more entries in one or more queues associated with the second NIC to permit copying of one or more other queue entries associated with the another controller;
the at least one agent is to update, at least in part, one or more pointers associated with one or more queue pairs associated with the another controller and the second NIC; and
the at least one agent is to indicate one or more buffers to be reused.

### Claim 14 (depends on 11)

The method of claim 11, wherein:
the at least one queue element includes at least one command identifier;
the another controller is to write at least one completion queue element to at least one completion queue associated with the another controller after performing, at least in part, the at least one operation, the at least one completion queue element indicating, at least in part, the at least one command identifier; and
the second NIC is to execute, at least in part, at least one other command associated with at least one command queue element associated with the second NIC, the at least one command queue element being identified, at least in part, by the at least one command identifier.

### Claim 15 (depends on 14)

The method of claim 14, wherein:
the at least one command queue element is stored in at least one entry in a table at an index indicated, at least in part, by the at least one command identifier, each respective entry in the table being associated with one or more respective buffers of a plurality of buffers that comprise the at least one buffer.

### Claim 16 (depends on 15)

The method of claim 15, wherein:
the at least one operation comprises a read of storage;
prior, at least in part, to completion of the at least one operation, the another controller is to select, at least in part, the at least one command queue element from the table based at least in part upon the at least one command identifier; and
the another controller is to write the at least one command queue element to at least one other command queue associated with the second NIC, write to the at least one completion queue, and ring at least one other doorbell.

### Claim 17

Computer-readable memory storing one or more instructions that when executed by a machine result in performance of operations comprising:
facilitating, at least in part, by circuitry, accessing by a first network interface controller (NIC) in a client, via a second NIC in a server that is remote from the client and in a manner that is independent of an operating system environment in the server, of at least one command interface of another controller of the server, the at least one command interface including at least one command queue of the another controller, the accessing including writing at least one queue element to the at least one command queue to command the another controller to perform at least one operation associated with the another controller, the another controller to perform the at least one operation in response, at least in part, to the at least one queue element.

### Claim 18 (depends on 17)

The memory of claim 17, wherein:
the at least one operation comprises at least one of a write operation and a read operation involving storage;
an integrated circuit chip comprises the second NIC, the another controller, and a central processing unit (CPU), the CPU being to execute the operating system environment; and
the storage comprises mass storage.

### Claim 19 (depends on 17)

The memory of claim 17, wherein:
the circuitry comprises, at least in part, the second NIC and the another controller;
the at least one command interface also includes at least one completion queue, at least one doorbell, and at least one data buffer;
the second NIC is to provide, at least in part, indicators to the first NIC to indicate, at least in part, where the at least one command queue, the at least one completion queue, the at least one doorbell, and the at least one data buffer are located; and
the first NIC is to use one or more of the indictors to access the at least one command interface.

### Claim 20 (depends on 19)

The memory of claim 19, wherein:
the first NIC is to write the at least one queue element to the at least one command queue to command the another controller to perform the at least one operation;
the first NIC is to ring the at least one doorbell;
in response, at least in part, to the at least one doorbell, the another controller is to read the at least one queue element and to perform, at least in part, the at least one operation;
after completion, at least in part, of the at least one operation, the another controller is to write at least one completion queue element to the at least one completion queue and to ring, after completion, at least in part, of the at least one operation, another doorbell associated with the second NIC; and
in response, at least in part, to the another doorbell, the second NIC is to provide, at least in part, the at least one completion queue element to the first NIC.

### Claim 21 (depends on 19)

The memory of claim 19, wherein:
at least one agent in the server is to establish, at least in part, one or more entries in one or more queues associated with the second NIC to permit copying of one or more other queue entries associated with the another controller;
the at least one agent is to update, at least in part, one or more pointers associated with one or more queue pairs associated with the another controller and the second NIC; and
the at least one agent is to indicate one or more buffers to be reused.

### Claim 22 (depends on 19)

The memory of claim 19, wherein:
the at least one queue element includes at least one command identifier;
the another controller is to write at least one completion queue element to at least one completion queue associated with the another controller after performing, at least in part, the at least one operation, the at least one completion queue element indicating, at least in part, the at least one command identifier; and
the second NIC is to execute, at least in part, at least one other command associated with at least one command queue element associated with the second NIC, the at least one command queue element being identified, at least in part, by the at least one command identifier.

### Claim 23 (depends on 22)

The memory of claim 22, wherein:
the at least one command queue element is stored in at least one entry in a table at an index indicated, at least in part, by the at least one command identifier, each respective entry in the table being associated with one or more respective buffers of a plurality of buffers that comprise the at least one buffer.

### Claim 24 (depends on 23)

The memory of claim 23, wherein:
the at least one operation comprises a read of storage;
prior, at least in part, to completion of the at least one operation, the another controller is to select, at least in part, the at least one command queue element from the table based at least in part upon the at least one command identifier; and
the another controller is to write the at least one command queue element to at least one other command queue associated with the second NIC, write to the at least one completion queue, and ring at least one other doorbell.

### Claim 25 (depends on 1)

The apparatus of claim 1, wherein:
the first NIC and the second NIC comprise respective remote direct memory access (RDMA)-enabled network interface controllers;
the another controller comprises a storage controller; and
the at least one operation involves storage associated with the storage controller.

### Claim 26 (depends on 9)

The method of claim 9, wherein:
the first NIC and the second NIC comprise respective remote direct memory access (RDMA)-enabled network interface controllers;
the another controller comprises a storage controller; and
the at least one operation involves storage associated with the storage controller.

### Claim 27 (depends on 17)

The memory of claim 17, wherein:
the first NIC and the second NIC comprise respective remote direct memory access (RDMA)-enabled network interface controllers;
the another controller comprises a storage controller; and
the at least one operation involves storage associated with the storage controller.

### Claim 28 (depends on 1)

The apparatus of claim 1, wherein:
the client comprises a plurality of clients to share the at least one command queue.

### Claim 29 (depends on 1)

The apparatus of claim 1, wherein:
the client comprises a plurality of clients to share at least one buffer pool that is comprised in the server.
