# US 2024/0005075 A1 · Graphic neural network acceleration solution with customized board for solid-state drives

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0005075 A1
- Document ID: US20240005075A1
- Status: Published application
- Kind: A1
- Application number: 18/071,970
- Filed: 2022-11-30
- Published: 2024-01-04
- Earliest claimed: 2022-07-01
- Assignees: Alibaba (China) Co., Ltd.
- Applicants: Alibaba (China) Co., Ltd.
- Inventors: Shuangchen LI; Dimin NIU; Hongzhong ZHENG
- Web page: https://patentgrep.com/patent/US20240005075A1

## CPC

- G06F 30/34: for reconfigurable circuits, e.g. field programmable gate arrays [FPGA] or programmable logic devices [PLD]
- G06F 30/331: with hardware acceleration, e.g. by using field programmable gate array [FPGA] or emulation
- G06F 3/06: Digital input from, or digital output to, record carriers {, e.g. RAID, emulated record carriers or networked record carriers}
- G06F 7/06: Arrangements for sorting, selecting, merging, or comparing data on individual record carriers
- G06F 13/14: Handling requests for interconnection or transfer
- G06F 30/20: Design optimisation, verification or simulation (optimisation, verification or simulation of circuit designs G06F30/30)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

This application describes systems and methods for facilitating memory access for graph neural network (GNN) processing. An example method includes fetching, by an access engine circuitry implemented on a circuitry board, a portion of structure data of a graph from one or more of a plurality of flash memory drives implemented on the circuitry board; performing node sampling using the fetched portion of the structure data of the graph to select one or more sampled nodes; fetching a portion of attribute data of the graph from two or more of the plurality of memory drives in parallel according to the selected one or more sampled nodes; sending the fetched portion of the attribute data of the graph to a host outside of the circuitry board; and performing, by the host, GNN processing for the graph using the fetched portion of the attribute data of the graph.

## Claims

### Claim 1

A system, comprising:
a host, and
a circuitry board,
wherein the circuitry board comprises:
a plurality of memory drives configured to store structure data of a graph and attribute data of the graph, wherein the plurality of memory drives include flash drives; and
an access engine circuitry communicatively coupled with each of the plurality of memory drives and the host, wherein the access engine circuitry is configured to:
fetch a portion of the structure data of the graph from one or more of the plurality of memory drives;
perform node sampling using the fetched portion of the structure data to select one or more sampled nodes;
fetch a portion of the attribute data of the graph from two or more of the plurality of memory drives in parallel according to the selected one or more sampled nodes; and
send the fetched portion of the attribute data of the graph to the host; and
the host is communicatively coupled with the circuitry board and configured to receive the portion of the attribute data of the graph from the circuitry board, the host comprising:
one or more processors configured to perform graph neural network (GNN) processing for the graph using the portion of the attribute data of the graph.

### Claim 2 (depends on 1)

The system of claim 1, wherein the access engine circuitry is implemented on a field programmable gate array (FPGA) located on the circuitry board.

### Claim 3 (depends on 1)

The system of claim 1, wherein the plurality of memory drives on the circuitry board are solid state drives (SSDs).

### Claim 4 (depends on 3)

The system of claim 3, wherein the plurality of memory drives on the circuitry board have the same memory capacity.

### Claim 5 (depends on 1)

The system of claim 1, wherein the access engine circuitry is further configured to access the structure data and the attribute data of the graph from a memory location outside of the circuitry board.

### Claim 6 (depends on 1)

The system of claim 1, wherein the one or more processors of the host are central processing units (CPUs), graphics processing units (GPUs), tensor processing units (TPU), neural processing units (NPUs), or graph neural network processing units.

### Claim 7 (depends on 1)

The system of claim 1, wherein the host further comprises:
one or more double data rate (DDR) synchronous dynamic random access memory (SDRAM) communicatively coupled with the one or more processors of the host and the circuitry board, the one or more DDR SDRAM configured to:
store the portion of the attribute data of the graph from the circuitry board; and
facilitate the one or more processors of the host to perform GNN processing.

### Claim 8 (depends on 1)

The system of claim 1, wherein the circuitry board further comprises a dedicated memory communicatively coupled to the access engine circuitry, wherein the dedicated memory is one or more double data rate (DDR) synchronous dynamic random access memory (SDRAM) and is configured to facilitate an implementation of one or more controllers for controlling access to the plurality of memory drives.

### Claim 9 (depends on 1)

The system of claim 1, wherein the host is communicatively coupled with a plurality of the circuitry boards, and the host is configured to communicate with each of the plurality of the circuitry boards in parallel.

### Claim 10 (depends on 9)

The system of claim 9, wherein the host is further configured to perform memory management on the plurality of the circuitry boards using open-channel controllers of a plurality of access engine circuitries in the plurality of the circuitry boards.

### Claim 11

A computer-implemented method, comprising:
fetching, by an access engine circuitry implemented on a circuitry board, a portion of structure data of a graph from one or more of a plurality of memory drives implemented on the circuitry board, wherein the plurality of memory drives include flash drives;
performing, by the access engine circuitry, node sampling using the fetched portion of the structure data of the graph to select one or more sampled nodes;
fetching, by the access engine circuitry, a portion of attribute data of the graph from two or more of the plurality of memory drives in parallel according to the selected one or more sampled nodes;
sending, by the access engine circuitry, the fetched portion of the attribute data of the graph to a host, wherein the host is outside of the circuitry board; and
performing, by one or more processors of the host, graph neural network (GNN) processing for the graph using the fetched portion of the attribute data of the graph.

### Claim 12 (depends on 11)

The method of claim 11, wherein the access engine circuitry is implemented on a field programmable gate array (FPGA) located on the circuitry board.

### Claim 13 (depends on 11)

The method of claim 11, wherein the plurality of memory drives on the circuitry board are solid state drives (SSDs).

### Claim 14 (depends on 13)

The method of claim 13, wherein the plurality of memory drives on the circuitry board have the same memory capacity.

### Claim 15 (depends on 11)

The method of claim 11, further comprising:
accessing, by the access engine circuitry, the structure data and the attribute data of the graph from a memory location outside of the circuitry board.

### Claim 16 (depends on 11)

The method of claim 11, wherein the one or more processors of the host are central processing units (CPUs), graphics processing units (GPUs), tensor processing units (TPU), neural processing units (NPUs), or graph neural network processing units.

### Claim 17 (depends on 11)

The method of claim 11, further comprising:
storing, by one or more double data rate (DDR) synchronous dynamic random access memory (SDRAM) of the host, the portion of the attribute data of the graph from the circuitry board; and
facilitating, by the one or more DDR SDRAM of the host, the one or more processors of the host to perform GNN processing.

### Claim 18 (depends on 11)

The method of claim 11, further comprising:
facilitating, by a dedicated memory of the circuitry board, an implementation of one or more controllers for controlling access to the plurality of memory drives, wherein the dedicated memory of the circuitry board is one or more double data rate (DDR) synchronous dynamic random access memory (SDRAM) and is communicatively coupled to the access engine circuitry.

### Claim 19 (depends on 11)

The method of claim 11, wherein the host is communicatively coupled with a plurality of the circuitry boards, and the method further comprises:
communicating, by the host, with each of the plurality of the circuitry boards in parallel.

### Claim 20

A non-transitory computer-readable storage medium storing instructions that, when executed by one or more processors, cause the one or more processors to perform operations comprising:
fetching, by an access engine circuitry implemented on a circuitry board, a portion of structure data of a graph from one or more of a plurality of memory drives implemented on the circuitry board, wherein the plurality of memory drives include flash drives;
performing, by the access engine circuitry, node sampling using the fetched portion of the structure data of the graph to select one or more sampled nodes;
fetching, by the access engine circuitry, a portion of attribute data of the graph from two or more of the plurality of memory drives in parallel according to the selected one or more sampled nodes; and
sending, by the access engine circuitry, the fetched portion of the attribute data of the graph to a host to make the host perform graph neural network (GNN) processing for the graph using the fetched portion of the attribute data of the graph, wherein the host is outside of the circuitry board.
