Memory expander, computing systems, and operating method of the host device
AssigneesKorea Advanced Institute of Science and Technology, Panmnesia Inc.
InventorsMyoungsoo JUNG, Miryeong Kwon, Junhyeok JANG, Seungjun LEE, Hanjin CHOI, Hanyeoreum BAE
Life of this patent
Estimating the term…
Abstract
A memory expander is disclosed. The memory expander includes a memory, a memory controller configured to control the memory, a compute express link (CXL) engine configured to acquire a CXL flit from a host device connected to the memory expander and configured to acquire a calculation request for pieces of data stored in the memory by performing conversion on the CXL flit, and a domain-specific accelerator configured to perform a calculation in response to the calculation request.
Claims20
A memory expander comprising:
- a memory;
- a memory controller configured to control the memory;
- a compute express link (CXL) engine configured to acquire a CXL flit from a host device connected to the memory expander and configured to acquire a calculation request for pieces of data stored in the memory by performing conversion on the CXL flit;
- and
- a domain-specific accelerator configured to perform a calculation in response to the calculation request.
A computing system comprising:
- a host device configured to store a command and data associated with a calculation request in a host memory and configured to transmit a doorbell signal associated with the calculation request to a memory expander;
- and
- the memory expander configured to perform a calculation between tensors corresponding to the calculation request in response to receiving the doorbell signal and configured to transmit a result of the calculation between the tensors to the host memory,
- wherein the tensors are stored in the memory expander.
An operating method of a host device configured to perform an approximate nearest neighbor search based on a search node, the operating method comprising:
- acquiring graph data, wherein each of nodes of the graph data corresponds to tensors stored in a memory expander;
- acquiring information of a neighbor node neighboring the search node by searching for the graph data;
- acquiring a result of a calculation between the tensors stored in the memory expander and an input tensor input to the host device, based on the information of the neighbor node;
- and
- updating a candidate array based on the result of the calculation,
- wherein the candidate array comprises, among the tensors stored in the memory expander, information about a tensor that is similar to the input tensor.
Dependencies are inferred from the claim text.