Memory device using multistage acceleration, operating method of memory device, and electronic device including the same
AssigneeSamsung Electronics Co., Ltd.
InventorJinhyun Kim
Life of this patent
Estimating the term…
Abstract
An electronic device is provided. The electronic host includes: a host; a memory package including a plurality of memory devices and a first accelerator circuit configured to receive first data from the plurality of memory devices and perform a coarse acceleration operation based on the first data to obtain second data; and a memory controller including a second accelerator circuit configured to receive the second data from the first accelerator circuit and perform a fine acceleration operation based on a neural network and the second data to obtain an inference result.
Claims20
An electronic device comprising:
- a memory package comprising a plurality of memory devices and a first accelerator circuit configured to receive first data from the plurality of memory devices and perform a coarse acceleration operation based on the first data to obtain second data, wherein the coarse acceleration operation comprises a filtering operation performed based on the first data;
- and
- a memory controller comprising a second accelerator circuit configured to receive the second data from the first accelerator circuit and perform a fine acceleration operation based on a neural network and the second data to obtain an inference result.
A memory controller comprising:
- a register configured to receive instructions from a host;
- a decoder configured to decode the instructions;
- a command generator configured to generate a command to be provided to a memory package based on the decoded instructions, wherein the memory package comprises a plurality of memory devices;
- and
- a first accelerator circuit configured to receive second data from the memory package and perform first operations for an inference operation based on a neural network,
- wherein the second data is data obtained as a result of performing second operations on first data stored in the plurality of memory devices through a second accelerator circuit provided in the memory package, wherein the second operations comprise a filtering operation performed based on the first data.
An operating method of a memory controller connected to a memory package comprising a plurality of memory devices, the operating method comprising:
- receiving output data from a first accelerator circuit which has performed a coarse acceleration operation on sparse data stored in the plurality of memory devices to obtain the output data, wherein the coarse acceleration operation comprises a filtering operation performed based on the sparse data;
- obtaining an inference result by performing a fine acceleration operation on the output data by using a second accelerator circuit inside the memory controller;
- and
- providing the inference result to a host.
Dependencies are inferred from the claim text.