US 2023/0147294 A1 · RESOURCE USAGE ARBITRATION IN NON-VOLATILE MEMORY (NVM) DATA STORAGE DEVICES WITH ARTIFICIAL INTELLIGENCE ACCELERATORS

Abstract

Methods and apparatus are provided for arbitrating access to, and usage of, various device resources of a data storage device (DSD) configured for Machine Learning with Low-Power. The data storage device may include a TinyML controller with an artificial intelligence (AI) accelerator integrated with a data storage controller on a system-on-a-chip (SoC). The device resources may be, e.g., storage resources such as random access memory (RAM) devices, non-volatile memory (NVM) arrays, and latches formed on NVM dies of the NVM arrays. The resource arbitration may be based, for example, on parameters pertaining to ML operations performed by an ML controller that includes the AI accelerator, such as a turnaround time of an ML epoch or a stage-wise execution time. The resource arbitration is configured to provide for the efficient interleaving of the ML/AI operations performed by the ML controller and data storage operations performed by the data storage controller.

Claims25

Dependent claims

A data storage device, comprising:

data storage device resources comprising a non-volatile memory (NVM) array and a random access memory (RAM);
a machine learning (ML) controller configured to perform ML operations to process ML data;
a data storage controller coupled to the ML controller and the data storage device resources and configured to access the data storage device resources;
and
a resource usage controller configured to control usage of the data storage device resources by both the data storage controller and the ML controller based, at least in part, on the ML operations of the ML controller.

2 more elements

Dependencies are inferred from the claim text.

Resource usage arbitration in non-volatile memory (nvm) data storage devices with artificial intelligence accelerators

Life of this patent

Resource usage arbitration in non-volatile memory (nvm) data storage devices with artificial intelligence accelerators

Life of this patent

Abstract

Claims25