Storage systems for large language model fine-tuning
AssigneeWestern Digital Technologies, Inc.
InventorsAriel Navon, Alexander Bazarsky, Eran Sharon
Life of this patent
Estimating the term…
Loading patent…
AssigneeWestern Digital Technologies, Inc.
InventorsAriel Navon, Alexander Bazarsky, Eran Sharon
Estimating the term…
Data is received from an application, and it is determined whether the received data is to be used for fine-tuning a Large Language Model (LLM). The received data is stored in a primary storage or in a secondary storage based at least in part on whether the received data is to be used for fine-tuning the LLM. The secondary storage is configured to store data that is less frequently accessed than data stored in the primary storage. In response to determining that the received data is to be used for fine-tuning the LLM, the received data is stored in the secondary storage. In one aspect, a query for information is received that is associated with particular data stored in the secondary storage and the query is input into the LLM to provide the information without accessing the particular data stored.
A method performed by a storage system including a primary storage and a secondary storage, the method comprising:
A system, comprising:
A system, comprising:
Dependencies are inferred from the claim text.