Systems for training artificial intelligence model and checkpoint file storage methods
AssigneeAlipay (Hangzhou) Information Technology Co., Ltd.
InventorsJian Liu, Shuwei GU, Xiaojun ZHAN, Ruoyi RUAN
Life of this patent
Estimating the term…
Loading patent…
AssigneeAlipay (Hangzhou) Information Technology Co., Ltd.
InventorsJian Liu, Shuwei GU, Xiaojun ZHAN, Ruoyi RUAN
Estimating the term…
This specification provides methods, systems, and computer-readable media for training an artificial intelligence model and storing a checkpoint file. An example system includes a computing node and a first cache node. The computing node is configured to: read a dataset for training from the first cache node to execute a training task of an artificial intelligence model; and in a process of executing the training task, generate a checkpoint file and send it to the first cache node. The first cache node is configured to: identify a type of obtained to-be-stored data; if the type of the to-be-stored data is a dataset, first write the to-be-stored data into a local buffer, and then store the to-be-stored data in a local hard disk from the local buffer; or if the type of the to-be-stored data is a checkpoint file, directly store the to-be-stored data in the local hard disk.
A system for training an artificial intelligence model, comprising a computing node and a first cache node, wherein:
A method for checkpoint file storage in a computing scenario, wherein the method comprises:
A non-transitory, computer-readable medium storing one or more instructions executable by a computer system to perform operations comprising:
Dependencies are inferred from the claim text.