Method and apparatus with scheduling neural network
AssigneesSamsung Electronics Co., Ltd., Seoul National University R&Db Foundation
InventorsSeok-Young YOON, Bernhard EGGER, Hyemi MIN, Jungyoon KWON, Jaume Mateu CUADRAT
Life of this patent
Estimating the term…
Abstract
A method and apparatus with scheduling a neural network (NN), which relate to extracting and scheduling priorities of operation sets, are provided. A scheduler may be configured to receive a loop structure corresponding to a NN model, generate a plurality of operation sets based on the loop structure, generate a priority table for the operation sets based on memory benefits of the operation sets, and schedule the operation sets based on the priority table.
Claims20
A processor-implemented scheduling method, comprising:
- receiving a loop structure corresponding to a neural network (NN) model;
- generating operation sets based on the loop structure;
- generating a priority table for the operation sets based on memory benefits of the operation sets;
- and
- scheduling the operation sets based on the priority table.
A scheduler, comprising:
- a processor configured to:
- receive a loop structure corresponding to processing operations of a neural network (NN) model;
- generate operation sets based on the loop structure;
- generate a priority table for the operation sets based on memory benefits of the operation sets;
- and
- schedule the operation sets based on the priority table.
A processor-implemented method, comprising:
- generating loop structures by receiving a network configuration and a specification of related hardware components;
- corresponding the generated loop structures to a neural network (NN) model;
- generating scheduled operation lists for the loop structures, respectively, based on predetermined priorities of operating the NN model;
- and
- determining a final scheduled operation list among the generated scheduled operations lists,
- wherein the final scheduled operation list has a smallest latency and data transfer size among the scheduled operation lists.
Dependencies are inferred from the claim text.