Method and apparatus for distributed parallel processing for layer of neural network
AssigneeSamsung Electronics Co., Ltd.
InventorsHyuntae Cho, Seung jin Kang, Geonu Kim, Gunhee Kim, Byunggook Na, Saerom Choi, Yongdeok Kim, Heejae Kim
Life of this patent
Estimating the term…
Abstract
A method and apparatus for distributed parallel processing for a layer of a neural network are disclosed. The method includes identifying an available resource among a plurality of computing resources, generating a partial graph from an input graph based on the available resource, performing, using the available resource, a neural network operation to the partial graph to obtain an updated partial graph, and generating an output graph based on the updated partial graph.
Claims21
A method of distributed parallel processing, the method comprising:
- identifying an available resource among a plurality of computing resources;
- generating a partial graph from an input graph based on the available resource;
- performing, using the available resource, a neural network operation to the partial graph to obtain an updated partial graph;
- and
- generating an output graph based on the updated partial graph.
An apparatus for distributed parallel processing for a layer of a neural network, the apparatus comprising:
- one or more processors;
- a memory;
- and
- one or more programs stored in the memory and configured to be executed by the one or more processors,
- wherein the one or more programs are configured to:
- identify an available resource among a plurality of computing resources;
- generate a partial graph from an input graph based on the available resource;
- perform, using the available resource, a neural network operation to the partial graph to obtain an updated partial graph;
- and
- generate an output graph based on the updated partial graph.
A method comprising:
- identifying a plurality of available resources among a plurality of computing resources;
- generating a plurality of partial graphs from an input graph based on the plurality of available resources;
- performing a neural network operation on each of the plurality of partial graphs using a corresponding available resource among the plurality of available resources, respectively, to obtain a plurality of updated partial graphs;
- and
- generating an output graph based on the plurality of updated partial graphs.
Dependencies are inferred from the claim text.