Method and apparatus with data preloading
AssigneeSamsung Electronics Co., Ltd.
InventorsJunyeon LEE, Jin-Hong KIM, Seok-Young YOON, Seungho LEE, Jungsik CHOI
Life of this patent
Estimating the term…
Abstract
A method and apparatus with data preloading are provided. The method includes obtaining a preloading command for a global memory, writing a global memory address to a routing table, allocating a local memory address corresponding to the global memory address, requesting a movement of shared data stored at the global memory address to the local memory address, and writing the local memory address to a location in the routing table corresponding to the global memory address in response to completion of the movement.
Claims20
A processor-implemented method comprising:
- receiving a preloading request for a global memory;
- writing a global memory address to a routing table;
- allocating a local memory address corresponding to the global memory address;
- requesting a movement of shared data stored at the global memory address to the local memory address;
- and
- writing the local memory address to a location in the routing table corresponding to the global memory address in response to completion of the movement.
An operation method comprising:
- dividing input data into a plurality of mini-batches and allocating each of the plurality of mini-batches to a corresponding one of a plurality of nodes;
- preloading, by each of the plurality of nodes, a parameter corresponding to a next stage via shared memory;
- releasing, by each of the plurality of nodes, a parameter corresponding to a preloaded previous stage;
- and
- performing, by each of the plurality of nodes, an operation for a current stage based on each of the plurality of allocated mini-batches and a parameter corresponding to a preloaded current stage.
An electronic device comprising:
- one or more processors respectively comprising processing circuitry;
- and
- a memory storing instructions,
- wherein the instructions, when individually or collectively executed by the one or more processors, configure the one or more processors to:
- obtain a preloading command for a global memory;
- write a global memory address to a routing table;
- allocate a local memory address corresponding to the global memory address;
- request a movement of shared data stored at the global memory address to the local memory address;
- and
- write the local memory address to a location in the routing table corresponding to the global memory address in response to completion of the movement.
Dependencies are inferred from the claim text.