Back to results
US 2026/0037340 A1Published application
Memory aware load balancing mechanism for heterogeneous llm training
AssigneeSamsung Electronics Co., Ltd.
InventorsHanqiu CHEN, Andrew CHANG
Life of this patent
Estimating the term…
Abstract
A heterogeneous computing system is described. The heterogeneous computing system may include nodes, which may include processing elements, the processing elements including local memories. The nodes may have capabilities that may differ. The heterogeneous computing system may also include a memory pool, accessible to the processing elements.
Claims20
A heterogeneous computing system, comprising:
- a first node, including a first processing element including a first local memory;
- and
- a second node, including a second processing element including a second local memory;
- and
- a memory pool, accessible to the first processing element using a first access request and accessible to the second processing element using a second access request,
- wherein the first node includes a first capability, and
- wherein the second node includes a second capability, the second capability different from the first capability.
4 more elements
A method, comprising:
- executing an operation on a first processing element of a first node in a heterogeneous computing system to generate an output;
- and
- storing the output in a memory pool of the heterogeneous computing system,
- wherein the heterogeneous computing system includes:
- the first node, including the first processing element including a first local memory;
- and
- a second node, including a second processing element including a second local memory;
- and
- the memory pool, accessible to the first processing element using a first access request and accessible to the second processing element using a second access request, and
- wherein the first node includes a first capability, and
- wherein the second node includes a second capability, the second capability different from the first capability.
8 more elements
A system, comprising a non-transitory storage medium, the non-transitory storage medium having stored thereon instructions that, when executed by a machine, result in:
- executing an operation on a first processing element of a first node in a heterogeneous computing system to generate an output;
- and
- storing the output in a memory pool of the heterogeneous computing system,
- wherein the heterogeneous computing system includes:
- the first node, including the first processing element including a first local memory;
- and
- a second node, including a second processing element including a second local memory;
- and
- the memory pool, accessible to the first processing element using a first access request and accessible to the second processing element using a second access request, and
- wherein the first node includes a first capability, and
- wherein the second node includes a second capability, the second capability different from the first capability.
8 more elements
Dependencies are inferred from the claim text.