Compile Time Logic for Detecting Streaming Compatible and Broadcast Compatible Data Access Patterns
AssigneeSambaNova Systems, Inc.
InventorsDavid Alan KOEPLINGER, Weiwei CHEN, Kevin James BROWN, Xiaoming GU
Life of this patent
Estimating the term…
Loading patent…
AssigneeSambaNova Systems, Inc.
InventorsDavid Alan KOEPLINGER, Weiwei CHEN, Kevin James BROWN, Xiaoming GU
Estimating the term…
A dataflow graph has operation units that are configured to be producer operation units to produce tensors for execution of the application, and to be consumer operation units to consume the tensors for execution of the application. Compile time logic is configured to process the dataflow graph to determine, for the tensors, expected producer memory layouts, expected consumer memory layouts, and current memory layouts. The expected producer memory layouts specify memory layouts required by the producer operation units that produce the tensors. The expected consumer memory layouts specify the memory layouts required by the consumer operation units that consume the tensors. The current memory layouts specify the memory layouts of the tensors. Each of the memory layouts includes a vector dimension and at least one of a vector ordering and a data alignment.
A system, comprising:
A computer-implemented method, including:
A non-transitory computer readable storage medium impressed with computer program instructions, the instructions, when executed on a processor, implement a method comprising:
A system, comprising:
Dependencies are inferred from the claim text.