Compile time logic for detecting streaming compatible and broadcast compatible data access patterns

A computer-implemented method, including:

• storing a dataflow graph for an application, the dataflow graph having operation units that are configured to be producers to produce tensors for execution of the application, and to be consumers to consume the tensors for execution of the application;
• storing write access patterns of the producers, and read access patterns of the consumers, wherein a write access pattern of a particular producer specifies an order in which the particular producer generates elements of a tensor, and a read access pattern of a corresponding consumer specifies an order in which the corresponding consumer processes the elements of the tensor;
• and
• detecting conflicts between certain ones of the producers and corresponding ones of the consumers that have mismatches between the write access patterns and the read access patterns, wherein a conflict occurs when the order in which the particular producer generates the elements of the tensor is different from the order in which the corresponding consumer processes the elements of the tensor;
• and
• resolving the conflicts by inserting buffers between the certain ones of the producers and the corresponding ones of the consumers.

A non-transitory computer readable storage medium impressed with computer program instructions to process data, the instructions, when executed on a processor, implement a method comprising:

• storing a dataflow graph for an application, the dataflow graph having operation units that are configured to be producers to produce tensors for execution of the application, and to be consumers to consume the tensors for execution of the application;
• storing write access patterns of the producers, and read access patterns of the consumers, wherein a write access pattern of a particular producer specifies an order in which the particular producer generates elements of a tensor, and a read access pattern of a corresponding consumer specifies an order in which the corresponding consumer processes the elements of the tensor;
• and
• detecting conflicts between certain ones of the producers and corresponding ones of the consumers that have mismatches between the write access patterns and the read access patterns, wherein a conflict occurs when the order in which the particular producer generates the elements of the tensor is different from the order in which the corresponding consumer processes the elements of the tensor;
• and
• resolving the conflicts by inserting buffers between the certain ones of the producers and the corresponding ones of the consumers.