Compile time logic for inserting a buffer between a producer operation unit and a consumer operation unit in a dataflow graph

A computer-implemented method, including:

• obtaining dataflow graph for an application;
• determining a write access pattern for elements of a tensor generated by a producer operation unit of the dataflow graph for an application;
• determining a read access pattern for the elements of the tensor processed by a consumer operation unit of the dataflow graph;
• comparing the write access pattern to the read access pattern;
• and
• modifying the dataflow graph by inserting a buffer between the producer operation unit and the consumer operation unit in response to determining that the write access pattern and the read access pattern are different to create a modified dataflow graph.

A non-transitory computer readable storage medium storing computer program instructions to process data, the instructions, when executed on a processor, implement a method comprising:

• obtaining dataflow graph for an application;
• determining a write access pattern for elements of a tensor generated by a producer operation unit of the dataflow graph for an application;
• determining a read access pattern for the elements of the tensor processed by a consumer operation unit of the dataflow graph;
• comparing the write access pattern to the read access pattern;
• and
• modifying the dataflow graph by inserting a buffer between the producer operation unit and the consumer operation unit in response to determining that the write access pattern and the read access pattern are different to create a modified dataflow graph.