Memory coloring for executing operations in concurrent paths of a graph representing a model

A non-transitory computer readable storage medium storing instructions that, when executed by an electronic device that includes a memory and one or more processors, each processor of the one or more processors supporting a plurality of streams, cause the electronic device to perform a method for handling memory accesses, the method comprising:

• acquiring a graph that includes paths of operations in a set of operations for processing instances of data through a model, each path of operations including a separate sequence of operations from the set of operations that is to be executed using a respective stream from among the plurality of streams on the one or more processors;
• identifying concurrent paths in the graph, the concurrent paths being paths of operations between split points at which two or more paths of operations diverge and merge points at which the two or more paths of operations merge;
• and
• executing operations in each of the concurrent paths using a respective stream from among the plurality of streams on the one or more processors, the executing including using memory coloring for handling memory accesses in the memory for the operations in each concurrent path.

An electronic device that handles memory accesses, comprising:

• a memory;
• and
• a processor that supports a plurality of streams, the processor configured to:
• acquire a graph that includes paths of operations in a set of operations for processing instances of data through a model, each path of operations including a separate sequence of operations from the set of operations that is to be executed using a respective stream from among the plurality of streams;
• identify concurrent paths in the graph, the concurrent paths being paths of operations between split points at which two or more paths of operations diverge and merge points at which the two or more paths of operations merge;
• and
• execute operations in each of the concurrent paths using a respective stream, the executing including using memory coloring for handling memory accesses in the memory for the operations in each concurrent path.