Methods and systems for memory bandwidth control

An electronic device, comprising:

• one or more processing clusters;
• and
• a plurality of memory blocks coupled to each processing cluster;
• wherein each processing cluster includes one or more respective processors and a controller, and the controller is configured to perform:
• partitioning resources of the electronic device into a plurality of resource portions to be utilized by a plurality of clients, each resource portion being assigned to a respective client and having a respective partition identifier (ID);
• receiving a plurality of data access requests associated with the plurality of clients to the plurality of memory blocks;
• and
• for each resource portion having the respective partition ID:
• tracking a plurality of memory bandwidth usage states corresponding to the memory blocks, wherein each memory bandwidth usage state is associated with a respective memory block and indicates at least how much of a memory access bandwidth assigned to the respective partition ID to access the respective memory block is used;
• determining a usage level associated with the respective partition ID from the plurality of memory bandwidth usage states;
• adjusting a credit count based on the usage level;
• comparing the adjusted credit count with a request issue threshold;
• and
• in accordance with a determination that the credit count is greater than the request issue threshold, issuing a next data access request associated with the respective partition ID in a memory access request queue.

A non-transitory computer-readable medium, having instructions stored thereon, which when executed by a controller of an electronic device cause the controller to perform operations comprising:

• at the electronic device having one or more processing clusters and a plurality of memory blocks coupled to each processing cluster, wherein each processing cluster includes one or more respective processors and the controller:
• partitioning resources of the electronic device into a plurality of resource portions to be utilized by a plurality of clients, each resource portion being assigned to a respective client and having a respective partition identifier (ID);
• receiving a plurality of data access requests associated with the plurality of clients to the plurality of memory blocks;
• and
• for each resource portion having the respective partition ID:
• tracking a plurality of memory bandwidth usage states corresponding to the memory blocks, wherein each memory bandwidth usage state is associated with a respective memory block and indicates at least how much of a memory access bandwidth assigned to the respective partition ID to access the respective memory block is used;
• determining a usage level associated with the respective partition ID from the plurality of memory bandwidth usage states;
• adjusting a credit count based on the usage level;
• comparing the adjusted credit count with a request issue threshold;
• and
• in accordance with a determination that the credit count is greater than the request issue threshold, issuing a next data access request associated with the respective partition ID in a memory access request queue.

An apparatus for managing memory access at an electronic device including one or more processing clusters and a plurality of memory blocks, each processing cluster including one or more respective processors and coupled to at least one of the memory blocks, comprising:

• means for partitioning resources of the electronic device into a plurality of resource portions to be utilized by a plurality of clients, each resource portion being assigned to a respective client and having a respective partition identifier (ID);
• means for receiving a plurality of data access requests associated with the plurality of clients to the plurality of memory blocks;
• and
• for each resource portion having the respective partition ID:
• means for tracking a plurality of memory bandwidth usage states corresponding to the memory blocks, wherein each memory bandwidth usage state is associated with a respective memory block and indicates at least how much of a memory access bandwidth assigned to the respective partition ID to access the respective memory block is used;
• means for determining a usage level associated with the respective partition ID from the plurality of memory bandwidth usage states;
• means for adjusting a credit count based on the usage level;
• means for comparing the adjusted credit count with a request issue threshold;
• and
• means for in accordance with a determination that the credit count is greater than the request issue threshold, issuing a next data access request associated with the respective partition ID in a memory access request queue.