High bandwidth extended memory in a parallel processing system

A method for accessing extended memory allocated within a system memory of a central processing unit, the method comprising:

• receiving, at a first parallel processor that is coupled to the central processing unit, a first memory access from a second parallel processor;
• determining that the first memory access is directed towards the extended memory allocated within the system memory of the central processing unit;
• and
• transmitting the first memory access from the first parallel processor to a memory controller that is coupled to the central processing unit for processing,
• wherein the extended memory is pinned in the system memory of the central processing unit for exclusive access by the second parallel processor.