Intelligent gpu memory pre-fetching and gpu translation lookaside buffer management

A non-transitory machine-readable medium having executable instructions to cause one or more processing units to perform a method to perform translation lookaside buffer coherency for a translation lookaside buffer of a graphics processing unit for a device, the method comprising:

• receiving a request to remove an entry of the translation lookaside buffer of the graphics processing unit, wherein the device includes a central processing unit and the graphics processing unit, the entry includes a virtual address translation of a process to a physical memory address of system memory of the device and the graphics processing unit is executing a compute task of the process;
• locating the entry in the translation lookaside buffer;
• and
• removing the entry.

A method to process a graphics processing unit page fault, the method comprising:

• detecting a page fault of a process associated with a first page that stores content of a memory object;
• determining if the page fault is associated with a graphics processing unit operation;
• and
• if the page fault is associated with a graphics processing unit operation,
• analyzing the memory object for domain information of the memory object;
• identifying a second page that is stored in persistent storage using the domain information;
• pre-fetching the second page associated with the memory object into physical memory;
• and
• mapping the second page to virtual memory of the process.

A method to perform translation lookaside buffer coherency for a translation lookaside buffer of a graphics processing unit for a device, the method comprising:

• receiving a request to remove an entry of the translation lookaside buffer of the graphics processing unit, wherein the device includes a central processing unit and the graphics processing unit, the entry includes a virtual address translation of a process to a physical memory address of system memory of the device and the graphics processing unit is executing a compute task of the process;
• locating the entry in the translation lookaside buffer;
• and
• removing the entry.