Method and system for managing memory of data processing accelerators

A non-transitory machine-readable medium having instructions stored therein, which when executed by a processor, cause the processor to perform operations, the operations comprising:

• performing a secure boot using a security module of a host system;
• establishing a trusted execution environment (TEE) associated with one or more processors of the host system;
• launching a memory manager, wherein the memory manager is configured to manage memory resources of a data processing (DP) accelerator coupled to the host system over a bus, including maintaining memory usage information at least by recording, in a memory usage data structure, allocation of memory blocks of a global memory residing within the DP accelerator to one or more applications to map, in the memory data structure, which of the memory blocks are allocated to which of the one or more applications, wherein the memory manager and the memory usage data structure are implemented as a part of a runtime library associated with the DP accelerator and the memory manager and the memory usage data structure are executed within the TEE of the host system;
• and
• in response to a request received from an application running within the TEE for accessing a memory location of the DP accelerator, allowing or denying the request based on the allocation of the global memory residing within the DP accelerator of the memory usage information.

A data processing host system, comprising:

• a security module;
• one or more processors coupled to the security module;
• and
• a memory coupled to the processor to store instructions, which when executed by the processor, cause the processor to perform operations, the operations including:
• performing a secure boot using the security module of the host system,
• establishing a trusted execution environment (TEE) associated with one or more processors of the host system,
• launching a memory manager, wherein the memory manager is configured to manage memory resources of a data processing (DP) accelerator coupled to the host system over a bus, including maintaining memory usage information at least by recording, in a memory usage data structure, allocation of memory blocks of a global memory residing within the DP accelerator to one or more applications to map, in the memory data structure, which of the memory blocks are allocated to which of the one or more applications, wherein the memory manager and the memory usage data structure are implemented as a part of a runtime library associated with the DP accelerator and the memory manager and the memory usage data structure are executed within the TEE of the host system, and
• in response to a request received from an application running within the TEE for accessing a memory location of the DP accelerator, allowing or denying the request based on the allocation of the global memory residing within the DP accelerator of the memory usage information.