Back to results
US 12,743,372 B1Granted
Firmware-controlled memory binding and implicit data persistence for hardware accelerators
AssigneeNVIDIA Corporation
InventorsDawid Stanislaw Pajak, Lachlan Francis Dowling, Nan Wang, Rohit Goel
Life of this patent
Estimating the term…
Abstract
Various examples, systems, and methods relate to facilitating memory use by a hardware accelerator. A system can check whether an on-chip memory region has already been set up for a given use. If it has, the system can reuse it. If not, the system can allocate a new region and connect it to a larger off-chip memory. The system can determine whether to load data into on-chip memory or save data back to off-chip memory based on various rules.
Claims20
A system, comprising:
- one or more processors to:
- allocate, via a firmware interface, a local memory region in a local memory of a hardware accelerator bound to an external memory region, the allocation returning a device pointer corresponding to a binding, the binding tracked using a resource identifier in a resource table corresponding with a non-privileged execution context;
- and
- provide the device pointer to a memory region accessible to the non-privileged execution context for at least one subsequent construction of at least one command buffer identifying the binding of the local memory region to the external memory region.
1 more element
A system-on-a-chip (SoC), comprising:
- processing circuitry to:
- transmit, via a firmware interface, a request to allocate a local memory region in a local memory of a hardware accelerator and bind the local memory region to an external memory region;
- receive, via the firmware interface, a device pointer corresponding to the binding of the local memory region to the external memory region, the binding tracked using a resource identifier in a resource table corresponding with a non-privileged execution context;
- and
- store the device pointer in a memory region accessible to a non-privileged execution context for at least one subsequent construction of at least one command buffer identifying the binding of the local memory region to the external memory region.
2 more elements
A method, comprising:
- allocating, by one or more processors via a firmware interface, a local memory region in a local memory of a hardware accelerator bound to an external memory region, the allocation returning a device pointer corresponding to a binding, the binding tracked using a resource identifier in a resource table corresponding with a non-privileged execution context;
- and
- providing, by the one or more processors, the device pointer to a memory region accessible to the non-privileged execution context for at least one subsequent construction of at least one command buffer identifying the binding of the local memory region to the external memory region.
Dependencies are inferred from the claim text.