Memory address caching for neural networks
AssigneeSynopsys, Inc.
InventorTom Michiels
Life of this patent
Estimating the term…
Abstract
A request to provide an application with direct memory access to data stored at an external memory address of an external memory is received. Responsive to determining that the external memory address is not registered in a cache, the data is copied from the external memory address to a first internal memory address within the internal memory. A first cache line, within the cache, associated with the external memory address is updated to include a reference to the first internal memory address. The data is provided from the internal memory to the application.
Claims20
A system comprising:
- a processor comprising a cache and an internal memory;
- and
- controller circuitry, operatively coupled to the processor, the controller circuitry to perform operations comprising:
- receiving a request to provide an application with access to data stored at an external memory address of an external memory coupled to the controller circuitry;
- copying the data from the external memory address to a first internal memory address within the internal memory;
- and
- updating, within the cache, a first cache line to include a reference to the first internal memory address.
An apparatus comprising:
- a direct memory access (DMA) controller coupled to a processor and configured to perform operations comprising:
- receiving a request to provide an application with access to data stored at an external memory address of an external memory coupled to the DMA controller;
- copying the data from the external memory address to a first internal memory address within an internal memory of the processor;
- and
- updating, within a cache of the processor, a first cache line associated with the external memory address to include a reference to the first internal memory address.
A method of managing a cache located on a processor, the method comprising:
- receiving, by controller circuitry coupled to the processor, a request to provide an application with direct memory access to data stored at an external memory address of an external memory coupled to the controller circuitry;
- copying, by the controller circuitry, the data from the external memory address to a first internal memory address within an internal memory of the processor;
- and
- updating, by the controller circuitry, a first cache line within the cache and associated with the external memory address to include a reference to the first internal memory address;
- and
- providing, by the controller circuitry, the data from the internal memory to the application.
Dependencies are inferred from the claim text.