Memory processing optimisation
AssigneeMyrtle Software Limited
InventorGraham Hazel
Life of this patent
Estimating the term…
Abstract
Table lookup from hardware data storage is managed as part of processing one or more computer programs operating on a data processing system. At least one request is received from the one or more computer programs for a table lookup, at a software component that is operating on the data processing system separately or segregated from the one or more computer programs. The software component retrieves the table lookup data corresponding with the at least one request from the hardware data storage. The retrieved table lookup data is returned to the one or more computer programs.
Claims21
A method for managing embedding table lookup from hardware data storage as part of processing one or more computer programs operating on a data processing system, the method comprising:
- receiving at least one request from the one or more computer programs for an embedding table lookup by a segregated system software component that centralizes said embedded table lookups and operates on the data processing system separately or segregated from processing by the one or more computer programs, said system software component functions to manage access to said hardware data storage for said embedding table lookups and to schedule lookup operations to said hardware data storage, whereby execution time and latency of said data processing system is reduced by overlapping all non-lookup computations with lookup operations by said segregated system software component;
- retrieving, by the segregated system software component, the embedding table lookup data corresponding with the at least one request from the hardware data storage, the hardware data storage operative to store an embedding table corresponding to the at least one request;
- and
- returning the retrieved embedding table lookup data to the one or more computer programs.
A non-transitory computer readable medium storing a computer program, comprising instructions that, when the program is executed by a computer, cause the computer to carry out a method comprising:
- receiving at least one request from one or more computer programs for an embedding table lookup by a segregated system software component that centralizes embedded table lookups and operates on a data processing system separately or segregated from processing by the one or more computer programs, said system software component functions to manage access to said hardware data storage for said embedding table lookups and to schedule lookup operations to said hardware data storage whereby execution time and latency of said data processing system is reduced by overlapping all non-lookup computations with lookup operations by said segregated system software component;
- retrieving, by the segregated system software component, the embedding table lookup data corresponding with the at least one request from hardware data storage, the hardware data storage operative to store an embedding table corresponding with the at least one request;
- and
- returning the retrieved embedding table lookup data to the one or more computer programs.
A data processing system, comprising:
- hardware data storage operative to store an embedding table therein;
- at least one processor, in communication with the hardware data storage, and operating one or more computer programs and operating a software component separately or segregated from the one or more computer programs, the software component being configured to:
- receive at least one request from the one or more computer programs for an embedding table lookup from the stored embedding table by a segregated system software component that centralizes said embedded table lookups and operates on the data processing system separately or segregated from processing by the one or more computer programs, said system software component functions to manage access to said hardware data storage for said embedding table lookups and to schedule lookup operations to said hardware data storage, whereby execution time and latency of said data processing system is reduced by overlapping all non-lookup computations with lookup operations by said segregated system software component;
- retrieve the embedding table lookup data corresponding with the at least one request from the hardware data storage, the hardware data storage operative to store an embedding table corresponding to the at least one request;
- and
- return the retrieved embedding table lookup data to the one or more computer programs.
Dependencies are inferred from the claim text.