Multitier cache framework
AssigneeHome Box Office, Inc.
InventorsSata Busayarat, Jonathan David Lutz, Allen Arthur Gay, Mei Qi
Life of this patent
Estimating the term…
Abstract
The described technology is directed towards a cache framework that accesses a tier of ordered caches, in tier order, to satisfy requests for data. The cache framework may be implemented at a front-end service level server, and/or a back end service level server, or both. The cache framework handles read-through and write-through operations, including handling batch requests for multiple data items. The cache framework also facilitates dynamically changing the tier structure, e.g., for adding, removing, replacing and/or reordering caches in the tier, e.g., by re-declaring a data structure such as an array that identifies the tiered cache configuration.
Claims20
A method comprising:
- declaring, by a system comprising a processor, a data structure that represents a first tiered cache order that identifies at least one cache comprising a first cache and a third cache;
- responding to a first request for first data based on the first tiered cache order;
- prepopulating a second cache with a second dataset, the second dataset comprising at least some additional data that is not in a first dataset of the first cache;
- re-declaring the data structure to represent a second tiered cache order that identifies the at least one cache comprising the first cache and the second cache instead of the first cache and the third cache, wherein the second tiered cache order is based on respective speeds of caches of the at least one cache;
- and
- responding to a second request for second data based on the second tiered cache order, comprising returning a first part of the second data from the first dataset of the first cache and returning a second part of the second data from the second dataset of the second cache.
A system, comprising:
- a processor, and
- a memory that stores executable instructions that, when executed by the processor, facilitate performance of operations, the operations comprising:
- serving a first request for first data based on a data structure that represents a first tiered cache order comprising at least one cache comprising a first cache and a second cache;
- prepopulating a third cache;
- changing the data structure to represent a second tiered cache order comprising the at least one cache comprising the first cache and the third cache, wherein the second tiered cache order is based on respective speeds of caches of the at least one cache;
- and
- serving, after changing the data structure to represent the second tiered cache order, a second request for second data based on the data structure that represents the second tiered cache order, comprising returning a first part of the second data from the first cache and returning a second part of the second data from the third cache.
A non-transitory computer-readable medium comprising executable instructions that, when executed by a processor of a system, facilitate performance of operations, the operations comprising:
- serving a first request for first data based on a first tiered cache order that represents at least one cache comprising an in-memory cache and a first distributed cache part;
- prepopulating a second distributed cache part;
- changing the first tiered cache order to a second tiered cache order that represents the at least one cache comprising the in-memory cache and the second distributed cache part and not the first distributed cache part, wherein the second tiered cache order is based on respective speeds of caches of the at least one cache;
- and
- after the changing the first tiered cache order to the second tiered cache order, serving a second request for second data based on the second tiered cache order, comprising returning a first part of the second data from the in-memory cache and returning a second part of the second data from the second distributed cache part.
Dependencies are inferred from the claim text.