Cache management in content delivery systems

A method for managing caching for a content delivery system, the method comprising:

• receiving, by a caching agent from a client, a request for content data;
• determining, by the caching agent, that the caching agent needs to fill the content data;
• sending, by the caching agent to a business logic agent, a content request indicating that the caching agent is requesting the content data for the client, wherein the business logic agent and the caching agent are operatively coupled via a network, and the business logic agent fills the content data in a first cache storage of the business logic agent responsive to the content request;
• filling, by the caching agent, the content data from an upstream node in a second cache storage of the caching agent;
• receiving, by the caching agent, additional content requests from additional clients, wherein the additional content requests indicate that the same content data is requested by additional clients;
• and
• while the second cache storage is being filled with the content data, the cached content data is provided by the business logic agent to the additional clients, wherein the content request comprises an address of the content data and a range of the content data;
• the address of the content data comprises a Uniform Resource Locator (URL);
• and
• the business logic agent determines whether any of the additional content requests is requesting the same content data as requested by the content request based on the address and the range.

A node of a content delivery system, comprising:

• a network device providing a network;
• at least one processor implementing a business logic agent and a caching agent, the business logic agent and the caching agent are operatively coupled via the network;
• and
• at least one memory implementing a first cache storage of the business logic agent and a second cache storage of the caching agent, wherein the at least one processor:
• sends, using the caching agent to the business logic agent, a content request indicating that the caching agent is requesting content data for a client;
• receives, using the business logic agent, the content data from an upstream node of the content delivery system;
• fills, using the business logic agent, the content data in the first cache storage;
• provides, using the business logic agent, the cached content data to the client;
• and
• while the second cache storage is being filled with the content data, maintains, using the business logic agent, the cached content data in response to the business logic agent receiving additional content requests from the caching agent, wherein the additional content requests indicate that the caching agent is requesting the same content data for additional clients, wherein
• the content request comprises an address of the content data and a range of the content data;
• the address of the content data comprises a Uniform Resource Locator (URL);
• and
• the business logic agent determines whether any of the additional content requests is requesting the same content data as requested by the content request based on the address and the range.

A non-transitory computer-readable medium comprising computer-readable instructions such that, when executed, cause a processor of a node of a content delivery system to:

• send, using a caching agent to a business logic agent, a content request indicating that the caching agent is requesting content data for a client;
• receive, using the business logic agent, the content data from an upstream node of the content delivery system;
• fill, using the business logic agent, the content data in the first cache storage;
• provide, using the business logic agent, the cached content data to the client;
• and
• while the second cache storage is being filled with the content data, maintain, using the business logic agent, the cached content data in response to the business logic agent receiving additional content requests from the caching agent, wherein the additional content requests indicate that the caching agent is requesting the same content data for additional clients, wherein
• the content request comprises an address of the content data and a range of the content data;
• the address of the content data comprises a Uniform Resource Locator (URL);
• and
• the business logic agent determines whether any of the additional content requests is requesting the same content data as requested by the content request based on the address and the range.