Cache management in content delivery systems

A method for managing caching for a content delivery system, the method comprising:

• receiving, by a caching agent from a client, a request for content data;
• determining, by the caching agent, that the caching agent needs to fill the content data;
• sending, by the caching agent to a business logic agent, a content request indicating that the caching agent is requesting the content data for the client, wherein the business logic agent and the caching agent are operatively coupled via a network, and the business logic agent fills the content data in a first cache storage of the business logic agent responsive to the content request;
• filling, by the caching agent, the content data from an upstream node in a second cache storage of the caching agent;
• receiving, by the caching agent, additional content requests from additional clients, wherein the additional content requests indicate that the same content data is requested by additional clients;
• and
• while the second cache storage is being filled with the content data, the cached content data is provided by the business logic agent to the additional clients, wherein
• the content delivery system is a content delivery network (CDN);
• the business logic agent and the caching agent are on a same edge node of the CDN;
• the upstream node is an origin server that stores the content data or a node between the edge node and the origin node in the CDN that stores the content data;
• and
• the network is a local host connection.

A node of a content delivery system, comprising:

• a network device providing a network;
• at least one processor implementing a business logic agent and a caching agent, the business logic agent and the caching agent are operatively coupled via the network;
• and
• at least one memory implementing a first cache storage of the business logic agent and a second cache storage of the caching agent, wherein the at least one processor:
• sends, using the caching agent to the business logic agent, a content request indicating that the caching agent is requesting content data for a client;
• receives, using the business logic agent, the content data from an upstream node of the content delivery system;
• fills, using the business logic agent, the content data in the first cache storage;
• provides, using the business logic agent, the cached content data to the client;
• and
• while the second cache storage is being filled with the content data, maintains, using the business logic agent, the cached content data in response to the business logic agent receiving additional content requests from the caching agent, wherein the additional content requests indicate that the caching agent is requesting the same content data for additional clients, wherein
• the content delivery system is a content delivery network (CDN);
• the business logic agent and the caching agent are on a same edge node of the CDN;
• the upstream node is an origin server that stores the content data or a node between the edge node and the origin node in the CDN that stores the content data;
• and
• the network is a local host connection.

A non-transitory computer-readable medium comprising computer-readable instructions such that, when executed, cause a processor of a node of a content delivery system to:

• send, using a caching agent to a business logic agent, a content request indicating that the caching agent is requesting content data for a client;
• receive, using the business logic agent, the content data from an upstream node of the content delivery system;
• fill, using the business logic agent, the content data in the first cache storage;
• provide, using the business logic agent, the cached content data to the client;
• and
• while the second cache storage is being filled with the content data, maintain, using the business logic agent, the cached content data in response to the business logic agent receiving additional content requests from the caching agent, wherein the additional content requests indicate that the caching agent is requesting the same content data for additional clients, wherein
• the content delivery system is a content delivery network (CDN);
• the business logic agent and the caching agent are on a same edge node of the CDN;
• the upstream node is an origin server that stores the content data or a node between the edge node and the origin node in the CDN that stores the content data;
• and
• the network is a local host connection.