System and method to schedule management operations and shared memory space for multi-tenant cache service in cloud

A non-transitory computer readable medium having instructions stored thereon that, when executed by at least one computing device, cause the at least one computing device to perform operations comprising:

• receiving multiple sets of service attributes, each set of the multiple sets of service attributes related to a cloud cache service instance (CCSI) of a set of CCSIs, each CCSI of the set of CCSIs corresponding to a different cloud application instance of a cloud application and storing corresponding in-memory data used by the different cloud application instance;
• receiving a first cloud cache management request comprising a first cloud cache management operation;
• after the receiving the first cloud cache management request, receiving a second cloud cache management request comprising a second cloud cache management operation;
• retrieving a first set of service attributes from the multiple sets of service attributes based on a first evaluation of the first cloud cache management operation, wherein the first set of service attributes comprise a plurality of dimensions associated with a first corresponding CCSI of one or more CCSIs, and wherein each dimension of the plurality of dimensions is associated with one or more corresponding weights and one or more corresponding plan levels;
• retrieving a second set of service attributes from the multiple sets of service attributes based on a second evaluation of the second cloud cache management operation;
• calculating a first priority value for the first cloud cache management request based on a sum of products, each product of the products being based on a corresponding product of a corresponding weight and a corresponding plan level in the each dimension of the plurality of dimensions;
• calculating a second priority value for the second cloud cache management request based on the second set of service attributes;
• determining a forwarding procedure for the first cloud cache management request and the second cloud cache management request, the forwarding procedure including delaying the first cloud cache management request or reordering the first cloud cache management request and the second cloud cache management request based on a comparison of the first priority value and the second priority value;
• and
• sending the first cloud cache management request to one or more corresponding CCSIs based on the forwarding procedure.

A computing system, comprising:

• at least one processor;
• a memory operatively coupled to the at least one processor and storing computer-readable instructions, which when executed by the at least one processor cause the computing system to perform operations comprising:
• receiving multiple sets of service attributes, each set of the multiple sets of service attributes related to a cloud cache service instance (CCSI) of a set of CCSIs, each CCSI of the set of CCSIs corresponding to a different cloud application instance of a cloud application and storing corresponding in-memory data used by the different cloud application instance;
• receiving a first cloud cache management request comprising a first cloud cache management operation;
• after the receiving the first cloud cache management request, receiving a second cloud cache management request comprising a second cloud cache management operation;
• retrieving a first set of service attributes from the multiple sets of service attributes based on a first evaluation of the first cloud cache management operation, wherein the first set of service attributes comprise a plurality of dimensions associated with a first corresponding CCSI of one or more CCSIs, and wherein each dimension of the plurality of dimensions is associated with one or more corresponding weights and one or more corresponding plan levels;
• retrieving a second set of service attributes from the multiple sets of service attributes based on a second evaluation of the second cloud cache management operation;
• calculating a first priority value for the first cloud cache management request based on a corresponding product of a corresponding weight and a corresponding plan level in the each dimension of the plurality of dimensions;
• calculating a second priority value for the second cloud cache management request based on the second set of service attributes;
• determining a forwarding procedure for the first cloud cache management request and the second cloud cache management request, the forwarding procedure including delaying the first cloud cache management request or reordering the first cloud cache management request and the second cloud cache management request based on a comparison of the first priority value and the second priority value;
• and
• sending the first cloud cache management request to one or more corresponding CCSIs based on the forwarding procedure.

A cloud caching service system, comprising:

• a cloud cache service manager comprising:
• first at least one processor;
• a first memory operatively coupled to the first at least one processor and storing first computer-readable instructions, which when executed by the first at least one processor cause the cloud cache service manager to perform first operations including:
• sending a first cloud cache management request comprising a first cloud cache management operation;
• and
• after the sending the first cloud cache management request, sending a second cloud cache management request comprising a second cloud cache management operation;
• and
• a cloud cache management controller (CCMC) comprising:
• second at least one processor;
• a second memory operatively coupled to the second at least one processor and storing second computer-readable instructions, which when executed by the second at least one processor cause the CCMC to perform second operations including:
• receiving multiple sets of service attributes, each set of the multiple sets of service attributes related to a cloud cache service instance (CCSI) of a set of CCSIs, each CCSI of the set of CCSIs corresponding to a different cloud application instance of a cloud application and storing corresponding in-memory data used by the different cloud application instance;
• retrieving a first set of service attributes from the multiple sets of service attributes based on a first evaluation of the first cloud cache management operation, wherein the first set of service attributes comprise a plurality of dimensions associated with a first corresponding CCSI of one or more CCSIs, and wherein each dimension of the plurality of dimensions is associated with one or more corresponding weights and one or more corresponding plan levels;
• retrieving a second set of service attributes from the multiple sets of service attributes based on a second evaluation of the second cloud cache management operation;
• calculating a first priority value for the first cloud cache management request based on the first set of service attributes based on a corresponding product of a corresponding weight and a corresponding plan level in the each dimension of the plurality of dimensions;
• calculating a second priority value for the second cloud cache management request based on the second set of service attributes;
• determining a forwarding procedure for the first cloud cache management request and the second cloud cache management request, the forwarding procedure including delaying the first cloud cache management request or reordering the first cloud cache management request and the second cloud cache management request based on a comparison of the first priority value and the second priority value;
• and
• sending the first cloud cache management request to one or more corresponding CCSIs based on the forwarding procedure.