# US 11,451,430 B2 · System and method to schedule management operations and shared memory space for multi-tenant cache service in cloud > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,451,430 B2 - Document ID: US11451430B2 - Status: Granted - Kind: B2 - Application number: 16/920,841 - Filed: 2020-07-06 - Published: 2020-10-29 - Granted: 2022-09-20 - Earliest claimed: 2018-06-06 - Assignees: Huawei Cloud Computing Technologies Co., Ltd. - Applicants: Huawei Cloud Computing Technologies Co., Ltd. - Inventors: Ming Chen; Gui Fu; Zhenhua Hu; Heng Kuang; Shaohui Xu; Zhi Zhao - Web page: https://patentgrep.com/patent/US11451430B2 ## CPC - G06F 9/4881: {Scheduling strategies for dispatcher, e.g. round robin, multi-level priority queues} - H04L 41/0273: using web services for network management, e.g. simple object access protocol [SOAP] - G06F 9/45558: {Hypervisor-specific management and integration aspects} - H04L 41/0803: Configuration setting - H04L 41/5022: by giving priorities, e.g. assigning classes of service - H04L 67/568: Storing data temporarily at an intermediate stage, e.g. caching - G06F 9/5005: {to service a request} - G06F 9/5072: {Grid computing} - G06F 2009/45583: {Memory management, e.g. access or allocation} - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M) ## Abstract Systems and methods for controlling management operations and shared memory space are disclosed. A cloud cache management controller may receive multiple sets of service attributes. Each set of the multiple sets of service attributes may be related to a cloud cache service instance. The cloud cache management controller may receive a first cloud cache management request. The cloud cache management request may comprise a cloud cache management operation. The cloud cache management controller may retrieve a set of service attributes from the multiple sets of service attributes based on an evaluation of the cloud cache management operation. The cloud cache management controller may send the first cloud cache management request to a corresponding CCSI based on a priority value for the first cloud cache management request calculated based on the retrieved set of service attributes. ## Claims ### Claim 1 A method, comprising: receiving, by a cloud cache management controller (CCMC) running on computing resources of a cloud computing system, multiple sets of service attributes, each set of the multiple sets of service attributes related to a cloud cache service instance (CCSI) of a set of CCSIs, each CCSI of the set of CCSIs corresponding to a different cloud application instance of a cloud application and storing corresponding in-memory data used by the different cloud application instance; receiving, by the CCMC, a first cloud cache management request comprising a first cloud cache management operation; after the receiving the first cloud cache management request, receiving, by the CCMC, a second cloud cache management request comprising a second cloud cache management operation; retrieving, by the CCMC, a first set of service attributes from the multiple sets of service attributes based on a first evaluation of the first cloud cache management operation, wherein the first set of service attributes comprise a plurality of dimensions associated with a first corresponding CCSI of one or more CCSIs, and wherein each dimension of the plurality of dimensions is associated with one or more corresponding weights and one or more corresponding plan levels; retrieving, by the CCMC, a second set of service attributes from the multiple sets of service attributes based on a second evaluation of the second cloud cache management operation; calculating, by the CCMC, a first priority value for the first cloud cache management request based on a sum of products, each product of the products being based on a corresponding product of a corresponding weight and a corresponding plan level in the each dimension of the plurality of dimensions; calculating, by the CCMC, a second priority value for the second cloud cache management request based on the second set of service attributes; determining, by the CCMC, a forwarding procedure for the first cloud cache management request and the second cloud cache management request, the forwarding procedure including delaying the first cloud cache management request or reordering the first cloud cache management request and the second cloud cache management request based on a comparison of the first priority value and the second priority value; and sending, by the CCMC, the first cloud cache management request to one or more corresponding CCSIs based on the forwarding procedure. ### Claim 2 (depends on 1) The method of claim 1, wherein the first evaluation further comprises: determining, by the CCMC, a management type of the first cloud cache management operation; and retrieving, by the CCMC, the first set of service attributes of the multiple sets of service attributes based on the management type, the first set of service attributes associated with the first corresponding CCSI of the one or more CCSIs. ### Claim 3 (depends on 1) The method of claim 1, the each dimension of the plurality of dimensions corresponding to a different service-level agreement (SLA). ### Claim 4 (depends on 3) The method of claim 3, wherein the plurality of dimensions comprises at least one of a dimension for service plans, a dimension for a time elapse entering a next maintenance time, a dimension for a time elapse exiting from a previous maintenance time, a dimension for an operation length projection, or a dimension for a resource consumption projection. ### Claim 5 (depends on 1) The method of claim 1, wherein a weight sum of the one or more corresponding weights associated with the each of the plurality of dimensions equals to 100%. ### Claim 6 (depends on 1) The method of claim 1, wherein the sending comprises: delaying, by the CCMC, until a next maintenance time window to send the first cloud cache management request to the first corresponding CCSI of the one or more CCSIs based on the first priority value and the second priority value. ### Claim 7 (depends on 1) The method of claim 1, wherein a management type of the first cloud cache management operation comprises one of backup, restore, or migration. ### Claim 8 (depends on 1) The method of claim 1, wherein the sending comprises: sending, by the CCMC, the first cloud cache management request to the first corresponding CCSI of the one or more CCSIs on a cloud cache service node, the cloud cache service node comprising the set of CCSIs including the first corresponding CCSI, wherein the set of CCSIs on the cloud cache service node share a same memory space. ### Claim 9 (depends on 1) The method of claim 1, wherein the first priority value is calculated based on the first priority value=Dimension1.level×Weight1+Dimension2.level×Weight2+ . . . +DimensionN.level×WeightN, wherein Dimensioni.level denotes a rank of a level for Dimensioni, and wherein Weighti denotes a weight associated with Dimensioni. ### Claim 10 (depends on 1) The method of claim 1, wherein the first priority value is calculated based on the first priority value=Dimension1.level1×Weight1+Dimension1.level2×Weight1+Dimension2.level×Weight2+ . . . +DimensionN level×WeightN, wherein Dimensioni.level denotes a rank of a level for Dimensioni except for Demention1, wherein Weighti denotes a weight associated with Dimensioni, wherein Dimension1.level1 denotes a rank of a first level for Dimension1, and wherein Dimension1.level2 denotes a rank of a second level for Dimension1. ### Claim 11 A non-transitory computer readable medium having instructions stored thereon that, when executed by at least one computing device, cause the at least one computing device to perform operations comprising: receiving multiple sets of service attributes, each set of the multiple sets of service attributes related to a cloud cache service instance (CCSI) of a set of CCSIs, each CCSI of the set of CCSIs corresponding to a different cloud application instance of a cloud application and storing corresponding in-memory data used by the different cloud application instance; receiving a first cloud cache management request comprising a first cloud cache management operation; after the receiving the first cloud cache management request, receiving a second cloud cache management request comprising a second cloud cache management operation; retrieving a first set of service attributes from the multiple sets of service attributes based on a first evaluation of the first cloud cache management operation, wherein the first set of service attributes comprise a plurality of dimensions associated with a first corresponding CCSI of one or more CCSIs, and wherein each dimension of the plurality of dimensions is associated with one or more corresponding weights and one or more corresponding plan levels; retrieving a second set of service attributes from the multiple sets of service attributes based on a second evaluation of the second cloud cache management operation; calculating a first priority value for the first cloud cache management request based on a sum of products, each product of the products being based on a corresponding product of a corresponding weight and a corresponding plan level in the each dimension of the plurality of dimensions; calculating a second priority value for the second cloud cache management request based on the second set of service attributes; determining a forwarding procedure for the first cloud cache management request and the second cloud cache management request, the forwarding procedure including delaying the first cloud cache management request or reordering the first cloud cache management request and the second cloud cache management request based on a comparison of the first priority value and the second priority value; and sending the first cloud cache management request to one or more corresponding CCSIs based on the forwarding procedure. ### Claim 12 (depends on 11) The non-transitory computer readable medium of claim 11, wherein the first evaluation further comprises: determining a management type of the first cloud cache management operation; and retrieving the first set of service attributes of the multiple sets of service attributes based on the management type, the first set of service attributes associated with the first corresponding CCSI of the one or more CCSIs. ### Claim 13 (depends on 11) The non-transitory computer readable medium of claim 11, the each dimension of the plurality of dimensions corresponding to a different service-level agreement (SLA). ### Claim 14 (depends on 13) The non-transitory computer readable medium of claim 13, wherein the plurality of dimensions comprises at least one of a dimension for service plans, a dimension for a time elapse entering a next maintenance time, a dimension for a time elapse exiting from a previous maintenance time, a dimension for an operation length projection, or a dimension for a resource consumption projection. ### Claim 15 (depends on 11) The non-transitory computer readable medium of claim 11, wherein a weight sum of the one or more corresponding weights associated with the each of the plurality of dimensions equals to 100%. ### Claim 16 (depends on 11) The non-transitory computer readable medium of claim 11, wherein the sending comprises: delaying until a next maintenance time window to send the first cloud cache management request to the first corresponding CCSI of the one or more CCSIs based on the first priority value and the second priority value. ### Claim 17 (depends on 11) The non-transitory computer readable medium of claim 11, wherein a management type of the first cloud cache management operation comprises one of backup, restore, or migration. ### Claim 18 (depends on 11) The non-transitory computer readable medium of claim 11, wherein the sending comprises: sending the first cloud cache management request to the first corresponding CCSI of the one or more CCSIs on a cloud cache service node, the cloud cache service node comprising the set of CCSIs including the first corresponding CCSI of the one or more CCSIs, wherein the set of CCSIs on the cloud cache service node share a same memory space. ### Claim 19 A computing system, comprising: at least one processor; a memory operatively coupled to the at least one processor and storing computer-readable instructions, which when executed by the at least one processor cause the computing system to perform operations comprising: receiving multiple sets of service attributes, each set of the multiple sets of service attributes related to a cloud cache service instance (CCSI) of a set of CCSIs, each CCSI of the set of CCSIs corresponding to a different cloud application instance of a cloud application and storing corresponding in-memory data used by the different cloud application instance; receiving a first cloud cache management request comprising a first cloud cache management operation; after the receiving the first cloud cache management request, receiving a second cloud cache management request comprising a second cloud cache management operation; retrieving a first set of service attributes from the multiple sets of service attributes based on a first evaluation of the first cloud cache management operation, wherein the first set of service attributes comprise a plurality of dimensions associated with a first corresponding CCSI of one or more CCSIs, and wherein each dimension of the plurality of dimensions is associated with one or more corresponding weights and one or more corresponding plan levels; retrieving a second set of service attributes from the multiple sets of service attributes based on a second evaluation of the second cloud cache management operation; calculating a first priority value for the first cloud cache management request based on a corresponding product of a corresponding weight and a corresponding plan level in the each dimension of the plurality of dimensions; calculating a second priority value for the second cloud cache management request based on the second set of service attributes; determining a forwarding procedure for the first cloud cache management request and the second cloud cache management request, the forwarding procedure including delaying the first cloud cache management request or reordering the first cloud cache management request and the second cloud cache management request based on a comparison of the first priority value and the second priority value; and sending the first cloud cache management request to one or more corresponding CCSIs based on the forwarding procedure. ### Claim 20 (depends on 19) The computing system of claim 19, wherein the first evaluation further comprises: determining a management type of the first cloud cache management operation; and retrieving the first set of service attributes of the multiple sets of service attributes based on the management type, the first set of service attributes associated with the first corresponding CCSI of the one or more CCSIs. ### Claim 21 (depends on 19) The computing system of claim 19, the each dimension of the plurality of dimensions corresponding to a different service-level agreement (SLA). ### Claim 22 (depends on 21) The computing system of claim 21, wherein the plurality of dimensions comprises at least one of a dimension for service plans, a dimension for a time elapse entering a next maintenance time, a dimension for a time elapse exiting from a previous maintenance time, a dimension for an operation length projection, or a dimension for a resource consumption projection. ### Claim 23 (depends on 19) The computing system of claim 19, wherein a weight sum of the one or more corresponding weights associated with the each of the plurality of dimensions equals to 100%. ### Claim 24 (depends on 19) The computing system of claim 19, wherein the sending comprises: delaying until a next maintenance time window to send the first cloud cache management request to the first corresponding CCSI of the one or more CCSIs based on the first priority value and the second priority value. ### Claim 25 (depends on 19) The computing system of claim 19, wherein a management type of the first cloud cache management operation comprises one of backup, restore, or migration. ### Claim 26 (depends on 19) The computing system of claim 19, wherein the sending comprises: sending the first cloud cache management request to the first corresponding CCSI of the one or more CCSIs on a cloud cache service node, the cloud cache service node comprising the set of CCSIs including the first corresponding CCSI, wherein the set of CCSIs on the cloud cache service node share a same memory space. ### Claim 27 A cloud caching service system, comprising: a cloud cache service manager comprising: first at least one processor; a first memory operatively coupled to the first at least one processor and storing first computer-readable instructions, which when executed by the first at least one processor cause the cloud cache service manager to perform first operations including: sending a first cloud cache management request comprising a first cloud cache management operation; and after the sending the first cloud cache management request, sending a second cloud cache management request comprising a second cloud cache management operation; and a cloud cache management controller (CCMC) comprising: second at least one processor; a second memory operatively coupled to the second at least one processor and storing second computer-readable instructions, which when executed by the second at least one processor cause the CCMC to perform second operations including: receiving multiple sets of service attributes, each set of the multiple sets of service attributes related to a cloud cache service instance (CCSI) of a set of CCSIs, each CCSI of the set of CCSIs corresponding to a different cloud application instance of a cloud application and storing corresponding in-memory data used by the different cloud application instance; retrieving a first set of service attributes from the multiple sets of service attributes based on a first evaluation of the first cloud cache management operation, wherein the first set of service attributes comprise a plurality of dimensions associated with a first corresponding CCSI of one or more CCSIs, and wherein each dimension of the plurality of dimensions is associated with one or more corresponding weights and one or more corresponding plan levels; retrieving a second set of service attributes from the multiple sets of service attributes based on a second evaluation of the second cloud cache management operation; calculating a first priority value for the first cloud cache management request based on the first set of service attributes based on a corresponding product of a corresponding weight and a corresponding plan level in the each dimension of the plurality of dimensions; calculating a second priority value for the second cloud cache management request based on the second set of service attributes; determining a forwarding procedure for the first cloud cache management request and the second cloud cache management request, the forwarding procedure including delaying the first cloud cache management request or reordering the first cloud cache management request and the second cloud cache management request based on a comparison of the first priority value and the second priority value; and sending the first cloud cache management request to one or more corresponding CCSIs based on the forwarding procedure. ### Claim 28 (depends on 27) The cloud caching service system of claim 27, wherein the first evaluation comprises: determining a management type of the first cloud cache management operation; and retrieving the first set of service attributes of the multiple sets of service attributes based on the management type, the first set of service attributes associated with the first corresponding CCSI of the one or more CCSIs. ### Claim 29 (depends on 27) The cloud caching service system of claim 27, each dimension of the plurality of dimensions corresponding to a different service-level agreement (SLA). ### Claim 30 (depends on 29) The cloud caching service system of claim 29, wherein the plurality of dimensions comprises at least one of a dimension for service plans, a dimension for a time elapse entering a next maintenance time, a dimension for a time elapse exiting from a previous maintenance time, a dimension for an operation length projection, or a dimension for a resource consumption projection. ### Claim 31 (depends on 27) The cloud caching service system of claim 27, wherein a weight sum of the one or more corresponding weights associated with the each of the plurality of dimensions equals to 100%. ### Claim 32 (depends on 27) The cloud caching service system of claim 27, wherein the sending the first cloud cache management request comprises: delaying until a next maintenance time window to send the first cloud cache management request to the first corresponding CCSI of the one or more CCSIs based on the first priority value and the second priority value. ### Claim 33 (depends on 27) The cloud caching service system of claim 27, wherein a management type of the first cloud cache management operation comprises one of backup, restore, or migration. ### Claim 34 (depends on 27) The cloud caching service system of claim 27, wherein the sending the first cloud cache management request comprises: sending the first cloud cache management request to the first corresponding CCSI of the one or more CCSIs on a cloud cache service node, the cloud cache service node comprising the set of CCSIs including the first corresponding CCSI, wherein the set of CCSIs on the cloud cache service node share a same memory space.