# US 2021/0176307 A1 · Content Delivery Method, Virtual Server Management Method, Cloud Platform, and System

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0176307 A1
- Document ID: US20210176307A1
- Status: Published application
- Kind: A1
- Application number: 17/141,809
- Filed: 2021-01-05
- Published: 2021-06-10
- Earliest claimed: 2015-11-20
- Assignees: Huawei Technologies Co., Ltd.
- Applicants: Huawei Technologies Co., Ltd.
- Inventors: Zheng Liu
- Web page: https://patentgrep.com/patent/US20210176307A1

## CPC

- H04L 67/1097: for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
- H04L 67/1031: Controlling of the operation of servers by a load balancer, e.g. adding or removing servers that serve requests
- H04L 67/1065: {Discovery involving distributed pre-established resource-based relationships among peers, e.g. based on distributed hash tables [DHT] (pre-configuration of logical or physical connections H04L67/1053)}
- H04L 67/563: Data redirection of data network streams
- H04L 67/568: Storing data temporarily at an intermediate stage, e.g. caching
- H04L 67/288: Distributed intermediate devices, i.e. intermediate devices for interaction with other intermediate devices on the same level
- H04L 67/5682: Policies or rules for updating, deleting or replacing the stored data
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

A content delivery method and system, where the content delivery method includes receiving, by a first virtual server, a first request message from a content requester, where the first request message carries a first uniform resource locator (URL) of user-requested content, determining, by the first virtual server according to a cache list maintained by the first virtual server, that one of one or more storage servers managed by the first virtual server has cached the content corresponding to the first URL, and redirecting the first request message to a first storage server that is recorded in the cache list and that has cached the content corresponding to the first URL. A computation capability and a storage capability of a server cluster are separated, and content input/output (I/O) throughput performance is effectively improved.

## Claims

### Claim 1

A method performed by a first virtual server of a content delivery system, wherein the method comprises:
managing a first storage server and a second storage server;
receiving a first request message comprising a first uniform resource locator (URL) of user-requested content from a content requester;
determining, according to a cache list maintained by the first virtual server, that neither the first storage server nor the second storage server caches the user-requested content;
determining, according to a consistent hashing algorithm, that the second storage server is configured to cache the user-requested content; and
redirecting the first request message to the second storage server in response to determining that the second storage server is configured to cache the user-requested content,
wherein the first request message instructs the second storage server to retrieve the user-requested content and send the user-requested content to the content requester.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
receiving a second request message comprising a second URL of second user-requested content from the content requester;
determining, according to the cache list, that either the first storage server or the second storage server has cached the second user-requested content;
redirecting, in response to determining that the first storage server has cached the second user-requested content the second request message to the first storage server, wherein the second request message instructs the first storage server to send the second user-requested content to the content requester.

### Claim 3 (depends on 2)

The method of claim 2, wherein before determining that either of the first storage server or the second storage server has cached the second user-requested content, the method further comprises determining, according to the second URL, that the first virtual server processes the second URL.

### Claim 4 (depends on 1)

The method of claim 1, wherein before determining that neither the first storage server nor the second storage server caches the user-requested content, the method further comprises determining, according to the first URL, that the first virtual server processes the first URL.

### Claim 5 (depends on 1)

The method of claim 1, further comprising:
receiving a third request message carrying a third URL of third user-requested content from the content requester;
determining, according to the third URL, that a second virtual server processes the third URL; and
redirecting the third request message to the second virtual server.

### Claim 6 (depends on 1)

The method of claim 1, further comprising:
computing, according to the first URL, a URL hash value of the first URL;
obtaining partition hash values of all partitions in a distributed database;
querying, based on the consistent hashing algorithm according to the URL hash value, for a partition corresponding to the first URL, wherein the partition is a division of storage servers in the content delivery system, which is divided into at least one partition; and
determining, according to a partition hash value of the partition and a correspondence stored in the distributed database between the partition hash value and a server hash value of a virtual server, that the first virtual server processes the first URL.

### Claim 7 (depends on 1)

The method of claim 1, wherein each storage server in the content delivery system comprises at least one partition, and wherein after redirecting the first request message to the second storage server, the method further comprises:
updating popularity information corresponding to the first URL;
determining, according to the popularity information, that the user-requested content needs to be cached;
determining that a partition storage capacity of a partition corresponding to the first URL is not full; and
instructing the second storage server to cache the user-requested content into the partition.

### Claim 8 (depends on 1)

The method of claim 1, wherein each partition in the content delivery system corresponds to one virtual server, and wherein the method further comprises:
determining that a partition storage capacity of a partition corresponding to the first URL is full;
determining that an available storage capacity of at least one of a plurality of partitions managed by the first virtual server is not full;
selecting a selected partition of the plurality of partitions that have the available storage capacity;
instructing the second storage server to cache the user-requested content into the selected partition; and
adding to a record of a cache queue, a URL hash value of the first URL, a partition hash value of the partition, and popularity information corresponding to the first URL.

### Claim 9 (depends on 1)

The method of claim 1, wherein each partition in the content delivery system corresponds to one virtual server, and wherein the method further comprises:
determining that a partition storage capacity of a partition corresponding to the first URL is full;
determining that storage capacities of the plurality of partitions are all full;
querying a cache queue for a record having a popularity that is lower than a first threshold; and
instructing, according to the cache queue, a storage server corresponding to a partition in the record to delete content corresponding to a URL in the record.

### Claim 10 (depends on 8)

The method of claim 8, wherein each partition of a plurality of partitions has a plurality of partition hash values, wherein one partition hash value of each partition corresponds to one virtual server, and wherein after redirecting the first request message to the second storage server, the method further comprises:
receiving, from the second storage server to which the partition belongs, notification information indicating that the partition is full when the partition storage capacity is full; and
sending a deletion notification carrying a URL of to-be-deleted content in a partition managed by the first virtual server and having a popularity that is lower than a second threshold to the second storage server, wherein the deletion notification instructs the second storage server to determine, according to popularity information indicating the popularity of the to-be-deleted content, whether to delete the to-be-deleted content.

### Claim 11

A content delivery system, comprising:
a first virtual server, wherein the first virtual server comprises:
a memory configured to stored instructions; and
a processor configured to execute the instructions, which cause the first virtual server to be configured to:
manage a first storage server and a second storage server;
receive a first request message comprising a first uniform resource locator (URL) of user-requested content from a content requester;
determine, according to a cache list maintained by the first virtual server, that neither the first storage server nor the second storage server caches the user-requested content;
determine, according to a consistent hashing algorithm, that the second storage server is configured to cache the user-requested content; and
redirect the first request message to the second storage server in response the second storage server being configured to cache the user-requested content,
wherein the first request message instructs the second storage server to retrieve the user-requested content and send the retrieved user-requested content to the content requester.

### Claim 12 (depends on 11)

The content delivery system of claim 11, wherein the instructions further cause the first virtual server to be configured to:
receive a second request message carrying a second URL of second user-requested content from the content requester;
determine, according to the cache list, that either the first storage server or the second storage server has cached the second user-requested content;
when the first storage server has cached the second user-requested content, redirect the second request message to the first storage server, wherein the second request message instructs the first storage server to send the second user-requested content to the content requester.

### Claim 13 (depends on 11)

The content delivery system of claim 11, wherein before the first virtual server determines that neither the first storage server nor the second storage server caches the user-requested content, the instructions further cause the first virtual server to be configured to determine, according to the first URL, that the first virtual server processes the first URL.

### Claim 14 (depends on 11)

The content delivery system of claim 11, wherein the instructions further cause the first virtual server to be configured to:
receive a third request message carrying a third URL of third user-requested content from the content requester;
determine, according to the third URL, that a second virtual server processes the third URL; and
redirect the third request message to the second virtual server.

### Claim 15 (depends on 11)

The content delivery system of claim 11, wherein the instructions further cause the first virtual server to be configured to:
compute, according to the first URL, a URL hash value of the first URL;
obtain partition hash values of all partitions in a distributed database;
query, based on the consistent hashing algorithm according to the URL hash value of the first URL, for a partition corresponding to the first URL, wherein each storage server in the content delivery system is divided into at least one partition; and
determine, according to a partition hash value of the partition and a correspondence stored in the distributed database between the partition hash value and a server hash value of a virtual server, that the first virtual server processes the first URL.

### Claim 16 (depends on 11)

The content delivery system of claim 11, wherein each of the first storage server and the second storage server comprises at least one partition, and wherein after the first virtual server redirects the first request message to the second storage server, the instructions further cause the first virtual server to be configured to:
determine that a partition storage capacity of a partition corresponding to the first URL is not full; and
instruct the second storage server to cache the user-requested content into the partition.

### Claim 17 (depends on 11)

The content delivery system of claim 11, wherein each partition in the content delivery system corresponds to one virtual server, and wherein the instructions further cause the first virtual server to be configured to:
determine that a partition storage capacity of a partition corresponding to the first URL is full;
determine that an available storage capacity of at least one of a plurality of partitions managed by the first virtual server is not full;
select a selected partition of the plurality of partitions that have the available storage capacity;
instruct the second storage server to cache the user-requested content into the selected partition; and
add, to a record of a cache queue, a URL hash value of the first URL, a partition hash value of the partition, and popularity information corresponding to the first URL.

### Claim 18 (depends on 11)

The content delivery system of claim 11, wherein each partition in the content delivery system corresponds to one virtual server, and wherein the instructions further cause the first virtual server to be configured to:
determine that a partition storage capacity of a partition corresponding to the first URL is full;
determine that storage capacities of the plurality of partitions are all full;
query a cache queue for a record having a popularity that is lower than a first threshold; and
instruct, according to the cache queue, a storage server corresponding to a partition in the record to delete content corresponding to a URL in the record.

### Claim 19 (depends on 17)

The content delivery system of claim 17, wherein each partition of a plurality of partitions has a plurality of partition hash values, wherein one partition hash value of each partition corresponds to one virtual server, and wherein after the first virtual server redirects the first request message to the second storage server, the instructions further cause the first virtual server to be configured to:
receive, from the second storage server to which the partition belongs, notification information indicating that the partition is full when the partition storage capacity is full; and
send a deletion notification carrying a URL of to-be-deleted content in a partition managed by the first virtual server and having a popularity that is lower than a second threshold to the second storage server, wherein the deletion notification instructs the second storage server to determine, according to popularity information indicating the popularity of the to-be-deleted content, whether to delete the to-be-deleted content.

### Claim 20

A computer program product comprising computer-executable instructions stored on a non-transitory computer-readable storage medium storage that, wherein the non-transitory medium storage comprise computer program instructions, when executed by a processor reads the computer program instructions to perform, cause an apparatus comprising a first virtual server to:
manage a first storage server and a second storage server;
receive a first request message comprising a first uniform resource locator (URL) of user-requested content from a content requester;
determine, according to a cache list maintained by the first virtual server, that neither the first storage server nor the second storage server caches the user-requested content;
determine, according to a consistent hashing algorithm, that the second storage server is configured to cache the user-requested content; and
redirect the first request message to the second storage server in response the second storage server being configured to cache the user-requested content,
wherein the first request message instructs the second storage server to retrieve the user-requested content and send the retrieved user-requested content to the content requester.
