# US 2023/0418670 A1 · Service processing method and apparatus, server, storage medium and computer program product

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0418670 A1
- Document ID: US20230418670A1
- Status: Published application
- Kind: A1
- Application number: 18/462,164
- Filed: 2023-09-06
- Published: 2023-12-28
- Earliest claimed: 2021-08-02
- Assignees: Tencent Technology (Shenzhen) Company Limited
- Applicants: Tencent Technology (Shenzhen) Company Limited
- Inventors: Shili XU; Yabin Fu; Bingwu ZHONG; Yulin HU; Yanhui LU; Xiaohu MA
- Web page: https://patentgrep.com/patent/US20230418670A1

## CPC

- G06F 9/4893: {taking into account power or heat criteria (power management in computers in general G06F1/3203; thermal management in computers in general G06F1/206)}
- G06F 9/5066: {Algorithms for mapping a plurality of inter-dependent sub-tasks onto a plurality of physical CPUs (mappping at compile time, see G06F8/451)}
- G06F 9/3877: {using a secondary processor, e.g. coprocessor (peripheral processor G06F13/12)}
- G06F 9/505: {considering the load}
- G06F 9/5072: {Grid computing}
- G06F 2209/501: Performance criteria
- G06F 2209/5017: Task decomposition
- G06F 2209/503: Resource availability
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A service processing method includes determining a first computing power resource for executing an offline task, determining N edge servers which execute the offline task and on which cloud applications are running based on idle computing power resources of the N edge servers being greater than the first computing power resource, and scheduling the offline task to the N edge servers in a distributed mode while ensuring normal operation of the cloud applications, so that each edge server in the N edge servers executes the offline task using the idle computing power resource of the edge server.

## Claims

### Claim 1

A service processing method, performed by a management server, the service processing method comprising:
determining a first computing power resource for executing an offline task;
determining N edge servers configured to execute the offline task and on which cloud applications are running based on idle computing power resources of the N edge servers being greater than the first computing power resource, N being an integer greater than or equal to 1; and
scheduling the offline task to the N edge servers in a distributed mode while ensuring normal operation of the cloud applications, so that for each edge server in the N edge servers, the edge server executes the offline task using the idle computing power resource of the edge server.

### Claim 2 (depends on 1)

The service processing method according to claim 1, wherein the scheduling comprises:
dividing the offline task into N subtasks based on the idle computing power resources of the N edge servers; and
respectively allocating the N subtasks to the N edge servers, so that each edge server in the N edge servers executes a corresponding subtask.

### Claim 3 (depends on 1)

The service processing method according to claim 1, wherein the cloud applications are deployed to M edge servers for execution, the M edge servers are allocated to P edge computing nodes, and each of the P edge computing nodes is deployed with one or more edge servers, M and P being integers greater than or equal to 1; and
wherein determining the N edge servers comprises:
selecting L edge computing nodes from the P edge computing nodes such that node idle computing power resources of the L edge computing nodes are greater than the first computing power resource, the node idle computing power resource being obtained according to the idle computing power resources of the edge servers deployed in the each edge computing node;
determining at least one candidate edge server from edge servers comprised in the L edge computing nodes based on attribute information of each edge server comprised in the L edge computing nodes; and
determining the N edge servers from the at least one candidate edge server according to the idle computing power resource of each edge server in the at least one candidate edge server and the first computing power resource.

### Claim 4 (depends on 3)

The service processing method according to claim 3, wherein the attribute information of the each edge server comprises a working state of each edge server, and the working state comprises an idle state or a busy state; and
wherein determining the at least one candidate edge server comprises:
determining an edge server with the working state being the idle state of the edge servers comprised in the L edge computing nodes as a candidate edge server.

### Claim 5 (depends on 3)

The service processing method according to claim 3, wherein the attribute information of the each edge server comprises a server type group to which the each edge server belongs, and the server type group comprises a default whitelist group and an ordinary group; and
wherein the determining at least one candidate edge server comprises:
determining an edge server with the server type group being the ordinary group of the edge servers comprised in the L edge computing nodes as the candidate edge server.

### Claim 6 (depends on 2)

The service processing method according to claim 2, further comprising:
monitoring execution of the matching subtask of each edge server; and
reselecting, based on monitoring an exception in the execution of the matching subtask, a new edge server and executing the matching subtask of the new edge server.

### Claim 7 (depends on 2)

The service processing method according to claim 2, wherein a subtask corresponds to an execution duration threshold, and
wherein the method further comprises:
receiving timeout prompt information reported by any edge server based on the any edge server not being able to execute the matching subtask, the timeout prompt information indicating that a duration required for the any edge server to execute the matching subtask is greater than an execution duration threshold corresponding to the matching subtask and indicating that a new edge server needs to be reallocated to execute the matching subtask of the new edge server.

### Claim 8 (depends on 1)

The service processing method according to claim 1, wherein the first computing power resource comprises any one or more of the following: a graphics processing unit computing power resource, a central processing unit computing power resource, an internal memory, a network bandwidth, and a network throughput; and
wherein the graphics processing unit computing power resource comprises at least one of the following: floating-point operations per second of a graphics processing unit and operations per second of the graphics processing unit; and the central processing unit computing power resource comprises at least one of the following: floating-point operations per second of a central processing unit and operations per second of the central processing unit.

### Claim 9 (depends on 1)

The service processing method according to claim 1, wherein the determining the first computing power resource comprises:
determining a computation complexity corresponding to a task type of the offline task based on a correspondence between the task type and the computation complexity;
finding at least one matching historical offline task from historical offline tasks according to the determined computation complexity based on a computation complexity corresponding to the at least one matching historical offline task matching the determined computation complexity; and
estimating a computing power resource required for the offline task based on the computing power resource for executing the at least one matching historical offline task, to obtain the first computing power resource required to execute the offline task.

### Claim 10

A service processing apparatus, comprising:
at least one memory configured to store program code; and
at least one processor configured to access the at least one memory and operate according to the program code, the program code comprising:
determining code, configured to cause at least one of the at least one processor to determine a first computing power resource for executing an offline task; and determine N edge servers configured to execute the offline task and on which cloud applications are running, based on idle computing power resources of the N edge servers being greater than the first computing power resource, N being an integer greater than or equal to 1; and
scheduling code configured to cause at least one of the at least one processor to schedule the offline task to the N edge servers in a distributed mode while ensuring normal operation of the cloud applications, so that for each edge server in the N edge servers, the edge server executes the offline task using the idle computing power resource of the edge server.

### Claim 11 (depends on 10)

The service processing apparatus according to claim 10, wherein the scheduling code is further configured to cause at least one of the at least one processor to:
divide the offline task into N subtasks based on the idle computing power resources of the N edge servers; and
respectively allocate the N subtasks to the N edge servers, so that each edge server in the N edge servers executes a corresponding subtask.

### Claim 12 (depends on 10)

The service processing apparatus according to claim 10, wherein the cloud applications are deployed to M edge servers for execution, the M edge servers are allocated to P edge computing nodes, and each of the P edge computing nodes is deployed with one or more edge servers, M and P being integers greater than or equal to 1; and
wherein the determining code is further configured to cause at least one of the at least one processor to:
select L edge computing nodes from the P edge computing nodes such that node idle computing power resources of the L edge computing nodes are greater than the first computing power resource, the node idle computing power resource being obtained according to the idle computing power resources of the edge servers deployed in the each edge computing node;
determine at least one candidate edge server from edge servers comprised in the L edge computing nodes based on attribute information of each edge server comprised in the L edge computing nodes; and
determine the N edge servers from the at least one candidate edge server according to the idle computing power resource of each edge server in the at least one candidate edge server and the first computing power resource.

### Claim 13 (depends on 12)

The service processing apparatus according to claim 12, wherein the attribute information comprises a working state of each edge server, and the working state comprises an idle state or a busy state; and
wherein the determining code is further configured to cause at least one of the at least one processor to:
determine an edge server with the working state being the idle state of the edge servers comprised in the L edge computing nodes as a candidate edge server.

### Claim 14 (depends on 12)

The service processing apparatus according to claim 12, wherein the attribute information comprises a server type group to which each edge server belongs, and the server type group comprises a default whitelist group and an ordinary group; and
wherein the determining code is further configured to cause at least one of the at least one processor to:
determine an edge server with the server type group being the ordinary group of the edge servers comprised in the L edge computing nodes as the candidate edge server.

### Claim 15 (depends on 11)

The service processing apparatus according to claim 11, wherein the program code further comprises:
processing code configured to cause at least one of the at least one processor to:
monitor execution of the matching subtask of each edge server; and
reselect, based on monitoring an exception in the execution of the matching subtask, a new edge server and execute the matching subtask of the new edge server.

### Claim 16 (depends on 11)

The service processing apparatus according to claim 11, wherein a subtask corresponds to an execution duration threshold, and
wherein the program code further comprises:
receiving code configured to cause at least one of the at least one processor to receive timeout prompt information reported by any edge server based on the any edge server not being able to execute the matching subtask, the timeout prompt information indicating that a duration required for the any edge server to execute the matching subtask is greater than an execution duration threshold corresponding to the matching subtask and indicating that a new edge server needs to be reallocated to execute the matching subtask of the new edge server.

### Claim 17 (depends on 10)

The service processing apparatus according to claim 10, wherein the first computing power resource comprises any one or more of the following: a graphics processing unit computing power resource, a central processing unit computing power resource, an internal memory, a network bandwidth, and a network throughput; and
wherein the graphics processing unit computing power resource comprises at least one of the following: floating-point operations per second of a graphics processing unit and operations per second of the graphics processing unit; and the central processing unit computing power resource comprises at least one of the following: floating-point operations per second of a central processing unit and operations per second of the central processing unit.

### Claim 18 (depends on 10)

The service processing apparatus according to claim 10, wherein the determining code is further configured to cause at least one of the at least one processor to:
determine a computation complexity corresponding to a task type of the offline task based on a correspondence between the task type and the computation complexity;
find at least one matching historical offline task from historical offline tasks according to the determined computation complexity based on a computation complexity corresponding to the at least one matching historical offline task matching the determined computation complexity; and
estimate a computing power resource required for the offline task based on the computing power resource for executing the at least one matching historical offline task, to obtain the first computing power resource required to execute the offline task.

### Claim 19

A non-transitory computer-readable storage medium, storing computer code which, when executed by at least one processor, causes the at least one processor to at least:
determine a first computing power resource for executing an offline task;
determine N edge servers configured to execute the offline task and on which cloud applications are running based on idle computing power resources of the N edge servers being greater than the first computing power resource, N being an integer greater than or equal to 1; and
schedule the offline task to the N edge servers in a distributed mode while ensuring normal operation of the cloud applications, so that for each edge server in the N edge servers, the edge server executes the offline task using the idle computing power resource of the edge server.

### Claim 20 (depends on 19)

The non-transitory computer-readable storage medium to claim 19, wherein the schedule comprises:
dividing the offline task into N subtasks based on the idle computing power resources of the N edge servers; and
respectively allocating the N subtasks to the N edge servers, so that each edge server in the N edge servers executes a corresponding subtask.
