# US 2026/0228051 A1 · Task execution method and apparatus, storage medium and electronic device

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0228051 A1
- Document ID: US20260228051A1
- Status: Published application
- Kind: A1
- Application number: 19/150,891
- Filed: 2023-06-30
- Published: 2026-08-06
- Earliest claimed: 2023-03-29
- Assignees: Zhejiang Lab
- Applicants: Zhejiang Lab
- Inventors: Lingfang ZENG; Zhiguang CHEN; Wen CHENG; Yong LI; Guang CHEN
- Web page: https://patentgrep.com/patent/US20260228051A1

## CPC

- G06F 9/5044: {considering hardware capabilities}
- G06F 9/4881: {Scheduling strategies for dispatcher, e.g. round robin, multi-level priority queues}
- G06F 9/4887: {involving deadlines, e.g. rate based, periodic}
- G06F 9/50: Allocation of resources, e.g. of the central processing unit [CPU]
- G06F 9/5027: {the resource being a machine, e.g. CPUs, Servers, Terminals}
- G06F 9/5038: {considering the execution order of a plurality of tasks, e.g. taking priority or time dependency constraints into consideration (scheduling strategies G06F9/4881 and subgroups)}
- G06F 9/505: {considering the load}
- G06F 9/5066: {Algorithms for mapping a plurality of inter-dependent sub-tasks onto a plurality of physical CPUs (mappping at compile time, see G06F8/451)}
- G06F 9/5072: {Grid computing}
- G06F 2209/501: Performance criteria
- G06F 2209/5017: Task decomposition
- G06F 2209/509: Offload
- Y02D 10/00: Energy efficient computing, e.g. low power processors, power management or thermal management
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- Y02D: CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE

## Abstract

Task execution methods and apparatuses, storage media and electronic devices are provided. The task execution method includes: determining a computing task corresponding to each of network layers in the target model, determining device information corresponding to a plurality of computing devices participating in a calculation of the target model; for each of the network layers, determining computing time required for executing a computing task corresponding to the network layer by the plurality of computing devices; determining a target device corresponding to the network layer according to at least one of the computing time, data transmission time between a computing device corresponding to a previous network layer and other computing devices, memory space required by data of the network layer or remaining memory of each of the computing devices, and executing the computing task by the target device after receiving an execution request of the computing task.

## Claims

### Claim 1

A task execution method, comprising:
acquiring model data of a target model;
parsing the model data, determining a computing task corresponding to each of network layers in the target model, and determining device information corresponding to a plurality of computing devices participating in a calculation of the target model, wherein the computing device comprises at least one central processing unit (CPU) and at least one graphic processing unit (GPU);
for each of the network layers, determining computing time required for executing a computing task corresponding to the network layer by the plurality of computing devices according to a number of calculations involved in executing the computing task corresponding to the network layer and the device information corresponding to the plurality of computing devices;
for each of the network layers, determining a computing device executing the computing task corresponding to the network layer as a target device corresponding to the network layer according to at least one of the computing time, data transmission time between a computing device executing a computing task corresponding to a previous network layer and other computing devices, memory space required by data of the network layer or remaining memory of the plurality of computing devices, wherein the data transmission time is determined according to an amount of data outputted by the previous network layer and transmission information between the computing device executing the computing task corresponding to the previous network layer and the other computing devices; and
deploying the computing task corresponding to each of the network layers in the target model in a target device corresponding to each of the network layers, so as to execute the computing task by the target device after receiving an execution request of the computing task corresponding to each of the network layers.

### Claim 2 (depends on 1)

The method according to claim 1, wherein before the determining the computing device executing the computing task corresponding to the network layer, the method further comprising:
determining at least one execution unit in each of the plurality of computing devices to obtain a plurality of execution units; and
determining computing power corresponding to each of the plurality of execution units according to the device information corresponding to the plurality of computing devices.

### Claim 3 (depends on 2)

The method according to claim 2, wherein, for each of the network layers, determining the computing time required for executing the computing task corresponding to the network layer by the plurality of computing devices according to the number of calculations involved in executing the computing task corresponding to the network layer and the device information corresponding to the plurality of computing devices comprises:
for each of the network layers, determining computing time required for executing the computing task corresponding to the network layer by each of the execution units according to the number of calculations involved in executing the computing task corresponding to the network layer and the computing power corresponding to each of the execution units.

### Claim 4 (depends on 3)

The method according to claim 3, wherein the determining the computing device executing the computing task corresponding to the network layer as the target device corresponding to the network layer according to at least one of the computing time, the data transmission time between the computing device executing the computing task corresponding to the previous network layer and the other computing devices, the memory space required by the data of the network layer or the remaining memory of the plurality of computing devices comprises:
determining an execution unit executing the computing task corresponding to the network layer as a target execution unit corresponding to the network layer according to at least one of the computing time corresponding to each of the execution units, data transmission time between a reference execution unit and other execution units, the memory space or the remaining memory, wherein the reference execution unit comprises an execution unit executing the computing task corresponding to the previous network layer; and
wherein the deploying the computing task corresponding to each of the network layers in the target model in the target device corresponding to each of the network layers, so as to execute the computing task by the target device after receiving the execution request of the computing task corresponding to each of the network layers comprises:
deploying the computing task corresponding to each of the network layers in a target device where a target execution unit corresponding to each of the network layers is located, so as to execute the computing task by the target execution unit after receiving the execution request of the computing task corresponding to each of the network layers.

### Claim 5 (depends on 4)

The method according to claim 4, wherein the data transmission time is determined according to transmission information between the reference execution unit and other execution units and the amount of data outputted by the previous network layer.

### Claim 6 (depends on 4)

The method according to claim 4, wherein the determining the execution unit executing the computing task corresponding to the network layer as the target execution unit corresponding to the network layer according to at least one of the computing time corresponding to each of the execution units, the data transmission time between the reference execution unit and the other execution units, the memory space or the remaining memory comprises:
in response to determining that the network layer is not an initial network layer of the target model, for each of the execution units, determining comprehensive time corresponding to the execution unit according to computing time corresponding to the execution unit and data transmission time corresponding to the execution unit;
determining one or more candidate execution units among the plurality of execution units, wherein each of the candidate execution units is an execution unit where remaining memory of a corresponding computing device is larger than the memory space, and corresponding comprehensive time is less than required computing time when executing the computing task corresponding to the network layer by the reference execution unit; and
determining the target execution unit corresponding to the network layer according to comprehensive time corresponding to each of the candidate execution units.

### Claim 7 (depends on 4)

The method according to claim 4, wherein the determining the execution unit executing the computing task corresponding to the network layer as the target execution unit corresponding to the network layer according to at least one of the computing time corresponding to each of the execution units, the data transmission time between the reference execution unit and the other execution units, the memory space or the remaining memory comprises:
in response to determining that the network layer is an initial network layer of the target model, determining one or more candidate execution units;
determining computing time corresponding to each of the candidate execution units according to the number of calculations involved in executing the computing task corresponding to the network layer and computing power corresponding to each of the candidate execution units; and
determining the target execution unit corresponding to the network layer according to the computing time corresponding to each of the candidate execution units.

### Claim 8 (depends on 7)

The method according to claim 7, wherein the determining the one or more candidate execution units comprises:
determining one or more execution units with remaining memory larger than the memory space as the one or more candidate execution units.

### Claim 9 (depends on 4)

The method according to claim 4, further comprising:
for each of the network layers, in response to determining that at least two transmission modes exist between the target execution unit corresponding to the network layer and a target execution unit corresponding to an adjacent network layer of the network layer, monitoring a transmission state of a current transmission mode;
determining whether the current transmission mode is to be adjusted according to the transmission state; and
in response to determining that the current transmission mode is to be adjusted, adjusting the current transmission mode to another transmission mode.

### Claim 10 (depends on 4)

The method according to claim 4, further comprising:
determining transmission modes among the plurality of execution units and a bandwidth corresponding to each of the transmission modes, wherein the transmission mode comprises: at least one of a first transmission mode or a second transmission mode.

### Claim 11 (depends on 10)

The method according to claim 10, further comprising:
in response to determining that the target execution unit corresponding to the network layer and a target execution unit corresponding to an adjacent network layer are related to the GPU, and the second transmission mode exists between the target execution unit corresponding to the network layer and the target execution unit corresponding to the adjacent network layer, transmitting data between the network layer and the adjacent network layer by the second transmission mode, or
in response to determining that the target execution unit corresponding to the network layer and a target execution unit corresponding to an adjacent network layer are not related to the GPU, or the second transmission mode does not exist between the target execution unit corresponding to the network layer and the target execution unit corresponding to the adjacent network layer, transmitting the data between the network layer and the adjacent network layer by the first transmission mode.

### Claim 12 (depends on 10)

The method according to claim 10, wherein the first transmission mode comprises a peripheral component interconnect express (PCI-e), and the second transmission mode comprises an NVLINK.

### Claim 13

(canceled)

### Claim 14

A non-transitory computer-readable storage medium, wherein the non-transitory computer-readable storage medium stores a computer program which, when executed by a processor, configured to:
acquire model data of a target model;
parse the model data, determine a computing task corresponding to each of network layers in the target model, and determine device information corresponding to a plurality of computing devices participating in a calculation of the target model, wherein the computing device comprises at least one central processing unit (CPU) and at least one graphic processing unit (GPU);
for each of the network layers, determine computing time required for executing a computing task corresponding to the network layer by the plurality of computing devices according to a number of calculations involved in executing the computing task corresponding to the network layer and the device information corresponding to the plurality of computing devices;
for each of the network layers, determine a computing device executing the computing task corresponding to the network layer as a target device corresponding to the network layer according to at least one of the computing time, data transmission time between a computing device executing a computing task corresponding to a previous network layer and other computing devices, memory space required by data of the network layer or remaining memory of the plurality of computing devices, wherein the data transmission time is determined according to an amount of data outputted by the previous network layer and transmission information between the computing device executing the computing task corresponding to the previous network layer and the other computing devices; and
deploy the computing task corresponding to each of the network layers in the target model in a target device corresponding to each of the network layers, so as to execute the computing task by the target device after receiving an execution request of the computing task corresponding to each of the network layers.

### Claim 15

An electronic device, comprising a memory, a processor and a computer program stored in the memory and executable on the processor, wherein the processor, when executing the computer program, is configured to:
acquire model data of a target model;
parse the model data, determine a computing task corresponding to each of network layers in the target model, and determine device information corresponding to a plurality of computing devices participating in a calculation of the target model, wherein the computing device comprises at least one central processing unit (CPU) and at least one graphic processing unit (GPU);
for each of the network layers, determine computing time required for executing a computing task corresponding to the network layer by the plurality of computing devices according to a number of calculations involved in executing the computing task corresponding to the network layer and the device information corresponding to the plurality of computing devices;
for each of the network layers, determine a computing device executing the computing task corresponding to the network layer as a target device corresponding to the network layer according to at least one of the computing time, data transmission time between a computing device executing a computing task corresponding to a previous network layer and other computing devices, memory space required by data of the network layer or remaining memory of the plurality of computing devices, wherein the data transmission time is determined according to an amount of data outputted by the previous network layer and transmission information between the computing device executing the computing task corresponding to the previous network layer and the other computing devices; and
deploy the computing task corresponding to each of the network layers in the target model in a target device corresponding to each of the network layers, so as to execute the computing task by the target device after receiving an execution request of the computing task corresponding to each of the network layers.

### Claim 16 (depends on 15)

The electronic device according to claim 15, wherein the processor is further configured to:
determine at least one execution unit in each of the plurality of computing devices to obtain a plurality of execution units; and
determine computing power corresponding to each of the plurality of execution units according to the device information corresponding to the plurality of computing devices.

### Claim 17 (depends on 16)

The electronic device according to claim 16, wherein the processor is further configured to:
for each of the network layers, determine computing time required for executing the computing task corresponding to the network layer by each of the execution units according to the number of calculations involved in executing the computing task corresponding to the network layer and the computing power corresponding to each of the execution units.

### Claim 18 (depends on 17)

The electronic device according to claim 17, wherein the processor is further configured to:
determine an execution unit executing the computing task corresponding to the network layer as a target execution unit corresponding to the network layer according to at least one of the computing time corresponding to each of the execution units, data transmission time between a reference execution unit and other execution units, the memory space or the remaining memory, wherein the reference execution unit comprises an execution unit executing the computing task corresponding to the previous network layer; and
wherein the deploy the computing task corresponding to each of the network layers in the target model in the target device corresponding to each of the network layers, so as to execute the computing task by the target device after receiving the execution request of the computing task corresponding to each of the network layers comprises:
deploy the computing task corresponding to each of the network layers in a target device where a target execution unit corresponding to each of the network layers is located, so as to execute the computing task by the target execution unit after receiving the execution request of the computing task corresponding to each of the network layers.

### Claim 19 (depends on 18)

The electronic device according to claim 18, wherein the processor is further configured to:
in response to determining that the network layer is not an initial network layer of the target model, for each of the execution units, determine comprehensive time corresponding to the execution unit according to computing time corresponding to the execution unit and data transmission time corresponding to the execution unit;
determine one or more candidate execution units among the plurality of execution units, wherein each of the candidate execution units is an execution unit where remaining memory of a corresponding computing device is larger than the memory space, and corresponding comprehensive time is less than required computing time when executing the computing task corresponding to the network layer by the reference execution unit; and
determine the target execution unit corresponding to the network layer according to comprehensive time corresponding to each of the candidate execution units.

### Claim 20 (depends on 18)

The electronic device according to claim 18, wherein the processor is further configured to:
in response to determining that the network layer is an initial network layer of the target model, determine one or more candidate execution units;
determine computing time corresponding to each of the candidate execution units according to the number of calculations involved in executing the computing task corresponding to the network layer and computing power corresponding to each of the candidate execution units; and
determine the target execution unit corresponding to the network layer according to the computing time corresponding to each of the candidate execution units.

### Claim 21 (depends on 18)

The electronic device according to claim 18, wherein the processor is further configured to:
for each of the network layers, in response to determining that at least two transmission modes exist between the target execution unit corresponding to the network layer and a target execution unit corresponding to an adjacent network layer of the network layer, monitor a transmission state of a current transmission mode;
determine whether the current transmission mode is to be adjusted according to the transmission state; and
in response to determining that the current transmission mode is to be adjusted, adjust the current transmission mode to another transmission mode.
