# US 2024/0202592 A1 · Method of supporting dynamic splitting execution of machine learning model in communication system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0202592 A1
- Document ID: US20240202592A1
- Status: Published application
- Kind: A1
- Application number: 18/527,498
- Filed: 2023-12-04
- Published: 2024-06-20
- Earliest claimed: 2022-12-14
- Assignees: Electronics and Telecommunications Research Institute
- Applicants: Electronics and Telecommunications Research Institute
- Inventors: Tae Chul Hong
- Web page: https://patentgrep.com/patent/US20240202592A1

## CPC

- G06F 9/4881: {Scheduling strategies for dispatcher, e.g. round robin, multi-level priority queues}
- G06N 20/00: Machine learning
- G06F 9/5061: {Partitioning or combining of resources}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

A method of supporting dynamic splitting execution of a machine learning model in a communication system is provided. The method includes transmitting device information to the service server by using the edge device, determining a splitting execution type of the machine learning model and transmitting splitting execution information including the determined splitting execution type to the edge device by using the service server, based on the device information, and performing an arithmetic operation on the machine learning model by using at least one of the edge device and the service server, based on the determined splitting execution type.

## Claims

### Claim 1

A method of supporting dynamic splitting execution of a machine learning model in a communication system including an edge device and a service server connected with each other over a communication network, the method comprising:
transmitting device information to the service server by using the edge device;
determining a splitting execution type of the machine learning model and transmitting splitting execution information including the determined splitting execution type to the edge device by using the service server, based on the device information; and
performing an arithmetic operation on the machine learning model by using at least one of the edge device and the service server, based on the determined splitting execution type.

### Claim 2 (depends on 1)

The method of claim 1, wherein the splitting execution information comprises information representing one of a type where the edge device performs all arithmetic operations on the machine learning model, a type where the service server performs all arithmetic operations on the machine learning model, and a type where the edge device and the service server split and perform all arithmetic operations on the machine learning model.

### Claim 3 (depends on 1)

The method of claim 1, wherein the splitting execution information comprises layer information representing layers allocated to each of the edge device among a plurality of layers included in the machine learning model and layer information representing layers allocated to the service server among the plurality of layers.

### Claim 4 (depends on 1)

The method of claim 1, wherein the performing of the arithmetic operation on the machine learning model comprises performing an arithmetic operation on all layers included in the machine learning model, based on the determined splitting execution type.

### Claim 5 (depends on 1)

The method of claim 1, wherein the performing of the arithmetic operation on the machine learning model comprises performing an arithmetic operation on all layers included in the machine learning model by using the service server, based on the determined splitting execution type.

### Claim 6 (depends on 1)

The method of claim 1, wherein the performing of the arithmetic operation on the machine learning model comprises performing an arithmetic operation on some of all layers included in the machine learning model by using the edge device and performing an arithmetic operation on the other layers by using the service server.

### Claim 7

A method of supporting dynamic splitting execution of a machine learning model in a communication system including an edge device and a service server connected with each other over a communication network, the method comprising:
changing a splitting execution type of the machine learning model previously determined based on a resource status change of the edge device by using the edge device;
transmitting splitting execution change information including the changed splitting execution type to the service server by using the edge device; and
changing an operation scheme of the machine learning model by using at least one of the edge device and the service server, based on the changed splitting execution type.

### Claim 8 (depends on 7)

The method of claim 7, wherein the changing of the operation scheme of the machine learning model comprises changing a scheme, which performs an arithmetic operation on all layers included in the machine learning model by using the edge device, to a scheme which performs an arithmetic operation on all layers included in the machine learning model by using the service server.

### Claim 9 (depends on 7)

The method of claim 7, wherein the changing of the operation scheme of the machine learning model comprises changing a scheme, which performs an arithmetic operation on all layers included in the machine learning model by using the service server, to a scheme which performs an arithmetic operation on all layers included in the machine learning model by using the edge device.

### Claim 10 (depends on 7)

The method of claim 7, wherein the changing of the operation scheme of the machine learning model comprises changing the number of layers allocated to the edge device and the number of layers allocated to the service server among all layers included in the machine learning model.

### Claim 11

A method of supporting dynamic splitting execution of a machine learning model in a communication system including an edge device and a service server connected with each other over a communication network, the method comprising:
transmitting splitting execution information including a splitting execution type of the machine learning model to the service server and the network management server by using the edge device;
performing an arithmetic operation on the machine learning model by using at least one of the edge device and the service server, based on the splitting execution type;
monitoring a current communication session generated between the edge device and the service server to determine a current communication quality class of the current communication session by using the network management server;
configuring a final communication session by using the network management server, based on a result of comparison of the current communication quality class and a reference communication quality class; and
performing data communication for performing an arithmetic operation on the machine learning model by using the edge device and the service server, based on the configured final communication session.

### Claim 12 (depends on 11)

The method of claim 11, wherein the splitting execution information comprises a splitting execution type changed based on a resource status change of the edge device.

### Claim 13 (depends on 11)

The method of claim 11, further comprising determining a reference communication quality class for smoothly supporting the splitting execution type by using the network management server.

### Claim 14 (depends on 13)

The method of claim 13, wherein the determining of the reference communication quality class comprises calculating the reference communication quality class, based on a mapping table where a mapping relationship between the splitting execution type and a communication quality class is previously defined.

### Claim 15 (depends on 11)

The method of claim 11, wherein the configuring of the final communication session comprises:
when the current communication quality class is equal to the reference communication quality class, configuring the current communication session as the final communication session; and
when the current communication quality class differs from the reference communication quality class, configuring a new communication session as the final communication session.

### Claim 16

A method of supporting dynamic splitting execution of a machine learning model in a communication system including an edge device and a service server connected with each other over a communication network, the method comprising:
configuring a communication session for performing data communication by using the edge device and the service server;
changing a splitting execution type of the machine learning model by using one of the edge device and the service server, based on a resource status thereof;
sharing the changed splitting execution type over the communication network by using the edge device and the service server;
performing data communication based on the changed splitting execution type to perform an arithmetic operation on the machine learning model by using the edge device and the service server;
monitoring data traffic based on the data communication to determine whether to change the splitting execution type, by using the network management server; and
in a case where the network management server determines whether to change the splitting execution type, updating the communication session to a communication quality class for smoothly supporting the changed splitting execution type by using a data transfer device, based on a result of the determination of the network management server.

### Claim 17 (depends on 16)

The method of claim 16, wherein the determining whether to change the splitting execution type comprises monitoring a level change of the data traffic and a destination change of the data traffic to determine whether to change the splitting execution type.

### Claim 18 (depends on 16)

The method of claim 16, wherein the determining whether to change the splitting execution type comprises:
calculating a movement average value of the data traffic during a certain period; and
determining whether to change the splitting execution type, based on a result of comparison of the movement average value and a reference value.

### Claim 19 (depends on 18)

The method of claim 18, wherein the reference value is a value which is previously set for determining whether to change the splitting execution type.

### Claim 20 (depends on 16)

The method of claim 16, wherein the updating of the communication session comprises updating routing information about a user plane function (UPF) so that the data transfer device transfers the data traffic to a changed destination, based on the changed splitting execution type.
