# US 2025/0097721 A1 · Determination of a machine learning model to be used for a given purpose related to a communication system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0097721 A1
- Document ID: US20250097721A1
- Status: Published application
- Kind: A1
- Application number: 18/570,635
- Filed: 2022-08-30
- Published: 2025-03-20
- Earliest claimed: 2022-08-30
- Assignees: Rakuten Mobile, Inc.
- Applicants: Rakuten Mobile, Inc.
- Inventors: Shinya KITA
- Web page: https://patentgrep.com/patent/US20250097721A1

## CPC

- H04W 16/22: Traffic simulation tools or models
- G06N 20/00: Machine learning
- H04W 24/02: Arrangements for optimising operational condition
- H04W 24/08: Testing, {supervising or monitoring} using real traffic
- H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

It is enabled that accurate determination of a machine learning model suitable for a communication system from among a plurality of machine learning models to be used for a given prediction purpose related to the communication system. An AI (70) inputs, to each of a plurality of trained machine learning models, input data corresponding to the machine learning model, and acquires a predicted value as an output of the machine learning model. The AI (70) evaluates an accuracy of a prediction related to the prediction purpose by the machine learning model based on the acquired predicted value and, of test data, a part indicating an actual result value corresponding to the predicted value. The AI (70) determines at least one machine learning model among the plurality of trained machine learning models based on a result of the evaluation of the accuracy.

## Claims

### Claim 1

A model determination system, comprising one or more processors, the model determination system causing at least one of the one or more processors to execute:
a test data acquisition process of acquiring test data indicating a time series of actual result values of a plurality of types of performance index values related to a communication system;
a predicted value acquisition process of inputting, to each of a plurality of trained machine learning models to be used for a given prediction purpose related to the communication system, input data corresponding to the machine learning model and acquiring a predicted value for a prediction time point, the input data being a part of the test data, the input data indicating the actual result value for at least one of time points with respect to at least one of the plurality of types of performance index values, pieces of the input data to be input to the plurality of trained machine learning models being different from each other, and the prediction time point being later than any one of the time points;
a prediction accuracy evaluation process of evaluating, for each of the plurality of trained machine learning models, an accuracy of a prediction related to the given prediction purpose by the machine learning model based on the acquired predicted value and, of the test data, a part indicating the actual result value at the prediction time point of the at least one of the plurality of types corresponding to the predicted value; and
a model determination process of determining at least one machine learning model among the plurality of trained machine learning models based on a result of the evaluation of the accuracy.

### Claim 2 (depends on 1)

The model determination system according to claim 1,
wherein the machine learning model outputs the predicted value of at least one of the plurality of types of performance index values, and
wherein a type of the actual result value indicated by the input data and a type of the predicted value are different.

### Claim 3 (depends on 1)

The model determination system according to claim 1,
wherein the machine learning model outputs the predicted value of at least one of the plurality of types of performance index values, and
wherein a type of the actual result value indicated by the input data and a type of the predicted value are the same.

### Claim 4 (depends on 1)

The model determination system according to claim 1, wherein the model determination system causes the at least one of the one or more processors to execute a learning process of generating the plurality of trained machine learning models by executing learning which uses data that is different from the test data and that indicates the actual result values of the plurality of types of performance index values related to the communication system.

### Claim 5 (depends on 1)

The model determination system according to claim 1,
wherein the model determination system causes the at least one of the one or more processors to execute:
a monitoring process of monitoring at least one type of performance index value related to the communication system; and
an additional performance index value type identification process of identifying, for each of the plurality of trained machine learning models, an additional performance index value type which is a type of performance index value which is required to be added to targets of the monitoring in order to use the machine learning model, and
wherein, in the model determination process, the machine learning model is determined based on the result of the evaluation of the accuracy and the additional performance index value type.

### Claim 6 (depends on 5)

The model determination system according to claim 5, wherein the model determination system causes the at least one of the one or more processors to execute a monitoring target addition process of adding, to monitoring targets in the monitoring process, the performance index value of the additional performance index value type which is required to be added in order to use the determined machine learning model.

### Claim 7 (depends on 1)

The model determination system according to claim 1, wherein the model determination system is configured to cause the at least one of the one or more processors to execute:
a monitoring process of monitoring at least one type of performance index value related to the communication system; and
a monitoring target addition process of adding, to monitoring targets in the monitoring process, a type of performance index value which is required to be added in order to use the determined machine learning model.

### Claim 8 (depends on 1)

The model determination system according to claim 1, wherein the model determination system causes the at least one of the one or more processors to execute a prediction process of predicting the performance index value of the communication system by using the determined machine learning model.

### Claim 9 (depends on 1)

The model determination system according to claim 1, wherein, in the model determination process, for each of a plurality of time slots, the machine learning model to be used in prediction in the time slot is determined.

### Claim 10

A model determination method, comprising:
acquiring test data indicating a time series of actual result values of a plurality of types of performance index values related to a communication system;
inputting, to each of a plurality of trained machine learning models to be used for a given prediction purpose related to the communication system, input data corresponding to the machine learning model and acquiring a predicted value for a prediction time point, the input data being a part of the test data, the input data indicating the actual result value for at least one of time points with respect to at least one of the plurality of types of performance index values, pieces of the input data to be input to the plurality of trained machine learning models being different from each other, and the prediction time point being later than any one of the time points;
evaluating, for each of the plurality of trained machine learning models, an accuracy of a prediction related to the given prediction purpose by the machine learning model based on the acquired predicted value and, of the test data, a part indicating the actual result value at the prediction time point of the at least one of the plurality of types corresponding to the predicted value; and
determining at least one machine learning model among the plurality of trained machine learning models based on a result of the evaluation of the accuracy.
