# US 2025/0148296 A1 · Fine-tuning an ai model

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0148296 A1
- Document ID: US20250148296A1
- Status: Published application
- Kind: A1
- Application number: 18/538,271
- Filed: 2023-12-13
- Published: 2025-05-08
- Earliest claimed: 2023-11-08
- Assignees: International Business Machines Corporation
- Applicants: International Business Machines Corporation
- Inventors: Aladin Djuhera; Fernando Luiz Koch; Martin Junghans; Alecio Pedro Delazari Binotto
- Web page: https://patentgrep.com/patent/US20250148296A1

## CPC

- G06N 3/098: Distributed learning, e.g. federated learning
- G06N 3/045: Combinations of networks
- G06N 20/00: Machine learning
- G06N 20/20: Ensemble learning
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

Aspects of the present invention, determine, by a specific first computer system of the first computer systems, a need to fine-tune a first artificial intelligence model for performing a specific task; perform a federated learning for a set of trained second artificial intelligence models for generating a combined artificial intelligence model, the second artificial intelligence models being configured to perform the specific task, each second artificial intelligence model having a structure which is at least a substructure of the first artificial intelligence model; and use learnable parameters of the combined artificial intelligence model for fine-tuning at the specific first computer system the first artificial intelligence model.

## Claims

### Claim 1

A method in a distributed system comprising first computer systems that are configured to connect to at least one second computer system of the distributed system, the method comprising:
determining, by a specific first computer system of the first computer systems, a need to fine-tune a first artificial intelligence model for performing a specific task;
performing a federated learning for a set of trained second artificial intelligence models for generating a combined artificial intelligence model, the set of trained second artificial intelligence models being configured to perform the specific task, each second artificial intelligence model having a structure that is at least a substructure of the first artificial intelligence model; and
using learnable parameters of the combined artificial intelligence model for fine-tuning, at the specific first computer system, the first artificial intelligence model.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
selecting the set of second artificial intelligence models from a larger set of second artificial intelligence models based on the specific task.

### Claim 3 (depends on 1)

The method of claim 1, the set of second artificial intelligence models being a subset of a larger set of second artificial intelligence models, wherein the set of second artificial intelligence models are described by model attributes, the method further comprising:
evaluating the model attributes for the larger set of second artificial intelligence models;
storing, in a database, records representing the larger set of second artificial intelligence models, the records comprising the evaluated model attributes;
indexing the database using one or more of the model attributes, resulting in an index; and
using the index and the specific task for identifying the set of trained second artificial intelligence models.

### Claim 4 (depends on 3)

The method of claim 3, wherein the evaluating and the storing are performed on a periodic basis.

### Claim 5 (depends on 3)

The method of claim 3, further comprising:
logging changes to the database in a log file, using the log file for tracking changes to the database; and
using the index based on the tracked changes.

### Claim 6 (depends on 5)

The method of claim 5, wherein using the index comprising:
evaluating at least part of the model attributes for the first artificial intelligence model;
defining a query based on the evaluated model attributes;
querying the database using the index and the defined query;
receiving a response of the query comprising candidate second artificial intelligence models; and
selecting the set of trained second artificial intelligence models from the candidate second artificial intelligence models using a selection criterion.

### Claim 7 (depends on 6)

The method of claim 6, wherein the candidate second artificial intelligence models have a matching level with the defined query that is higher than a minimum threshold.

### Claim 8 (depends on 7)

The method of claim 7, the threshold being defined by the specific first computer system.

### Claim 9 (depends on 6)

The method of claim 6, the selection criterion requiring an inference accuracy of the candidate second artificial intelligence model that is better than an accuracy threshold.

### Claim 10 (depends on 1)

The method of claim 1, the federated learning being performed by aggregating learnable parameters of the set of second artificial intelligence models.

### Claim 11 (depends on 10)

The method of claim 10, wherein the aggregating is done using a weighted sum, wherein weights are inference accuracies of the set of second artificial intelligence models, respectively.

### Claim 12 (depends on 1)

The method of claim 1, wherein the first computer system has an amount of processing resources that is smaller than the processing resources of the at least one second computer system.

### Claim 13 (depends on 1)

The method of claim 1, the distributed system being a wireless communication system, wherein the first computer systems are multi-access edge computing (MEC) nodes and the at least one second computer system is a cloud system.

### Claim 14 (depends on 1)

The method of claim 1, wherein each artificial intelligence model is a foundation model.

### Claim 15

A computer program product for a distributed system comprising first computer systems which are configured to connect to at least one second computer system of the distributed system, the computer program product comprising a computer-readable storage medium having computer-readable program code embodied therewith, the computer-readable program code configured to perform a method comprising:
determining, by a specific first computer system of the first computer systems, a need to fine-tune a first artificial intelligence model for performing a specific task;
performing a federated learning for a set of trained second artificial intelligence models for generating a combined artificial intelligence model, the set of trained second artificial intelligence models being configured to perform the specific task, each second artificial intelligence model having a structure that is at least a substructure of the first artificial intelligence model; and
using learnable parameters of the combined artificial intelligence model for fine-tuning, at the specific first computer system, the first artificial intelligence model.

### Claim 16

A computer system for a distributed system comprising first computer systems which are configured to connect to at least one second computer system of the distributed system, the computer system comprising one or more computer-readable storage media configured to store computer program code, and one or more computer processors configured to access said computer program code and operate as instructed by said computer program code, said computer program code being configured for:
determining a need to fine-tune a first artificial intelligence model for performing a specific task;
performing a federated learning for a set of trained second artificial intelligence models for generating a combined artificial intelligence model, the second artificial intelligence models being configured to perform the specific task, each second artificial intelligence model having a structure which is at least a substructure of the first artificial intelligence model; and
using learnable parameters of the combined artificial intelligence model for fine-tuning the first artificial intelligence model.

### Claim 17 (depends on 16)

The computer system of claim 16, being a first computer system of the first computer systems.
