# US 2024/0005216 A1 · Using secure and reliable benefit-analysis matchmaking to select federated learning candidates

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0005216 A1
- Document ID: US20240005216A1
- Status: Published application
- Kind: A1
- Application number: 17/810,006
- Filed: 2022-06-30
- Published: 2024-01-04
- Earliest claimed: 2022-06-30
- Assignees: International Business Machines Corporation
- Applicants: International Business Machines Corporation
- Inventors: Jayaram Kallapalayam Radhakrishnan; Vinod Muthusamy; Ashish Verma; Zhongshu Gu; Gegi Thomas; Supriyo Chakraborty; Mark Purcell
- Web page: https://patentgrep.com/patent/US20240005216A1

## CPC

- G06N 3/098: Distributed learning, e.g. federated learning
- G06N 20/20: Ensemble learning
- G06F 9/5055: {considering software capabilities, i.e. software resources associated or available to the machine}
- G06F 11/3495: {for systems}
- G06N 3/045: Combinations of networks
- G06F 11/3692: {for test results analysis}
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Embodiments of the invention include a computer-implemented method that uses a processor system to access a first machine learning (ML) model. The first ML model has been trained using data of a first server. A first performance metric of the first ML model is determined using data of a second server. A benefit analysis is performed to determine a benefit of the first ML server and the second ML server participating in a federated learning system, where the benefit analysis includes using the first performance metric.

## Claims

### Claim 1

A computer-implemented method comprising:
using a processor system to access a first machine learning (ML) model that has been trained using data of a first server;
using the processor system to determine a first performance metric of the first ML model using data of a second server; and
performing a benefit analysis to determine a benefit of the first server and the second server participating in a federated learning system;
wherein the benefit analysis includes using the first performance metric.

### Claim 2 (depends on 1)

The computer-implemented method of claim 1 further comprising:
using the processor system to access a second ML model that has been trained using the data of the second server; and
using the processor system to determine a second performance metric of the second ML model using the data of the first server;
wherein the benefit analysis further includes using the second performance metric.

### Claim 3 (depends on 2)

The computer-implemented method of claim 2, wherein:
the determination of the first performance metric of the first ML model using the data of the second server is performed within a first trusted execution environment (TEE); and
the determination of the second performance metric of the second ML model using the data of the first server is performed within a second TEE.

### Claim 4 (depends on 3)

The computer-implemented method of claim 3 further comprising, subsequent to performing the benefit analysis:
deleting from the first TEE the first ML model and the data of the second server; and
deleting from the second TEE the second ML model and the data of the first server.

### Claim 5 (depends on 2)

The computer-implemented method of claim 2, wherein:
the determination of the first performance metric of the first ML model using the data of the second server is performed within a trusted execution environment (TEE); and
the determination of the second performance metric of the second ML model using the data of the first server is performed within the TEE.

### Claim 6 (depends on 5)

The computer-implemented method of claim 5 further comprising, subsequent to performing the benefit analysis, deleting from the TEE:
the first ML model;
the data of the second server;
the second ML model; and
the data of the first server.

### Claim 7 (depends on 5)

The computer-implemented method of claim 5, wherein the TEE is implemented in a cloud computing server.

### Claim 8

A computer system comprising a processor system communicatively coupled to memory, wherein the processor system is operable to perform processor system operations comprising:
accessing a first machine learning (ML) model that has been trained using data of a first server;
determining a first performance metric of the first ML model using data of a second server; and
performing a benefit analysis to determine a benefit of the first server and the second server participating in a federated learning system;
wherein the benefit analysis includes using the first performance metric.

### Claim 9 (depends on 8)

The computer system of claim 8, wherein the processor system operations further comprise:
accessing a second ML model that has been trained using the data of the second server; and
determining a second performance metric of the second ML model using data of the first server;
wherein the benefit analysis further includes using the second performance metric.

### Claim 10 (depends on 9)

The computer system of claim 9, wherein:
the determination of the first performance metric of the first ML model using the data of the second server is performed within a first trusted execution environment (TEE); and
the determination of the second performance metric of the second ML model using the data of the first server is performed within a second TEE.

### Claim 11 (depends on 10)

The computer system of claim 10, wherein the processor system operations further comprise, subsequent to performing the benefit analysis:
deleting from the first TEE the first ML model and the data of the second server; and
deleting from the second TEE the second ML model and the data of the first server.

### Claim 12 (depends on 9)

The computer system of claim 9, wherein:
the determination of the first performance metric of the first ML model using the data of the second server is performed within a trusted execution environment (TEE); and
the determination of the second performance metric of the second ML model using the data of the first server is performed within the TEE.

### Claim 13 (depends on 12)

The computer system of claim 12, wherein the processor system operations further comprise, subsequent to performing the benefit analysis, deleting from the TEE:
the first ML model;
the data of the second server;
the second ML model; and
the data of the first server.

### Claim 14 (depends on 8)

The computer system of claim 8, wherein the benefit comprises a difference between:
a first benefit that incurs to the first server based on the first server participating in the federated learning system; and
a second benefit that incurs to the second server based on the second server participating in the federated learning system.

### Claim 15

A computer program product for performing matchmaking operations on federated learning candidates, the computer program product comprising a computer readable program stored on a computer readable storage medium, wherein the computer readable program, when executed on a processor system, causes the processor system to perform a method comprising:
accessing a first machine learning (ML) model that has been trained using data of a first server;
determining a first performance metric of the first ML model using data of a second server; and
performing a benefit analysis to determine a benefit of the first server and the second server participating in a federated learning system;
wherein the benefit analysis includes using the first performance metric.

### Claim 16 (depends on 15)

The computer program product of claim 15, wherein the method further comprises:
accessing a second ML model that has been trained using the data of the second server; and
determining a second performance metric of the second ML model using the data of the first server; and
wherein the benefit analysis further includes using the second performance metric.

### Claim 17 (depends on 16)

The computer program product of claim 16, wherein:
the determination of the first performance metric of the first ML model using the data of the second server is performed within a first trusted execution environment (TEE); and
the determination of the second performance metric of the second ML model using the data of the first server is performed within a second TEE.

### Claim 18 (depends on 17)

The computer program product of claim 17, wherein the method further comprises, subsequent to performing the benefit analysis:
deleting from the first TEE the first ML model and the data of the second server; and
deleting from the second TEE the second ML model and the data of the first server.

### Claim 19 (depends on 16)

The computer program product of claim 16, wherein:
the determination of the first performance metric of the first ML model using the data of the second server is performed within a trusted execution environment (TEE);
the determination of the second performance metric of the second ML model using the data of the first server is performed within the TEE.

### Claim 20 (depends on 19)

The computer program product of claim 19, wherein the method further comprises, subsequent to performing the benefit analysis, deleting from the TEE:
the first ML model;
the data of the second server;
the second ML model; and
the data of the first server.
