# US 2024/0256973 A1 · Training a machine learning model using a distributed machine learning process

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0256973 A1
- Document ID: US20240256973A1
- Status: Published application
- Kind: A1
- Application number: 18/561,893
- Filed: 2021-05-19
- Published: 2024-08-01
- Earliest claimed: 2021-05-19
- Assignees: Telefonaktiebolaget LM Ericsson (publ)
- Applicants: Telefonaktiebolaget LM Ericsson (publ)
- Inventors: Konstantinos VANDIKAS; Athanasios KARAPANTELAKIS; Sunil Kumar VUPPALA
- Web page: https://patentgrep.com/patent/US20240256973A1

## CPC

- G06F 21/6254: {by anonymising data, e.g. decorrelating personal data from the owner's identification}
- G06N 20/00: Machine learning
- G06F 21/552: {involving long-term monitoring or reporting}
- G06F 21/554: {involving event detection and direct action}
- H04L 9/085: {Secret sharing or secret splitting, e.g. threshold schemes}
- H04L 63/1416: {Event detection, e.g. attack signature detection}
- H04L 2209/46: Secure multiparty computation, e.g. millionaire problem
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

There is provided a computer implemented method for use in a distributed machine learning process for training a machine learning model, wherein the training is distributed across a plurality of computing nodes and updates to the machine learning model, as determined by the plurality of computing nodes, are aggregated using secure multi party computation. The method includes: i) obtaining an aggregated characteristic of updates to the machine learning model provided by a first subset of the plurality of computing nodes; ii) comparing the aggregated characteristic to an equivalent reference; and iii) identifying whether the first subset of nodes are contributing updates that are corrupting the machine learning model, based on the comparison.

## Claims

### Claim 1

A computer implemented method for use in a distributed machine learning process for training a machine learning model, wherein the training is distributed across a plurality of computing nodes and updates to the machine learning model, as determined by the plurality of computing nodes, are aggregated using secure multi party computation, the method comprising:
i) obtaining an aggregated characteristic of updates to the machine learning model provided by a first subset of the plurality of computing nodes;
ii) comparing the aggregated characteristic to an equivalent reference; and
iii) identifying whether the first subset of computing nodes are contributing updates that are corrupting the machine learning model, based on the comparison.

### Claim 2 (depends on 1)

A method as in claim 1 further comprising selecting the first subset of nodes, and wherein the first subset of nodes are selected such that their respective masks, associated with the secure multi party computation, cancel each other out when aggregated.

### Claim 3 (depends on 2)

A method as in claim 2 wherein the secure multi party computation uses a groupwise secret sharing masking process and the step of selecting the first subset of nodes comprises:
selecting a group of nodes from the groupwise secret sharing masking process as the first subset of nodes.

### Claim 4 (depends on 1)

A method as in claim 1 wherein the aggregated characteristic comprises a measure of convergence or accuracy of the machine learning model when the updates to the machine learning model from the first subset of nodes are aggregated into the machine learning model.

### Claim 5 (depends on 4)

A method as in claim 4 wherein the equivalent reference comprises:
a measure of convergence or accuracy of the machine learning model when updates from the first subset of nodes are not aggregated into the machine learning model;
a measure of convergence or accuracy of the machine learning model as determined using a trusted dataset; or
a measure of convergence or accuracy of the machine learning model as determined from updates to the machine learning model provided by a second subset of the plurality of computing nodes.

### Claim 6 (depends on 1)

A method as in claim 1 wherein the step of identifying whether the first subset of nodes are contributing updates that are corrupting the machine learning model comprises:
determining that the first subset of nodes are contributing updates that are corrupting the machine learning model if the aggregated characteristic indicates that the machine learning model converges faster or is more accurate when updates from the first subset of nodes are not aggregated into the machine learning model compared to when updates from the first subset of nodes are aggregated into the machine learning model.

### Claim 7 (depends on 1)

A method as in claim 1 wherein the aggregated characteristic comprises an aggregated parameter value obtained using an explainable AI, XAI, process and the equivalent reference is a ground truth value for said parameter.

### Claim 8 (depends on 7)

A method as in claim 7 wherein the parameter value obtained using the XAI process is a measure of feature importance of an input feature to the machine learning model.

### Claim 9 (depends on 8)

A method as in claim 8 wherein the step of identifying whether the first subset of nodes are contributing updates that are corrupting the machine learning model comprises:
determining that the first subset of nodes are contributing updates that are corrupting the machine learning model if the feature importance as determined by the first subset of nodes is different to the ground truth feature importance.

### Claim 10 (depends on 1)

A method as in claim 1 further comprising:
determining that the first subset of nodes are not contributing updates that are corrupting the machine learning model; and
repeating steps i)-iii) in an iterative manner for other subsets of nodes.

### Claim 11 (depends on 1)

A method as in claim 1 wherein the method is performed responsive to detecting a reduction in performance of the machine learning model.

### Claim 12 (depends on 1)

A method as in claim 1 wherein the first subset of nodes are selected from nodes associated with a common aggregation point in the distributed machine learning process.

### Claim 13 (depends on 1)

A method as in claim 1 wherein the first subset of nodes are selected from nodes associated with different aggregation points in the distributed machine learning process.

### Claim 14 (depends on 1)

A method as in claim 1 further comprising:
quarantining the first subset of nodes from the distributed machine learning process, if the first subset of nodes are identified as contributing updates that are corrupting the machine learning model.

### Claim 15 (depends on 1)

A method as in claim 1 wherein the method is performed by a first node in a communications network.

### Claim 16 (depends on 15)

A method as in claim 15 wherein the first node is configured to
send a message to a second node, the second node being an aggregation point in the distributed machine learning process for the plurality of computing nodes, and wherein the message instructs the second node to determine the characteristic for the first subset of nodes.

### Claim 17 (depends on 16)

A method as in claim 16 wherein the message further instructs the second node to determine the characteristic for other nodes in the plurality of computing nodes that are not in the first subset of nodes; and
wherein the characteristic for the other nodes in the plurality of computing nodes is used as the equivalent reference.

### Claim 18 (depends on 1)

A method as in claim 1 wherein the method is for use in identifying nodes in the plurality of computing nodes that are performing a data poison attack.

### Claim 19 (depends on 1)

A method as in claim 1 wherein the method is used in training the machine learning model for use in a determining actions that should be performed in a safety critical system.

### Claim at position 20

-24. (canceled)

### Claim 25

An apparatus for use in a distributed machine learning process for training a machine learning model, wherein the training is distributed across a plurality of computing nodes and updates to the machine learning model, as determined by the plurality of computing nodes, are aggregated using secure multi party computation, the apparatus comprising:
a memory comprising instruction data representing a set of instructions; and
a processor configured to communicate with the memory and to execute the set of instructions, wherein the set of instructions, when executed by the processor, cause the processor to:
i) obtain an aggregated characteristic of updates to the machine learning model provided by a first subset of the plurality of computing nodes;
ii) compare the aggregated characteristic to an equivalent reference; and
iii) identify whether the first subset of nodes are contributing updates that are corrupting the machine learning model, based on the comparison.

### Claim at position 22

-29. (canceled)
