# US 2024/0202593 A1 · Anonymous training of a learning model

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0202593 A1
- Document ID: US20240202593A1
- Status: Published application
- Kind: A1
- Application number: 18/538,536
- Filed: 2023-12-13
- Published: 2024-06-20
- Earliest claimed: 2020-10-09
- Assignees: Aquasys LLC
- Applicants: AquaSys LLC
- Inventors: Kevin Kelly; Calden Carroll; Adam Koeppel; Tyler Locke
- Web page: https://patentgrep.com/patent/US20240202593A1

## CPC

- G06N 3/08: Learning methods
- G06N 20/00: Machine learning
- G01N 33/24: Earth materials (G01N33/42 takes precedence)
- G06N 3/042: Knowledge-based neural networks; Logical representations of neural networks
- G06N 3/044: Recurrent networks, e.g. Hopfield networks
- G06N 3/0442: characterised by memory or gating, e.g. long short-term memory [LSTM] or gated recurrent units [GRU]
- G06N 3/09: Supervised learning
- G06N 3/096: Transfer learning
- G06N 3/098: Distributed learning, e.g. federated learning
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G01N: INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES (measuring or testing apparatus or processes other than immunoassay, involving enzymes or microorganisms C12M, C12Q)

## Abstract

Systems, methods, and programs for privately and securely providing accurate machine learning models to anonymous clients for various applications. Discrete model classes of models are trained on non-anonymous datasets at a centralized server and served to anonymous clients. Clients validate each model against its own localized datasets and retain the most accurate model. Clients improve their model locally through transfer learning on new datasets, and share the updated, anonymized parameters with a centralized computer. The centralized server aggregates and updates model parameters for each respective discrete model class. The improved models may be served to future and existing clients.

## Claims

### Claim 1

A computing system for obtaining a trained model privately and securely, the system comprising:
at least one processor;
at least one data storage device;
a neural network; and
machine readable instructions stored in the at least one data storage device that when executed by the at least one processor controls the system to:
define, in a cloud-based computing system, a plurality of discrete model classes, wherein the plurality of discrete model classes comprises a plurality of machine learning models;
receive by the cloud-based computing system, at least one dataset for modeling the plurality of discrete model classes;
train at least one respective machine learning model of the plurality of machine learning models for each discrete model class of the plurality of discrete model classes using the at least one dataset using the neural network;
transmit the plurality of trained learning models associated with each discrete model class to at least one anonymous client;
receive updated parameters from the at least one anonymous client, wherein the updated parameters are from a selected one of the plurality of trained models by the at least one anonymous client;
aggregate and update parameters of the plurality of machine learning models by the neural network;
transmit the updated plurality of machine learning models to at least one client.

### Claim 2 (depends on 1)

The computing system according to claim 1, wherein the at least one anonymous client comprises a processor enabled device comprising memory, a processor, and machine readable instructions stored in the memory that when executed by the processor controls the processor enabled device to:
validate each one of the plurality of trained learning models using a localized dataset,
select one of the plurality of trained learning models having the highest accuracy among the plurality of trained learning models,
retrain the selected one of the plurality of trained learning models using new datasets obtained by the at least one anonymous client through transfer learning.

### Claim 3 (depends on 1)

The computing system according to claim 1, wherein the plurality of discrete model classes is subdivided into a plurality of submodel classes, wherein each submodel class of the plurality of submodel classes comprises at least one machine learning model.

### Claim 4 (depends on 3)

The computing system according to claim 3, further comprising transmitting the at least one machine learning model from any submodel class of the plurality of submodel classes associated with the selected one of the plurality of trained learning models having the highest accuracy.

### Claim 5 (depends on 3)

The computing system according to claim 3, wherein the processor enabled device is further configured to:
validate each one of the at least one machine learning model for the submodel class using a localized dataset of the at least one anonymous client;
select one of the plurality of trained learning models from the submodel class having the highest accuracy;
retrain the selected one of the plurality of trained learning models from the submodel class using new datasets obtained by the at least one anonymous client through transfer learning;
transmit updated parameters used in the selected one of the plurality of trained models of the submodel class to the neural network.

### Claim 6 (depends on 2)

The computing system according to claim 2, wherein the processor enabled device is further configured to delete any remaining trained learning model that was not selected as having the highest accuracy.

### Claim 7 (depends on 2)

The computing system according to claim 2, wherein the system is further configured to:
retransmit the plurality of trained learning models associated with each discrete model class to the at least one anonymous client after a predetermined amount of time; and
the at least one anonymous client is further configured to:
validate each one of the plurality of trained learning models using the localized dataset of the at least one anonymous client;
select one of the plurality of trained learning models having the highest accuracy;
train the selected one of the plurality of trained learning models using new datasets obtained by the at least one anonymous client through transfer learning;
transmit the updated parameters used in the selected one of the plurality of trained models to the neural network.

### Claim 8 (depends on 7)

The computing system according to claim 7, wherein the predetermined amount of time is every thirty days or monthly.

### Claim 9 (depends on 1)

The computing system according to claim 1, wherein the at least one anonymous client is configured to transmit any updated parameters used in the selected one of the plurality of trained models to the cloud-based computing system after a predetermined amount of time.

### Claim 10 (depends on 1)

The computing system according to claim 1, wherein the plurality of discrete model classes is directed to soil mapping and the at least one dataset includes data from representative soil types.

### Claim 11 (depends on 10)

The computing system according to claim 10, wherein the plurality of machine learning models comprises machine learning models for each representative soil type.

### Claim 12 (depends on 10)

The computing system according to claim 10,
wherein the localized dataset comprises data obtained from a plurality of sensors installed at a location of the at least one anonymous client, and
wherein the plurality of sensors collect data that includes at least one of soil volumetric moisture, soil capacitance, soil tension, soil temperature, air humidity, air temperature, and barometric pressure.

### Claim 13 (depends on 11)

The computing system according to claim 11, further comprising:
downloading a soil-specific machine learning model from the updated plurality of machine learning models for a soil type of the at least one client, and
wherein the updated plurality of machine learning models are soil-specific models for each discrete model class of the plurality of discrete model classes.

### Claim 14 (depends on 1)

The computing system according to claim 1, wherein the plurality of discrete model classes is directed to predictive text for regional dialects and the at least one dataset includes data from different regions that speak the dialect.

### Claim 15

A method for obtaining a trained model privately and securely, the method comprising:
defining, in a cloud-based computing system, a plurality of discrete model classes, the plurality of discrete model classes comprising a plurality of machine learning models;
receiving, by the cloud-based computing system, at least one dataset for modeling the plurality of discrete model classes;
training the plurality of machine learning models for each discrete model class of the plurality of discrete model classes using the at least one dataset using a neural network;
transmitting the plurality of trained learning models associated with each discrete model class to at least one anonymous client;
validating each one of the plurality of trained learning models by the at least one anonymous client using a localized dataset of the at least one anonymous client;
selecting one of the plurality of trained learning models having the highest accuracy;
retraining the selected one of the plurality of trained learning models using new datasets obtained by the at least one anonymous client through transfer learning;
transmitting updated parameters used in the selected one of the plurality of trained models to the neural network;
aggregating and updating parameters of the plurality of machine learning models by the neural network; and
transmitting the updated plurality of machine learning models to at least one client.
