# US 2023/0267375 A1 · Distributed Machine Learning Systems, Apparatus, And Methods

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0267375 A1
- Document ID: US20230267375A1
- Status: Published application
- Kind: A1
- Application number: 18/137,812
- Filed: 2023-04-21
- Published: 2023-08-24
- Earliest claimed: 2016-07-18
- Assignees: NantOmics, LLC; Nant Holdings IP, LLC
- Applicants: NantOmics, LLC; Nant Holdings IP, LLC
- Inventors: Christopher W. SZETO; Stephen Charles BENZ; Nicholas J. WITCHEY
- Web page: https://patentgrep.com/patent/US20230267375A1

## CPC

- G06N 20/00: Machine learning
- G06F 21/6254: {by anonymising data, e.g. decorrelating personal data from the owner's identification}
- G06N 20/10: using kernel methods, e.g. support vector machines [SVM]
- G16H 10/60: for patient-specific data, e.g. for electronic patient records
- G16H 40/20: for the management or administration of healthcare resources or facilities, e.g. managing hospital staff or surgery rooms
- G16H 50/20: for computer-aided diagnosis, e.g. based on medical expert systems
- G16H 50/50: for simulation or modelling of medical disorders
- G06F 21/6245: {Protecting personal data, e.g. for financial or medical purposes}
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA

## Abstract

A distributed, online machine learning system is presented. Contemplated systems include many private data servers, each having local private data. Researchers can request that relevant private data servers train implementations of machine learning algorithms on their local private data without requiring de-identification of the private data or without exposing the private data to unauthorized computing systems. The private data servers also generate synthetic or proxy data according to the data distributions of the actual data. The servers then use the proxy data to train proxy models. When the proxy models are sufficiently similar to the trained actual models, the proxy data, proxy model parameters, or other learned knowledge can be transmitted to one or more non-private computing devices. The learned knowledge from many private data servers can then be aggregated into one or more trained global models without exposing private data.

## Claims

### Claim at position 1

1-38. (canceled)

### Claim 39

A computer-based distributed machine learning system comprising:
at least one private data server storing local private data and having a local modeling agent; and
a non-private data server coupled with the at least one private data server over a network, the non-private data server lacking authorized access to the local private data, the non-private data server comprising at least one processor that, upon execution of software instructions stored in a computer readable memory, performs operations of:
transmitting a definition of a machine learning task to the modeling agent of the at least one private data server, the definition of the machine learning task including machine learning model instructions and local private data features;
enabling the modeling agent of the at least one private data server to generate synthetic data capable of reproducing knowledge gained from execution the machine learning model instructions on at least some of the local private data having the local private data features;
receiving from the modeling agent of the at least one private data server, proxy model data representative of the knowledge gained via the synthetic data; and
aggregating the proxy model data representative of knowledge gained via the synthetic data into a global model corresponding to the machine learning task.

### Claim 40 (depends on 39)

The system of claim 39, wherein the proxy model data comprises compressed learned data.

### Claim 41 (depends on 39)

The system of claim 39, wherein the proxy model data comprises lossy compressed learned data.

### Claim 42 (depends on 39)

The system of claim 39, wherein the proxy model data comprises the synthetic data.

### Claim 43 (depends on 39)

The system of claim 39, wherein the proxy model data comprises proxy model parameters derived from the synthetic data.

### Claim 44 (depends on 43)

The system of claim 43, wherein the operations further include duplicating the synthetic data according to the proxy model parameters.

### Claim 45 (depends on 44)

The system of claim 44, wherein the proxy model parameters include a seed for a deterministic function able to generate the synthetic data.

### Claim 46 (depends on 39)

The system of claim 39, wherein the proxy model data comprises a trained proxy model trained on the synthetic data.

### Claim 47 (depends on 39)

The system of claim 39, wherein the synthetic data comprises Monte Carlo data.

### Claim 48 (depends on 39)

The system of claim 39, wherein the local private data comprises private patient data.

### Claim 49 (depends on 48)

The system of claim 48, wherein the private patient data comprises at least one of healthcare data or genomic data.

### Claim 50 (depends on 39)

The system of claim 39, wherein the local private data includes at least one of insurance data, financial data, social media profile data, human capital data, proprietary experimental data, gaming or gambling data, military data, network traffic data, or shopping or marketing data.

### Claim 51 (depends on 39)

The system of claim 39, wherein the operations further include paying a fee in exchange for accessing the modeling agent of the at least one private data server.

### Claim 52 (depends on 39)

The system of claim 39, wherein the machine learning model instructions comprise at least one of supervised machine learning instructions, unsupervised machine learning instructions, or machine learning clustering instructions.

### Claim 53 (depends on 39)

The system of claim 39, wherein the machine learning model instructions comprise at least one of machine learning regression instructions or machine learning classification instructions.

### Claim 54 (depends on 39)

The system of claim 39, wherein the operations further include receiving private data metadata about the local private data from the local modeling engine.

### Claim 55 (depends on 54)

The system of claim 54, wherein the operations further include generating the definition of the machine learning task based on the private data metadata.

### Claim 56 (depends on 55)

The system of claim 55, wherein the private data metadata comprises attribute space information relating to the local private data.

### Claim 57 (depends on 39)

The system of claim 39, wherein synthetic data is generated such that a trained proxy model trained on the synthetic data satisfies similarity criteria to a trained actual model trained on at least some of the local private data.

### Claim 58 (depends on 57)

The system of claim 57, wherein the proxy model data is received upon satisfaction of transmission requirements defined based on the similarity criteria.

### Claim 59

A method of computer-based distributed machine learning, the method comprising:
transmitting, by at least one processor of a non-private data server coupled with at least one private data server over a network, a definition of a machine learning task to a modeling agent of at least one private data server,
the at least one private data server storing local private data and having a local modeling engine,
the non-private data server lacking authorized access to the local private data, and
the definition of the machine learning task including machine learning model instructions and local private data features;
enabling the modeling agent of the at least one private data server to generate synthetic data capable of reproducing knowledge gained from execution the machine learning model instructions on at least some of the local private data having the local private data features;
receiving from the modeling agent of the at least one private data server, proxy model data representative of the knowledge gained via the synthetic data; and
aggregating the proxy model data representative of knowledge gained via the synthetic data into a global model corresponding to the machine learning task.

### Claim 60

A non-transitory computer-readable medium comprising computer-executable instructions configured to, when executed by at least one processor, cause the processor to perform operations including:
transmitting, by at least one processor of a non-private data server coupled with at least one private data server over a network, a definition of a machine learning task to a modeling agent of at least one private data server,
the at least one private data server storing local private data and having a local modeling engine,
the non-private data server lacking authorized access to the local private data, and
the definition of the machine learning task including machine learning model instructions and local private data features;
enabling the modeling agent of the at least one private data server to generate synthetic data capable of reproducing knowledge gained from execution the machine learning model instructions on at least some of the local private data having the local private data features;
receiving from the modeling agent of the at least one private data server, proxy model data representative of the knowledge gained via the synthetic data; and
aggregating the proxy model data representative of knowledge gained via the synthetic data into a global model corresponding to the machine learning task.
