# US 2021/0342490 A1 · Auditable secure reverse engineering proof machine learning pipeline and methods

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0342490 A1
- Document ID: US20210342490A1
- Status: Published application
- Kind: A1
- Application number: 17/307,646
- Filed: 2021-05-04
- Published: 2021-11-04
- Earliest claimed: 2020-05-04
- Assignees: Cerebri AI Inc.
- Applicants: Cerebri AI Inc.
- Inventors: Alain Charles Briancon; Eric Paver Simon; Mirza Safiullah Baig; Jean Joseph Belanger; Michael Henry Engeling; Sathish Kumar Lakshmipathy; Travis Stanton Penn; Bryan Wayne Collins; Arun Prakash; Chris Michael Coovrey; Piyush Sunil Deshmukh; Vasilis Andrew Sotiris; Mounib Mohamad Ismail
- Web page: https://patentgrep.com/patent/US20210342490A1

## CPC

- G06F 21/14: against software analysis or reverse engineering, e.g. by obfuscation
- G06F 21/75: by inhibiting the analysis of circuitry or operation
- G06N 3/0475: Generative networks
- G06N 3/094: Adversarial learning
- G06N 3/10: Interfaces, programming languages or software development kits, e.g. for simulating neural networks
- G06N 5/04: Inference or reasoning models
- G06N 20/00: Machine learning
- G06N 3/045: Combinations of networks
- G06N 7/01: Probabilistic graphical models, e.g. probabilistic networks
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

Provided is a process including: searching code of a machine-learning pipeline to find a first and a second object code sequences performing similar tasks; modifying the code of the machine learning pipeline by inserting a third object code sequence into the code of the machine learning pipeline, the third code sequence being operable to pass control to the first object code sequence; inserting a branch at the end of the first code sequence, the branch being operable to: pass control, upon detection of a first predefined condition, to an instruction following the first object code sequence, and to pass control, upon detection of a second predefined condition, to an instruction following the third object code sequence; and wherein the third code sequence is executed in place of the second object sequence without affecting completion of the tasks.

## Claims

### Claim 1

A tangible, non-transitory, machine-readable medium storing instructions that, when executed by one or more processors, effectuate operations comprising:
obtaining, with a computer system, code and data implementing a machine-learning model;
modifying, with the computer system, the code or data implementing the machine-learning model to make the code and data implementing the machine-learning model more difficult to reverse engineer by probing the machine-learning model with input data; and
storing, with the computer system, the modified code and data implementing the machine-learning model in memory.

### Claim 2 (depends on 1)

The medium of claim 1, wherein the machine-learning model is part of a machine-learning pipeline, the code is part of object code of the machine-learning pipeline, and modifying comprises:
matching a first object code sequence to a second object code sequence in the code in response to classifying a first task of the first object code sequence as being similar to a second task of the second object code sequence;
modifying the object code of the machine learning pipeline by:
inserting a third object code sequence into the object code of the machine learning pipeline, the third code sequence comprising one or more instructions, and being operable to pass control to the first object code sequence;
inserting a branch at an end of the first object code sequence, the branch being operable to:
pass control, upon detection of a first predefined condition, to an instruction following the first object code sequence, and to pass control, upon detection of a second predefined condition, to an instruction following the third object code sequence; and
wherein:
the third code sequence is configured to be executed in place of the second object sequence without affecting completion of the first task or the second task, or
the third code sequence is configured to be executed ahead of the second object sequence without affecting completion of the first task or the second task.

### Claim 3 (depends on 2)

The medium of claim 2, wherein the third code sequence is configured to be executed in place of the second object sequence without affecting completion of the first task or the second task.

### Claim 4 (depends on 2)

The medium of claim 2, wherein the third code sequence is configured to be executed ahead of the second object sequence without affecting completion of the first task or the second task.

### Claim 5 (depends on 2)

The medium of claim 2, wherein modifying the object code of the machine-learning pipeline comprises modifying a feature engineering stage of the machine-learning pipeline.

### Claim 6 (depends on 5)

The medium of claim 5, the object code of the machine-learning pipeline is obtained by interpreting a source code representation of the feature engineering stage to obtain the object code of the machine-learning pipeline.

### Claim 7 (depends on 6)

The medium of claim 6, wherein the first, the second, and the third object code sequences perform at least one of the following when executed:
injection affinity score,
inject propensity score,
compose target,
extract statistical parameters,
set parameters, explore parameters,
enrich data,
aggregate on one or more time dimensions,
aggregate on one or more spatial dimensions,
select features based on correlation,
create lag based features,
encode stationarity,
encode seasonality,
encode cyclicity,
impute over range of dimension,
regress,
create a stream,
publish a stream,
subscribe to a stream,
update a record,
connect to a source,
perform source to target mapping,
connect to a sink,
select a record,
use deep learning to extract new features,
leverage parameters from boosted gradient search,
synthesis through generative adversarial networks,
encode,
morph outliers,
bins,
nonlinear transform,
group,
feature split,
decimate,
up sample,
down sample,
extract reliability, and
changes attributes.

### Claim 8 (depends on 2)

The medium of claim 2, wherein modifying comprises obfuscating stages of the machine-learning pipeline.

### Claim 9 (depends on 1)

The medium of claim 1, wherein modifying comprises:
selecting a sequence of source to target mapping statements, the sequence of source to target mapping statements having a predefined order;
incorporating at least a first concurrent process and a second concurrent process into a computer program by which at least part of the machine-learning model is implemented;
incorporating a first source to target mapping statement from the sequence into the first concurrent process;
incorporating a second source to target mapping statement from the sequence into the second concurrent process;
introducing a plurality of guard variables to control the execution of the at least one of the first concurrent process or the second concurrent process;
causing execution of the first concurrent process and the second concurrent process such that the sequence of source to target mapping statements is executed in the predefined order; and
assigning an error value to at least one of the plurality of guard variables without causing incorrect execution of the sequence of source to target mapping statements.

### Claim 10 (depends on 9)

The medium of claim 9, wherein modifying comprises obfuscating a data processing stage of a machine learning pipeline including the machine-learning model.

### Claim 11 (depends on 9)

The medium of claim 9, wherein the machine-learning model is part of a machine-learning pipeline, the code is part of object code of the machine-learning pipeline, and modifying comprises:
matching a first object code sequence to a second object code sequence in the code in response to classifying a first task of the first object code sequence as being similar to a second task of the second object code sequence;
modifying the object code of the machine learning pipeline by:
inserting a third object code sequence into the object code of the machine learning pipeline, the third code sequence comprising one or more instructions, and being operable to pass control to the first object code sequence;
inserting a branch at an end of the first code sequence, the branch being operable to:
pass control, upon detection of a first predefined condition, to an instruction following the first object code sequence, and to pass control, upon detection of a second predefined condition, to an instruction following the third object code sequence; and
wherein:
the third code sequence is configured to be executed in place of the second object sequence without affecting completion of the first task or the second task, or
the third code sequence is configured to be executed ahead of the second object sequence without affecting completion of the first task or the second task.

### Claim 12 (depends on 1)

The medium of claim 1, wherein modifying comprises:
selecting a watermark integer;
choosing a watermark journey template corresponding to the selected watermark integer from a class of watermark journey templates having at least one property, the at least one property being an enumeration such that each member watermark journey template of the class of watermark journey template is associated with a respective integer value;
creating a watermark-generated journey piece with generated events and features of the watermark journey template; and
creating a watermarked customer journey by modifying a customer journey among the data by embedding the watermark-generated journey piece with the customer journey such that the watermark-generated journey piece becomes present and detectable in further processing of the watermarked customer journey.

### Claim 13 (depends on 12)

The medium of claim 12, wherein the watermark-generated journey piece is detectable in further processing using substantially all events and features modified by a machine-learning pipeline including the machine-learning model.

### Claim 14 (depends on 1)

The medium of claim 1, wherein modifying comprises:
selecting a fingerprint integer;
selecting a fingerprint template corresponding to the selected watermark integer from a class of fingerprint template having at least one property, the at least one property being an enumeration such that each member fingerprint template of the class of fingerprint template is associated with a respective integer value;
creating a fingerprint journey piece with generated events and features of watermark journey template;
creating a fingerprinted customer journey by modifying a customer journey among the data by embedding the fingerprint journey piece with the customer journey; and
providing the fingerprinted customer journey to a one or more target computing devices for execution.

### Claim 15 (depends on 14)

The medium of claim 14, wherein the fingerprinted customer journey will only execute correctly on a specified set of target computing devices and will not execute correctly on other computing devices.

### Claim 16 (depends on 1)

The medium of claim 1, wherein modifying comprises:
evolving a unique initial key value assigned to a set of parameters and hyperparameters of a first component of a machine-learning pipeline including the machine-learning model, wherein the unique initial key is evolved with components of the machine-learning pipeline executing an integrity check and using a one-way function that produces a new key value within a chosen mathematical subgroup, such that the new key value will stay within the subgroup unless tampering to the set of parameters and hyperparameters of the first component of the machine learning pipeline occurs; and
regulating behavior of the set of parameters and hyperparameters of a second component of the machine learning pipeline using the new key value, such that an integrity check fails if the evolved new key value is incorrect.

### Claim 17 (depends on 16)

The medium of claim 16, wherein the second component of the machine learning pipeline is not functioning correctly.

### Claim 18 (depends on 16)

The medium of claim 16, wherein parameters are global, local, categorical, longitudinal, or continuous.

### Claim 19 (depends on 1)

The medium of claim 1, wherein modifying comprises:
receiving a customer journey at a first stage of a machine-learning pipeline including the machine-learning model;
receiving stage configuration information from a second stage of the machine-learning pipeline;
generating a model output journey at the first stage of a machine-learning pipeline for the customer journey, wherein the model output journey is generated based, at least in part, on the stage configuration information from second stage;
determining a starting point within the model output journey at the first stage of the machine learning pipeline;
transmitting the starting point from the first stage of the machine learning pipeline to the second stage of the machine learning pipeline;
generating a secret key based on the model output journey at the first stage of the machine learning pipeline; and
generating a perfectly secret encryption key based on the secret key at the first stage of the machine learning pipeline.

### Claim 20 (depends on 1)

The medium of claim 1, wherein modifying comprises protecting machine-learning pipeline components including the machine-learning model by generating a secret key from joint randomness shared by a data processing stage of the machine-learning pipeline and a modeling stage of the machine-learning pipeline.

### Claim 21 (depends on 20)

The medium of claim 20, wherein generating comprises:
generating, with the modeling stage of the machine-learning pipeline, a journey response vector based on information from a channel between the data processing stage and the modeling stage;
receiving, with the modeling stage, a syndrome from the data processing stage, wherein the syndrome is generated by the data processing stage from a first set of bits generated from a first sampled journey based on feature engineering generated between the data processing stage and the modeling stage;
generating, with the modeling stage, the second set of bits from the syndrome received from the data processing stage and the journey response vector; and
generating, with the modeling stage, the secret key from the second set of bits.

### Claim 22 (depends on 20)

The medium of claim 20, wherein the generating comprises:
receiving, by at least one computing device, a data stream comprising a plurality of data points;
comparing, by the at least one computing device, individual data patterns of the plurality of data points with a decision boundary to determine whether the individual data patterns are outside the decision boundary, the decision boundary corresponding to at least one classification model formed using training data; and
recording individual data patterns into a log.

### Claim 23 (depends on 20)

The medium of claim 20, wherein the generating comprises:
receiving, by at least one computing device, a data stream comprising a plurality of data points;
comparing, by the at least one computing device, individual data patterns of the plurality of data points with a decision boundary to determine whether the individual data patterns are outside the decision boundary, the decision boundary corresponding to at least one classification model formed using training data; and
changing, upon detection of being outside the decision boundary, the execution steps of one or more of the pipeline components.

### Claim 24 (depends on 1)

The medium of claim 1, wherein:
the machine-learning model is part of a machine-learning pipeline, the code is part of object code of the machine-learning pipeline, and modifying comprises:
matching a first object code sequence to a second object code sequence in the code in response to classifying a first task of the first object code sequence as being similar to a second task of the second object code sequence;
modifying the object code of the machine learning pipeline by:
inserting a third object code sequence into the object code of the machine learning pipeline, the third code sequence comprising one or more instructions, and being operable to pass control to the first object code sequence;
inserting a branch at an end of the first object code sequence, the branch being operable to:
pass control, upon detection of a first predefined condition, to an instruction following the first object code sequence, and to pass control, upon detection of a second predefined condition, to an instruction following the third object code sequence; and
wherein:
the third code sequence is configured to be executed in place of the second object sequence without affecting completion of the first task or the second task, or
the third code sequence is configured to be executed ahead of the second object sequence without affecting completion of the first task or the second task;
the code is part of object code of the machine-learning pipeline, and modifying comprises:
matching a first object code sequence to a second object code sequence in the code in response to classifying a first task of the first object code sequence as being similar to a second task of the second object code sequence;
modifying the object code of the machine learning pipeline by:
inserting a third object code sequence into the object code of the machine learning pipeline, the third code sequence comprising one or more instructions, and being operable to pass control to the first object code sequence;
inserting a branch at an end of the first code sequence, the branch being operable to:
pass control, upon detection of a first predefined condition, to an instruction following the first object code sequence, and to pass control, upon detection of a second predefined condition, to an instruction following the third object code sequence; and
wherein:
the third code sequence is configured to be executed in place of the second object sequence without affecting completion of the first task or the second task, or
the third code sequence is configured to be executed ahead of the second object sequence without affecting completion of the first task or the second task;
modifying comprises:
selecting a watermark integer;
choosing a watermark journey template corresponding to the selected watermark integer from a class of watermark journey templates having at least one property, the at least one property being an enumeration such that each member watermark journey template of the class of watermark journey template is associated with a respective integer value;
creating a watermark-generated journey piece with generated events and features of the watermark journey template; and
creating a watermarked customer journey by modifying a first customer journey among the data by embedding the watermark-generated journey piece with the first customer journey such that the watermark-generated journey piece becomes present and detectable in further processing of the watermarked customer journey;
modifying comprises:
selecting a fingerprint integer;
selecting a fingerprint template corresponding to the selected watermark integer from a class of fingerprint template having at least one property, the at least one property being an enumeration such that each member fingerprint template of the class of fingerprint template is associated with a respective integer value;
creating a fingerprint journey piece with generated events and features of watermark journey template;
creating a fingerprinted customer journey by modifying a second customer journey among the data by embedding the fingerprint journey piece with the second customer journey; and
providing the fingerprinted customer journey to a one or more target computing devices for execution;
modifying comprises:
evolving a unique initial key value assigned to a set of parameters and hyperparameters of a first component of a machine-learning pipeline including the machine-learning model, wherein the unique initial key is evolved with components of the machine-learning pipeline executing an integrity check and using a one-way function that produces a new key value within a chosen mathematical subgroup, such that the new key value will stay within the subgroup unless tampering to the set of parameters and hyperparameters of the first component of the machine learning pipeline occurs; and
regulating behavior of the set of parameters and hyperparameters of a second component of the machine learning pipeline using the new key value, such that an integrity check fails if the evolved new key value is incorrect;
modifying comprises:
receiving a customer journey at a first stage of a machine-learning pipeline including the machine-learning model;
receiving stage configuration information from a second stage of the machine-learning pipeline;
generating a model output journey at the first stage of a machine-learning pipeline for the customer journey, wherein the model output journey is generated based, at least in part, on the stage configuration information from second stage;
determining a starting point within the model output journey at the first stage of the machine learning pipeline;
transmitting the starting point from the first stage of the machine learning pipeline to the second stage of the machine learning pipeline;
generating a secret key based on the model output journey at the first stage of the machine learning pipeline; and
generating a perfectly secret encryption key based on the secret key at the first stage of the machine learning pipeline; and
modifying comprises protecting machine-learning pipeline components including the machine-learning model by generating a secret key from joint randomness shared by a data processing stage of the machine-learning pipeline and a modeling stage of the machine-learning pipeline
