Machine-learning execution security
AssigneeMicrosoft Technology Licensing, LLC
InventorAditya Vasanth CHALLAPALLY
Life of this patent
Estimating the term…
Abstract
This invention provides a system for enhancing the privacy and security of neural networks through dynamic execution trace obfuscation. The system generates randomized computational patterns to mask the actual processing flow during inference and training, preventing information leakage via side-channel attacks. It employs a randomization engine to reorder operations, vary memory access patterns, and introduce timing variations, ensuring mathematical correctness and model performance. The system includes a protection component for monitoring execution patterns and a performance optimization component to balance security and efficiency.
Claims20
A method for obfuscating execution of operations of a machine-learning model during execution of inference tasks, the method comprising:
- receiving, by a processor, an inference task comprising input data to be processed by the machine-learning model, the inference task received from a requestor;
- creating, by the processor, a computational graph mapping execution dependency of the machine-learning model by representing input-dependent operations as nodes and specifying data flow paths between nodes as edges, the computational graph created based on a model architecture of the machine-learning model;
- identifying, by the processor, and based upon the computational graph, independent operations within the machine-learning model that are performed during the inference task that can be processed in a different order without changing an output of the inference task;
- generating, by the processor, using a pseudo-random number generator, randomization parameters for determining an execution order of the independent operations within the machine-learning model that are performed during the inference task;
- ordering, by the processor, the independent operations within the machine-learning model that are performed during the inference task according to the randomization parameters to create a reordered independent operations of the independent operations within the machine-learning model that are performed during the inference task;
- executing, by the processor, the reordered independent operations on the input data to produce an output of the inference task, the reordered independent operations generating randomized execution traces for each inference task of the machine-learning model;
- and
- transmitting, by the processor, the output of the inference task to the requestor.
A computing device for obfuscating execution of operations of a machine-learning model during execution of inference tasks, the computing device comprising:
- a hardware processor;
- a memory, the memory storing instructions, which when executed by the hardware processor cause the computing device to perform operations comprising:
- receiving an inference task comprising input data to be processed by the machine-learning model, the inference task received from a requestor;
- creating a computational graph mapping execution dependency of the machine-learning model by representing input-dependent operations as nodes and specifying data flow paths between nodes as edges, the computational graph created based on a model architecture of the machine-learning model;
- identifying, based upon the computational graph, independent operations within the machine-learning model that are performed during the inference task that can be processed in a different order without changing an output of the inference task;
- generating, using a pseudo-random number generator, randomization parameters for determining an execution order of the independent operations within the machine-learning model that are performed during the inference task;
- ordering the independent operations within the machine-learning model that are performed during the inference task according to the randomization parameters to create a reordered independent operations of the independent operations within the machine-learning model that are performed during the inference task;
- executing the reordered independent operations on the input data to produce an output of the inference task, the reordered independent operations generating randomized execution traces for each inference task of the machine-learning model;
- and
- transmitting the output of the inference task to the requestor.
A non-transitory machine-readable medium, storing instructions for obfuscating execution of operations of a machine-learning model during execution of inference tasks, the instructions, which when executed, cause the machine to perform operations comprising:
- receiving an inference task comprising input data to be processed by the machine-learning model, the inference task received from a requestor;
- creating a computational graph mapping execution dependency of the machine-learning model by representing input-dependent operations as nodes and specifying data flow paths between nodes as edges, the computational graph created based on a model architecture of the machine-learning model;
- identifying, based upon the computational graph, independent operations within the machine-learning model that are performed during the inference task that can be processed in a different order without changing an output of the inference task;
- generating, using a pseudo-random number generator, randomization parameters for determining an execution order of the independent operations within the machine-learning model that are performed during the inference task;
- ordering the independent operations within the machine-learning model that are performed during the inference task according to the randomization parameters to create a reordered independent operations of the independent operations within the machine-learning model that are performed during the inference task;
- executing the reordered independent operations on the input data to produce an output of the inference task, the reordered independent operations generating randomized execution traces for each inference task of the machine-learning model;
- and
- transmitting the output of the inference task to the requestor.
Dependencies are inferred from the claim text.