# US 2026/0094048 A1 · Machine learning model pruning system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0094048 A1
- Document ID: US20260094048A1
- Status: Published application
- Kind: A1
- Application number: 18/899,369
- Filed: 2024-09-27
- Published: 2026-04-02
- Earliest claimed: 2024-09-27
- Assignees: Amazon Technologies, Inc.
- Applicants: Amazon Technologies, Inc.
- Inventors: Gilad Amir Rosenberg; John Kyle Brubaker; Martin Schuetz; Helmut Gottfried Katzgraber
- Web page: https://patentgrep.com/patent/US20260094048A1

## CPC

- G06N 3/0499: Feedforward networks
- G06N 20/00: Machine learning
- G06N 3/0495: Quantised networks; Sparse networks; Compressed networks
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

Methods and apparatus for pruning weights of a trained machine learning model and making pruning adjustments to substantially optimize a loss function. In some embodiments, a machine learning model pruning system is configured to perform a first pruning pass of a machine learning model wherein at least a portion of the weights are set to zero. In some embodiments one or more additional pruning passes of the machine learning model may be performed in batches wherein each batch comprises one or more remaining weights and one or more previously pruned weights. In some embodiments, one or more pruning adjustments may be determined based on an optimization problem that minimizes a loss function for a given batch. In some embodiments, the pruning adjustment comprises restoring a previously pruned weight or pruning a remaining weight of the model.

## Claims

### Claim 1

A system comprising:
one or more computing devices configured to implement a machine learning model pruning system, wherein the machine learning model pruning system is configured to:
perform a first pruning pass of a machine learning model wherein at least a portion of the weights are set to zero;
perform one or more additional pruning passes of the machine learning model for one or more respective batches wherein each batch comprises one or more remaining weights and one or more previously pruned weights; and
wherein, performing the one or more pruning passes comprises determining, using an optimization problem, one or more pruning adjustments for a given batch, wherein:
the pruning adjustment comprises restoring a previously pruned weight or pruning a remaining weight of the model; and
wherein the optimization problem is used to find the one or more pruning adjustments for a given batch that substantially minimizes an expected change in value of a loss function for the machine learning model.

### Claim 2 (depends on 1)

The system of claim 1, wherein the machine learning model pruning system is configured to:
assign a weight-scoring metric to respective weights of the machine learning model;
prune, during the first pruning pass, respective ones of the weights with a weight-scoring metric below a threshold.

### Claim 3 (depends on 1)

The system of claim 1, wherein to perform the first pruning pass:
the portion of the weights that are kept corresponds to a target density, wherein the target density corresponds to a target ratio of:
a number of weights of the machine learning model that have been kept; and
a total number of weights of the machine learning model before the machine learning model is pruned.

### Claim 4 (depends on 1)

The system of claim 1, wherein:
the pruning adjustments for a given batch of the one or more additional pruning passes maintains a number of weights not zeroed out after the pruning adjustment to a number of weights not zeroed out before the pruning adjustment within a tolerated range.

### Claim 5 (depends on 1)

The system of claim 1, wherein to determine the one or more pruning adjustments, the machine learning model pruning system is further configured to:
exempt weights from consideration for pruning adjustments based on the exempted weights having at least one of:
a determined predicted significance greater than a threshold;
the determined predicted significance less than another threshold; or
been considered for pruning adjustment in a previous batch of a given layer of the machine learning model.

### Claim 6 (depends on 1)

The system of claim 1 further comprising:
one or more computing devices configured to implement an optimization problem service, wherein the one or more computing devices that implement the machine learning model pruning system are configured to:
provide the optimization problem to the optimization problem service; and
receive results of the optimization problem from the optimization problem service.

### Claim 7 (depends on 6)

The system of claim 6, wherein:
the optimization problem service comprises one or more quantum computing devices; and
the optimization problem is solved using one or more quantum algorithms executed on the one or more quantum computing devices.

### Claim 8 (depends on 6)

The system of claim 6, wherein the optimization solver is configured to:
determine estimated gradients for samples of a batch and estimating a mean gradient based on the estimated gradients of the samples; and
estimate a Hessian of the loss function based on the estimated gradients of the samples.

### Claim 9

A method comprising:
performing a first pruning pass of a machine learning model wherein at least a portion of the weights are set to zero;
performing one or more additional pruning passes of the machine learning model for one or more respective batches wherein each batch comprises one or more remaining weights and one or more previously pruned weights; and
wherein said performing the one or more additional pruning passes comprises determining, using an optimization problem, one or more pruning adjustments for a given batch.

### Claim 10 (depends on 9)

The method of claim 9, wherein performing the one or more additional pruning passes comprises:
finding, by substantially solving the optimization problem, the one or more pruning adjustments for a given batch that minimizes an expected change to a loss function;
wherein the one or more pruning adjustments comprises restoring a previously pruned weight or pruning a remaining weight of the model.

### Claim 11 (depends on 9)

The method of claim 9, further comprising:
assigning a weight-scoring metric to each weight of the machine learning model;
pruning, during the first pruning pass, respective weights with a weight-scoring metric below a threshold.

### Claim 12 (depends on 9)

The method of claim 9, wherein to perform the first pruning pass:
the portion of the weights that are kept corresponds to a target density, wherein the target density corresponds to a target ratio of:
a number of weights of the machine learning model that have been kept; and
a total number of weights of the machine learning model before the machine learning model is pruned.

### Claim 13 (depends on 9)

The method of claim 9, wherein said determining the one or more pruning adjustments for a given batch comprises:
maintaining a number of weights after the pruning adjustment to a number of weights before the pruning adjustment within a tolerated range.

### Claim 14 (depends on 9)

The method of claim 9, wherein determining the one or more pruning adjustments comprises:
exempting weights from consideration for pruning adjustments based on the exempted weights having at least one of:
a determined predicted significance greater than a threshold;
the determined predicted significance less than another threshold; or
been considered for pruning adjustment in a previous batch of a given layer of the machine learning model.

### Claim 15 (depends on 14)

The method of claim 14, wherein determining the one or more pruning adjustments further comprises:
reconsidering weights for pruning adjustment that previously have been exempted from consideration for pruning adjustments, wherein:
the maximum number of exempted weights exempted from consideration for pruning adjustments is a fixed size; and
to reconsider weights for pruning adjustments, other weights are exempted from consideration.

### Claim 16 (depends on 9)

The method of claim 9 wherein performing the one or more additional pruning passes comprises:
substantially solving the optimization problem using one or more computing devices configured to implement an optimization solver to determine one or more pruning adjustments for a given batch.

### Claim 17 (depends on 16)

The method of claim 16, wherein:
substantially solving the optimization problem is performed by the one or more computing devices that are quantum computing devices; and
substantially solving the optimization problem is performed using one or more quantum algorithms executed on the one or more quantum computing devices.

### Claim 18

One or more non-transitory computer-readable storage media storing program instructions that, when executed on or across one or more processors, cause the one or more processors to:
perform a first pruning pass of a machine learning model wherein at least a portion of the weights are set to zero;
perform one or more additional pruning passes of the machine learning model for one or more respective batches wherein each batch comprises one or more remaining weights and one or more previously pruned weights; and
determine, using an optimization problem, one or more pruning adjustments for a given batch, wherein:
the pruning adjustment comprises restoring a previously pruned weight or pruning a remaining weight of the model; and
wherein the optimization problem finds the one or more pruning adjustments for a given batch that substantially minimizes an expected change in a loss function.

### Claim 19 (depends on 18)

The one or more non-transitory computer-readable storage media of claim 18, wherein the program instructions, when executed on or across the one or more processors, cause the one or more processors to:
maintain a number of weights not zeroed out after the pruning adjustment to a number of weights not zeroed out before the pruning adjustment within a tolerated range.

### Claim 20 (depends on 18)

The one or more non-transitory computer-readable storage media of claim 18, wherein the program instructions, when executed on or across the one or more processors, cause the one or more processors to:
exempt weights from consideration for pruning adjustments based on the exempted weights having at least one of:
a determined predicted significance greater than a threshold;
the determined predicted significance less than another threshold; or
been considered for pruning adjustment in a previous batch of a given layer of the machine learning model.
