# US 2026/0099712 A1 · Machine learning model compression

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0099712 A1
- Document ID: US20260099712A1
- Status: Published application
- Kind: A1
- Application number: 18/905,761
- Filed: 2024-10-03
- Published: 2026-04-09
- Earliest claimed: 2024-10-03
- Assignees: Salesforce, Inc.
- Applicants: Salesforce, Inc.
- Inventors: Romain Cosentino; Sarath Shekkizhar; Damjan Kalajdzievski; Adam Earle
- Web page: https://patentgrep.com/patent/US20260099712A1

## CPC

- G06N 3/082: modifying the architecture, e.g. adding, deleting or silencing nodes or connections
- G06N 3/0495: Quantised networks; Sparse networks; Compressed networks
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

Techniques are described herein for a method of machine learning model compression. The method includes receiving a machine learning model comprising a plurality of blocks. The method further includes removing one or more blocks of the plurality of blocks to obtain an intermediate machine learning model comprising a subset of the plurality of blocks. The method further includes adding a block to the intermediate machine learning model to obtain a compressed machine learning model. The block generates an output corresponding to an output of the removed one or more blocks of the plurality of blocks. The method further includes executing the compressed machine learning model on a low resource device.

## Claims

### Claim 1

A method comprising:
receiving a machine learning model comprising a plurality of blocks that each comprise a respective stack of sequential layers configured to perform a task in the machine learning model;
removing one or more blocks of the plurality of blocks to obtain an intermediate machine learning model comprising a subset of the plurality of blocks;
adding an approximated block to the intermediate machine learning model to obtain a compressed machine learning model, wherein the approximated block is configured to approximate operation of the removed one or more blocks of the plurality of blocks; and
executing the compressed machine learning model on a low resource device, wherein the executing comprises:
predicting, by the approximated block, a domain-specific region.

### Claim 2 (depends on 1)

The method of claim 1, wherein the removed one or more blocks are sequential blocks of the plurality of blocks.

### Claim 3

(canceled)

### Claim 4 (depends on 1)

The method of claim 1, wherein the executing comprises:
predicting, by the approximated block, a coordinate in an embedding space, wherein the coordinate is based on a sequence of inputs of the machine learning model.

### Claim 5 (depends on 1)

The method of claim 1, wherein the executing comprises:
providing, to the compressed machine learning model, a domain-specific query; and
generating, by the compressed machine learning model, domain-specific natural language text responsive to the domain-specific query.

### Claim 6 (depends on 1)

The method of claim 1, wherein the executing comprises:
receiving, by the approximated block, an embedding of a token;
generating, by the approximated block, an approximated output that approximates an output that would have been generated by the removed one or more blocks of the plurality of blocks, wherein the approximated output is an embedding of a next token.

### Claim 7 (depends on 1)

The method of claim 1, wherein the removed one or more blocks are two or more blocks of the plurality of blocks.

### Claim 8

A non-transitory computer-readable medium storing executable instructions, which when executed by a computing device, cause the computing device to perform operations comprising:
receiving a machine learning model comprising a plurality of blocks that each comprise a respective stack of sequential layers configured to perform a task in the machine learning model;
removing one or more blocks of the plurality of blocks to obtain an intermediate machine learning model comprising a subset of the plurality of blocks;
adding an approximated block to the intermediate machine learning model to obtain a compressed machine learning model, wherein the approximated block is configured to approximate operation of the removed one or more blocks of the plurality of blocks, and wherein the approximated block is configured to predict a domain-specific region; and
providing the compressed machine learning model for execution by a low resource device.

### Claim 9 (depends on 8)

The non-transitory computer-readable medium of claim 8, wherein the removed one or more blocks are sequential blocks of the plurality of blocks.

### Claim 10

(canceled)

### Claim 11 (depends on 8)

The non-transitory computer-readable medium of claim 8, wherein the approximated block is configured to predict a coordinate in an embedding space, wherein the coordinate is based on a sequence of inputs of the machine learning model.

### Claim 12 (depends on 8)

The non-transitory computer-readable medium of claim 8, wherein execution of the compressed machine learning model on the low resource device further comprises:
providing, to the compressed machine learning model, a domain-specific query; and
generating, by the compressed machine learning model, domain-specific natural language text responsive to the domain-specific query.

### Claim 13 (depends on 8)

The non-transitory computer-readable medium of claim 8, the operations further comprising:
receiving, by the approximated block, an embedding of a token;
generating, by the approximated block, and approximated output that approximates an output that would have been generated by the removed one or more blocks of the plurality of blocks, wherein the approximated output is an embedding of a next token.

### Claim 14 (depends on 8)

The non-transitory computer-readable medium of claim 8, wherein the removed one or more blocks are two or more blocks of the plurality of blocks.

### Claim 15

A system comprising:
a computing device configured to perform operations comprising:
receiving a machine learning model comprising a plurality of blocks that each comprise a respective stack of sequential layers configured to perform a task in the machine learning model;
removing one or more blocks of the plurality of blocks to obtain an intermediate machine learning model comprising a subset of the plurality of blocks; and
adding an approximated block to the intermediate machine learning model to obtain a compressed machine learning model, wherein the approximated block is configured to approximate operation of the removed one or more blocks of the plurality of blocks, and wherein the approximated block is configured to predict a domain-specific region; and
a low resource device configured to receive and execute the compressed machine learning model.

### Claim 16 (depends on 15)

The system of claim 15, wherein the removed one or more blocks are sequential blocks of the plurality of blocks.

### Claim 17

(canceled)

### Claim 18 (depends on 15)

The system of claim 15, wherein the approximated block is configured to predict a coordinate of the output in an embedding space, wherein the coordinate is based on a sequence of inputs of the machine learning model.

### Claim 19 (depends on 15)

The system of claim 15, wherein execution of the compressed machine learning model on the low resource device comprises:
providing, to the compressed machine learning model, a domain-specific query; and
generating, by the compressed machine learning model, domain-specific natural language text responsive to the domain-specific query.

### Claim 20 (depends on 15)

The system of claim 15, wherein execution of the compressed machine learning model on the low resource device comprises:
receiving, by the approximated block, an embedding of a token;
generating, by the approximated block, an approximated output that approximates an output that would have been generated by the removed one or more blocks of the plurality of blocks, wherein the approximated output is an embedding of a next token.
