# US 2026/0030508 A1 · Dynamic compression by reinforcement learning in a distributed learning environment

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0030508 A1
- Document ID: US20260030508A1
- Status: Published application
- Kind: A1
- Application number: 18/783,235
- Filed: 2024-07-24
- Published: 2026-01-29
- Earliest claimed: 2024-07-24
- Applicants: VMware LLC
- Inventors: Yaniv Ben-Izhak; Shay Vargaftik
- Web page: https://patentgrep.com/patent/US20260030508A1

## CPC

- G06N 3/092: Reinforcement learning
- G06N 3/084: Backpropagation, e.g. using gradient descent
- G06N 3/098: Distributed learning, e.g. federated learning
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

An example device includes: a first system configured to implement a model having first parameters, generate gradients for the first parameters in response to training the model on first data sets, and compress the gradients based on second parameters; and circuits in the first system, the circuits including a network interface controller. The first system is further configured to receive updates to the second parameters from a second system through the network interface controller coupled to a network, send the gradients as compressed to a third system through the network interface controller, and apply the updates to the second parameters to adjust resource consumption of at least one of the circuits.

## Claims

### Claim 1

A device, comprising:
a first system configured to implement a model having first parameters, generate gradients for the first parameters in response to training the model on first data sets, and compress the gradients based on second parameters; and
circuits in the first system, the circuits including a network interface controller;
wherein the first system is further configured to receive updates to the second parameters from a second system through the network interface controller coupled to a network, send the gradients as compressed to a third system through the network interface controller, and apply the updates to the second parameters to adjust resource consumption of at least one of the circuits.

### Claim 2 (depends on 1)

The device of claim 1, wherein the model is a local model of the device, wherein the third system is configured to implement a global model, and wherein the network interface controller is configured to receive updates to the first parameters from the third system based on the global model.

### Claim 3 (depends on 1)

The device of claim 1, wherein the first system is configured to generate second data sets comprising state of the device, and wherein the network interface controller is configured to send the second data sets to the second system over the network as input to a reinforcement learning (RL) model implemented by the second system.

### Claim 4 (depends on 3)

The device of claim 3, wherein the first system is configured to generate third data sets comprising measurements of the resource consumption, and wherein the network interface circuit is configured to send the third data sets to the second system over the network as input to the RL model.

### Claim 5 (depends on 3)

The device of claim 3, wherein the second data sets comprise first data describing state of the circuits and second data describing state of the model.

### Claim 6 (depends on 1)

The device of claim 1, wherein a parameter of the second parameters comprises a number of bits per coordinate of the gradients, and wherein the updates to the second parameters include a change to the number of bits per coordinate.

### Claim 7 (depends on 1)

The device of claim 1, wherein a parameter of the second parameters comprises a compression algorithm for compressing the gradients, and wherein the updates to the second parameters include a change of the compression algorithm.

### Claim 8 (depends on 1)

The device of claim 1, wherein the first system comprises a digital logic circuit configured to implement compression of the gradients, and wherein the first system is configured to adjust the digital logic circuit to apply the updates to the second parameters.

### Claim 9

An apparatus, comprising:
a first server, coupled to a network, configured to implement a first model;
a second server, coupled to the network, configured to implement a second model; and
a client device including circuits, the circuits including a network interface controller coupled to the network, the client device configured to:
implement a third model having first parameters;
generate gradients for the first parameters in response to training the third model on first data sets;
compress the gradients based on second parameters;
receive, through the network interface controller, updates to the second parameters from the second server;
send, through the network interface controller, the gradients as compressed to the first server; and
apply the updates to the second parameters to adjust resource consumption of at least one of the circuits.

### Claim 10 (depends on 9)

The apparatus of claim 9, wherein the first model comprises a global model for multiple client devices including the client device, wherein the second model comprises a reinforcement learning (RL) model, and wherein the second server is configured to:
receive, over the network, first state of the client devices;
receive, over the network, measurements of resource consumption in the client devices; and
apply the first state and the measurements of resource consumption to the RL model to generate the updates to the second parameters.

### Claim 11 (depends on 10)

The apparatus of claim 10, wherein the second server is further configured to receive, over the network, second state of the global model from the first server, and apply the second state to the RL model along with the first state and the measurements or resource consumption to generate the updates to the second parameters.

### Claim 12 (depends on 10)

The apparatus of claim 10, wherein the second server is configured to send the updates to the second parameters to each of the multiple client devices over the network.

### Claim 13 (depends on 10)

The apparatus of claim 10, wherein the first state includes first data describing state of the circuits of the client device and second data describing state of the third model.

### Claim 14 (depends on 9)

The apparatus of claim 9, wherein client device a digital logic circuit configured to implement compression of the gradients, and wherein the client device is configured to adjust the digital logic circuit to apply the updates to the second parameters.

### Claim 15 (depends on 9)

The apparatus of claim 9, wherein the circuits of the client device include a power supply, and wherein the client device is configured to apply the updates to the second parameters to adjust power consumption from the power supply by the client device.

### Claim 16 (depends on 9)

The apparatus of claim 9, wherein a parameter of the second parameters comprises a number of bits per coordinate of the gradients, and wherein the updates to the second parameters include a change to the number of bits per coordinate.

### Claim 17 (depends on 9)

The apparatus of claim 9, wherein a parameter of the second parameters comprises a compression algorithm for compressing the gradients, and wherein the updates to the second parameters include a change of the compression algorithm.

### Claim 18

A method of data transmission in a network, comprising:
implementing, by a first system of a device coupled to the network, a model having first parameters;
generating, by the first system, gradients for the first parameters in response to training the model on first data sets;
compressing, by the first system, the gradients based on second parameters;
receiving, at the first system over the network, updates to the second parameters from a second system;
sending, from the first system over the network, the gradients as compressed to a third system; and
applying, by the first system, the updates to the second parameters to adjust resource consumption of at least one circuit in the device.

### Claim 19 (depends on 18)

The method of claim 18, further comprising:
generating, by the first system, second data sets comprising state of the device;
generating, by the first system, third data sets comprising measurements of the resource consumption; and
sending, by the first system over the network, the second and third data sets to the second system as input to a reinforcement learning (RL) model implemented in the second system to generate the updates to the second parameters.

### Claim 20 (depends on 18)

The method of claim 18, wherein the device comprises a digital logic circuit that implements at least a portion of the model and compresses the gradients, and wherein the method comprises:
adjusting the digital logic to apply the updates to the second parameters.
