# US 2025/0147753 A1 · Incremental machine learning model deployment

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0147753 A1
- Document ID: US20250147753A1
- Status: Published application
- Kind: A1
- Application number: 18/939,097
- Filed: 2024-11-06
- Published: 2025-05-08
- Earliest claimed: 2023-11-06
- Assignees: Nokia Technologies Oy
- Applicants: Nokia Technologies Oy
- Inventors: Serhan Gul; Homayun Afrabandpey; Saba Ahsan; Hamed Rezazadegan Tavakoli; Igor Danilo Diego Curcio; Gazi Karam Illahi
- Web page: https://patentgrep.com/patent/US20250147753A1

## CPC

- G06F 8/658: Incremental updates; Differential updates
- G06N 5/04: Inference or reasoning models
- G06N 20/00: Machine learning
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

In accordance with example embodiments of the invention there is at least a method and apparatus to perform executing a machine learning inference loop of a currently deployed or stored at least one machine learning model, wherein the currently deployed or stored at least one machine learning model is identified based on a manifest file received from a communication network; based on determined factors, requesting from the communication network a model update to trigger the model update for use with the currently deployed or stored at least one machine learning model; based on the request, receiving information from the communication network comprising the model update; and based on the information, performing a model update to update the currently deployed or stored at least one machine learning model. Further, receiving, based on determined factors, from a user equipment a communication to trigger a machine learning model update for use with a currently deployed or stored at least one machine learning model at the user equipment; based on the communication, determining information comprising the model update; based on the determining, sending towards the client the information comprising the model update for a model update to update the currently deployed or stored at least one machine learning model.

## Claims

### Claim 1

An apparatus, comprising:
at least one processor; and
at least one memory storing instructions, that when executed by the at least one processor, cause the apparatus at least to:
execute a machine learning inference loop of a currently deployed or stored at least one machine learning model,
wherein the currently deployed or stored at least one machine learning model is identified based on a manifest file received from a communication network;
based on determined factors, request from the communication network a model update to trigger the model update for use with the currently deployed or stored at least one machine learning model;
based on the request, receive information from the communication network comprising the model update; and
based on the information, communicate a trigger for a model update to update the currently deployed or stored at least one machine learning model.

### Claim 2 (depends on 1)

The apparatus of claim 1, wherein
based on the trigger, perform a model update comprising: the at least one memory is storing instructions is executed by the at least one processor, to cause the apparatus to:
based on the information from the communication network, establish a bit incremental model delivery for a split inference session; and
based on the bit incremental model delivery, identify during each of more than one occasion an inference output result from the artificial intelligence inference engine,
wherein based on an inference output result at each occasion of more than one occasion, the model update comprises a model subset bit precision update of the currently deployed or stored at least one machine learning model.

### Claim 3 (depends on 1)

The apparatus of claim 1, wherein the currently deployed or stored at least one machine learning model is based on the at least one memory storing instructions, executed by the at least one processor, to cause the apparatus to:
identify a machine learning model to be downloaded; and
request an identified machine learning model from a server of the communication network.

### Claim 4 (depends on 1)

The apparatus of claim 1, wherein the model update is received with an artificial intelligence model access function of the apparatus.

### Claim 5 (depends on 2)

The apparatus of claim 2, wherein a model run by an inference engine is updated to a higher precision using the model update.

### Claim 6 (depends on 5)

The apparatus of claim 5, wherein the model update is performed on the deployed or stored at least one machine learning model without affecting inference operations being executed by the inference engine.

### Claim 7 (depends on 1)

The apparatus of claim 1, wherein the at least one memory storing instructions, is executed by the at least one processor, to cause the apparatus to:
perform a hot swap between the currently deployed at least one machine learning model and an updated model based on the model update.

### Claim 8 (depends on 1)

The apparatus of claim 1, wherein the model update is based on one or more of:
a model manifest file, information about client resources, network conditions, or machine learning application requirements.

### Claim 9 (depends on 1)

The apparatus of claim 1, wherein the at least one memory storing instructions, is executed by the at least one processor, to cause the apparatus to:
receive an identified model manifest file from the communication network; and
based on at least part of the manifest file, identify a lower precision version of a model or a model subset to be downloaded for use by the artificial intelligence inference engine.

### Claim 10 (depends on 9)

The apparatus of claim 9, wherein the lower precision version of a model or a model subset comprises a representation wherein some or all weights are represented using a bit precision representation lower than that of a corresponding higher precision model or model subset.

### Claim 11 (depends on 9)

The apparatus of claim 9, wherein the lower precision version of a model or a model subset comprises a representation wherein some or all weights are quantized versions of the corresponding weights in a higher precision model or model subset.

### Claim 12 (depends on 9)

The apparatus of claim 9, wherein the lower precision version of a model or a model subset comprises a representation wherein some parts of the computational graph in a higher precision model are pruned, for example, by setting the value a node and its subsequent child nodes to zero.

### Claim 13 (depends on 9)

The apparatus of claim 9, wherein the identified model manifest file is based on one or more of: client resources, network conditions; or machine learning application requirements.

### Claim 14 (depends on 1)

The apparatus of claim 1, wherein the triggering the model update is at a particular time period, and wherein the particular time period is one of:
immediately after receiving the at least one machine learning model, or
triggering the model update after a period of time.

### Claim 15 (depends on 1)

The apparatus of claim 1, wherein the determined factors comprise at least one of:
a model update delivery time, achievable machine learning model accuracy, prospective accuracy improvement achievable with a model update, or a change in accuracy requirements of the client application.

### Claim 16

A method, comprising:
executing a machine learning inference loop of a currently deployed or stored at least one machine learning model,
wherein the currently deployed or stored at least one machine learning model is identified based on a manifest file received from a communication network;
based on determined factors, requesting from the communication network a model update to trigger the model update for use with the currently deployed or stored at least one machine learning model;
based on the request, receiving information from the communication network comprising the model update; and
based on the information, communicate a trigger for a model update to update the currently deployed or stored at least one machine learning model.

### Claim 17

An apparatus, comprising:
at least one processor; and
at least one memory storing instructions, that when executed by the at least one processor, cause the apparatus at least to:
receive, based on determined factors, from a user equipment a communication to trigger a machine learning model update for use with a currently deployed or stored at least one machine learning model at the user equipment;
based on the communication, determine information comprising the model update;
based on the determining, send towards the client the information comprising the model update for a model update to update the currently deployed or stored at least one machine learning model.

### Claim 18 (depends on 17)

The apparatus of claim 17, wherein sending the trigger for the model update comprises: the at least one memory storing instructions executed by the at least one processor, to cause the apparatus to:
based on the information, establish a bit incremental model delivery for a split inference session; and
based on the bit incremental model delivery, identify during each of more than one occasion an inference output result from the artificial intelligence inference engine,
wherein based on an inference output result at each occasion of the more than one occasion, the model update comprises a model subset bit precision update of the currently deployed or stored at least one machine learning model.

### Claim 19 (depends on 17)

The apparatus of claim 17, wherein the currently deployed or stored at least one machine learning model is based on the at least one memory storing instructions, executed by the at least one processor, to cause the apparatus to:
receive from the user equipment a request an the identified machine learning model to be downloaded by the user equipment.

### Claim 20 (depends on 17)

The apparatus of claim 17, wherein the currently deployed or stored at least one machine learning model is based on the at least one memory storing instructions, executed by the at least one processor, to cause the apparatus to:
receive from the user equipment a request for an identified machine learning model.

### Claim 21 (depends on 17)

The apparatus of claim 17, wherein the machine learning model precision update is sent with a network application.

### Claim 22 (depends on 17)

The apparatus of claim 17, wherein the machine learning model precision update is for updating the at least one of the currently deployed or stored at least one machine learning model to a higher precision model.

### Claim 23 (depends on 17)

The apparatus of claim 17, wherein the machine learning model precision update is for use on the stored at least one machine learning model without affecting inference operations being executed by the client.

### Claim 24 (depends on 17)

The apparatus of claim 17, wherein the precision update comprises a hot swap between the currently deployed at least one machine learning model and an updated model based on the precision update.

### Claim 25 (depends on 17)

The apparatus of claim 17, wherein the model update is based on one or more of:
a model manifest file, information about client resources, network conditions, or machine learning application requirements.

### Claim 26 (depends on 17)

The apparatus of claim 17, wherein the at least one memory storing instructions, is executed by the at least one processor, to cause the apparatus to:
send an identified model manifest file from the communication network, wherein based on at least part of the manifest file, a lower precision version of a model or a model subset can be identified to be downloaded for use by the client.

### Claim 27 (depends on 26)

The apparatus of claim 26, wherein the lower precision version of a model or a model subset comprises a representation wherein some or all weights are represented using a bit precision representation lower than that of a corresponding higher precision model or model subset.

### Claim 28 (depends on 26)

The apparatus of claim 26, wherein the lower precision version of a model or a model subset comprises a representation wherein some or all weights are quantized versions of the corresponding weights in a higher precision model or model subset.

### Claim 29 (depends on 26)

The apparatus of claim 26, wherein the lower precision version of a model or a model subset comprises a representation wherein some parts of the computational graph in a higher precision model are pruned, for example, by setting the value a node and its subsequent child nodes to zero.

### Claim 30 (depends on 26)

The apparatus of claim 26, wherein the identified model manifest file is based on one or more of: client resources, network conditions; or
machine learning application requirements.

### Claim 31 (depends on 17)

The apparatus of claim 17, wherein the triggering the model update is at a particular time period, and wherein the particular time period is one of:
immediately after receiving the at least one machine learning model, or
triggering the model update after a period of time

### Claim 32 (depends on 17)

The apparatus of claim 17, wherein the determined factors comprise at least one of:
a model update delivery time,
achievable machine learning model accuracy,
prospective accuracy improvement achievable with a model update, or a change in accuracy requirements of the client application.

### Claim 33

A method, comprising:
receiving, based on determined factors, from a user equipment a communication to trigger a machine learning model update for use with a currently deployed or stored at least one machine learning model at the user equipment;
based on the communication, determining information comprising the model update;
based on the determining, sending towards the client the information comprising the model update for a model update to update the currently deployed or stored at least one machine learning model.
