# US 2025/0384271 A1 · Parameter-efficient neural network model adaptation and inference via matrix sharing

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0384271 A1
- Document ID: US20250384271A1
- Status: Published application
- Kind: A1
- Application number: 18/740,772
- Filed: 2024-06-12
- Published: 2025-12-18
- Earliest claimed: 2024-06-12
- Assignees: Adobe Inc.
- Applicants: Adobe Inc.
- Inventors: Zhao SONG; Ritwik Sinha; Raghavendra Kiran Addanki; Lichen Zhang
- Web page: https://patentgrep.com/patent/US20250384271A1

## CPC

- G06N 3/082: modifying the architecture, e.g. adding, deleting or silencing nodes or connections
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

Some aspects relate to technologies for neural network model adaptation and inference for multiple tasks via matrix sharing. In accordance with some aspects, a neural network model is accessed that has a pre-trained matrix at a layer of the neural network model. A shared matrix and a task matrix are added to the pre-trained matrix at the layer of the neural network model. The neural network model is trained for a plurality of tasks by updating the task matrix for each task to provide a trained task matrix for each task while maintaining the pre-trained matrix and the shared matrix the same for all tasks.

## Claims

### Claim 1

One or more computer storage media storing computer-useable instructions that, when used by one or more computing devices, cause the one or more computing devices to perform operations, the operations comprising:
accessing a neural network model with a pre-trained matrix at a layer of the neural network model;
adding a shared matrix and a task matrix to the pre-trained matrix at the layer of the neural network model; and
training the neural network model for a plurality of tasks by updating the task matrix for each task to provide a trained task matrix for each task while maintaining the pre-trained matrix and the shared matrix the same for all tasks.

### Claim 2 (depends on 1)

The one or more computer storage media of claim 1, wherein the operations further comprise:
receiving an input for a first task from the plurality of tasks; and
performing the first task using the pre-trained matrix, the shared matrix, and the trained task matrix for the first task at the layer of the neural network model.

### Claim 3 (depends on 2)

The one or more computer storage media of claim 2, wherein the operations further comprise:
determining the input corresponds to the first task; and
accessing the trained task matrix in response to determining the input corresponds to the first task.

### Claim 4 (depends on 2)

The one or more computer storage media of claim 2, wherein the operations further comprise:
receiving an input for a second task from the plurality of tasks; and
performing the second task using the pre-trained matrix, the shared matrix, and the trained task matrix for the second task at the layer of the neural network model.

### Claim 5 (depends on 4)

The one or more computer storage media of claim 4, wherein the second task is performed after performing the first task by:
subtracting the trained task matrix for the first task to obtain the pre-trained matrix and the shared matrix; and
adding the trained task matrix for the second task.

### Claim 6 (depends on 1)

The one or more computer storage media of claim 1, wherein parameters of the shared matrix are initialized with random Gaussian values.

### Claim 7 (depends on 1)

The one or more computer storage media of claim 1, wherein parameters of the task matrix are initialized with zero values.

### Claim 8 (depends on 1)

The one or more computer storage media of claim 1, wherein the neural network model comprises a second pre-trained matrix at a second layer, and wherein the operations further comprise:
adding a second shared matrix and a second task matrix to the second pre-trained matrix at the second layer of the neural network model; and
wherein the neural network model is trained for the plurality of tasks by also updating the second task matrix for each task to provide a trained second task matrix for each task while maintaining the second pre-trained matrix and the second shared matrix for all tasks.

### Claim 9

A computer-implemented method comprising:
receiving, at a model inference component, an input for a task;
determining, by the model inference component, a task type for the input;
retrieving, from a data store, a task matrix for a layer of a neural network model based on the task type, the layer of the neural network model including a pre-trained matrix and a shared matrix, the shared matrix being shared by one or more other tasks; and
performing the task for the input using the neural network model with the pre-trained matrix, the shared matrix, and the task matrix at the layer of the neural network model.

### Claim 10 (depends on 9)

The computer-implemented method of claim 9, wherein the neural network model includes a second layer having a second pre-trained matrix and a second shared matrix, the second shared matrix being shared by the one or more other tasks, and wherein the method further comprises:
retrieving, from the data store, a second task matrix for the second layer of the neural network model based on the task type; and wherein the task is performed for the input using the second pre-trained matrix, the second shared matrix, and the second task matrix at the second layer of the neural network model.

### Claim 11 (depends on 9)

The computer-implemented method of claim 9, wherein the method further comprises:
receiving a second input for a second task;
determining, by the model inference component, a second task type for the second input;
retrieving, from the data store, a second task matrix for the layer of the neural network model based on the second task type; and
performing the second task for the second input using the neural network model with the pre-trained matrix, the shared matrix, and the second task matrix at the layer of the neural network model.

### Claim 12 (depends on 11)

The computer-implemented method of claim 11, wherein performing the second task for the second input comprises:
subtracting the task matrix to obtain the pre-trained matrix and shared matrix; and
adding the second task matrix.

### Claim 13

A computer system comprising:
one or more processors; and
one or more computer storage media storing computer-useable instructions that, when used by the one or more processors, causes the computer system to perform operations comprising:
accessing a neural network model having a first-layer pre-trained matrix for a first layer of the neural network model;
supplementing, by a matrix supplementation component, the first-layer pre-trained matrix with a first-layer shared matrix and a first-layer task matrix to provide a supplemented neural network model;
freezing, by a task-specific model training component, parameters of the first-layer pre-trained matrix and parameters of the first-layer shared matrix; and
fine-tuning, by the task-specific model training component, the supplemented neural network model for a first task by updating parameters of the first-layer task matrix using a first set of training data to provide a trained first-layer first-task matrix.

### Claim 14 (depends on 13)

The computer system of claim 13, wherein the operations further comprise:
receiving an input for the first task; and
performing the first task using the first-layer pre-trained matrix, the first-layer shared matrix, and the trained first-layer first-task matrix.

### Claim 15 (depends on 14)

The computer system of claim 14, wherein the operations further comprise:
determining the input corresponds to the first task; and
accessing the trained first-layer first-task matrix in response to determining the input corresponds to the first task.

### Claim 16 (depends on 13)

The computer system of claim 13, wherein the operations further comprise:
fine-tuning the supplemented neural network model for a second task by updating the first-layer task matrix using a second set of training data to provide a trained first-layer second-task matrix.

### Claim 17 (depends on 16)

The computer system of claim 16, wherein the operations further comprise:
receiving an input for the second task; and
performing the second task using the first-layer pre-trained matrix, the first-layer shared matrix, and the trained first-layer second-task matrix.

### Claim 18 (depends on 17)

The computer system of claim 17, wherein the second task is performed after performing the first task by:
subtracting the trained first-layer first-task matrix to obtain the first-layer pre-trained matrix and the first-layer shared matrix; and
adding the trained first-layer second-task matrix.

### Claim 19 (depends on 13)

The computer system of claim 13, wherein the parameters of the first-layer shared matrix are initialized with random Gaussian values, and wherein the parameters of the first-layer task matrix are initialized with zero values.

### Claim 20 (depends on 13)

The computer system of claim 13, wherein the neural network model comprises a second-layer pre-trained matrix for a second layer, and wherein the operations further comprise:
supplementing the second-layer pre-trained matrix with a second-layer shared matrix and a second-layer task matrix to provide the supplemented neural network model;
freezing parameters of the second-layer pre-trained matrix and the second-layer shared matrix; and
wherein the supplemented neural network model is fine-tuned for the first task by also updating parameters of the second-layer task matrix using the first set of training data to provide a trained second-layer first-task matrix.
