# US 2026/0087267 A1 · Different neural network encoders for different portions of a set of information

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0087267 A1
- Document ID: US20260087267A1
- Status: Published application
- Kind: A1
- Application number: 18/898,473
- Filed: 2024-09-26
- Published: 2026-03-26
- Earliest claimed: 2024-09-26
- Assignees: NVIDIA Corporation
- Applicants: NVIDIA Corporation
- Inventors: Shantanu Acharya; Fei Jia; Boris Ginsburg
- Web page: https://patentgrep.com/patent/US20260087267A1

## CPC

- G06F 40/40: Processing or translation of natural language (natural language analysis G06F40/20; semantic analysis G06F40/30)
- G06F 40/284: Lexical analysis, e.g. tokenisation or collocates
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Apparatuses, systems, and techniques to use two or more neural networks to encode two or more different portions of a a set of information are described. In at least one embodiment, two or more neural network encoders are used to encode two or more different portions of a set of information to be used by two or more networks that each include one of the two or more neural networks respectively.

## Claims

### Claim 1

A processor, comprising:
one or more circuits to use two or more neural network encoders to encode two or more different portions of a set of information to be used by two or more neural networks, each comprising one of the two or more neural network encoders, respectively.

### Claim 2 (depends on 1)

The processor of claim 1, wherein the one or more circuits further use the two or more neural network encoders to encode a same input to be used by the two or more neural networks.

### Claim 3 (depends on 2)

The processor of claim 2, wherein the set of information is a context, wherein the same input is a question, and wherein the two or more neural networks are respective copies of a Large Language Model (LLM).

### Claim 4 (depends on 2)

The processor of claim 2,
wherein to use the two or more neural network encoders to encode the two or more different portions of the set of information, the one or more circuits apply local attention; and
wherein to use the two or more neural network encoders to encode the same input to be used by the two or more neural network encoders to encode the same input, the one or more circuits apply global attention.

### Claim 5 (depends on 1)

The processor of claim 1, wherein individual ones of the two or more neural networks are executed by respective ranks of one or more graphics processor units (GPUs) that store encoded values of the two or more different portions of the set of information in respective key-value caches.

### Claim 6 (depends on 1)

The processor of claim 1, wherein the two or more neural network encoders use a same portion of the set of information as additional data to encode at least one of the two or more different portions.

### Claim 7 (depends on 1)

The processor of claim 1, wherein the two or more neural network encoders use different, adjacent portions of the set of information as additional data to encode at least one of the two or more different portions.

### Claim 8

A method, comprising:
using two or more neural network encoders to encode two or more different portions of a set of information to be used by two or more neural networks, each comprising one of the two or more neural network encoders, respectively.

### Claim 9 (depends on 8)

The method of claim 8, further comprising using the two or more neural network encoders to encode a same input to be used by the two or more neural networks.

### Claim 10 (depends on 9)

The method of claim 9, wherein the set of information is a context, wherein the same input is a question, and wherein the two or more neural networks are respective copies of a Large Language Model (LLM).

### Claim 11 (depends on 9)

The method of claim 9,
wherein using the two or more neural network encoders to encode the two or more different portions of the set of information comprises applying local attention; and
wherein using the two or more neural network encoders to encode the same input to be used by the two or more neural network encoders to encode the same input comprises applying global attention.

### Claim 12 (depends on 8)

The method of claim 8, wherein individual ones of the two or more neural networks are executed by respective ranks of one or more graphics processor units (GPUs) that store encoded values of the two or more different portions of the set of information in respective key-value caches.

### Claim 13 (depends on 8)

The method of claim 8, wherein the two or more neural network encoders use a same portion of the set of information as additional data to encode at least one of the two or more different portions.

### Claim 14 (depends on 8)

The method of claim 8, wherein the two or more neural network encoders use different, adjacent portions of the set of information as additional data to encode at least one of the two or more different portions.

### Claim 15

A system, comprising:
one or more processors to use two or more neural network encoders to encode two or more different portions of a set of information to be used by two or more neural networks, each comprising one of the two or more neural network encoders, respectively; and
one or more memories to store weights of the two or more neural networks.

### Claim 16 (depends on 15)

The system of claim 15, wherein the one or more processors further use the two or more neural network encoders to encode a same input to be used by the two or more neural networks.

### Claim 17 (depends on 16)

The system of claim 16, wherein the set of information is a context, wherein the same input is a question, and wherein the two or more neural networks are respective copies of a Large Language Model (LLM).

### Claim 18 (depends on 15)

The system of claim 15, wherein individual ones of the two or more neural networks are executed by respective ranks of one or more graphics processor units (GPUs) that store encoded values of the two or more different portions of the set of information in respective key-value caches.

### Claim 19 (depends on 15)

The system of claim 15, wherein the two or more neural network encoders use a same portion of the set of information as additional data to encode at least one of the two or more different portions.

### Claim 20 (depends on 15)

The system of claim 15, wherein the two or more neural network encoders use different, adjacent portions of the set of information as additional data to encode at least one of the two or more different portions.
