# US 2026/0065160 A1 · Information processing system, information processing device, information processing method, scheduling method, information processing program, and scheduling program

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0065160 A1
- Document ID: US20260065160A1
- Status: Published application
- Kind: A1
- Application number: 19/312,980
- Filed: 2025-08-28
- Published: 2026-03-05
- Earliest claimed: 2024-08-30
- Assignees: Preferred Networks, Inc.
- Applicants: Preferred Networks, Inc.
- Inventors: Hiroaki MIKAMI; Gentaro WATANABE
- Web page: https://patentgrep.com/patent/US20260065160A1

## CPC

- G06N 20/00: Machine learning
- G06F 9/5027: {the resource being a machine, e.g. CPUs, Servers, Terminals}
- G06F 9/5066: {Algorithms for mapping a plurality of inter-dependent sub-tasks onto a plurality of physical CPUs (mappping at compile time, see G06F8/451)}
- G06N 3/045: Combinations of networks
- G06F 2209/5017: Task decomposition
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

An information processing system includes a plurality of memories and a plurality of processors configured to perform parallel processing using a model. The plurality of processors execute communication processing of a result of executing computational processing using at least a part of the model for first input data, and computational processing using at least a part of the model for second input data, such that processing periods of the communication processing and the computational processing at least partially overlap.

## Claims

### Claim 1

An information processing system comprising a plurality of memories and a plurality of processors configured to perform parallel processing using a model,
wherein the plurality of processors execute communication processing of a result of executing computational processing using at least a part of the model for first input data, and computational processing using at least a part of the model for second input data, such that processing periods of the communication processing and the computational processing at least partially overlap.

### Claim 2 (depends on 1)

The information processing system as claimed in claim 1, wherein the parallel processing is processing using intra-layer parallelism.

### Claim 3 (depends on 1)

The information processing system as claimed in claim 1, wherein the first input data and the second input data are data based on two micro-batches adjacent in a processing order in a training process of the model.

### Claim 4 (depends on 1)

The information processing system as claimed in claim 1, wherein the first input data and the second input data are data used in an inference process using the model.

### Claim 5 (depends on 1)

The information processing system as claimed in claim 1,
wherein the parallel processing is performed by using at least tensor parallelism,
wherein processors used for the tensor parallelism each execute computational processing using a partitioned model parameter and at least one of the first input data or the second input data;
wherein the partitioned model parameter is obtained by partitioning model parameters of the model based on a number of the processors used for the tensor parallelism.

### Claim 6 (depends on 5)

The information processing system as claimed in claim 5,
wherein a first processor executes computational processing using a first model parameter after the partitioning and the first input data,
wherein a second processor executes computational processing using a second model parameter after the partitioning and the first input data,
wherein communication processing of sending and receiving a result of the first processor executing the computational processing and a result of the second processor executing the computational processing between the first processor and the second processor is executed,
wherein the first processor executes computational processing using the first model parameter and the second input data such that a processing period of the computational processing and a processing period of the communication processing at least partially overlap; and
wherein the second processor executes computational processing using the second model parameter and the second input data such that a processing period of the computational processing and a processing period of the communication processing at least partially overlap.

### Claim 7 (depends on 1)

The information processing system as claimed in claim 1,
wherein the parallel processing is performed by using at least sequence parallelism,
wherein the first input data and the second input data are partitioned based on a number of processors used for the sequence parallelism, and
wherein the processors used for the sequence parallelism each execute computational processing using at least one of the partitioned first input data or the partitioned second input data and a model parameter of the model.

### Claim 8 (depends on 7)

The information processing system as claimed in claim 7,
wherein a first processor executes computational processing using one of the partitioned first input data and the model parameter,
wherein a second processor executes computational processing using another one of the partitioned first input data and the model parameter,
wherein communication processing of sending and receiving a result of the first processor executing the computational processing and a result of the second processor executing the computational processing between the first processor and the second processor is executed,
wherein the first processor executes computational processing using one of the partitioned second input data and the model parameter such that a processing period of the computational processing and a processing period of the communication processing at least partially overlap, and
wherein the second processor executes computational processing using another one of the partitioned second input data and the model parameter such that a processing period of the computational processing and a processing period of the communication processing at least partially overlap.

### Claim 9 (depends on 1)

The information processing system as claimed in claim 1,
wherein the parallel processing is performed by using a combination of tensor parallelism and sequence parallelism,
wherein the first input data and the second input data are partitioned based on a number of processors used for the combination of the tensor parallelism and the sequence parallelism,
wherein the processors each execute computational processing using a partitioned model parameter and at least one of the partitioned first input data or the partitioned second input data, and
wherein the partitioned model parameter is obtained by partitioning model parameters of the model based on a number of the processors used for the combination of the tensor parallelism and the sequence parallelism.

### Claim 10 (depends on 1)

The information processing system as claimed in claim 1,
wherein the model is a neural network, and
wherein the computational processing and the communication processing are computational processing and communication processing in the neural network.

### Claim 11 (depends on 10)

The information processing system as claimed in claim 10,
wherein the neural network includes a Transformer, and
wherein the computational processing and the communication processing include at least computational processing and communication processing in one of an attention block of an encoder included in the Transformer, a multi-layer perceptron (MLP) block of the encoder, or an MLP block of a decoder included in the Transformer.

### Claim 12

An information processing system comprising: a plurality of memories and a plurality of processors configured to perform expert parallel processing using a plurality of experts,
wherein the plurality of processors execute transmission processing of transmitting, to an expert, a token corresponding to the expert, and computational processing for the token in the expert, such that processing periods of the transmission processing and the computational processing at least partially overlap.

### Claim 13

An information processing method comprising executing, by a plurality of processors of an information processing device configured to perform parallel processing using a model, communication processing of a result of executing computational processing using at least a part of the model for first input data and computational processing using at least a part of the model for second input data, such that processing periods of the communication processing and the computational processing at least partially overlap.

### Claim 14 (depends on 13)

The information processing method as claimed in claim 13, wherein the parallel processing is processing using intra-layer parallelism.

### Claim 15 (depends on 13)

The information processing method as claimed in claim 13, wherein the first input data and the second input data are data based on two micro-batches adjacent in a processing order in a training process of the model.

### Claim 16 (depends on 13)

The information processing method as claimed in claim 13, wherein the first input data and the second input data are data used in an inference process using the model.

### Claim 17 (depends on 13)

The information processing method as claimed in claim 13,
wherein the parallel processing is performed by using at least tensor parallelism,
wherein processors used for the tensor parallelism each execute computational processing using a partitioned model parameter and at least one of the first input data or the second input data;
wherein the partitioned model parameter is obtained by partitioning model parameters of the model based on a number of the processors used for the tensor parallelism.

### Claim 18 (depends on 13)

The information processing method as claimed in claim 13,
wherein the parallel processing is performed by using at least sequence parallelism,
wherein the first input data and the second input data are partitioned based on a number of processors used for the sequence parallelism, and
wherein the processors used for the sequence parallelism each execute computational processing using at least one of the partitioned first input data or the partitioned second input data and a model parameter of the model.

### Claim 19 (depends on 13)

The information processing method as claimed in claim 13,
wherein the parallel processing is performed by using a combination of tensor parallelism and sequence parallelism,
wherein the first input data and the second input data are partitioned based on a number of processors used for the combination of the tensor parallelism and the sequence parallelism,
wherein the processors each execute computational processing using a partitioned model parameter and at least one of the partitioned first input data or the partitioned second input data, and
wherein the partitioned model parameter is obtained by partitioning model parameters of the model based on a number of the processors used for the combination of the tensor parallelism and the sequence parallelism.

### Claim 20 (depends on 13)

The information processing method as claimed in claim 13,
wherein the model is a neural network, and
wherein the computational processing and the communication processing are computational processing and communication processing in the neural network.
