# US 2025/0054157 A1 · Information processing apparatus, information processing method, and non-transitory recording medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0054157 A1
- Document ID: US20250054157A1
- Status: Published application
- Kind: A1
- Application number: 18/722,729
- Filed: 2021-12-24
- Published: 2025-02-13
- Earliest claimed: 2021-12-24
- Assignees: NEC Corporation
- Applicants: NEC Corporation
- Inventors: Hiroshi FUKUI
- Web page: https://patentgrep.com/patent/US20250054157A1

## CPC

- G06T 7/11: Region-based segmentation
- G06F 17/15: Correlation function computation {including computation of convolution operations (arithmetic circuits for sum of products per se, e.g. multiply-accumulators G06F7/5443; digital filters, e.g. FIR, IIR, adaptive filters H03H17/00)}
- G06T 3/4046: using neural networks
- G06V 10/50: by performing operations within image blocks; by using histograms, e.g. histogram of oriented gradients [HoG]; by summing image-intensity values; Projection analysis
- G06V 10/82: using neural networks
- G06V 10/955: {using specific electronic processors}
- G06T 2207/20021: Dividing image into blocks, subimages or windows
- G06T 2207/20084: Artificial neural networks [ANN]
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

An information processing apparatus includes: a generation unit that generates a patch token and a prefix token corresponding to an input image; an extension unit that extends the prefix token to a prefix token block having a size corresponding to a number of a plurality of patch token blocks into which the patch token is segmented in accordance with a predetermined grid pattern; and an arithmetic unit that performs an arithmetic operation on the prefix token block and the patch token blocks, on the basis of a self-attention mechanism, for each group of elements located at a common position in the respective blocks. According to the information processing apparatus, it is possible to properly perform processing based on the self-attention mechanism on the input image.

## Claims

### Claim 1

An information processing apparatus comprising:
at least one memory that is configured to store instructions; and
at least one processor that is configured to execute the instructions to:
generate a patch token and a prefix token corresponding to an input image;
extend the prefix token to a prefix token block having a size corresponding to a number of a plurality of patch token blocks into which the patch token is segmented in accordance with a predetermined grid pattern; and
perform an arithmetic operation on the prefix token block and the patch token blocks, on the basis of a self-attention mechanism, for each group of elements located at a common position in the respective blocks.

### Claim 2 (depends on 1)

The information processing apparatus according to claim 1, wherein the at least one processor is configured to execute the instructions to restore a size of a feature quantity corresponding to the prefix token block, of feature quantities obtained as a result of the arithmetic operation, to a size of the prefix token before extension.

### Claim 3 (depends on 2)

The information processing apparatus according to claim 2, wherein the at least one processor is configured to execute the instructions to restore the size of the feature quantity corresponding to the prefix token block, to the size of the prefix token before extension, by calculating a mean value of elements included in the feature quantity.

### Claim 4 (depends on 2)

The information processing apparatus according to claim 2, wherein the at least one processor is configured to execute the instructions to restore the size of the feature quantity corresponding to the prefix token block, to the size of the prefix token before extension, by calculating a maximum value of elements included in the feature quantity.

### Claim 5 (depends on 1)

The information processing apparatus according to claim 1, wherein the at least one processor is configured to execute the instructions to modify the patch token to a tensor that provides a 1×1 convolutional layer in each block.

### Claim 6 (depends on 5)

The information processing apparatus according to claim 5, wherein the at least one processor is configured to execute the instructions to modify a tensor, for at least one of a query, a key, and a value in the self-attention mechanism and a feature quantity obtained as a result of the arithmetic operation of the self-attention mechanism.

### Claim 7

An information processing method that is executed by at least one computer, the information processing method comprising:
generating a patch token and a prefix token corresponding to an input image;
extending the prefix token to a prefix token block having a size corresponding to a number of a plurality of patch token blocks into which the patch token is segmented in accordance with a predetermined grid pattern; and
performing an arithmetic operation on the prefix token block and the patch token blocks, on the basis of a self-attention mechanism, for each group of elements located at a common position in the respective blocks.

### Claim 8

A non-transitory recording medium on which a computer program that allows at least one computer to execute an information processing method is recorded, the information processing method including:
generating a patch token and a prefix token corresponding to an input image;
extending the prefix token to a prefix token block having a size corresponding to a number of a plurality of patch token blocks into which the patch token is segmented in accordance with a predetermined grid pattern; and
performing an arithmetic operation on the prefix token block and the patch token blocks, on the basis of a self-attention mechanism, for each group of elements located at a common position in the respective blocks.
