# US 2023/0274467 A1 · Image encoding apparatus, image encoding method and program

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0274467 A1
- Document ID: US20230274467A1
- Status: Published application
- Kind: A1
- Application number: 18/015,303
- Filed: 2020-07-13
- Published: 2023-08-31
- Earliest claimed: 2020-07-13
- Assignees: Nippon Telegraph and Telephone Corporation
- Applicants: Nippon Telegraph and Telephone Corporation
- Inventors: Shiori SUGIMOTO; Takayuki KUROZUMI; Hideaki KIMATA
- Web page: https://patentgrep.com/patent/US20230274467A1

## CPC

- G06T 9/002: {using neural networks}
- H04N 19/90: using coding techniques not provided for in groups H04N19/10-H04N19/85, e.g. fractals
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

An image encoding method is an image encoding method executed by an image encoding device, the method including: a feature map generating step of generating a first feature map representing a feature of an encoding target image which is an encoding target image and a second feature map representing a feature of the encoding target image at different resolutions; a correlation map generation step of generating a correlation map representing a correlation distribution between the first and second feature maps; a contraction function generation step of generating a contraction function which is a function used for a contraction process for a predetermined image in a decoding process based on the correlation map; and an encoding step of executing an encoding process on the contraction function and outputting a result of the encoding process.

## Claims

### Claim 1

An image encoding method executed by an image encoding device, the method comprising:
a feature map generating step of generating a first feature map representing a feature of an encoding target image which is an encoding target image and a second feature map representing a feature of the encoding target image at different resolutions;
a correlation map generation step of generating a correlation map representing a correlation distribution between the first and second feature maps;
a contraction function generation step of generating a contraction function which is a function used for a contraction process for a predetermined image in a decoding process based on the correlation map; and
an encoding step of executing an encoding process on the contraction function.

### Claim 2 (depends on 1)

The image encoding method according to claim 1, wherein, in the contraction function generation step, a positional deviation amount and a positional deviation direction of a corresponding point between the correlation maps, a resolution of each of the correlation maps, and a rotational deviation amount and a rotational direction of a corresponding point between the correlation maps are estimated based on a position of a correlation peak in the correlation map, and the contraction function is generated based on an estimation result.

### Claim 3 (depends on 1)

The image encoding method according to claim 1,
wherein the image encoding device includes a neural network, and
in the contraction function generation step, the neural network generates the contraction function using the correlation map as an input.

### Claim 4

Image encoding device comprising:
a processor; and
a storage medium having computer program instructions stored thereon, when executed by the processor, perform to:
generate a first feature map representing a feature of an encoding target image which is an encoding target image and a second feature map representing a feature of the encoding target image at different resolutions;
generate a correlation map representing a correlation distribution between the first and second feature maps;
generate a contraction function which is a function used for a contraction process for a predetermined image in a decoding process based on the correlation map; and
execute an encoding process on the contraction function.

### Claim 5 (depends on 4)

A non-transitory computer-readable medium having computer-executable instructions that, upon execution of the instructions by a processor of a computer, cause the computer to function as as the image encoding device according to claim 4.
