# US 2026/0073491 A1 · Image processing method, image processing apparatus, image processing system, and manufacturing method of learnt weight

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0073491 A1
- Document ID: US20260073491A1
- Status: Published application
- Kind: A1
- Application number: 19/392,997
- Filed: 2025-11-18
- Published: 2026-03-12
- Earliest claimed: 2019-06-06
- Assignees: Canon Kabushiki Kaisha
- Applicants: Canon Kabushiki Kaisha
- Inventors: NORIHITO HIASA
- Web page: https://patentgrep.com/patent/US20260073491A1

## CPC

- G06T 5/73: Deblurring; Sharpening
- G06N 3/045: Combinations of networks
- G06N 3/0464: Convolutional networks [CNN, ConvNet]
- G06N 3/047: Probabilistic or stochastic networks
- G06N 3/0475: Generative networks
- G06N 3/08: Learning methods
- G06N 3/084: Backpropagation, e.g. using gradient descent
- G06N 3/09: Supervised learning
- G06N 3/094: Adversarial learning
- G06N 20/00: Machine learning
- G06T 5/20: using local operators
- G06T 5/60: using machine learning, e.g. neural networks
- G06N 3/044: Recurrent networks, e.g. Hopfield networks
- G06T 2207/20081: Training; Learning
- G06T 2207/20084: Artificial neural networks [ANN]
- G06T 2207/20172: Image enhancement details
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

An image processing method includes a first step of acquiring input data including a captured image and optical system information relating to a state of an optical system used for capturing the captured image and a second step of inputting the input data to a machine learning model and of generating an estimated image acquired by sharpening the captured image or by reshaping blurs included in the captured image.

## Claims

### Claim 1

An image processing method comprising:
acquiring input data including a captured image and first information indicating a state of an optical system at a time of capturing the captured image, the optical system having been used for capturing the captured image; and
generating an estimated image by inputting the input data to a trained machine learning model.

### Claim 2 (depends on 1)

The image processing method according to claim 1, wherein generating the estimated image uses the trained machine learning model for a first captured image captured in a first state of the optical system and for a second captured image captured in a second state of the optical system that is different from the first state.

### Claim 3 (depends on 1)

The image processing method according to claim 1, wherein the first information includes a numerical value indicating at least one of states of a zoom, Fnumber, and distance from the optical system to an in-focus object, and
wherein the numerical value is normalized based on a range that is can be set in the optical system for the at least one of the states of the zoom, the F-number, and the distance.

### Claim 4 (depends on 1)

The image processing method according to claim 1, wherein the input data includes a state map indicating the state of the optical system, and
wherein the state map is generated based on the number of pixels of the captured image and the first information.

### Claim 5 (depends on 4)

The image processing method according to claim 4, wherein each element of a same channel in the state map is a same numerical value.

### Claim 6 (depends on 1)

The image processing method according to claim 1, wherein the input data further includes second information relating to a position of each pixel of the captured image.

### Claim 7 (depends on 6)

The image processing method according to claim 6, wherein the second information includes a numerical value normalized by a length based on an image circle of the optical system.

### Claim 8 (depends on 1)

The image processing method according to claim 1, wherein the first information includes information on a type of the optical system.

### Claim 9 (depends on 1)

The image processing method according to claim 1, wherein the first information includes information on presence or absence of an optical low-pass filter, or a type of the optical low-pass filter.

### Claim 10 (depends on 1)

The image processing method according to claim 1, wherein the first
information includes information on presence or absence of an accessory of the optical system or a type of the accessory.

### Claim 11 (depends on 1)

The image processing method according to claim 1, wherein the input data further includes information on a distribution of distance to an object space at the time of capturing the captured image.

### Claim 12 (depends on 1)

The image processing method according to claim 1, wherein the input data includes information on a pixel pitch or a color filter array of an image sensor used for capturing the captured image.

### Claim 13 (depends on 1)

The image processing method according to claim 1, wherein the input data is obtained by concatenating the captured image and a map generated based on the first information in a channel direction.

### Claim 14 (depends on 1)

A non-transitory computer-readable storage medium storing a computer program that causes a computer to execute the image processing method according to claim 1.

### Claim 15

An image processing apparatus comprising:
a memory storing instructions; and
at least one processor or circuit that executes the instructions to:
acquire input data including a captured image and first information indicating a state of an optical system at a time of capturing the captured image, the optical system having been used for capturing the captured image; and
generate an estimated image by inputting the input data to a trained machine learning model.

### Claim 16 (depends on 15)

An image processing system having the image processing
apparatus according to claim 15 and a control apparatus,
wherein the control apparatus includes a memory storing instructions, and at least one processor or circuit that executes the instructions to transmit, to the image processing apparatus, a request relating to an execution of processing on the captured image.

### Claim 17

An image processing method comprising:
acquiring input data including a training image and first information indicating a state of an optical system corresponding to the training image;
generating an output image by inputting the input data to a trained machine learning model; and
updating the trained machine learning model based on the output image and a ground truth image.

### Claim 18 (depends on 17)

A non-transitory computer-readable storage medium storing a computer program that causes a computer to execute the image processing method according to claim 17.

### Claim 19

A generating method of learnt trained machine learning model
comprising:
acquiring input data including a training image and first information relating to indicating a state of an optical system corresponding to the training image;
generating an output image by inputting the input data to a trained machine learning model; and
updating the trained machine learning model based on the output image and a ground truth image.

### Claim 20

An image processing apparatus comprising:
a memory storing instructions; and
at least one processor or circuit that executes the instructions to:
acquire input data including a training image and first information indicating a state of an optical system corresponding to the training image;
input the input data to a trained machine learning model and
generate an output image by inputting the input data to a trained machine learning model; and update the trained machine learning model based on the output image and a ground truth image.

### Claim 21 (depends on 1)

The image processing method according to claim 1, further comprising acquiring weight information of the trained machine learning model, and
wherein generating the estimated image generates the estimated image by inputting data to the trained machine learning model that is based on the weight information.

### Claim 22 (depends on 21)

The image processing method according to claim 21, wherein the trained machine learning model is a neural network.

### Claim 23 (depends on 21)

The image processing method according to claim 21,
wherein the trained machine learning model has been subjected to learning in advance, and
wherein the learning uses training input data including a training image and information indicating a state of an optical system corresponding to the training image, and is performed so that different processing is performed according to the first information.

### Claim 24 (depends on 1)

The image processing method according to claim 1, wherein the estimated image is generated by inputting the input data directly to the trained machine learning model.

### Claim 25 (depends on 1)

The image processing method according to claim 1, wherein the trained machine learning model generates different estimated images depending on the first information.

### Claim 26 (depends on 1)

The image processing method according to claim 1, wherein the state of the optical system includes at least one of states of a zoom, F-number, and distance from the optical system to an in-focus object.
