# US 2025/0363602 A1 · Processing apparatus, processing method, and non-transitory computer-readable storage medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0363602 A1
- Document ID: US20250363602A1
- Status: Published application
- Kind: A1
- Application number: 19/207,522
- Filed: 2025-05-14
- Published: 2025-11-27
- Earliest claimed: 2024-05-22
- Assignees: Canon Kabushiki Kaisha
- Applicants: Canon Kabushiki Kaisha
- Inventors: Aihiko NUMATA
- Web page: https://patentgrep.com/patent/US20250363602A1

## CPC

- G06T 5/77: Retouching; Inpainting; Scratch removal
- H04N 25/68: applied to defects
- G06T 5/50: using two or more images, e.g. averaging or subtraction
- G06V 10/751: {Comparing pixel values or logical combinations thereof, or feature values having positional relevance, e.g. template matching}
- H04N 25/62: Detection or reduction of noise due to excess charges produced by the exposure, e.g. smear, blooming, ghost image, crosstalk or leakage between pixels
- H04N 25/773: comprising photon counting circuits, e.g. single photon detection [SPD] or single photon avalanche diodes [SPAD]
- G06T 2207/20224: Image subtraction
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

A processing apparatus for generating and correcting an image based on a count value output by a photoelectric conversion element that has an avalanche photodiode, converts light from a subject into an electrical signal, counts the electrical signal, and outputs the count value, the processing apparatus generates a first image based on the count value, and executes correction processing for correcting the first image, wherein the correction processing includes first correction processing for a first pixel including a pixel in a surrounding area of a first type of defective pixel in which miscounting occurs due to a first cause, and second correction processing different from the first correction processing for a second pixel including a pixel in a surrounding area of a second type of defective pixel in which miscounting occurs due to a second cause different from the first cause.

## Claims

### Claim 1

A processing apparatus for generating and correcting an image based on a count value output by a photoelectric conversion element that has an avalanche photodiode, converts light from a subject into an electrical signal, counts the electrical signal, and outputs the count value, the processing apparatus comprising:
at least one processor; and
at least one memory having stored thereon instructions which, when executed by the at least one processor, cause the processing apparatus to
generate a first image based on the count value, and
execute correction processing for correcting the first image,
wherein the correction processing includes
first correction processing for a first pixel including a pixel in a surrounding area of a first type of defective pixel in which miscounting occurs due to a first cause, and
second correction processing different from the first correction processing for a second pixel including a pixel in a surrounding area of a second type of defective pixel in which miscounting occurs due to a second cause different from the first cause.

### Claim 2 (depends on 1)

The processing apparatus according to claim 1,
wherein in the correction processing,
the first correction processing is executed using a first weighting coefficient, and
the second correction processing is executed using a second weighting coefficient different from the first weighting coefficient.

### Claim 3 (depends on 1)

The processing apparatus according to claim 1,
wherein in the correction processing, the first correction processing and the second correction processing are executed based on first array data of a two-dimensional array in which a position of the first pixel and the second pixel is associated with a correction value for correcting the pixels.

### Claim 4 (depends on 3)

The processing apparatus according to claim 3,
wherein in the correction processing, a second image is generated by executing a convolution operation on the first image using array data obtained by multiplying second array data by a weighting coefficient, the second array data being generated from the first array data.

### Claim 5 (depends on 4)

The processing apparatus according to claim 4,
wherein in the correction processing,
in the first correction processing, the second array data is multiplied by a first weighting coefficient, and
in the second correction processing, the second array data is multiplied by a second weighting coefficient different from the first weighting coefficient.

### Claim 6 (depends on 5)

The processing apparatus according to claim 5,
wherein in the correction processing,
in the first correction processing, a third image is generated by subtracting the first pixel of the second image from the first pixel of the first image, and
in the second correction processing, a third image is generated by subtracting the second pixel of the second image from the second pixel of the first image.

### Claim 7 (depends on 3)

The processing apparatus according to claim 3,
wherein in the correction processing, a second image is generated by executing convolution operation processing using second array data generated from the first array data on a fourth image generated by multiplying a pixel of the first image by a weighting coefficient.

### Claim 8 (depends on 2)

The processing apparatus according to claim 2,
wherein the larger the difference between an output value of the second type of defective pixel and an output value of the second pixel other than the second type of defective pixel is, the smaller the second weighting coefficient in the second correction processing is.

### Claim 9 (depends on 1)

The processing apparatus according to claim 1,
wherein in the correction processing, if an output value of the second type of defective pixel is greater than a predetermined output threshold value, the second correction processing is not executed.

### Claim 10 (depends on 3)

The processing apparatus according to claim 3,
wherein the first array data includes the correction value obtained based on an occurrence probability of miscounting caused by light-emission crosstalk.

### Claim 11 (depends on 1)

The processing apparatus according to claim 1,
wherein the first type of the defective pixel has a higher occurrence probability of miscounting caused by light-emission crosstalk than the second type of defective pixel.

### Claim 12 (depends on 2)

The processing apparatus according to claim 2,
wherein the second weighting coefficient is smaller than the first weighting coefficient.

### Claim 13 (depends on 1)

The processing apparatus according to claim 1,
wherein in the correction processing, the first type of defective pixel and the second type of defective pixel are extracted based on address data acquired in advance.

### Claim 14 (depends on 1)

The processing apparatus according to claim 1,
wherein the correction processing includes
first defect extraction processing for extracting a defective pixel by comparing an output value of a pixel with output values of pixels in a surrounding area of the pixel using the first image, and
second defect extraction processing for distinguishing between the first type of defective pixel and the second type of defective pixel by comparing output values between a plurality of pixels in the surrounding area of the defective pixel.

### Claim 15 (depends on 1)

The processing apparatus according to claim 1,
wherein in the correction processing, output values of the first type of defective pixel and the second type of defective pixel are corrected based on output values of pixels in the surrounding area of the first type of defective pixel and pixels in the surrounding area of the second type of defective pixel.

### Claim 16 (depends on 3)

The processing apparatus according to claim 3,
wherein the correction processing executes third correction processing different from the first correction processing and the second correction processing on a normal pixel other than the first type of defective pixel and the second type of defective pixel.

### Claim 17 (depends on 16)

The processing apparatus according to claim 16,
wherein the correction processing executes the third correction processing using a third weighting coefficient that is greater than the first weighting coefficient used in the first correction processing.

### Claim 18 (depends on 1)

The processing apparatus according to claim 1,
wherein the pixels include two or more types of pixels having different spectral characteristics, and
the correction processing is executed using a different weighting coefficient for each of the pixels having the different spectral characteristics.

### Claim 19

A processing method for generating and correcting an image based on a count value output by a photoelectric conversion element that has an avalanche photodiode, converts light from a subject into an electrical signal, counts the electric signal, and outputs the count value, the processing method comprising:
generating a first image based on the count value; and
executing correction processing for correcting the first image,
wherein the correction processing includes
first correction processing for a first pixel including a pixel in a surrounding area of a first type of defective pixel in which miscounting occurs due to a first cause, and
second correction processing different from the first correction processing for a second pixel including a pixel in a surrounding area of a second type of defective pixel in which miscounting occurs due to a second cause different from the first cause.

### Claim 20

A non-transitory computer-readable storage medium storing a computer program that, when read and executed by a computer that generates and corrects an image based on a count value output by a photoelectric conversion element that has an avalanche photodiode, converts light from a subject into an electrical signal, counts the signal, and outputs the count value, causes the computer to function as:
an image generation unit configured to generate a first image based on the count value; and
a correction processing unit configured to execute correction processing for correcting the first image,
wherein the correction processing includes
first correction processing for a first pixel including a pixel in a surrounding area of a first type of defective pixel in which miscounting occurs due to a first cause, and
second correction processing different from the first correction processing for a second pixel including a pixel in a surrounding area of a second type of defective pixel in which miscounting occurs due to a second cause different from the first cause.
