# US 2026/0227621 A1 · All-in-focus image generation

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0227621 A1
- Document ID: US20260227621A1
- Status: Published application
- Kind: A1
- Application number: 19/461,752
- Filed: 2026-01-28
- Published: 2026-08-06
- Earliest claimed: 2023-09-22
- Assignees: Hamamatsu Photonics K.K.
- Applicants: Hamamatsu Photonics K.K.
- Inventors: Masaki IIZUKA; Satoshi TSUCHIYA
- Web page: https://patentgrep.com/patent/US20260227621A1

## CPC

- G02B 21/367: {providing an output produced by processing a plurality of individual source images, e.g. image tiling, montage, composite images, depth sectioning, image comparison}
- H04N 23/67: Focus control based on electronic image sensor signals
- G02B 21/36: arranged for photographic purposes or projection purposes (G02B21/18 takes precedence){or digital imaging or video purposes including associated control and data processing arrangements (image data processing per se G06T)}
- G06T 5/50: using two or more images, e.g. averaging or subtraction
- G06T 5/73: Deblurring; Sharpening
- H04N 23/673: {based on contrast or high frequency components of image signals, e.g. hill climbing method}
- H04N 23/676: {Bracketing for image capture at varying focusing conditions}
- H04N 23/743: Bracketing, i.e. taking a series of images with varying exposure conditions
- H04N 23/80: Camera processing pipelines; Components thereof
- H04N 23/951: by using two or more images to influence resolution, frame rate or aspect ratio
- H04N 23/958: for extended depth of field imaging
- G06T 2207/10056: Microscopic image
- G06T 2207/10148: Varying focus
- G06T 2207/20221: Image fusion; Image merging
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A method of generating an all-in-focus image includes: acquiring an original image for each focal position of an object by capturing an image of the object while shifting the focal position in a predetermined direction; performing frequency decomposition on the original image for each focal position to generate an edge image for each frequency band; generating an all-in-focus edge image for each frequency band by integrating the edge images for each frequency band in the predetermined direction; and generating the all-in-focus image by integrating the all-in-focus edge images for each frequency band.

## Claims

### Claim 1

A method of generating an all-in-focus image, the method comprising:
acquiring, as a respective original image for each focal position related to an object, an image captured for each focal position by capturing an image of the object while shifting the focal position in a predetermined direction;
performing frequency decomposition in each of the original images for each focal position to generate a respective edge image for each frequency band;
generating a respective all-in-focus edge image for each frequency band by integrating the edge images for each frequency band in the predetermined direction; and
generating the all-in-focus image by integrating the all-in-focus edge images for each frequency band.

### Claim 2 (depends on 1)

The method according to claim 1, wherein performing frequency decomposition includes generating the edge images for each frequency band corresponding to a plurality of color component images by decomposing the original image for each focal position into a plurality of color component images and performing frequency decomposition on each of the plurality of color component images.

### Claim 3 (depends on 1)

The method according to claim 1, wherein performing frequency decomposition includes excluding an image not including the focal position, among the original images for each focal position from targets of generation of the edge image of each frequency band.

### Claim 4 (depends on 1)

The method according to claim 1, further comprising selecting a specific region in the original image for each focal position,
wherein performing frequency decomposition includes performing frequency decomposition on the specific region in each of the original images for each focal position to generate the edge image for each frequency band in the specific region.

### Claim 5 (depends on 1)

The method according to claim 1, further comprising selecting a specific region in the all-in-focus image and converting the all-in-focus image into an image focused on the specific region.

### Claim 6 (depends on 1)

The method according to claim 1, wherein performing frequency decomposition includes:
generating the respective edge image for each frequency band in order from highest frequency band;
calculating, in the edge images for each frequency band, an image similarity between edge images for each focal position that share a common frequency band; and
stopping subsequent frequency decomposition when the image similarity satisfies a predetermined similarity condition.

### Claim 7

An all-in-focus imaging device comprising:
an imaging device configured to:
acquire a first original image by capturing an image of an object at a first focal position; and
acquire a second original image by capturing an image of the object at a second focal position that is different from the first focal position; and
a controller configured to:
generate, by performing frequency decomposition:
a first edge image of the first original image corresponding to a first frequency band;
a second edge image of the first original image corresponding to a second frequency band that is different from the first frequency band;
a first edge image of the second original image corresponding to the first frequency band; and
a second edge image of the second original image corresponding to the second frequency band;
integrate the first edge image of the first original image and the first edge image of the second original image to generate a first all-in-focus edge image of the first frequency band;
integrate the second edge image of the first original image and the second edge image of the second original image to generate a second all-in-focus edge image of the second frequency band; and
integrate the first all-in-focus edge image and the second all-in-focus edge image to generate an all-in-focus image.

### Claim 8 (depends on 7)

The all-in-focus imaging device according to claim 7,
wherein the controller is further configured to generate, by performing color decomposition on the first original image, a first color component image and a second color component image, and
wherein the controller generates the first edge image of the first original image by:
performing frequency decomposition on the first color component image to generate a first color edge image of the first original image;
performing frequency decomposition on the second color component image to generate a second color edge image of the first original image; and
integrating the first color edge image and the second color edge image to generate the first edge image.

### Claim 9 (depends on 7)

The all-in-focus imaging device according to claim 7, wherein the controller generates the first all-in-focus edge image of the first frequency band by integrating:
the first edge image of the first original image generated by performing frequency decomposition on the first original image; and
the first edge image of the second original image generated by performing frequency decomposition on the second original image.

### Claim 10 (depends on 7)

The all-in-focus imaging device according to claim 7, wherein the imaging device is further configured to capture a plurality of images of the object, the plurality of images including the first original image, the second original image and a third original image which does not include a focal position, and
wherein the controller excludes the third original image in generating the all-in-focus image.

### Claim 11 (depends on 7)

The all-in-focus imaging device according to claim 7, wherein the controller is further configured to:
select a portion of the first original image as a first specific region;
select a portion of the second original image as a second specific region;
generate the first edge image and the second edge image of the first original image based on the first specific region; and
generate the first edge image and the second edge image of the second original image based on the second specific region.

### Claim 12 (depends on 7)

The all-in-focus imaging device according to claim 7, wherein the controller is further configured to:
select a portion of the all-in-focus image as a specific region; and
transform the all-in-focus image so that the specific region is in focus.

### Claim 13 (depends on 7)

The all-in-focus imaging device according to claim 7, wherein the controller is configured to:
generate the first edge image of the first original image corresponding to the first frequency band;
after generating the first edge image of the first original image, generate the second edge image of the first original image corresponding to the second frequency band having a frequency lower than the first frequency band;
generate the first edge image of the second original image corresponding to the first frequency band; and
after generating the first edge image of the second original image, generate the second edge image of the second original image corresponding to the second frequency band.

### Claim 14 (depends on 13)

The all-in-focus imaging device according to claim 13, wherein the controller is further configured to:
calculate an image similarity based on the second edge image of the first original image and the second edge image of the second original image;
generate, by performing frequency decomposition, a third edge image of the first original image corresponding to a third frequency band having a frequency lower than the second frequency band, if the image similarity satisfies a predetermined similarity condition; and
generate, by performing frequency decomposition, a third edge image of the second original image corresponding to the third frequency band, if the image similarity satisfies the similarity condition.

### Claim 15 (depends on 7)

The all-in-focus imaging device according to claim 7, wherein the controller is configured to:
generate a compressed image by reducing a resolution of the first original image;
generate a resized image by resizing the compressed image; and
generate the first edge image of the first original image by subtracting the resized image from the first original image.

### Claim 16 (depends on 7)

The all-in-focus imaging device according to claim 7,
wherein the controller is configured to generate the first all-in-focus edge image by selecting, for each corresponding pixel between the plurality of pixels constituting the first edge image of the first original image and the plurality of pixels constituting the first edge image of the second original image, a pixel with the highest pixel value.

### Claim 17

A method of generating an all-in-focus image, the method comprising:
acquiring a first original image by capturing an image of an object at a first focal position;
acquiring a second original image by capturing an image of the object at a second focal position that is different from the first focal position;
generating, by performing frequency decomposition:
a first edge image of the first original image corresponding to a first frequency band;
a second edge image of the first original image corresponding to a second frequency band that is different from the first frequency band;
a first edge image of the second original image corresponding to the first frequency band; and
a second edge image of the second original image corresponding to the second frequency band;
integrating the first edge image of the first original image and the first edge image of the second original image to generate a first all-in-focus edge image of the first frequency band;
integrating the second edge image of the first original image and the second edge image of the second original image to generate a second all-in-focus edge image of the second frequency band; and
integrating the first all-in-focus edge image and the second all-in-focus edge image to generate the all-in-focus image.

### Claim 18 (depends on 17)

The method according to claim 17, the method further comprising:
generating, by performing color decomposition on the first original image, a first color component image and a second color component image;
wherein generating the first edge image of the first original image includes:
generating a first color edge image of the first original image by performing frequency decomposition on the first color component image;
generating a second color edge image of the first original image by performing frequency decomposition on the second color component image; and
generating the first edge image of the first original image by integrating the first color edge image and the second color edge image.

### Claim 19 (depends on 17)

The method according to claim 17, the method further comprising:
capturing a plurality of images of the object, the plurality of images including the first original image, the second original image and a third original image which does not include a focal position; and
excluding the third original image in generating the all-in-focus image.

### Claim 20 (depends on 17)

The method according to claim 17, the method further comprising:
selecting a portion of the first original image as a first specific region;
selecting a portion of the second original image as a second specific region;
generating the first edge image and the second edge image of the first original image based on the first specific region; and
generating the first edge image and the second edge image of the second original image based on the second specific region.
