# US 2025/0148742 A1 · Image processing method and image processing device

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0148742 A1
- Document ID: US20250148742A1
- Status: Published application
- Kind: A1
- Application number: 18/838,119
- Filed: 2023-03-23
- Published: 2025-05-08
- Earliest claimed: 2022-03-30
- Assignees: Panasonic Intellectual Property Management Co., Ltd.
- Applicants: Panasonic Intellectual Property Management Co., Ltd.
- Inventors: Masato TAKEMOTO; Akihiro ODAGAWA; Shinzo KOYAMA; Shigeru SAITOU
- Web page: https://patentgrep.com/patent/US20250148742A1

## CPC

- G06V 10/22: by selection of a specific region containing or referencing a pattern; Locating or processing of specific regions to guide the detection or recognition
- G01S 17/18: wherein range gates are used
- G06T 1/00: General purpose image data processing
- G06T 7/00: Image analysis
- G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80)
- G06V 10/25: Determination of region of interest [ROI] or a volume of interest [VOI]
- G06T 2207/10028: Range image; Depth image; 3D point clouds
- G06V 2201/07: Target detection
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

An image processing method includes: first processing of acquiring a range gate image using a range gate imaging device that captures an image of a set distance range for a predetermined capture area; second processing of searching for a detection target in the range gate image using a search window having a size corresponding to a capture distance from the range gate imaging device to the set distance range; and third processing of synthesizing, when a window region satisfying a predetermined condition is detected in the range gate image in the second processing, object information included in the window region and a grayscale image acquired using a grayscale imaging device that captures a grayscale image of the predetermined capture area and outputting the result.

## Claims

### Claim 1

An image processing method, comprising:
first processing of acquiring a range gate image using a range gate imaging device that captures an image of a set distance range for a predetermined capture area;
second processing of searching for a detection target in the range gate image using a search window having a size corresponding to a capture distance from the range gate imaging device to the set distance range; and
third processing of synthesizing, when a window region satisfying a predetermined condition is detected in the range gate image in the second processing, object information included in the window region and a grayscale image acquired using a grayscale imaging device that captures a grayscale image of the predetermined capture area and outputting the result.

### Claim 2 (depends on 1)

The image processing method of claim 1, wherein
the object information includes at least pixel information of an object captured in the window region satisfying a predetermined condition or information of a rectangular region in which the object is inscribed.

### Claim 3 (depends on 2)

The image processing method of claim 2, wherein
the object information includes information of the capture distance of the window region satisfying a predetermined condition.

### Claim 4 (depends on 1)

The image processing method of claim 1, wherein
the grayscale imaging device is a texture imaging device capturing a texture image.

### Claim 5 (depends on 1)

The image processing method of claim 1, wherein
when an object having a size corresponding to the capture distance is detected in the search window in the search of the second processing, it is determined that the window region satisfying a predetermined condition is present and the third processing is executed.

### Claim 6 (depends on 1)

The image processing method of claim 1, wherein
when the number of pixels of a static object detected in the search window exceeds a predetermined number corresponding to the capture distance in the search of the second processing, it is determined that the window region satisfying a predetermined condition is present and the third processing is executed.

### Claim 7 (depends on 1)

The image processing method of claim 1, wherein
in the third processing, the synthesizing is cutting-out processing of cutting out and extracting a region of the object information from the grayscale image, and
a homography matrix from the range gate image to the grayscale image is calculated, and an expanded region expanded from the object information is regarded as a target of the cutting-out processing based on the homography matrix.

### Claim 8 (depends on 7)

The image processing method of claim 7, wherein
the range gate imaging device includes a light source and a camera,
in the expanded region, a shadow region formed for the detection target by the light source is estimated based on at least either a positional relationship between the light source and the camera or the capture distance, and the expanded region is further expanded according to the shadow region.

### Claim 9 (depends on 8)

The image processing method of claim 8, wherein
the shadow region is estimated by adding thickness information of the detection target.

### Claim 10 (depends on 8)

The image processing method of claim 8, wherein
the shadow region is estimated based on the capture distance at which the window region satisfying a predetermined condition has been detected in the third processing.

### Claim 11

An image processing device, comprising:
a range gate imaging device that captures a range gate image in a set distance range for a predetermined capture area;
a grayscale imaging device that captures a grayscale image of the predetermined capture area;
a search processing unit that searches for a detection target in the range gate image using a search window having a size corresponding to a capture distance from the range gate imaging device to the set distance range; and
a synthesizing processing unit that synthesizes, when a window region satisfying a predetermined condition is detected in the range gate image, object information included in the window region and the grayscale image acquired using the grayscale imaging device, and outputs the result.

### Claim 12 (depends on 11)

The image processing device of claim 11, wherein
the object information includes at least pixel information of an object captured in the window region satisfying a predetermined condition or information of a rectangular region in which the object is inscribed.

### Claim 13 (depends on 12)

The image processing device of claim 12, wherein
the object information includes information of the capture distance of the window region satisfying a predetermined condition.

### Claim 14 (depends on 11)

The image processing device of claim 11, wherein
the grayscale imaging device is a texture imaging device capturing a texture image.

### Claim 15 (depends on 11)

The image processing device of claim 11, wherein
when an object having a size corresponding to the capture distance is detected in the search window in the search by the search processing unit, the synthesizing processing unit executes processing of synthesizing the object information and the grayscale image and outputting the result.

### Claim 16 (depends on 11)

The image processing device of claim 11, wherein
when the number of pixels of a static object detected in the search window exceeds a predetermined number corresponding to the capture distance in the search by the search processing unit, the synthesizing processing unit executes processing of synthesizing the object information and the grayscale image and outputting the result.

### Claim 17 (depends on 11)

The image processing device of claim 11, wherein
the synthesizing by the synthesizing processing unit is cutting-out processing of cutting out and extracting a region of the object information from the grayscale image, and
the synthesizing processing unit calculates a homography matrix from the range gate image to the grayscale image, and regards an expanded region expanded from the object information as a target of the cutting-out processing based on the homography matrix.

### Claim 18 (depends on 17)

The image processing device of claim 17, wherein
the range gate imaging device includes a light source and a camera,
the synthesizing processing unit estimates a shadow region formed for the detection target by the light source based on at least either a positional relationship between the light source and the camera or the capture distance, and further expands the expanded region according to the shadow region.

### Claim 19 (depends on 18)

The image processing device of claim 18, wherein
the synthesizing processing unit estimates the shadow region by adding thickness information of the detection target.

### Claim 20 (depends on 18)

The image processing device of claim 18, wherein
the synthesizing processing unit estimates the shadow region based on the capture distance at which the window region satisfying a predetermined condition has been detected.
