# US 2026/0030768 A1 · Image processing system and method for processing camera images

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0030768 A1
- Document ID: US20260030768A1
- Status: Published application
- Kind: A1
- Application number: 19/200,711
- Filed: 2025-05-07
- Published: 2026-01-29
- Earliest claimed: 2024-07-23
- Assignees: Intel Corporation
- Applicants: Intel Corporation
- Inventors: Fabian OBORIL; Cornelius BUERKLE
- Web page: https://patentgrep.com/patent/US20260030768A1

## CPC

- G06T 7/50: Depth or shape recovery
- G06T 5/50: using two or more images, e.g. averaging or subtraction
- G06T 5/77: Retouching; Inpainting; Scratch removal
- G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80)
- G06V 10/761: {Proximity, similarity or dissimilarity measures}
- H04N 23/73: by influencing the exposure time
- G06T 2207/10012: Stereo images
- G06T 2207/10028: Range image; Depth image; 3D point clouds
- G06T 2207/20036: Morphological image processing
- G06T 2207/20221: Image fusion; Image merging
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

According to one aspect of the present disclosure, an image processing system is provided, comprising a memory and a processor, wherein the processor is configured to determine a depth image from at least two camera images of a scene, to determine at least one area in the depth image where depth information is insufficient, for the at least one determined area in the depth image where depth information is insufficient, to determine, for each of the at least two camera images, a camera image area of the camera image that corresponds to the determined area in the depth image where depth information is insufficient, to perform a matching of at least parts of the determined camera image areas, to determine a cause for the insufficient depth information from a result of the matching, and to further process the depth image depending on the determined cause.

## Claims

### Claim 1

An image processing system, comprising:
A memory and a processor, whereby the processor is configured,
to determine a depth image from at least two camera images of a scene;
to determine at least one area in the depth image where depth information is insufficient;
for the at least one determined area in the depth image where depth information is insufficient,
for each of at least two camera images, determine a camera image area of the camera image that corresponds to the determined area in the depth image where depth information is insufficient;
perform a matching of at least parts of the determined camera image areas;
determine a cause for the insufficient depth information from a result of the matching; and
further process the depth image depending on the cause determined.

### Claim 2 (depends on 1)

The image processing system according to claim 1, wherein determining the cause of the insufficient depth information from a result of the matching comprises detecting a camera contamination from the result of the matching.

### Claim 3 (depends on 2)

The image processing system according to claim 2, wherein the matching comprises a camera image area matching of the detected camera image areas, and wherein the result of the matching comprises a camera image area match score describing a degree of match of the detected camera image areas, and wherein the processor is arranged to determine that the cause is camera contamination if the camera image area match score is below a predetermined threshold.

### Claim 4 (depends on 2)

The image processing system according to claim 2, wherein the further processing of the depth image comprises outputting an alarm signal or an automatic control command depending on the detected cause, in response to the processor detecting that the cause is camera contamination.

### Claim 5 (depends on 2)

The image processing system according to claim 2, wherein further processing the depth image depending on the determined cause, in response to the processor determining that the cause is camera contamination, comprises the processor determining whether it also determines camera contamination for subsequent camera images and further processing the depth image depending on whether it also determines camera contamination for subsequent camera images.

### Claim 6 (depends on 1)

The image processing system according to claim 1, wherein the processor is arranged to determine whether overexposure areas are present in the determined camera image areas, and wherein the processor is arranged, in response to determining that overexposure areas are present in the determined camera image areas, to determine the overexposure areas, and the adjustment comprises an overexposure area adjustment of the determined overexposure areas.

### Claim 7 (depends on 6)

The image processing system according to claim 6, wherein the result of the matching comprises an overexposure area match score describing a degree of match of the detected overexposure areas, and wherein the processor is arranged to determine that the cause is a luminous object if the overexposure area match score is above a predetermined threshold value.

### Claim 8 (depends on 7)

The image processing system according to claim 7, wherein further processing the depth image depending on the determined cause in response to the processor determining that the cause is a luminous object comprises determining a position of the luminous object and supplementing depth information corresponding to the determined position of the luminous object in the depth image.

### Claim 9 (depends on 8)

The image processing system according to claim 8, wherein the processor is configured to determine the position of the luminous object on the basis of the position of the determined overexposure areas in the at least two camera images.

### Claim 10 (depends on 6)

The image processing system according to claim 6, wherein further processing the depth image depending on the determined cause in response to the processor determining that the cause is a luminous object comprises reducing the exposure time of at least two cameras used to take the at least two camera images, and fusing the depth image with a further depth image determined by the processor from further camera images of the scene subsequently taken using the at least two cameras.

### Claim 11 (depends on 1)

The image processing system according to claim 1, wherein the processor is arranged to determine whether underexposure areas are present in the determined camera image areas, and wherein the processor is arranged, in response to determining that underexposure areas are present in the determined camera image areas, to determine the underexposure areas, and the adjustment comprises an underexposure area adjustment of the determined underexposure areas.

### Claim 12 (depends on 11)

The image processing system according to claim 11, wherein the result of the matching comprises an underexposure area match score describing a degree of match of the detected underexposure areas, and wherein the processor is arranged to determine that the cause is an underexposed object if the underexposure area match score is above a predetermined threshold.

### Claim 13 (depends on 12)

The image processing system according to claim 12, wherein further processing the depth image depending on the determined cause in response to the processor determining that the cause is an underexposed object comprises determining a position of the underexposed object and adding depth information corresponding to the determined position of the underexposed object in the depth image.

### Claim 14 (depends on 1)

The image processing system according to claim 1, wherein the processor is arranged, when determining the at least one area in the depth image at which depth information is insufficient, to exclude areas in the depth image at which depth information is insufficient but whose size is below a predetermined minimum size.

### Claim 15 (depends on 1)

The image processing system according to claim 1, wherein further processing the depth image depending on the determined cause comprises generating input data for a system expecting the depth image as input depending on the determined cause.

### Claim 16 (depends on 1)

The image processing system according to claim 1, wherein the image processing system is implemented as a robot, an assisted vehicle, or an autonomous vehicle.

### Claim 17

A method for processing camera images, comprising:
Determining a depth image from at least two camera images of a scene;
Determining at least one area in the depth image where depth information is insufficient;
for the at least one determined area in the depth image where depth information is insufficient,
Determining, for each of the at least two camera images, a camera image area of the camera image corresponding to the determined area in the depth image at which depth information is insufficient;
Carrying out a matching of at least parts of the determined camera image areas;
Determining a cause of the insufficient depth information from a result of the matching; and
Further processing of the depth image depending on the cause determined.

### Claim 18 (depends on 17)

The method according to claim 17, wherein determining the cause of the insufficient depth information from a result of the matching comprises detecting a camera contamination from the result of the matching.

### Claim 19

A non-transitory computer readable storage medium comprising instructions which, when executed by a processor, cause the processor to
Determine a depth image from at least two camera images of a scene;
Determine at least one area in the depth image where depth information is insufficient;
for the at least one determined area in the depth image where depth information is insufficient,
Determine, for each of the at least two camera images, a camera image area of the camera image corresponding to the determined area in the depth image at which depth information is insufficient;
Carry out a matching of at least parts of the determined camera image areas;
Determine a cause of the insufficient depth information from a result of the matching; and
Further process of the depth image depending on the cause determined.

### Claim 20 (depends on 19)

The non-transitory computer readable storage medium according to claim 19, wherein determining the cause of the insufficient depth information from a result of the matching comprises detecting a camera contamination from the result of the matching.
