# US 2022/0044364 A1 · Method and apparatus with image processing

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0044364 A1
- Document ID: US20220044364A1
- Status: Published application
- Kind: A1
- Application number: 16/951,290
- Filed: 2020-11-18
- Published: 2022-02-10
- Earliest claimed: 2020-08-07
- Assignees: Samsung Electronics Co., Ltd.; Industry-Academic Cooperation Foundation, Yonsei University
- Applicants: Samsung Electronics Co., Ltd.; Industry-Academic Cooperation Foundation, Yonsei University
- Inventors: Seunghoon JEE; Moon Gi KANG; Soon Young HONG; Min Sub KIM; Sang Yoon LEE
- Web page: https://patentgrep.com/patent/US20220044364A1

## CPC

- G06T 5/73: Deblurring; Sharpening
- G05D 1/0253: {extracting relative motion information from a plurality of images taken successively, e.g. visual odometry, optical flow (determining position or orientation from images G06T7/70)}
- G06T 5/20: using local operators
- G06T 5/50: using two or more images, e.g. averaging or subtraction
- G06T 7/13: Edge detection
- G06T 2207/20192: Edge enhancement; Edge preservation
- G06T 2207/20212: Image combination
- G06T 2207/20221: Image fusion; Image merging
- G06T 2207/30252: Vehicle exterior; Vicinity of vehicle
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G05D: SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES

## Abstract

An image processing method includes: determining a source transmission map based on a dark channel map of an input image; determining transformed transmission maps by applying different filters to the determined source transmission map; generating haze-free images by removing haze from the input image based respectively on the determined transformed transmission maps; and generating an output image by blending the generated haze-free images.

## Claims

### Claim 1

An image processing method, comprising:
determining a source transmission map based on a dark channel map of an input image;
determining transformed transmission maps by applying different filters to the determined source transmission map;
generating haze-free images by removing haze from the input image based respectively on the determined transformed transmission maps; and
generating an output image by blending the generated haze-free images.

### Claim 2 (depends on 1)

The method of claim 1, wherein the transformed transmission maps and the haze-free images are based on a size of a single mask of the source transmission map.

### Claim 3 (depends on 1)

The method of claim 1, wherein the filters comprise:
a first filter configured to restore a texture; and
a second filter configured to suppress a halo artifact.

### Claim 4 (depends on 3)

The method of claim 3, wherein the first filter comprises a multi-directional kernel-based filter, and the second filter comprises a guided filter.

### Claim 5 (depends on 1)

The method of claim 1, wherein the generating of the output image comprises:
determining a blending weight based on edges in the input image; and
generating the output image by blending the haze-free images based on the determined blending weight.

### Claim 6 (depends on 1)

The method of claim 1, wherein the haze-free images comprise:
a first haze-free image for determining a flat region of the output image; and
a second haze-free image for determining a strong edge region of the output image.

### Claim 7 (depends on 6)

The method of claim 6, wherein
the first haze-free image comprises the flat region including a restored texture; and
the second haze-free image comprises the strong edge region including a suppressed halo artifact.

### Claim 8 (depends on 6)

The method of claim 6, wherein the generating of the output image comprises:
determining an edge map by detecting an edge in the input image; and
blending the first haze-free image and the second haze-free image based on the determined edge map.

### Claim 9 (depends on 8)

The method of claim 8, wherein the blending comprises:
blending the first haze-free image and the second haze-free image by assigning a greater weight to an edge region in the second haze-free image than a weight assigned to the edge region in the first haze-free image, wherein the edge region is determined based on the edge map.

### Claim 10 (depends on 8)

The method of claim 8, wherein the blending comprises:
generating first transformed haze-free images of different scales by performing a pyramid transformation on the first haze-free image;
generating second transformed haze-free images of different scales by performing a pyramid transformation on the second haze-free image; and
generating blended intermediate images by blending the first transformed haze-free images and the second transformed haze-free images based on the edge map.

### Claim 11 (depends on 10)

The method of claim 10, wherein the generating of the output image comprises:
generating the output image by performing an inverted pyramid transformation on the blended intermediate images.

### Claim 12 (depends on 8)

The method of claim 8, wherein the determining of the edge map comprises:
determining the edge map by performing a morphological operation on the detected edge of the input image.

### Claim 13 (depends on 1)

A non-transitory computer-readable storage medium storing instructions that, when executed by a processor, configure the processor to perform the method of claim 1.

### Claim 14

An image processing apparatus, comprising:
a processor configured to:
determine a source transmission map based on a dark channel map of an input image;
determine transformed transmission maps by applying different filters to the determined source transmission map;
generate haze-free images by removing haze from the input image based respectively on the determined transformed transmission maps; and
generate an output image by blending the generated haze-free images.

### Claim 15 (depends on 14)

The apparatus of claim 14, wherein the transformed transmission maps and the haze-free images are based on a size of a single mask of the source transmission map.

### Claim 16 (depends on 14)

The apparatus of claim 14, wherein the filters comprise:
a multi-directional kernel-based filter configured to restore a texture; and
a guided filter configured to suppress a halo artifact.

### Claim 17 (depends on 14)

The apparatus of claim 14, wherein, for the generating of the output image, the processor is configured to:
determine a blending weight based on edges in the input image; and
generate the output image by blending the haze-free images based on the determined blending weight.

### Claim 18 (depends on 17)

The apparatus of claim 17, wherein, for the determining of the blending weight, the processor is configured to:
detect an edge in the input image; and
determine the blending weight by performing a morphological operation on the detected edge.

### Claim 19 (depends on 14)

The apparatus of claim 14, further comprising:
a camera configured to generate the input image; and
a control system configured to control a vehicle based on a generated control instruction,
wherein the processor is configured to generate the control instruction based on the generated output image, and the apparatus is a vehicle control apparatus.

### Claim 20 (depends on 14)

The apparatus of claim 14 further comprising a memory storing instructions that, when executed by the processor, configure the processor to perform the determining of the source transmission map, the determining of the transformed transmission maps, the generating of the haze-free images, and the generating of the output image.

### Claim 21

A vehicle control apparatus, comprising:
a camera configured to generate an input image of surroundings of a vehicle;
a processor configured to
determine a source transmission map based on a dark channel map of the input image,
determine transformed transmission maps by applying different filters to the determined source transmission map,
generate haze-free maps by removing haze from the input image based respectively on the determined transformed transmission maps,
generate an output image by blending the generated haze-free images, and
generate a control instruction for traveling of the vehicle based on the generated output image; and
a control system configured to control the vehicle based on the generated control instruction.

### Claim 22 (depends on 21)

The apparatus of claim 21, wherein the filters comprise:
a multi-directional kernel-based filter configured to restore a texture; and
a guided filter configured to suppress a halo artifact.

### Claim 23 (depends on 21)

The apparatus of claim 21, wherein, for the generating of the output image, the processor is configured to:
determine a blending weight based on edges in the input image; and
generate the output image by blending the haze-free images based on the determined blending weight.

### Claim 24

An image processing method, comprising:
determining a source transmission map, based on a dark channel map of an input image generated based on a mask of a predetermined size;
determining first and second transformed transmission maps by respectively applying a multi-directional kernel-based filter and a guided filter to the source transmission map;
generating first and second haze-free images by removing haze from the input image based respectively on the first and second transformed transmission maps; and
generating an output image by blending the first and second haze-free images based on an edge map of the input image.
