# US 2020/0396393 A1 · Imaging system and method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0396393 A1
- Document ID: US20200396393A1
- Status: Published application
- Kind: A1
- Application number: 16/440,433
- Filed: 2019-06-13
- Published: 2020-12-17
- Earliest claimed: 2019-06-13
- Assignees: Motherson Innovations Company Limited
- Applicants: Motherson Innovations Company Limited
- Inventors: Maximilian KAUFFMANN; Kai Uwe HAGENBURG
- Web page: https://patentgrep.com/patent/US20200396393A1

## CPC

- H04N 5/265: Mixing
- H04N 7/183: {for receiving images from a single remote source}
- B60R 1/23: with a predetermined field of view
- G06T 3/40: Scaling of whole images or parts thereof, e.g. expanding or contracting
- G06T 5/92: based on global image properties
- G06T 11/00: Two-dimensional [2D] image generation
- G06T 11/10: Texturing; Colouring; Generation of textures or colours (retouching, inpainting or scratch removal G06T5/77)
- H04N 5/445: for displaying additional information (H04N5/50 takes precedence)
- B60R 2300/207: using multi-purpose displays, e.g. camera image and navigation or video on same display
- B60R 2300/303: using joined images, e.g. multiple camera images
- G06T 2207/10024: Color image
- G06T 2207/20021: Dividing image into blocks, subimages or windows
- G06T 2207/20024: Filtering details
- G06T 2207/20208: High dynamic range [HDR] image processing
- G06T 2207/20221: Image fusion; Image merging
- G06T 2207/30252: Vehicle exterior; Vicinity of vehicle
- H04N 1/62: Retouching, i.e. modification of isolated colours only or in isolated picture areas only
- H04N 25/57: Control of the dynamic range
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- B60R: VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

An imaging system includes an image sensor and an image signal processor (ISP). The image sensor generates image data including a set of pixel values. The ISP defines a first subset of pixel values from the set of pixel values. The first subset of pixel values corresponds to at least one region of interest. The ISP defines a second subset of pixel values that is complementary to the first subset of pixel values. The ISP generates a first sub-image based on the second subset of pixel values. The ISP processes the first subset of pixel values to generate a second sub-image. Processing the first subset of pixel values includes at least one of changing a color of one or more pixel values from the first subset of pixel values and scaling the first subset of pixel values. The ISP merges the first and second sub-images to generate an output image.

## Claims

### Claim 1

An imaging system for a vehicle, the imaging system comprising:
an image sensor disposed on the vehicle and configured to generate image data, the image data comprising a set of pixel values;
an image signal processor (ISP) communicably coupled to the image sensor, the ISP configured to:
receive the image data from the image sensor;
define a first subset of pixel values from the set of pixel values, the first subset of pixel values corresponding to one or more distance lines that indicate a distance from the vehicle;
define a second subset of pixel values from the set of pixel values, the second subset of pixel values being complementary to the first subset of pixel values;
generate a first sub-image based on the second subset of pixel values;
process the first subset of pixel values to generate a second sub-image, wherein processing the first subset of pixel values comprises at least one of:
(i) changing a color of one or more pixel values from the first subset of pixel values; and
(ii) scaling the first subset of pixel values;
merge the first and second sub-images to generate an output image; and
a display device configured to display the output image received from the ISP,
wherein processing the first subset of pixel values results in an increased visual contrast between the one or more distance lines and other portions of the output image.

### Claim 2

(canceled)

### Claim 3

(canceled)

### Claim 4 (depends on 1)

The imaging system of claim 1, wherein the processing of the first subset of pixel values comprises changing a color of each pixel value of the first subset of pixel values.

### Claim 5 (depends on 4)

The imaging system of claim 4, wherein the processing of the first subset of pixel values further comprises filtering out at least one of red, green and blue colors from each pixel value of the first subset of pixel values.

### Claim 6 (depends on 1)

The imaging system of claim 1, wherein the processing of the first subset of pixel values comprises magnifying the first subset of pixel values.

### Claim 7 (depends on 1)

The imaging system of claim 1, wherein the ISP is further configured to perform high dynamic range (HDR) processing of the first subset of pixel values.

### Claim 8 (depends on 1)

The imaging system of claim 1, wherein the ISP is further configured to perform high dynamic range (HDR) processing of the second subset of pixel values.

### Claim 9

An imaging method for a vehicle, the imaging method comprising:
receiving image data from an image sensor disposed on the vehicle, the image data comprising a set of pixel values;
defining a first subset of pixel values from the set of pixel values, the first subset of pixel values corresponding to one or more distance lines that indicate a distance from the vehicle;
defining a second subset of pixel values from the set of pixel values, the second subset of pixel values being complementary to the first subset of pixel values;
generating a first sub-image based on the second subset of pixel values;
processing the first subset of pixel values to generate a second sub-image, wherein processing the first subset of pixel values comprises at least one of:
(i) changing a color of one or more pixel values from the first subset of pixel values; and
(ii) scaling the first subset of pixel values;
merging the first and second sub-images to generate an output image; and
displaying the output image by a display device,
wherein processing the first subset of pixel values results in an increased visual contrast between the one or more distance lines and other portions of the output image.

### Claim 10

(canceled)

### Claim 11

(canceled)

### Claim 12 (depends on 9)

The imaging method of claim 9, wherein the processing of the first subset of pixel values comprises changing a color of each pixel value of the first subset of pixel values.

### Claim 13 (depends on 9)

The imaging method of claim 9, wherein the processing of the first subset of pixel values comprises magnifying the first subset of pixel values.

### Claim 14 (depends on 9)

The imaging method of claim 9, further comprising performing high dynamic range (HDR) processing of the first subset of pixel values.

### Claim 15 (depends on 9)

The imaging method of claim 9, further comprising performing high dynamic range (HDR) processing of the second subset of pixel values.

### Claim at position 16

16-20. (canceled)

### Claim 21

An imaging system for a vehicle, the imaging system comprising:
an image sensor disposed on the vehicle and configured to generate image data, the image data comprising a set of pixel values;
an image signal processor (ISP) communicably coupled to the image sensor, the ISP configured to:
receive the image data from the image sensor;
define a first subset of pixel values from the set of pixel values, the first subset of pixel values corresponding to a visual icon or identified object;
define a second subset of pixel values from the set of pixel values, the second subset of pixel values being complementary to the first subset of pixel values;
generate a first sub-image based on the second subset of pixel values;
process the first subset of pixel values to generate a second sub-image, wherein processing the first subset of pixel values comprises at least one of:
(i) changing a color of one or more pixel values from the first subset of pixel values; and
(ii) scaling the first subset of pixel values;
merge the first and second sub-images to generate an output image; and
a display device configured to display the output image received from the ISP,
wherein processing the first subset of pixel values results in an increased visual contrast between the visual icon or identified object and other portions of the output image.

### Claim 22 (depends on 21)

The imaging system of claim 21, wherein the processing of the first subset of pixel values comprises changing a color of each pixel value of the first subset of pixel values.

### Claim 23 (depends on 22)

The imaging system of claim 22, wherein the processing of the first subset of pixel values further comprises filtering out at least one of red, green and blue colors from each pixel value of the first subset of pixel values.

### Claim 24 (depends on 21)

The imaging system of claim 21, wherein the processing of the first subset of pixel values comprises magnifying the first subset of pixel values.

### Claim 25 (depends on 21)

The imaging system of claim 21, wherein the ISP is further configured to perform high dynamic range (HDR) processing of the first subset of pixel values.

### Claim 26 (depends on 21)

The imaging system of claim 21, wherein the ISP is further configured to perform high dynamic range (HDR) processing of the second subset of pixel values.
