# US 2021/0279846 A1 · Enhanced imaging system for a motor vehicle

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0279846 A1
- Document ID: US20210279846A1
- Status: Published application
- Kind: A1
- Application number: 16/809,141
- Filed: 2020-03-04
- Published: 2021-09-09
- Earliest claimed: 2020-03-04
- Assignees: GM Global Technology Operations LLC
- Applicants: GM Global Technology Operations LLC
- Inventors: Sai Vishnu Aluru; James A. Carpenter; Jayasimha V. Rao
- Web page: https://patentgrep.com/patent/US20210279846A1

## CPC

- G06T 5/90: Dynamic range modification of images or parts thereof
- G06T 5/92: based on global image properties
- B60K 35/10: Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
- B60K 35/22: Display screens
- B60K 35/50: Instruments characterised by their means of attachment to or integration in the vehicle (B60K35/231 takes precedence)
- B60K 35/656: {the user being a passenger}
- B60K 35/81: for controlling displays
- B60K 37/20: Dashboard panels
- G06T 1/20: Processor architectures; Processor configuration, e.g. pipelining
- G06T 5/40: using histogram techniques
- H04N 23/63: by using electronic viewfinders
- H04N 23/71: Circuitry for evaluating the brightness variation
- H04N 23/741: by increasing the dynamic range of the image compared to the dynamic range of the electronic image sensors
- B60K 35/23: Head-up displays [HUD] (optical aspects of head-up displays G02B27/01)
- B60K 35/28: characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver
- B60K 35/60: Instruments characterised by their location or relative disposition in or on vehicles (arrangements of lighting devices on dashboards B60Q3/10)
- B60K 2360/1523: Matrix displays
- B60K 2360/176: Camera images
- G06T 2207/10004: Still image; Photographic image
- G06T 2207/10016: Video; Image sequence
- G06T 2207/20208: High dynamic range [HDR] image processing
- G06T 2207/30252: Vehicle exterior; Vicinity of vehicle
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- B60K: ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

An enhanced imaging system for a motor vehicle includes a vision processing module that generates a data signal, in response to the camera capturing at least one of the video and the image. A graphics processor is configured to tone map the video or image to generate an RGB histogram including an overall tonal range. The processor is further configured to compare the overall tonal range to a tonal threshold. The processor detects one or more objects having a boundary that separates an interior region having an object tonal value from an exterior region having an exterior tonal value. The processor generates an optimized signal for increasing a difference between the object tonal value and the exterior tonal value, in response to the overall tonal range being above the tonal threshold. The system can further include a display device for displaying an optimized video or image.

## Claims

### Claim 1

An enhanced imaging system for a motor vehicle, the enhanced imaging system comprising:
a vision processing module including a camera for capturing at least one of a video and an image, and the camera generating a data signal, in response to the camera capturing at least one of the video and the image;
a graphics processor configured to:
determine whether at least one of the video and the image comprises one of an HDR video and an HDR image, in response to the graphics processor receiving the data signal from the vision processing module;
tone map at least one of the video and the image to generate an RGB histogram including an overall tonal range, in response to the graphics processor determining that at least one of the video and the image comprises one of the HDR video and the HDR image;
compare the overall tonal range to a tonal threshold;
detect at least one object having a boundary, with the boundary surrounding an interior region that has an object tonal value and separating the interior region from an exterior region that has an exterior tonal value; and
generate an optimized signal for transforming the tone mapping to increase a difference between the object tonal value and the exterior tonal value, in response to the graphics processor determining that the overall tonal range is above the tonal threshold; and
a display device for receiving the optimized signal from the graphics processor and displaying one of an optimized video and an optimized image, in response to the display device receiving the optimized signal from the graphics processor.

### Claim 2 (depends on 1)

The enhanced imaging system of claim 1 wherein the graphics processor is further configured to detect the object, in response to the graphics processor detecting that the boundary defines a closed profile surrounding the interior region of the object.

### Claim 3 (depends on 2)

The enhanced imaging system of claim 2 wherein the graphics processor is further configured to detect at least a portion of the boundary, in response to the graphics processor detecting that a tone gradient separates the exterior region of the object and the interior region of the object from one another.

### Claim 4 (depends on 3)

The enhanced imaging system of claim 3 wherein the graphics processor is configured to detect at least a portion of the boundary, in response to graphics processor determining that the difference between the object tonal value and the exterior tonal value is at least 60.

### Claim 5 (depends on 4)

The enhanced imaging system of claim 4 wherein the graphics processor determines that the overall tonal range is above the tonal threshold, in response to the graphics processor determining that the overall tonal range is between 64 and 192.

### Claim 6 (depends on 5)

The enhanced imaging system of claim 5 wherein the graphics processor generates the optimized signal in real time, in response to the graphics processor receiving the data signal for displaying at least one of the video and the image on the display device in real time.

### Claim 7 (depends on 5)

The enhanced imaging system of claim 5 wherein the graphics processor generates the optimized signal, in response to the graphics processor recording the data signal for playing back at least one of the video and the image on the display device.

### Claim 8

A motor vehicle comprising:
a passenger cabin;
a dashboard facing the passenger cabin and having first and second portions adjacent to one another;
an instrument panel cluster attached to the first portion of the dashboard and facing the passenger cabin;
a center stack attached to the second portion of the dashboard and facing the passenger cabin; and
an enhanced imaging system comprising:
a vision processing module including a camera for capturing at least one of a video and an image external to the passenger cabin, and the camera generating a data signal, in response to the camera capturing at least one of the video and the image;
a graphics processor configured to:
determine whether at least one of the video and the image comprises one of an HDR video and an HDR image, in response to the graphics processor receiving the data signal from the vision processing module;
tone map at least one of the video and the image to generate an RGB histogram including an overall tonal range, in response to the graphics processor determining that at least one of the video and the image comprises one of the HDR video and the HDR image;
compare the overall tonal range to a tonal threshold;
detect at least one object having a boundary, with the boundary surrounding an interior region that has an object tonal value and separating the interior region from an exterior region that has an exterior tonal value; and
generate an optimized signal for transforming the tone mapping to increase a difference between the object tonal value and the exterior tonal value, in response to the graphics processor determining that the overall tonal range is above the tonal threshold; and
a display device mounted to at least one of the instrument panel cluster and the center stack, with the display device being configured to receive the optimized signal from the graphics processor and display one of an optimized video and an optimized image, in response to the display device receiving the optimized signal from the graphics processor.

### Claim 9 (depends on 8)

The motor vehicle of claim 8 further comprising:
a front end structure disposed forward of the passenger cabin;
a rear end structure disposed rearward of the passenger cabin;
at least one side view mirror disposed laterally outboard of the passenger cabin; and
a rear view mirror module disposed within the passenger cabin;
wherein the camera is mounted to one of the front end structure, the rear end structure, the at least one side view mirror, and the rear view mirror module.

### Claim 10 (depends on 8)

The motor vehicle of claim 8 further comprising:
a front end structure disposed forward of the passenger cabin;
a rear end structure disposed rearward of the passenger cabin;
at least one side view mirror disposed laterally outboard of the passenger cabin; and
a rear view mirror module disposed within the passenger cabin;
wherein the vision processing module includes a plurality of the cameras mounted to an associated one of the front end structure, the rear end structure, the at least one side view mirror, and the rear view mirror module.

### Claim 11 (depends on 8)

The motor vehicle of claim 8 wherein the graphics processor determines that the overall tonal range is above the tonal threshold, in response to the graphics processor determining that the overall tonal range is between 64 and 192.

### Claim 12 (depends on 8)

The motor vehicle of claim 8 wherein the graphics processor is further configured to detect the object, in response to the graphics processor detecting that the boundary defines a closed profile surrounding the interior region of the object.

### Claim 13 (depends on 12)

The motor vehicle of claim 12 wherein the graphics processor is further configured to detect at least a portion of the boundary, in response to the graphics processor detecting that a tone gradient separates the exterior region of the object and the interior region of the object from one another.

### Claim 14 (depends on 13)

The motor vehicle of claim 13 wherein the graphics processor generates the optimized signal in real time, in response to the graphics processor receiving the data signal for displaying at least one of the video and the image on the display device in real time.

### Claim 15

A method for operating an enhanced imaging system for a motor vehicle having a passenger cabin, and the enhanced imaging system includes a vision processing module with a camera, a graphics processor, and a display device, the method comprising:
capturing, using the camera, at least one of a video and an image external to the passenger cabin;
generating, using the camera, a data signal, in response to the camera capturing at least one of the video and the image;
determining, using the graphics processor, whether at least one of the video and the image comprises one of an HDR video and an HDR image, in response to the graphics processor receiving the data signal from the vision processing module;
tone mapping, using the graphics processor, at least one of the video and the image to generate an RGB histogram including an overall tonal range, in response to the graphics processor determining that at least one of the video and the image comprises one of the HDR video and the HDR image;
comparing, using the graphics processor, the overall tonal range to a tonal threshold;
detecting, using a graphics processor, at least one object having a boundary surrounding an interior region that has an object tonal value and separating the interior region from an exterior region that has an exterior tonal value; and
generating, using the graphics processor, an optimized signal for transforming the tone mapping to increase a difference between the object tonal value and the exterior tonal value, in response to the graphics processor determining that the overall tonal range is above the tonal threshold; and
receiving, with the display device, the optimized signal from the graphics processor and displaying, using the display device, one of an optimized video and an optimized image, in response to the display device receiving the optimized signal from the graphics processor.

### Claim 16 (depends on 15)

The method of claim 15 further comprising detecting, using the graphics processor, the object, in response to the graphics processor detecting that the boundary defines a closed profile surrounding the interior region of the object.

### Claim 17 (depends on 16)

The method of claim 16 further comprising detecting, using the graphics processor, at least a portion of the boundary, in response to the graphics processor detecting that a tone gradient separates the exterior region of the object and the interior region of the object from one another.

### Claim 18 (depends on 17)

The method of claim 17 further comprising detecting, using the graphics processor, at least a portion of the boundary, in response to graphics processor determining that the difference between the object tonal value and the exterior tonal value is at least 60.

### Claim 19 (depends on 18)

The method of claim 18 further comprising determining, using the graphics processor, that the overall tonal range is above the tonal threshold, in response to the graphics processor determining that the overall tonal range is between 64 and 192.

### Claim 20 (depends on 19)

The method of claim 19 further comprising generating, using the graphics processor, the optimized signal in real time, in response to the graphics processor receiving the data signal for displaying at least one of the video and the image on the display device in real time.