# US 2018/0322347 A1 · Driver Assistance System Featuring Adaptive Processing of Image Data of the Surroundings

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2018/0322347 A1
- Document ID: US20180322347A1
- Status: Published application
- Kind: A1
- Application number: 15/773,224
- Filed: 2016-10-26
- Published: 2018-11-08
- Earliest claimed: 2015-11-24
- Assignees: Conti Temic microelectronic GmbH
- Applicants: Conti Temic microelectronic GmbH
- Inventors: Markus FRIEBE
- Web page: https://patentgrep.com/patent/US20180322347A1

## CPC

- B60W 50/14: Means for informing the driver, warning the driver or prompting a driver intervention
- B60R 1/27: providing all-round vision, e.g. using omnidirectional cameras
- G06F 18/24: Classification techniques
- G06T 7/50: Depth or shape recovery
- G06T 7/60: Analysis of geometric attributes
- G06V 20/56: exterior to a vehicle by using sensors mounted on the vehicle
- G06V 20/58: Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
- H04N 5/2624: {for obtaining an image which is composed of whole input images, e.g. splitscreen}
- B60K 35/10: Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
- B60K 35/28: characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver
- B60K 35/29: Instruments characterised by the way in which information is handled, e.g. showing information on plural displays or prioritising information according to driving conditions
- B60K 2360/1438: Touch screens
- B60K 2360/176: Camera images
- B60K 2360/178: Warnings
- B60K 2360/191: Highlight information
- B60R 2300/105: using multiple cameras
- B60R 2300/303: using joined images, e.g. multiple camera images
- B60R 2300/307: virtually distinguishing relevant parts of a scene from the background of the scene
- B60R 2300/60: characterised by monitoring and displaying vehicle exterior scenes from a transformed perspective
- B60W 2050/0055: {High-pass filters}
- B60W 2050/0056: {Low-pass filters}
- B60W 2050/146: {Display means}
- B60W 2420/403: Image sensing, e.g. optical camera
- B60W 2554/00: Input parameters relating to objects
- G06T 11/10: Texturing; Colouring; Generation of textures or colours (retouching, inpainting or scratch removal G06T5/77)
- G06T 2207/20024: Filtering details
- H04N 23/90: Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
- B60W: CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60R: VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- B60K: ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES

## Abstract

A driver assistance system for displaying an image of the surroundings for a vehicle having a vehicle camera which produce camera images of the surroundings of the vehicle, and having a data processing unit which combines the camera images produced by the vehicle cameras to form an image of the surroundings of the vehicle, wherein an associated region of interest (ROI) is processed adaptively for at least one object contained in the image of the surroundings.

## Claims

### Claim 1

A driver assistance system for a vehicle, for displaying an image of surroundings of the vehicle, comprising:
vehicle cameras configured to produce camera images of the surroundings of the vehicle;
a data processing unit configured to combine the camera images produced by the vehicle cameras to form a combined image of the surroundings of the vehicle, and configured to adaptively filter a region of interest associated with at least one object contained in the combined image of the surroundings; and
a display unit configured to display the combined image of the surroundings including the adaptively filtered region of interest.

### Claim 2

(canceled)

### Claim 3 (depends on 1)

The driver assistance system according to claim 1, wherein the region of interest associated with the at least one object is formed by a polygon, vertices of which are coordinates of a coordinate system of the vehicle.

### Claim 4 (depends on 1)

The driver assistance system according to claim 1, wherein the region of interest associated with the at least one object is determined by an environmental data model of the surroundings of the vehicle.

### Claim 5 (depends on 1)

The driver assistance system according to claim 1, further comprising a user interface configured so that the region of interest associated with the at least one object is specified by a user of the driver assistance system via the user interface.

### Claim 6 (depends on 1)

The driver assistance system according to claim 1, wherein the data processing unit is configured to adaptively filter the region of interest by high-pass filtering or low-pass filtering.

### Claim 7 (depends on 1)

The driver assistance system according to claim 1, wherein the region of interest is covered with a predefined associated texture.

### Claim 8 (depends on 1)

The driver assistance system according to claim 1, further comprising sensors configured to capture a height profile of the surroundings of the vehicle, wherein the at least one object contained in the combined image of the surroundings is identified based on the height profile of the surroundings of the vehicle.

### Claim 9 (depends on 1)

The driver assistance system according to claim 1, wherein the data processing unit is configured to classify, into a determined class, a classified object among the at least one object contained in the combined image of the surroundings, and the adaptive filtering of the region of interest by the data processing unit is effected as a function of the determined class of the classified object.

### Claim 10 (depends on 1)

The driver assistance system according to claim 1, wherein the data processing unit is configured to perform the adaptive filtering of the region of interest as a function of a distance of the region of interest and/or of the at least one object from a coordinate origin of a vehicle coordinate system.

### Claim 11

A method of processing and displaying image data of an image of surroundings of a vehicle in a driver assistance system of the vehicle, comprising the steps:
(a) combining camera images, which are respectively produced by cameras of the vehicle, to form a combined image of the surroundings of the vehicle;
(b) performing an adaptive filtering of a region of interest associated with at least one object contained in the combined image of the surroundings; and
(c) displaying the combined image of the surroundings including the adaptively filtered region of interest on a display unit of the driver assistance system of the vehicle.

### Claim 12 (depends on 11)

The method according to claim 11, wherein the region of interest associated with the at least one object is formed by a polygon, vertices of which are formed by coordinates of a coordinate system of the vehicle.

### Claim 13 (depends on 11)

The method according to claim 11, further comprising determining the region of interest associated with the at least one object by an environmental data model of the surroundings of the vehicle.

### Claim 14 (depends on 11)

The method according to claim 11, wherein the adaptive filtering of the region of interest comprises high-pass or low-pass filtering.

### Claim 15 (depends on 11)

The method according to claim 11, further comprising capturing a height profile of the surroundings of the vehicle with sensors, and identifying the at least one object contained in the combined image of the surroundings based on the height profile of the surroundings.

### Claim 16 (depends on 11)

The method according to claim 11, further comprising classifying, into a determined class, at least one classified object among the at least one object contained in the combined image of the surroundings, wherein the adaptive filtering of the region of interest is effected as a function of the determined class of the classified object.

### Claim 17 (depends on 11)

The method according to claim 11, wherein the adaptive filtering of the region of interest is effected as a function of a distance of the region of interest or of the at least one object from a coordinate origin of a coordinate system of the vehicle.

### Claim 18 (depends on 11)

The method according to claim 11, further comprising determining the region of interest associated with the at least one object by receiving a specification thereof input by a user via a user interface of the driver assistance system.

### Claim 19 (depends on 11)

The method according to claim 11, further comprising covering the region of interest with a predefined associated texture.
