# US 11,113,549 B2 · Method and device for analyzing an image and providing the analysis for a driving assistance system of a vehicle

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,113,549 B2
- Document ID: US11113549B2
- Status: Granted
- Kind: B2
- Application number: 16/470,795
- Filed: 2017-11-22
- Published: 2020-03-19
- Granted: 2021-09-07
- Earliest claimed: 2016-12-21
- Assignees: Robert Bosch GmbH
- Applicants: Robert Bosch GmbH
- Inventors: Caroline Gerardon; Omar Alaa El-Din; Tobias Stumber; Steffen Brueggert; Alvaro Marcos-Ramiro; Matthias Kirschner; Matthias Wacker
- Web page: https://patentgrep.com/patent/US11113549B2

## CPC

- G06V 20/582: {of traffic signs}
- B60W 40/02: related to ambient conditions
- G06F 18/24: Classification techniques
- G06V 10/87: {using selection of the recognition techniques, e.g. of a classifier in a multiple classifier system}
- G06V 20/58: Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
- G06V 20/584: {of vehicle lights or traffic lights}
- G06V 40/10: Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- B60W 2420/403: Image sensing, e.g. optical camera
- B60W 2554/00: Input parameters relating to objects
- B60W 2555/20: Ambient conditions, e.g. wind or rain
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- B60W: CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A method and device for analyzing an image and providing the analysis for a driving assistance system of a vehicle, including recording the image; determining an operating state of the vehicle; analyzing the image using at least one image analysis method that is selected from at least two possible image analysis methods as a function of the operating state of the vehicle; and providing the analysis of the image as data values for the driving assistance system.

## Claims

### Claim 1

A method of an image analysis system of a vehicle for analyzing an image and providing the analysis for a driving assistance system of the vehicle, a plurality of operating states of the vehicle being predefined in the image analysis system and a plurality of image analysis processes being predefined in the image analysis system, the method comprising:
recording the image;
identifying which one of the predefined plurality of operating states is a current operating state of the vehicle;
based on the one of the predefined plurality of operating states having been identified as being the current operating state of the vehicle, selecting, from the plurality of image analysis processes, at least one of the plurality of image analysis processes that is predefined in the image analysis system as corresponding to the one of the predefined plurality of operating states that has been identified as being the current operating state of the vehicle;
based on the selection, analyzing the image selectively using the at least one image analysis process that has been selected, without use of others of the plurality of image analysis processes; and
providing the analysis of the image as data values for the driving assistance system.

### Claim 2 (depends on 1)

The method of claim 1, wherein the image represents an environment of the vehicle, and wherein the data values are a description of at least one object therein.

### Claim 3 (depends on 1)

The method of claim 1, wherein the image is recorded as at least a partial image, and wherein the at least one partial image includes a subset of image properties of the image.

### Claim 4 (depends on 3)

The method of claim 3, wherein the image is recorded as at least two partial images, and wherein each of the at least two partial images includes a different subset of image properties.

### Claim 5 (depends on 1)

The method of claim 1, wherein the operating state of the vehicle includes at least one of the following states: a speed of the vehicle, weather conditions in an environment of the vehicle, and light conditions in the environment of the vehicle.

### Claim 6 (depends on 3)

The method of claim 3, wherein the analysis is performed by the at least one image analysis process in a way that enables the at least one image analysis process to include a first analysis task and a second analysis task, wherein at least one feature is classified by the first analysis task using the subset of image properties in the at least one partial image, and wherein the at least one object is determined by the second analysis task based on the at least one classified feature.

### Claim 7 (depends on 2)

The method of claim 2, wherein the at least one object is a traffic sign, a pedestrian, another vehicle and/or an animal.

### Claim 8

A device for analyzing an image and providing the analysis for a driving assistance system of a vehicle, the device comprising: a camera system that includes a camera, wherein the camera system is configured to record the image with the camera; a storage in which a plurality of operating states of the vehicle are predefined and a plurality of image analysis processes are predefined; and
at least one processor, wherein the at least one processor is configured to:
identify which one of the predefined plurality of operating states is a current operating state of the vehicle;
based on the one of the predefined plurality of operating states having been identified as being the current operating state of the vehicle, select, from the plurality of image analysis processes, at least one of the plurality of image analysis processes that is predefined in the storage as corresponding to the one of the predefined plurality of operating states that has been identified as being the current operating state of the vehicle;
based on the selection, analyze the image selectively using the at least one image analysis process that has been selected, without use of other of the plurality of image analysis processes; and
provide the analysis of the image as data values for the driving assistance system.

### Claim 9 (depends on 8)

The device of claim 8, wherein the analysis is performed by the at least one image analysis process in a way that enables the at least one image analysis process to include a first analysis task and a second analysis task, wherein at least one feature is classified by the first analysis task using a subset of image properties in at least one partial image of the image, and wherein at least one object represented in the image is determined by the second analysis task based on the at least one classified feature.

### Claim 10

A system for operating a vehicle, the system comprising: a camera system for capturing an image; a driving assistance system for executing a driving assistance function; and a device for analyzing the image and providing the analysis for the driving assistance system of the vehicle, the device including:
a camera system that includes a camera, wherein the camera system is configured to record the image with the camera; a storage in which a plurality of operating states of the vehicle are predefined and a plurality of image analysis processes are predefined; and
at least one processor;
wherein the at least one processor is configured to:
identify which one of the predefined plurality of operating states is a current operating state of the vehicle;
based on the one of the predefined plurality of operating states having been identified as being the current operating state of the vehicle, select, from the plurality of image analysis processes, at least one of the plurality of image analysis processes that is predefined in the storage as corresponding to the one of the predefined plurality of operating states that has been identified as being the current operating state of the vehicle;
based on the selection, analyze the image selectively using the at least one image analysis process that has been selected, without use of other of the plurality of image analysis processes; and
provide the analysis of the image as data values for the driving assistance system.

### Claim 11 (depends on 1)

The method of claim 1, wherein a first of the predefined plurality of operating states is a first speed range at which the vehicle is traveling and a second of the predefined plurality of operating states is a second speed range at which the vehicle is traveling, so that different ones of the predefined plurality of image analysis processes are used for the analysis depending on an identified current speed of the vehicle.

### Claim 12 (depends on 11)

The method of claim 11, wherein the different ones of the predefined plurality of image analysis processes that are used for the analysis depending on the identified current speed of the vehicle, differ with respect to a number of image details of the image are analyzed.
