# US 2019/0315274 A1 · Vehicle behavior using information from other vehicles lights

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0315274 A1
- Document ID: US20190315274A1
- Status: Published application
- Kind: A1
- Application number: 15/952,904
- Filed: 2018-04-13
- Published: 2019-10-17
- Earliest claimed: 2018-04-13
- Assignees: GM Global Technology Operations LLC
- Applicants: GM Global Technology Operations LLC
- Inventors: Syed B. Mehdi; Yasen Hu; Upali P. Mudalige
- Web page: https://patentgrep.com/patent/US20190315274A1

## CPC

- B60Q 9/008: {for anti-collision purposes}
- B60Q 9/005: {using a video camera}
- B60W 30/06: Automatic manoeuvring for parking
- B60W 30/0956: {the prediction being responsive to traffic or environmental parameters}
- B60W 50/16: Tactile feedback to the driver, e.g. vibration or force feedback to the driver on the steering wheel or the accelerator pedal
- G05D 1/0246: {using a video camera in combination with image processing means}
- G06V 20/584: {of vehicle lights or traffic lights}
- B60W 2420/403: Image sensing, e.g. optical camera
- B60W 2520/10: Longitudinal speed
- B60Q: ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
- B60W: CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- G05D: SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

A method for controlling an operating vehicle includes: (a) determining, via a controller, a confidence level that the light of the other vehicle is ON based on images captured by a camera of the operating vehicle; and (b) controlling, via the controller, an alarm of the operating vehicle based on the confidence level that the light of the other vehicle is ON.

## Claims

### Claim 1

A method for controlling an operating vehicle, comprising:
determining, via a controller, a confidence level that a light of an other vehicle is ON based on images captured by a camera of the operating vehicle; and
controlling, via the controller, an alarm of the operating vehicle based on the confidence level that the light of the other vehicle is ON.

### Claim 2 (depends on 1)

The method of claim 1, wherein controlling, via the controller, the alarm of the operating vehicle includes:
determining, via the controller, that the confidence level is greater than a first predetermined threshold; and
activating, via the controller, the alarm of the operating vehicle in response to determining that the confidence level is greater than the first predetermined threshold.

### Claim 3 (depends on 2)

The method of claim 2, wherein controlling, via the controller, the alarm of the operating vehicle includes:
determining, via the controller, that the confidence level is less than a second predetermined threshold; and
deactivating, via the controller, the alarm of the operating vehicle in response to determining that the confidence level is less than the second predetermined threshold; and
wherein the first predetermined threshold is greater than the second predetermined threshold.

### Claim 4 (depends on 3)

The method of claim 3, wherein controlling, via the controller, the alarm of the operating vehicle includes:
determining, via the controller, that the confidence level is less than the second predetermined threshold; and
maintaining, via the controller, the alarm of the operating vehicle deactivated in response to determining that the confidence level is less than the first predetermined threshold.

### Claim 5 (depends on 1)

The method of claim 1, wherein the alarm includes a haptic feedback emitted from a haptic seat of the operating vehicle.

### Claim 6 (depends on 1)

The method of claim 1, further comprising:
determining, via the controller, that the confidence level is greater than a first predetermined threshold; and
redistributing computational resources of the controller to increase an allocation of the computational resources of the controller used to visually analyze the other vehicle in response to determining that the confidence level is greater than the first predetermined threshold.

### Claim 7 (depends on 6)

The method of claim 6, further comprising:
determining, via the controller, that the confidence level is less than a second predetermined threshold; and
redistributing computational resources of the controller to decrease an allocation of the computational resources of the controller used to visually analyze the other vehicle in response to determining that the confidence level of is less than the second predetermined threshold.

### Claim 8 (depends on 1)

The method of claim 1, further comprising updating, via the controller, a trajectory cost based on a speed of the operating vehicle and the confidence level.

### Claim 9 (depends on 8)

The method of claim 8, wherein updating the trajectory cost includes increasing the trajectory cost as a function of the confidence level, wherein an increase in the trajectory cost is proportional to the confidence level.

### Claim 10 (depends on 9)

The method of claim 9, wherein updating the trajectory cost includes increasing the trajectory cost as a function of a speed of the operating vehicle, wherein an increase in the trajectory cost is proportional to the speed of the operating vehicle.

### Claim 11 (depends on 10)

The method of claim 10, further comprising updating a maximum allowed speed of the operating vehicle as a function of the confidence level, wherein the maximum allowed speed of the operating vehicle is inversely proportional to the confidence level.

### Claim 12 (depends on 11)

The method of claim 11, further comprising:
determining a distance from the operating vehicle to the other vehicle;
wherein updating the trajectory cost includes increasing the trajectory cost as a function of the distance from the operating vehicle to the other vehicle; and
wherein an increase in the trajectory cost is inversely proportional to the distance from the operating vehicle to the other vehicle.

### Claim 13 (depends on 12)

The method of claim 12, further comprising updating a minimum allowed distance from the operating vehicle to the other vehicle as a function of the confidence level, wherein the minimum allowed distance from the operating vehicle to the other vehicle is directly proportional to the confidence level.

### Claim 14 (depends on 13)

The method of claim 13, further comprising determining a final trajectory of the operating vehicle based on the trajectory cost, the maximum allowed speed of the operating vehicle, and the minimum allowed distance from the operating vehicle to the other vehicle.

### Claim 15 (depends on 1)

The method of claim 1, further comprising:
after determining the confidence level that the light of the other vehicle is ON, determining a confidence level that a reverse light of the other vehicle is ON; and
determining a time from the determining the confidence level that the light of the other vehicle is ON to a present moment; and
updating a trajectory cost of the operating vehicle as a function of the time, the confidence level that the light of the other vehicle is ON, and the confidence level that a reverse light of the other vehicle is ON.

### Claim 16 (depends on 1)

The method of claim 1, wherein determining the confidence level that the light of the other vehicle is ON includes:
bounding the other vehicle in a bounding box;
using, via the controller, an orientation of the other vehicle to identify areas of interest as possible pixel locations for the light of the other vehicle;
searching, via the controller, for predetermined pixel color ranges in the areas of interest; and
searching, via the controller, for a difference in brightness between the areas of interest and a remaining area within the bounding box.

### Claim 17

A subject vehicle, comprising:
a vehicle body;
a camera coupled to the vehicle body, wherein the camera is configured to capture images;
a controller coupled to the camera, wherein the controller is programmed to:
continuously determine a confidence level that a light of an other vehicle is ON based on the images captured by the camera; and
control an alarm of the subject vehicle based on the confidence level that the light of the other vehicle is ON.

### Claim 18 (depends on 17)

The subject vehicle of claim 17, wherein, in determining the confidence level that the light of the other vehicle is ON, the controller is programmed to:
bound the other vehicle in a bounding box;
use an orientation of the other vehicle to identify areas of interest as possible pixel locations for the light of the other vehicle;
search for predetermined pixel color ranges in the areas of interest;
search for a difference in brightness between the areas of interest and a remaining area within the bounding box;
determine that the light of the other vehicle is ON in response to:
determining that a predetermined color pixel ranges are found in the areas of interest; and
determining that the difference in brightness between the areas of interest and the remaining area within the bounding box is greater than a predetermined brightness threshold;
wherein the controller is further programmed to:
activate the alarm of the subject vehicle in response to determining that the confidence level is greater than a first predetermined threshold, wherein the alarm includes a haptic feedback emitted from a haptic seat of the subject vehicle;
redistribute computational resources of the controller to increase an allocation of the computational resources of the controller used to visually analyze the other vehicle in response to determining that the confidence level is greater than the first predetermined threshold;
update a trajectory cost based on a speed of the subject vehicle and the confidence level;
increase the trajectory cost as a function of the confidence level, wherein the increase in the trajectory cost is proportional to the confidence level;
increase the trajectory cost as a function of a speed of the subject vehicle, wherein the increase in the trajectory cost is proportional to the speed of the subject vehicle;
update a maximum allowed speed of the subject vehicle as a function of the confidence level, wherein the maximum allowed speed of the subject vehicle is inversely proportional to the confidence level;
determine a distance from a from a potential trajectory to the other vehicle;
increase the trajectory cost as a function of the distance from the potential trajectory to the other vehicle, wherein the increase in the trajectory cost is inversely proportional to the distance from the potential trajectory to the other vehicle;
update a minimum allowed distance from the subject vehicle to the other vehicle as a function of the confidence level, wherein the minimum allowed distance from the subject vehicle to the other vehicle is directly proportional to the confidence level;
generate a final trajectory of the subject vehicle based on the trajectory cost, the maximum allowed speed of the subject vehicle, and the minimum allowed distance from the subject vehicle to the other vehicle;
control the subject vehicle to follow the final trajectory; and
after activating the alarm, deactivating the alarm in response to determining that the confidence level is less than a second predetermined threshold, wherein the first predetermined threshold is greater than the second predetermined threshold.
