# US 2022/0017088 A1 · Video analytics traffic monitoring and control

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0017088 A1
- Document ID: US20220017088A1
- Status: Published application
- Kind: A1
- Application number: 16/929,193
- Filed: 2020-07-15
- Published: 2022-01-20
- Earliest claimed: 2020-07-15
- Assignees: Charter Communications Operating, LLC
- Applicants: Charter Communications Operating , LLC
- Inventors: Hany A. Heikal; Hossam H. Hmimy
- Web page: https://patentgrep.com/patent/US20220017088A1

## CPC

- B60W 30/143: {Speed control (B60W30/16 takes precedence)}
- B60Q 9/00: Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00 {, e.g. haptic signalling}
- B60W 10/18: including control of braking systems
- B60W 30/18154: {Approaching an intersection}
- G06V 10/751: {Comparing pixel values or logical combinations thereof, or feature values having positional relevance, e.g. template matching}
- G06V 20/54: of traffic, e.g. cars on the road, trains or boats
- G06V 20/63: {Scene text, e.g. street names}
- G08G 1/0112: {from the vehicle, e.g. floating car data [FCD]}
- G08G 1/0116: {from roadside infrastructure, e.g. beacons}
- G08G 1/0133: {for classifying traffic situation}
- G08G 1/0145: {for active traffic flow control}
- G08G 1/017: identifying vehicles (G08G1/015, G08G1/054 take precedence)
- G08G 1/04: using optical or ultrasonic detectors
- G08G 1/052: with provision for determining speed or overspeed {(speed measuring in general G01P)}
- G08G 1/056: with provision for distinguishing direction of travel
- G08G 1/08: according to detected number or speed of vehicles
- G08G 1/081: Plural intersections under common control
- G08G 1/096725: {where the received information generates an automatic action on the vehicle control}
- G08G 1/096741: {where the source of the transmitted information selects which information to transmit to each vehicle}
- G08G 1/096783: {where the origin of the information is a roadside individual element}
- B60W 2420/403: Image sensing, e.g. optical camera
- B60W 2554/20: Static objects
- B60W 2554/80: Spatial relation or speed relative to objects
- B60W 2555/60: Traffic rules, e.g. speed limits or right of way
- B60W 2556/45: External transmission of data to or from the vehicle
- G06V 20/625: {License plates}
- G06V 2201/08: Detecting or categorising vehicles
- B60W: CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60Q: ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G08G: TRAFFIC CONTROL SYSTEMS (guiding railway traffic, ensuring the safety of railway traffic B61L; arrangement of road signs or traffic signals E01F9/00; radar or analogous systems, sonar systems, lidar systems specially adapted for traffic control G01S13/91, G01S15/88, G01S17/88; {radar or analogous systems, sonar systems, lidar systems specially adapted for anti-collision purposes G01S13/93, G01S15/93, G01S17/93})

## Abstract

A controlled intersection employs video analytics to identify incoming vehicles coupled with autonomous driving capabilities in the vehicle to selectively provide intervention for collision avoidance. A camera image of an approaching vehicle is used to identify a range and speed, and to compute whether intervention is appropriate based on a detected distance and speed from the intersection. A vehicle approaching a stop signal (e.g. “red light”) at an unsafe rate of speed triggers an invocation of on-board autonomous systems in the vehicle that provide appropriate warnings and ultimately, forced braking if warnings go unheeded. A registration system maintains a local grouping of vehicles in proximity to an intersection for minimizing latency in vehicle identification for commencing intervention. In this manner, on-board vehicle collision avoidance systems collaborate with complementary traffic control logic at a controlled intersection for preventing inadvertent or intentional disregard of a red signal.

## Claims

### Claim 1

A method of controlling a semi-autonomous vehicle, comprising:
propagating a local set of vehicle identities to an edge unit, the edge unit in communication with a traffic signal at a controlled intersection, the local set of vehicle identities based on a subset of vehicles deemed proximate to the controlled intersection;
computing, from an imaged detection of a vehicle corresponding to the set of vehicle identities, a distance of the vehicle approaching the controlled intersection; and
controlling, based on a comparison of a speed threshold with the computed distance, the vehicle in order to conform a speed of the vehicle with a predetermined speed corresponding to the speed threshold.

### Claim 2 (depends on 1)

The method of claim 1 further comprising identifying a distance marker corresponding to each of the plurality of speed thresholds, further comprising controlling the vehicle speed if a speed of the vehicle exceeds the speed threshold when the vehicle reaches the distance marker associated with the speed threshold and the traffic signal is issuing a stop signal.

### Claim 3 (depends on 2)

The method of claim 2 further comprising:
tracking a distance of the approaching vehicle from the controlled intersection, and
performing the comparison of the speed threshold when a distance of the vehicle from the controlled intersection meets one of the distance markers of the plurality of the distance markers associated with the respective speed thresholds.

### Claim 4 (depends on 1)

The method of claim 1 wherein controlling further comprises:
determining a distance marker from the plurality of distance markers corresponding to a current location of the vehicle;
determining that the speed of the vehicle exceeds the speed threshold associated with the determined distance marker; and
applying an intervention to the vehicle based on the distance marker.

### Claim 5 (depends on 4)

The method of claim 4 wherein the intervention includes an alert signal, a braking signal and a stop signal.

### Claim 6 (depends on 1)

The method of claim 1 further comprising:
geolocating an approaching vehicle from the set of vehicle identities for identifying the approaching vehicle and a vector based on movement of the vehicle, the vector indicative of an ingress path to the controlled intersection;
comparing a speed of the vehicle, the speed derived from the vector, with a plurality of distance markers, each distance marker of the plurality of distance markers associated with a speed threshold and the ingress path to the controlled intersection.

### Claim 7 (depends on 1)

The method of claim 1 further comprising:
identifying an image of an approaching vehicle;
determining a direction of the approaching vehicle;
computing, based on the direction, an ingress path from a plurality of ingress paths to the controlled intersection; and
indexing, based on the controlled intersection and the ingress paths, a sequence of distance markers and corresponding speed thresholds for comparison with vehicle speed.

### Claim 8 (depends on 7)

The method of claim 7 wherein imaged detection further comprises:
determining, based on which camera of a plurality of cameras disposed at the controlled intersection received the identified image, an ingress path to the intersection; and
comparing the speed to a plurality of distance markers corresponding to the determined ingress path.

### Claim 9 (depends on 7)

The method of claim 7 further comprising:
identifying an image of an approaching vehicle;
determining, from the identified image, features of the approaching vehicle;
comparing the determined features to the local set of vehicle identities; and
referencing, based on the comparison, a matching vehicle from the subset of vehicles based on the comparison.

### Claim 10 (depends on 9)

The method of claim 9 wherein the features include alphanumeric characters from a vehicle plate tag.

### Claim 11 (depends on 1)

The method of claim 1 further comprising:
establishing a repository of semi-autonomous vehicles, the semi-autonomous vehicles responsive to intervention from the edge unit;
storing an identity of each of a plurality of semi-autonomous vehicles in the repository; and
populating the local set of vehicle identities at the edge unit based on an indication of a vehicle in a predetermined region around the controlled intersection corresponding to the edge unit.

### Claim 12 (depends on 11)

The method of claim 11 further comprising:
propagating vehicle identities among a plurality of edge units, each of the edge units disposed appurtenant to a controlled intersection; and
maintaining the subset of vehicles deemed proximate to the controlled intersection based on vehicles determined to be within a predetermined geographical region around the controlled intersection.

### Claim 13

An edge unit device for controlling a semi-autonomous vehicle, comprising:
an interface to a vehicle registration repository for receiving a local set of vehicle identities;
an interface to a traffic signal at a controlled intersection, the local set of vehicle identities based on a subset of vehicles deemed proximate to the controlled intersection;
a video analytics processor for computing, from an imaged detection of a vehicle corresponding to the set of vehicle identities, a distance of the vehicle approaching the controlled intersection;
an interface to one or more cameras for transmitting the image for vehicle detection; and
processor logic for controlling, based on a comparison of a speed threshold with the computed distance, the vehicle in order to conform a speed of the vehicle with a predetermined speed corresponding to the speed threshold.

### Claim 14 (depends on 13)

The device of claim 13 wherein the processor logic is configured for identifying a distance marker corresponding to each of the plurality of speed thresholds, and further configured to send a message for controlling the vehicle speed if a speed of the vehicle exceeds the speed threshold when the vehicle reaches the distance marker associated with the speed threshold.

### Claim 15 (depends on 14)

The device of claim 14 further wherein the video analytics processor is configured to track a distance of the approaching vehicle from the controlled intersection, and performing the comparison of the speed threshold when a distance of the vehicle from the controlled intersection meets one of the distance markers of the plurality of the distance markers associated with the respective speed thresholds.

### Claim 16 (depends on 13)

The device of claim 13 wherein the local set of vehicle identities at the edge unit is based on an indication of a vehicle in a predetermined region around the controlled intersection corresponding to the edge unit.

### Claim 17 (depends on 13)

The device of claim 13 wherein the processor logic is configured to:
determine a distance marker from the plurality of distance markers corresponding to a current location of the vehicle;
determine that the speed of the vehicle exceeds the speed threshold associated with the determined distance marker; and
apply an intervention to the vehicle based on the distance marker.

### Claim 18 (depends on 17)

The device of claim 17 further comprising a DSRC Dedicated Short Range Communications modem configured for transmitting a message triggering the intervention in the vehicle, the intervention including at least one of an alert signal, a braking signal and a stop signal.

### Claim 19 (depends on 13)

The device of claim 13 wherein the video analytics processor is configured to geolocate an approaching vehicle from the set of vehicle identities for identifying the approaching vehicle and a vector based on movement of the vehicle, the vector indicative of an ingress path to the controlled intersection, and
The processor logic is configured to compare a speed of the vehicle, the speed derived from the vector, with a plurality of distance markers, each distance marker of the plurality of distance markers associated with a speed threshold and the ingress path to the controlled intersection.

### Claim 20

A computer program embodying program code on a non-transitory medium that, when executed by a processor, performs steps for implementing a method of controlling a semi-autonomous vehicle, the method comprising:
propagating a local set of vehicle identities to an edge unit, the edge unit in communication with a traffic signal at a controlled intersection, the local set of vehicle identities based on a subset of vehicles deemed proximate to the controlled intersection;
computing, from an imaged detection of a vehicle corresponding to the set of vehicle identities, a distance of the vehicle approaching the controlled intersection; and
controlling, based on a comparison of a speed threshold with the computed distance, the vehicle in order to conform a speed of the vehicle with a predetermined speed corresponding to the speed threshold.
