US 11,688,182 B2 · Lane violation detection using convolutional neural networks

Abstract

Disclosed herein are systems, methods, and devices for detecting traffic lane violations. In one embodiment, a method for detecting a potential traffic violation is disclosed comprising bounding a vehicle detected from one or more video frames of a video in a vehicle bounding box. The vehicle can be detected and bounded using a first convolutional neural network. The method can also comprise bounding, using the one or more processors of the edge device, a plurality of lanes of a roadway detected from the one or more video frames in a plurality of polygons. The plurality of lanes can be detected and bounded using multiple heads of a multi-headed second convolutional neural network. The method can further comprise detecting a potential traffic violation based in part on an overlap of at least part of the vehicle bounding box and at least part of one of the polygons.

Claims20

Dependent claims

A method for detecting a potential traffic violation, comprising:

bounding, using one or more processors of an edge device, a vehicle detected from one or more video frames of a video in a vehicle bounding box, wherein the video is captured by one or more video image sensors of the edge device, and wherein the vehicle is detected and bounded using a first convolutional neural network;
bounding, using the one or more processors of the edge device, a plurality of lanes of a roadway detected from the one or more video frames in a plurality of polygons, wherein the plurality of lanes are detected and bounded using multiple heads of a multi-headed second convolutional neural network separate from the first convolutional neural network, and wherein at least one of the polygons is a lane-of-interest (LOI) polygon bounding a LOI;
and
detecting, using the one or more processors, a potential traffic violation based in part on an overlap of at least part of the vehicle bounding box and at least part of the LOI polygon.

1 more element

A device for detecting a potential traffic violation, comprising:

one or more video image sensors configured to capture a video of a vehicle and a plurality of lanes of a roadway;
and
one or more processors programmed to execute instructions to:
bound the vehicle detected from one or more video frames of the video in a vehicle bounding box, wherein the vehicle is detected and bounded using a first convolutional neural network;
bound a plurality of lanes of a roadway detected from the one or more video frames in a plurality of polygons, wherein the plurality of lanes are detected and bounded using multiple heads of a multi-headed second convolutional neural network separate from the first convolutional neural network, and wherein at least one of the polygons is a lane-of-interest (LOI) polygon bounding a LOI;
detect that a potential traffic violation has occurred based in part on an overlap of at least part of the vehicle bounding box and at least part of the LOI polygon.

3 more elements

A non-transitory computer-readable medium comprising machine-executable instructions stored thereon, wherein the instructions comprise the steps of:

bounding a vehicle detected from one or more video frames of a video in a vehicle bounding box, wherein the video is captured by one or more video image sensors of an edge device, and wherein the vehicle is detected and bounded using a first convolutional neural network;
bounding a plurality of lanes of a roadway detected from the one or more video frames in a plurality of polygons, wherein the plurality of lanes are detected and bounded using multiple heads of a multi-headed second convolutional neural network separate from the first convolutional neural network, and wherein at least one of the polygons is a lane-of-interest (LOI) polygon bounding a LOI;
detecting a potential traffic violation based in part on an overlap of at least part of the vehicle bounding box and at least part of the LOI polygon.

Dependencies are inferred from the claim text.

Lane violation detection using convolutional neural networks

Life of this patent

Lane violation detection using convolutional neural networks

Life of this patent

Abstract

Claims20