Systems and methods for controlling a vehicle by detecting and tracking objects through associated detections

Abstract

This disclosure provides methods and systems for dynamically detecting and tracking objects in an environment of an autonomous vehicle. In some embodiments, the method comprises: receiving image data from sensors of the autonomous vehicle, the image data comprising a plurality of images representative of objects in a field of view of the autonomous vehicle; detecting the objects in the plurality of images through an object detector; generating image embeddings for the objects detected in the plurality of images; determining similarity scores of the image embeddings of the objects that are detected in images received from two or more different sensors; identifying the objects that are detected in the images received from the two or more different sensors as a candidate object for tracking, if the objects have a similarity score of the image embeddings equal to or greater than a threshold value; and initializing a track for the candidate object.

Dependencies are inferred from the claim text.