US 10,095,954 B1Granted

Trajectory matching across disjointed video views

AssigneeVerint Systems Ltd.

InventorsShahar Daliyot, Gadi Zimerman, Shmuel Kiro, Oren Golan

Life of this patent

Estimating the term…

Loading patent…

Abstract

Embodiments disclosed herein provide systems and methods for matching trajectories across disjointed video views. In a particular embodiment, a method provides receiving a plurality of tagged trajectories that are tagged with an indicator of which trajectory pairs of the plurality of tagged trajectories are matching trajectory pairs and processing each of the trajectory pairs using each of a plurality of trajectory matching algorithms. The method further provides creating a model for matching trajectories based on the output of each of the plurality of trajectory matching algorithms for each of the pairs. The method further provides receiving a pair of trajectories and processing the pair of trajectories using each of the plurality of the trajectory matching algorithms. The method further provides processing the output of each of the plurality of the trajectory matching algorithms for the pair of trajectories using the model to determine whether the pair of trajectories is matching.

Claims8

Dependent claims

A method for tracking the trajectory of an object moving in regions covered by a video surveillance system, the method comprising:

locating objects in video captured by a first camera covering a region;
generating a signature for each object in the region, wherein the signature for each object comprises views of the object obtained from a subset of frames selected from the video of the region, and wherein each view of the object is a portion of a video frame that shows the object from a particular view point, and wherein the frames in the subset of frames are spaced apart in time to decrease the likelihood of redundant views in the signature;
computing a trajectory for each object in the region from the captured video;
determining that a particular object that traced a trajectory in the region has also traced a trajectory in another region, wherein the determining comprises:
locating objects in video captured by a second camera covering the other region,
generating a signature for each object in the other region, wherein the signature for each object in the other region comprises views of the object obtained from a subset of frames selected from the video captured by the second camera covering the other region, wherein the frames in the subset of frames are spaced apart in time to decrease the likelihood of redundant views in the signature,
comparing the signatures from the region to the signatures from the other region to find a match, the match determined by a number of matching views exceeding a threshold, and
updating the signature for the particular object by adding views of the particular object in the other region, wherein only views of the particular object in the other region that are different from the views already contained in the signature of the particular object are added;
creating a composite trajectory for the particular object that includes the trajectory in each region and an estimation of the trajectory between the region and the other region not covered by the first camera or the second camera;
repeating the determining and creating for other regions using the updated signature for the particular object so that as the particular object is tracked its signature is expanded to include different views of the particular object;
and
displaying a map of the region and the other region with the composite trajectory of the object superimposed over the map.

9 more elements

A non-transitory computer readable medium having instructions stored thereon for operating a video processing system, wherein the instructions, when executed by the video processing system, direct the video processing system to:

locate objects in video captured by a first camera covering a region;
generate a signature for each object in the region, wherein the signature for each object comprises views of each object obtained from a subset of frames selected from the video of the region, and wherein each view of each object comprises a portion of a video frame that shows the object from a particular view point, and wherein the frames in the subset of frames are spaced apart in time to decrease the likelihood of redundant views in the signature;
compute a trajectory for each object in the region from the captured video;
determine that a particular object that traced a trajectory in the region has also traced a trajectory in another region, wherein the determining directs the video processing system to:
locate objects in video captured by a second camera covering the other region,
generate a signature for each object in the other region, wherein the signature for each object in the other region comprises views of the object obtained from a subset of frames selected from the video captured by the second camera covering the other region, wherein the frames in the subset of frames are spaced apart in time to decrease the likelihood of redundant views in the signature,
compare the signatures from the region to the signatures from the other region to find a match, the match determined by a number of matching views exceeding a threshold, and
update the signature for the particular object by adding views of the particular object in the other region, wherein only views of the particular object in the other region that are different from the views already contained in the signature of the particular object are added;
create a composite trajectory for the particular object that includes the trajectory in each region and an estimation of the trajectory between the region and the other region not covered by the first camera or the second camera;
repeat the determining and creating for other regions using the updated signature for the particular object so that as the particular object is tracked its signature is expanded to included different views of the particular object;
and
display a map that includes the region and the other region with the composite trajectory of the object superimposed over the map.

9 more elements

Dependencies are inferred from the claim text.

Facts

Application: 13/743,635Filed 17 Jan 2013 · us provisional application
Priority: 17 Jan 2012
Granted: 9 Oct 2018
Term ends: Not estimatedThe source records don’t support an estimate.

Classification10 codes

G06T 7/246
Analysis of motion: using feature-based methods, e.g. the tracking of corners or segments
G06T 7/292
Analysis of motion: multi-camera tracking
G06V 20/52
Context or environment of the image: surveillance or monitoring of activities, e.g. for recognising suspicious objects
G06T 2207/10016
Image acquisition modality: video; Image sequence