Robust tracking of objects in videos

A system for tracking objects in videos comprising:

• a memory comprising a video;
• a computing device, storing instructions thereon that, when executed by the computing device, cause the system to:
• extract a plurality of video frames from the video;
• generate an image search index from the plurality of video frames by extracting one or more features from each of the video frames;
• receive an indication of a query object within one or more key frames of the plurality of video frames and a location of the query object with the one or more key frames;
• and
• for each of the plurality of video frames:
• determine a similarity score between a key frame and a video frame based on a search area in the key frame by comparing features of the query object in the key frame to features of the video frame within the search area, wherein a size of the search area is determined based on a distance between the key frame and the video frame, and
• generate a voting map that utilizes the determined similarity score to localize the query object in the video frame.

A non-transitory computer-readable medium storing instructions thereon that, when executed by at least one processor, cause a computer system to:

• extract a plurality of video frames from the video;
• generate an image search index from the plurality of video frames by extracting one or more features from each of the video frames;
• receive an indication of a query object within one or more key frames of the plurality of video frames and a location of the query object with the one or more key frames;
• and
• for each of the plurality of video frames:
• determine a similarity score between a key frame and a video frame based on a search area in the key frame, wherein a size of the search area is determined based on a distance between the key frame and the video frame, and
• generate a voting map that utilizes the determined similarity score to localize the query object in the video frame.