Information processing apparatus and control method thereof

A control method of an information processing apparatus for tracking a tracking target in a video sequence, comprising:

• performing objectness detection for detecting an image area with a relatively high object existence likelihood in an image in the video sequence;
• setting a first area and a second area corresponding to image areas of the tracking target, which are different from each other, for a template image included in the video sequence and including an image of the tracking target, wherein the first area and the second area are set based on the image area detected by the performing objectness detection for the template image;
• extracting a first area feature and a second area feature, which are template features, from the first area and the second area using a feature extraction neural network (NN);
• extracting a search area feature from a search area image included in the video sequence and following the template image using the feature extraction NN;
• performing correlation calculation between each of the first area feature and the second area feature and the search area feature and deriving a first feature correlation map and a second feature correlation map, which are correlation maps;
• integrating the first feature correlation map and the second feature correlation map and deriving an integrated feature;
• detecting the tracking target from the search area image based on the integrated feature, wherein the objectness detection is executed for a plurality of template images;
• and
• clustering an image feature for the image area, of the image area based on the objectness detection for the template image, having at least a predetermined overlap with the tracking target, and the first area and the second area are set based on the image area corresponding to a cluster with a large appearance count.

A non-transitory computer-readable recording medium storing a program that, when executed by a computer, causes the computer to perform a control method of an information processing apparatus for tracking a tracking target in a video sequence, comprising:

• performing objectness detection for detecting an image area with a relatively high object existence likelihood in an image in the video sequence;
• setting a first area and a second area corresponding to image areas of the tracking target, which are different from each other, for a template image included in the video sequence and including an image of the tracking target, wherein the first area and the second area are set based on the image area detected by the performing objectness detection for the template image;
• extracting a first area feature and a second area feature, which are template features, from the first area and the second area using a feature extraction neural network (NN);
• extracting a search area feature from a search area image included in the video sequence and following the template image using the feature extraction NN;
• performing correlation calculation between each of the first area feature and the second area feature and the search area feature and deriving a first feature correlation map and a second feature correlation map, which are correlation maps;
• integrating the first feature correlation map and the second feature correlation map and deriving an integrated feature;
• detecting the tracking target from the search area image based on the integrated feature, wherein the objectness detection is executed for a plurality of template images;
• and
• clustering an image feature for the image area, of the image area based on the objectness detection for the template image, having at least a predetermined overlap with the tracking target, and the first area and the second area are set based on the image area corresponding to a cluster with a large appearance count.