Apparatus and method for generating object-labeled image in video sequence

An apparatus for receiving a video sequence including query objects to be extracted and generating object-labeled images based on the query objects, the apparatus comprising:

• a shot and key frame setting unit for dividing the video sequence into one or more shots, each of which is a set of frames having a similar scene, and selecting one or more key frames from each of the shots;
• an initial object region extractor for determining whether there exists an object similar to each of the query objects in each of the key frames and extracting the similar objects as corresponding query object based initial object regions from each of the key frames;
• an object region tracker for tracking, for each query object, object regions in all frames of only shots determined to have a respective similar object in a key frame based on the corresponding query image object based initial object regions;
• and
• an object-labeled image generator for labeling the object regions tracked in each of the frames based on information on the corresponding query objects.

A computer readable medium having embodied thereon a computer program for receiving a video sequence including query objects to be extracted and generating object-labeled images based on the query objects, wherein generating object-labeled images comprises the steps of:

• (a) dividing the video sequence into one or more shots, each of which is a set of frames having a similar scene, and selecting one or more key frames from each of the shots;
• (b) determining whether there exists an object similar to each of the query objects in each of the key frames and extracting the similar objects as corresponding query object based initial object regions from each of the key frames;
• (c) for each query object, tracking object regions in all frames of only shots determined to have a respective similar object in a key frame based on the corresponding query object based initial object regions;
• and
• (d) labeling the object regions tracked in each of the frames based on information on the corresponding query objects.