Content management system, management content generating method, management content play back method, and recording medium

A content management system that manages management content having a management image and moving image data associated with the management image, comprising:

• a still image data extracting unit that extracts a plurality of frames of still image data from moving image data;
• a person of interest detecting unit that detects a person of interest that is a person who is a processing target from each of a plurality of still images corresponding to the plurality of frames of still image data;
• a movement trajectory detecting unit that detects a movement trajectory of the person of interest by tracking movement of the person of interest in a moving image corresponding to the moving image data based on detection results of the person of interest in the plurality of still images;
• a motion analysis unit that analyzes a motion of the person of interest in the moving image based on the movement trajectory of the person of interest and calculates an evaluation value with respect to the motion of the person of interest based on the analyzed motion of the person of interest for each of the plurality of still images;
• a still image data output unit that outputs, from among the plurality of frames of still image data, still image data of two or more still images each having the evaluation value with respect to the motion of the person of interest equal to or greater than a threshold value as output still image data;
• a scene determining unit that determines a scene of the moving image including an output still image corresponding to the output still image data for each of two or more pieces of the output still image data;
• a management marker registration unit that registers, as a management marker, each of the two or more pieces of output still image data or an image feature amount of each of two or more output still images corresponding to the two or more pieces of output still image data in association with moving image data of a scene of a moving image corresponding to each of the two or more output still images;
• and
• a management image generator that generates management image data including at least two pieces of the output still image data.

A method for generating management content having a management image and moving image data associated with the management image, comprising the steps of:

• extracting a plurality of frames of still image data from moving image data with a still image data extracting unit;
• detecting a person of interest that is a person who is a processing target from among each of a plurality of still images corresponding to the plurality of frames of still image data with a person of interest detecting unit;
• detecting a movement trajectory of the person of interest by tracking movement of the person of interest in a moving image corresponding to the moving image data based on detection results of the person of interest in the plurality of still images with a movement trajectory detecting unit;
• analyzing a motion of the person of interest in the moving image based on the movement trajectory of the person of interest and calculating an evaluation value with respect to the motion of the person of interest based on the analyzed motion of the person of interest for each of the plurality of still images with a motion analysis unit;
• outputting, from among the plurality of frames of still image data, still image data of one still image having the evaluation value with respect to the motion of the person of interest equal to or greater than a threshold value as output still image data with a still image data output unit;
• registering, as a management marker, the output still image data or an image feature amount of an output still image corresponding to the output still image data in association with moving image data of a moving image corresponding to the output still image with a management marker registration unit;
• and
• generating management image data including the output still image data with a management image generator.

A method for generating management content having a management image and moving image data associated with the management image, comprising the steps of:

• extracting a plurality of frames of still image data from moving image data with a still image data extracting unit;
• detecting a person of interest that is a person who is a processing target from each of a plurality of still images corresponding to the plurality of frames of still image data with a person of interest detecting unit;
• detecting a movement trajectory of the person of interest by tracking movement of the person of interest in a moving image corresponding to the moving image data based on detection results of the person of interest in the plurality of still images with a movement trajectory detecting unit;
• analyzing a motion of the person of interest in the moving image based on the movement trajectory of the person of interest and calculating an evaluation value with respect to the motion of the person of interest based on the analyzed motion of the person of interest for each of the plurality of still images with a motion analysis unit;
• outputting, from among the plurality of frames of still image data, still image data of two or more still images each having the evaluation value with respect to the motion of the person of interest equal to or greater than a threshold value as output still image data with a still image data output unit;
• determining a scene of the moving image including an output still image corresponding to the output still image data for each of two or more pieces of the output still image data with a scene determining unit;
• registering, as a management marker, each of the two or more pieces of output still image data or an image feature amount of each of two or more output still images corresponding to the two or more pieces of output still image data in association with moving image data of a scene of a moving image corresponding to each of the two or more output still images with a management marker registration unit;
• and
• generating management image data including at least two pieces of the output still image data with a management image generator.

A method for generating management content having a management image and moving image data associated with the management image, comprising the steps of:

• extracting a plurality of frames of still image data from moving image data with a still image data extracting unit;
• detecting a person of interest that is a person who is a processing target from each of a plurality of still images corresponding to the plurality of frames of still image data with a person of interest detecting unit;
• detecting a movement trajectory of the person of interest by tracking movement of the person of interest in a moving image corresponding to the moving image data based on detection results of the person of interest in the plurality of still images with a movement trajectory detecting unit;
• analyzing a motion of the person of interest in the moving images based on the movement trajectory of the person of interest and calculating an evaluation value with respect to the motion of the person of interest based on the analyzed motion of the person of interest for each of the plurality of still images with a motion analysis unit;
• outputting, from among the plurality of frames of still image data, still image data of one or two or more still images each having the evaluation value with respect to the motion of the person of interest equal to or greater than a threshold value as output still image data with a still image data output unit;
• determining a scene of the moving image including an output still image corresponding to the output still image data for one piece of the output still image data or each of two or more pieces of the output still image data with a scene determining unit;
• repeatedly performing processes on each of a plurality of pieces of moving image data with the still image data extracting unit, the person of interest detecting unit, the movement trajectory detecting unit, the motion analysis unit, the still image data output unit, and the scene determining unit;
• registering, as a first management marker, each of a plurality of pieces of first output still image data obtained by selecting at least one piece of the output still image data from among each of the output still image data corresponding to each of the plurality of pieces of moving image data, or an image feature amount of each of a plurality of first output still images corresponding to the plurality of pieces of first output still image data, in association with moving image data of a scene of a moving image corresponding to each of the plurality of first output still images, and, by setting the output still image data as second output still image data for each of the plurality of pieces of moving image data, registering, as a second management marker, one piece of the second output still image data or each of two or more pieces of the second output still image data, or an image feature amount of a second output still image corresponding to the one piece of second output still image data or each of the two or more pieces of second output still image data, in association with moving image data of a scene of a moving image corresponding to one piece of the second output still image or each of two or more pieces of the second output still images with a management marker registration unit;
• and
• generating first management image data including at least two pieces of the first output still image data and second management image data including at least one piece of the second output still image data for each of the plurality of pieces of moving image data with the management image generator.