Method and apparatus for extracting color scheme from video
OwnerSunghee Choi, Suzi Kiminventors
Life of this patent
Estimating the term…
Abstract
An apparatus for extracting a color scheme from a video is provided. The apparatus comprises: a semi-master shot segmentation part for segmenting an input video into a plurality of semi-master shots through semi-master-shot boundary detection (SBD); a base palette extraction part for extracting base palettes from the segmented semi-master shots; and a color scheme merging part for merging the base palettes extracted from the semi-master shots to extract a color scheme.
Claims20
An apparatus for extracting a color scheme from a video, the apparatus comprising:
- a semi-master shot segmentation part for segmenting an input video into a plurality of semi-master shots through semi-master-shot boundary detection (SBD);
- a base palette extraction part for extracting base palettes from the segmented semi-master shots;
- and
- a color scheme merging part for merging the base palettes extracted from the semi-master shots to extract a color scheme;
- wherein the base palette extraction part comprises:
- a keyframe selection part for reducing the amount of data to be clustered by selecting select keyframes;
- and
- a color clustering part for extracting a base palette from a set of selected keyframes by clustering pixels based on the distance in the color space and selecting the cluster centroids as representative colors;
- and wherein the keyframe selection part provides an objective function to ensure that the keyframe captures the entire shot contents well, and the objective function is defined as a weighted sum of saliency, clarity, and representativeness for each frame.
An apparatus for extracting a color scheme from a video, the apparatus comprising:
- a semi-master shot segmentation part for segmenting an input video into a plurality of semi-master shots through semi-master-shot boundary detection (SBD);
- a base palette extraction part for extracting base palettes from the segmented semi-master shots;
- and
- a color scheme merging part for merging the base palettes extracted from the semi-master shots to extract a color scheme;
- wherein the base palette extraction part comprises:
- a keyframe selection part for reducing the amount of data to be clustered by selecting select keyframes;
- and
- a color clustering part for extracting a base palette from a set of selected keyframes by clustering pixels based on the distance in the color space and selecting the cluster centroids as representative colors;
- and wherein the color clustering part weights the cluster according to pixel's visual attention using saliency maps from the selected keyframes.
A method for extracting a color scheme from a video by using an apparatus for extracting a color scheme from a video, the method comprising:
- a step of segmenting an input video into a plurality of semi-master shots through semi-master-shot boundary detection (SBD);
- a step of extracting base palettes from the segmented semi-master shots;
- and
- a step of merging the base palettes extracted from the semi-master shots to extract a color scheme
- wherein the step of extracting base palettes from the segmented semi-master shots comprises:
- a keyframe selection step in which keyframes are selected to reduce the amount of data to be clustered;
- and
- a color clustering step in which a base palette is extracted from a set of selected keyframes by clustering pixels based on the distance in the color space and selecting the cluster centroids as representative colors;
- and wherein, in the keyframe selection step, an objective function is provided to ensure that the keyframe captures the entire shot contents well, and the objective function is defined as a weighted sum of saliency, clarity, and representativeness for each frame.
Dependencies are inferred from the claim text.