Media segmentation system and related methods
AssigneeMicrosoft Corporation
InventorsTong Lin, Hong-Jiang Zhang
Life of this patent
Estimating the term…
Abstract
A method comprising receiving media content and analyzing one or more attributes of successive shots of the received media. Based, at least in part on the analysis of the one or more attributes, generating a correlation score for each of the successive shots, wherein scene segmentation is performed to group semantically cohesive shots.
Claims51
A computer-implemented method comprising:
- identifying successive shots of received media content;
- generating color histograms associated with frames in the successive shots;
- identifying dominant color objects within the color histograms;
- tracking the dominant color objects in the color histograms across the frames;
- detecting shot boundaries based, at least in part, on a relative position of the dominant color objects across the frames;
- and
- generating correlation scores for the successive shots based, at least in part, on analysis of the dominant color objects.
A computer-implemented method comprising:
- analyzing color information associated with received media content in a color space to identify one or more color objects;
- tracking the color objects through the received media content;
- and
- quantifying a correlation between shots to identify a scene based, at least in part, on the tracking of the color objects.
A computer-implemented method comprising:
- identifying color objects within a color space associated with shots of received media;
- tracking the color objects in the color space across shots to generate a correlation score between shots;
- and
- segmenting the received media content into scenes based, at least in part, on the correlation score.
A storage medium comprising a plurality of instructions which, when executed, implement a media analysis agent to identify color objects within a color space associated with shots of received media, track the color objects in the color space across shots to generate a correlation score between shots, and segment the received media content into scenes based, at least in part, on the correlation score.
A computing system comprising:
- a memory device, to receive and provide media content;
- and
- a media analysis agent, coupled to the memory device, and configured to generate color histograms associated with shots in the media content, identify color objects from local maximums in the color histograms, track the color objects across shots to identify shots with semantically similar frames, and segment the received media content into scenes having shots with semantically similar frames.
A computer-implemented method comprising:
- analyzing color information associated with received media content in a color space to identify one or more color objects, comprising:
- projecting pixels of each frame, or DC blocks of intra-encoded frame(s) into a quantized color space;
- generating a normalized distribution of the pixels and/or blocks to form a color histogram of the media content;
- identifying local maximum points in the color histogram;
- and
- defining a color object as a sphere of N quantization units surrounding each of the identified local maximums;
- tracking the color objects through the received media content to identify shots, comprising:
- selecting one or more color objects in the color space associated with two frames;
- and
- generating a correlation score for the frames denoting a likelihood that an object appearing in each of the frames is the same object;
- and
- quantifying a correlation between shots to identify a scene based, at least in part, on the analyzed color information associated with the received media content.
A computing system comprising:
- a memory device, to receive and provide media content;
- and
- a media analysis agent, coupled to the memory device, to analyze one or more attributes of media content to identify semantic similarity between elements of the received content, and segment the received media content into scenes of semantically correlated elements, the media analysis agent further comprising:
- a color object analyzer to project pixels of media frame(s), and/or DC blocks of intra-encoded frame(s), into a quantized color space and generate a color histogram of the frame(s), the color object analyzer being further configured to identify color space objects from local maximums in the color histogram, and tracks color space objects across frames to identify shots of semantically similar frames.
Dependencies are inferred from the claim text.