Back to results
US 8,510,252 B1Granted
Classification of inappropriate video content using multi-scale features
AssigneeGoogle Inc.
InventorsUllas Gargi, Jay Yagnik
Life of this patent
Estimating the term…
Abstract
A method, a system and a computer program product generate a statistical classification model used by a computer system to determine whether a video contains content in a particular class, such as inappropriate content.
Claims60
A computer-implemented method of determining that a video contains inappropriate content, the method comprising:
- identifying a set of time-series features associated with a video;
- generating a scale space decomposition from the set of time-series features, the scale space decomposition being associated with a plurality of scales and comprising a plurality of space components corresponding to the scales;
- determining a set of multi-scale features associated with the video based on the scales in the generated scale space decomposition, wherein each of a plurality of the multi-scale features is associated with a scale of the plurality of the scales, with one or more of the space components corresponding to the scale, and with a spatial or temporal portion of the video corresponding to a threshold of the time-series features at the scale, and wherein at least some of the multi-scale features are associated with a spatial or temporal portion of the video containing inappropriate content;
- and
- determining that the video contains inappropriate content based on the set of multi-scale features.
2 more elements
A computer system for determining that a video contains inappropriate content, the system comprising:
- a computer processor;
- and
- a non-transitory computer readable storage medium storing modules encoded with executable program code, the modules comprising:
- a time-series feature generation module adapted to identify a set of time-series features associated with a video;
- a multi-scale feature generation module adapted to:
- generate a scale space decomposition from the set of time-series features, the scale space decomposition being associated with a plurality of scales and comprising a plurality of space components corresponding to the scales;
- determine a set of multi-scale features associated with the video based on the scales in the generated scale space decomposition, wherein each of a plurality of the multi-scale features is associated with a scale of the plurality of the scales, with one or more of the space components corresponding to the scale, and with a spatial or temporal portion of the video corresponding to a threshold of the time-series features at the scale, and wherein at least some of the multi-scale features are associated with a spatial or temporal portion of the video containing inappropriate content;
- and
- an inappropriate video classification module adapted to determine that the video contains inappropriate content based on the set of multi-scale features.
6 more elements
A non-transitory computer-readable storage medium encoded with executable program code for determining that a video contains inappropriate content, the program code comprising program code for:
- identifying a set of time-series features associated with a video;
- generating scale space decomposition from the set of time-series features, the scale space decomposition being associated with a plurality of scales and comprising a plurality of space components corresponding to the scales;
- determining a set of multi-scale features associated with the video based on the scales in the generated scale space decomposition, wherein each of a plurality of the multi-scale features is associated with a scale of the plurality of scales, with one or more of the space components corresponding to the scale, and with a spatial or temporal portion of the video corresponding to a threshold of the time series features at the scale, and wherein at least some of the multi-scale features are associated with a spatial or temporal portion of the video containing inappropriate content;
- and
- determining that the video contains inappropriate content based on the set of multi-scale features.
2 more elements
A computer-implemented method of determining that a video is associated with a class of videos, the method comprising:
- identifying a set of time-series features associated with a video;
- generating scale space decomposition from the set of time-series features, the scale space decomposition being associated with a plurality of scales and comprising a plurality of space components corresponding to the scales;
- determining a set of multi-scale features associated with the video based on the scales in the generated scale space decomposition, wherein each of a plurality of the multi-scale features is associated with a scale of the plurality of the scales, with one or more of the space components corresponding to the scale, and with a spatial or temporal portion of the video corresponding to a threshold of the time-series features at the scale, and wherein at least some of the multi-scale features are associated with a spatial or temporal portion of the video associated with the class of videos;
- and
- determining that the video is associated with the class of videos based on the set of multi-scale features.
2 more elements
A computer system for determining that a video is associated with a class of videos, the system comprising:
- a computer processor;
- and
- a non-transitory computer readable storage medium storing modules encoded with executable program code, the modules comprising:
- a time-series feature generation module adapted to identify a set of time-series features associated with a video;
- a multi-scale feature generation module adapted to:
- generate a scale space decomposition from the set of time-series features, the scale space
- decomposition being associated with a plurality of scales and comprising a plurality of space components corresponding to the scales;
- determine a set of multi-scale features associated with the video based on the scales in the generated scale space decomposition, wherein each of a plurality of the multi-scale features is associated with a scale of the plurality of the scales, with one or more of the space components corresponding to the scale, and with a spatial or temporal portion of the video corresponding to a threshold of the time-series features at the scale, and wherein at least some of the multi-scale features are associated with a spatial or temporal portion of the video associated with the class of videos;
- and
- an inappropriate video classification module adapted to determine that the video is associated with the class of videos based on the set of multi-scale features.
7 more elements
A non-transitory computer-readable storage medium encoded with executable program code for determining that a video is associated with a class of videos, the program code comprising program code for:
- identifying a set of time-series features associated with a video;
- generating a scale space decomposition from the set of time-series features, the scale space decomposition being associated with a plurality of scales and comprising a plurality of space components corresponding to the scales;
- determining a set of multi-scale features associated with the video based on the scales in the generated scale space decomposition, wherein each of a plurality of the multi-scale features is associated with a scale of the plurality of the scales, with one or more of the space components corresponding to the scale, and with a spatial or temporal portion of the video corresponding to a threshold of the time-series features at the scale, and wherein at least some of the multi-scale features are associated with a spatial or temporal portion of the video associated with the class of videos;
- and
- determining that the video is associated with the class of videos based on the set of multi-scale features.
2 more elements
Dependencies are inferred from the claim text.