US 2017/0289624 A1 · MULTIMODAL AND REAL-TIME METHOD FOR FILTERING SENSITIVE MEDIA

Abstract

A multimodal and real-time method for filtering sensitive content, receiving as input a digital video stream, the method including segmenting digital video into video fragments along the video timeline; extracting features containing significant information from the digital video input on sensitive media; reducing the semantic difference between each of the low-level video features, and the high-level sensitive concept; classifying the video fragments, generating a high-level label (positive or negative), with a confidence score for each fragment representation; performing high-level fusion to properly match the possible high-level labels and confidence scores for each fragment; and predicting the sensitive time by combining the labels of the fragments along the video timeline, indicating the moments when the content becomes sensitive.

Claims12

Dependent claims

A multimodal and real-time method for filtering sensitive content, receiving as input a digital video stream, comprising:

segmenting digital video into video fragments along a video timeline;
extracting features containing significant information from the digital video input on sensitive media;
reducing a semantic difference between each of low-level video features, and a high-level sensitive concept;
classifying the video fragments, and generating a high-level label (positive or negative), with a confidence score for each fragment representation;
performing high-level fusion to properly match the possible high-level labels and confidence scores for each fragment;
and
predicting sensitive moments by combining labels of the fragments along the video timeline, indicating the moments when the content becomes sensitive.

4 more elements

Dependencies are inferred from the claim text.

Facts

Application

15/198,626Filed 30 Jun 2016

Priority

BR 10 2016 007265 41 Apr 2016

Published

5 Oct 2017

Term ends

Not estimatedThe source records don’t support an estimate.

Classification18 codes

H04N 21/4542
Content or additional data filtering, e.g. blocking advertisements: blocking scenes or portions of the received content, e.g. censoring scenes
G06F 16/78
Of video data: retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
G06F 18/2411
Relating to the classification model, e.g. parametric or non-parametric approaches: based on the proximity to a decision surface, e.g. support…
G06V 10/464
Salient features, e.g. scale invariant feature transforms [SIFT]: using a plurality of salient features, e.g. bag-of-words [BoW] representations

Multimodal and real-time method for filtering sensitive media

Life of this patent

Multimodal and real-time method for filtering sensitive media

Life of this patent

Abstract

Claims12