Transductive Multi-Label Learning For Video Concept Detection
AssigneeMicrosoft Corporation
InventorsJingdong Wang, Shipeng Li, Xian-Sheng Hua, Yinghai Zhao
Life of this patent
Estimating the term…
Abstract
This disclosure describes various exemplary method and computer program products for transductive multi-label classification in detecting video concepts for information retrieval. This disclosure describes utilizing a hidden Markov random field formulation to detect labels for concepts in a video content and modeling a multi-label interdependence between the labels by a pairwise Markov random field. The process groups the labels into several parts to speed up a labeling inference and calculates a conditional probability score for the labels, the conditional probability scores are ordered for ranking in a video retrieval evaluation.
Claims20
A method for a transductive multi-label classification, implemented at least in part by a computing device, the method comprising:
- utilizing a hidden Markov random field formulation to identify labels for concepts in a video content;
- modeling a multi-label interdependence between the labels by a pairwise Markov random field, wherein combinations of pairwise relationships over multiple labels are seamlessly modeled into the hidden Markov random field formulation;
- grouping the labels into several parts to speed up a labeling inference;
- and
- calculating a conditional probability score for the labels, wherein the conditional probability scores are ordered for ranking in a video retrieval evaluation.
A computer-readable storage media comprising computer-readable instructions executed on a computing device, the computer-readable instructions comprising instructions for:
- detecting concepts in a video content by using a hidden Markov random field formulation to identify labels for the concepts in the video content;
- determining a transductive multi-label classification by finding labels that are similar as a pre-given labeling on labeled data points;
- determining the labeling is consistent between neighboring points;
- determining a multi-label interdependence on unlabeled data points is similar to a multi-label interdependence on labeled data points;
- and
- retrieving a video based on an ordered score of a transductive multi-label classification.
A method for a transductive multi-label classification, implemented at least in part by a computing device, the method comprising:
- detecting concepts in a video content by using a hidden Markov random field formulation to identify labels by:
- determining a transductive multi-label classification by measuring similarity scores based on labels and a pre-given labeling on labeled data points;
- determining the labeling is consistent between neighboring points;
- determining a multi-label interdependence on unlabeled data points is similar to a multi-label interdependence on labeled data points;
- and
- analyzing information for multi-labels using chunklet analysis.
Dependencies are inferred from the claim text.