Techniques for Improving the Quality of Subjective Data
AssigneeNetflix, Inc.
InventorZhi LI
Life of this patent
Estimating the term…
Abstract
In various embodiments, a subjective modeling engine mitigates inaccuracies in subjective content assessments. The subjective modeling engine generates a model that includes the subjective content assessments in addition to parameters for subjective scores and subjective factors. The subjective modeling engine initializes the parameters and then performs optimization operations that increase the likelihood that the optimized subjective scores compensate for the optimized subjective factors. Advantageously, because the subjective modeling engine jointly optimizes the subjective scores and the subjective factors, the optimized subjective scores provide unbiased and consistent digital content assessments.
Claims20
A computer-implemented method, comprising:
- generating a model that includes a plurality of subjective content assessments and a plurality of parameters that comprise a plurality of subjective scores and a plurality of subjective factors;
- initializing the plurality of parameters;
- performing one or more optimization operations on the plurality of parameters to generate a plurality of optimized subjective scores and a plurality of optimized subjective factors, wherein the plurality of optimized subjective scores are configured to compensate for the plurality of optimized subjective factors;
- and
- storing or transmitting the plurality of optimized subjective scores to use as unbiased and consistent digital content assessments.
A computer-readable storage medium including instructions that, when executed by a processor, cause the processor to perform the steps of:
- initializing a plurality of parameters included in a model for a plurality of subjective content assessments, wherein the plurality of parameters comprise a plurality of subjective scores and a plurality of subjective factors;
- jointly optimizing the plurality of subjective scores and the plurality of subjective factors to generate a plurality of optimized subjective scores and a plurality of optimized subjective factors, wherein the plurality of optimized subjective scores are configured to compensate for the plurality of optimized subjective factors;
- and
- storing or transmitting the plurality of optimized subjective scores to use as unbiased and consistent digital content assessments.
A system comprising:
- a memory storing instructions associated with a subjective modeling engine;
- and
- a processor that is coupled to the memory and, when executing the instructions, is configured to:
- generate a model for a plurality of subjective content assessments that includes a plurality of subjective scores and a plurality of Gaussian variables that are associated with a plurality of subjective factors;
- perform one or more optimization operations on the model to generate a plurality of optimized subjective scores and a plurality of optimized Gaussian variables that are associated with a plurality of optimized subjective factors, wherein the plurality of optimized subjective scores are configured to compensate for the plurality of optimized subjective factors;
- and
- store or transmit the plurality of optimized subjective scores to use as unbiased and consistent digital content assessments.
Dependencies are inferred from the claim text.