US 2011/0238670 A1 · CROWD-SOURCING AND CONTEXTUAL RECLASSIFICATION OF RATED CONTENT

Abstract

A content evaluation system is described herein that empowers end users and organizations to share their interpretation of an automatically generated sentiment score. The system provides a control that a user can move to indicate agreement or disagreement with an automatic score. The system adds metadata to a revised score based on the user's feedback that tracks information about the user to consider different demographic contexts. The system performs rescoring with the user-provided scores with contextual consideration, and then exposes the rescored values on context specific endpoints. The system provides a crowd-sourcing approach that scales extremely well, adds more accuracy because individuals within known demographic categories/contexts do the scoring, and generates value-added data products that can be sold/re-sold.

Claims20

Dependent claims

A computer-implemented method for crowd-sourced rating of online content, the method comprising:

receiving an identification of a content item for which a publisher wants to determine and track a sentiment rating;
determining a baseline automated sentiment rating for the identified content item;
receiving a request to access the received content item based on a user request;
providing the requested content item for display to a user along with a control for receiving a user rating of the content item;
receiving a revised rating of the content item from the provided control;
determining a demographic profile of the user that provided the received rating of the content item;
assigning at least one metadata tag to a record associated with the user's revised score for the content item based on the determined demographic profile of the user;
and
storing the assigned metadata tag in association with the received revised rating so that subsequent reporting and analysis can process revised content item ratings based on demographic profiles,
wherein the preceding steps are performed by at least one processor.

7 more elements

A computer system for crowd-sourced rating and reporting of online content, the system comprising:

a processor and memory configured to execute software instructions;
a publisher interface component configured to provide an interface through which publishers can add content to the system to be automatically and manually rated;
a baseline evaluation component configured to automatically determine a rating sentiment for a content item;
a sentiment data store configured to store rating information for one or more content items;
a user interface component configured to provide a user interface through which users of the system can provide manual sentiment ratings through a user interface control;
a user feedback component configured to receive user feedback from the user interface and stores the user feedback in the sentiment data store;
a user demographic component configured to track user demographic information as users rate content items and provide the demographic information to data consumers that receive reports from the system describing user sentiment ratings;
and
a data consumer interface component configured to provide aggregate data about content item sentiment to one or more data consumers.

6 more elements

Dependencies are inferred from the claim text.

Crowd-sourcing and contextual reclassification of rated content

Life of this patent

Crowd-sourcing and contextual reclassification of rated content

Life of this patent

Abstract

Claims20