US 10,855,803 B2Granted

Performance evaluation in a network community

AssigneeShanghai Bilibili Technology Co., Ltd.

InventorsXiaoshan Lin, Fang Fang

Life of this patent

Estimating the term…

Loading patent…

Abstract

Techniques for evaluating performance of reviewing events in a network community are described herein. The disclosed techniques include authorizing a first user account to review the events in the network community for a first valid period; monitoring information associated with the first user account reviewing the events in the network community; generating data indicative of review behaviors associated with the first user account during at least a part of the first valid period based at least in part on the information and predetermined parameters of evaluating performance; determining values of a plurality of evaluation coefficients based on the generated data and predetermined rules; and determining a performance evaluation result for the first user account based on the generated data and the values of the plurality of evaluation coefficients.

Claims18

Dependent claims

A computer-implemented method for improving a computer network community, comprising:

authorizing, by a server, a first user account a review qualification of reviewing events in a network community for a first valid period, wherein a first user account is among a plurality of user accounts in the network community;
automatically initiating, by the server, a performance evaluation for the first user account in response to authorizing the first user account the review qualification;
monitoring, by the server, information associated with the first user account reviewing the events in the network community;
generating, by the server, data indicative of review behaviors associated with the first user account during at least a part of the first valid period based at least in part on the information and predetermined parameters of evaluating performance of reviewing events in the network community;
determining, by the server, values of a plurality of evaluation coefficients based on the generated data and predetermined rules, wherein the plurality of evaluation coefficients comprise voting accuracy coefficient, active coefficient, violation coefficient, comment coefficient, incorrect answer coefficient, and anti-cheating coefficient, and wherein the predetermined rules comprise corresponding relationships between the generated data and the plurality of evaluation coefficients;
determining, by the server, a result of the performance evaluation for the first user account based on the generated data and the values of the plurality of evaluation coefficients;
determining, by the server, whether to revoke or maintain the review qualification of the first user account based on the result of the performance evaluation;
sending, by the server, a post relating to a report against a review behavior of the first user account to a second plurality of user accounts for review, wherein the second plurality of user accounts are authorized to review the events in the network community;
receiving, by the server, reviews from the second plurality user accounts;
in response to a determination that a number of the received reviews reaches a predetermined threshold, analyzing the received reviews by the server;
in response to a determination that a number of reviews indicative of the first user account involving a violation relative to a total number of the received reviews is greater than a first predetermined ratio, modifying, by the server, a status of the post as a recheck status;
in response to a determination that a number of reviews indicative of the first user account not involving a violation relative to a total number of the received reviews is greater than a second predetermined ratio, modifying, by the server, the status of the post as a withdrawal status;
and
otherwise, determining, by the server, to return to a status of receiving reviews from the second plurality user accounts.

11 more elements

A computing system of improving a computer network community, comprising:

a processor;
and
a memory communicatively coupled to the processor to configure the processor at least to:
authorize a first user account a review qualification of reviewing events in a network community for a first valid period, wherein a first user account is among a plurality of user accounts in the network community;
automatically initiate, by the server, a performance evaluation for the first user account in response to authorizing the first user account the review qualification;
monitor information associated with the first user account reviewing the events in the network community;
generate data indicative of review behaviors associated with the first user account during at least a part of the first valid period based at least in part on the information and predetermined parameters of evaluating performance of reviewing events in the network community;
determine values of a plurality of evaluation coefficients based on the generated data and predetermined rules, wherein the plurality of evaluation coefficients comprise voting accuracy coefficient, active coefficient, violation coefficient, comment coefficient, incorrect answer coefficient, and anti-cheating coefficient, and wherein the predetermined rules comprise corresponding relationships between the generated data and the plurality of evaluation coefficients;
determine a result of the performance evaluation for the first user account based on the generated data and the values of the plurality of evaluation coefficients;
determine, by the server, whether to revoke or maintain the review qualification of the first user account based on the result of the performance evaluation;
send, by the server, a post relating to a report against a review behavior of the first user account to a second plurality of user accounts for review, wherein the second plurality of user accounts are authorized to review the events in the network community;
receive, by the server, reviews from the second plurality user accounts;
in response to a determination that a number of the received reviews reaches a predetermined threshold, analyze the received reviews by the server;
in response to a determination that a number of reviews indicative of the first user account involving a violation relative to a total number of the received reviews is greater than a first predetermined ratio, modify, by the server, a status of the post as a recheck status;
in response to a determination that a number of reviews indicative of the first user account not involving a violation relative to a total number of the received reviews is greater than a second predetermined ratio, modify, by the server, the status of the post as a withdrawal status;
and
otherwise, determine, by the server, to return to a status of receiving reviews from the second plurality user accounts.

14 more elements

A non-transitory computer-readable storage medium bearing computer-readable instructions that upon execution on a computing device cause the computing device at least to:

authorize a first user account a review qualification of reviewing events in a network community for a first valid period, wherein a first user account is among a plurality of user accounts in the network community;
automatically initiate, by the server, a performance evaluation for the first user account in response to authorizing the first user account the review qualification;
monitor information associated with the first user account reviewing the events in the network community;
generate data indicative of review behaviors associated with the first user account during at least a part of the first valid period based at least in part on the information and predetermined parameters of evaluating performance of reviewing events in the network community;
determine values of a plurality of evaluation coefficients based on the generated data and predetermined rules, wherein the plurality of evaluation coefficients comprise voting accuracy coefficient, active coefficient, violation coefficient, comment coefficient, incorrect answer coefficient, and anti-cheating coefficient, and wherein the predetermined rules comprise corresponding relationships between the generated data and the plurality of evaluation coefficients;
determine a result of the performance evaluation for the first user account based on the generated data and the values of the plurality of evaluation coefficients;
and
determine, by the server, whether to revoke or maintain the review qualification of the first user account based on the result of the performance evaluation
send, by the server, a post relating to a report against a review behavior of the first user account to a second plurality of user accounts for review, wherein the second plurality of user accounts are authorized to review the events in the network community;
receive, by the server, reviews from the second plurality user accounts;
in response to a determination that a number of the received reviews reaches a predetermined threshold, analyze the received reviews by the server;
in response to a determination that a number of reviews indicative of the first user account involving a violation relative to a total number of the received reviews is greater than a first predetermined ratio, modify, by the server, a status of the post as a recheck status;
in response to a determination that a number of reviews indicative of the first user account not involving a violation relative to a total number of the received reviews is greater than a second predetermined ratio, modify, by the server, the status of the post as a withdrawal status;
and
otherwise, determine, by the server, to return to a status of receiving reviews from the second plurality user accounts.

12 more elements

Dependencies are inferred from the claim text.