US 10,944,805 B1Granted

Scalable multi-level collaborative content moderation

AssigneeAgora Lab, Inc.

InventorSheng Zhong

Life of this patent

Estimating the term…

Loading patent…

Abstract

Content moderation in real-time communication includes receiving, by a sending device of a sending user, a first portion of a media stream from the sending user; determining, by the sending device, that the first portion of the media stream is classified as uncertain for transmission to a receiving user; transmitting, by the sending device to a centralized content moderation device, the first portion of the media stream, where the centralized content moderation device determines a centralized determination of whether the first portion is appropriate; in response to the centralized determination indicating that the first portion is appropriate, transmitting, by the sending device to the receiving user, the first portion; and, in response to the centralized determination indicating that the first portion is inappropriate, transmitting, by the sending device to the receiving user, a blurred first portion of the first portion.

Claims20

Dependent claims

An apparatus for content moderation in real-time communication, comprising:

a memory;
and
a processor, the processor configured to execute instructions stored in the memory to:
receive a first portion of a media stream from a sending user;
determine a classification of the first portion of the media stream, wherein the classification is indicative of an appropriateness of transmission of the first portion to a receiving user, wherein the classification is one of appropriate, inappropriate, or uncertain, and wherein the classification of uncertain indicates that the first portion cannot be determined with sufficient certainty whether the first portion is appropriate or inappropriate;
in response to determining that the first portion is uncertain for transmission to the receiving user, perform instructions to:
transmit, to a centralized content moderation device, the first portion of the media stream, wherein the centralized content moderation device determines a centralized determination of whether the first portion is appropriate;
and
in response to the centralized determination indicating that the first portion of the media stream is inappropriate:
blur the first portion to obtain a blurred first portion;
and
transmit, to the receiving user, the blurred first portion;
and
in response to determining that the first portion is appropriate, transmit the first portion to the receiving user.

11 more elements

A system for content moderation in real-time communication, comprising:

a centralized content moderation device;
and
a user-side content moderation device, the user-side content moderation device configured to:
receive a first portion of a media stream from a sending user;
determine whether the first portion of the media stream is appropriate for sending to a receiving user;
on a first condition that the first portion of the media stream is not determined to be appropriate and the media stream is not determined to be inappropriate for sending to the receiving user:
scale the first portion of the media stream to obtain a scaled first portion of the media stream;
forward the scaled first portion of the media stream to the centralized content moderation device;
receive, from the centralized content moderation device, a centralized determination as to whether the first portion of the media stream is inappropriate;
and
use the centralized determination to determine whether to transmit the first portion or a blurred first portion of the first portion to the receiving user;
and
on a second condition that the first portion of the media stream is determined to be appropriate for sending to the receiving user:
transmit the first portion of the media stream to the receiving user.

11 more elements

A method for content moderation in real-time communication, comprising:

receiving, by a sending device of a sending user, a first portion of a media stream from the sending user;
determining, by the sending device, that the first portion of the media stream is classified as uncertain for transmission to a receiving user, wherein a classification of uncertain indicates that the first portion cannot be determined with certainty whether the first portion is appropriate or inappropriate for transmission to the receiving user;
transmitting, by the sending device to a centralized content moderation device, the first portion of the media stream, wherein the centralized content moderation device determines a centralized determination of whether the first portion is appropriate;
in response to the centralized determination indicating that the first portion is appropriate, transmitting, by the sending device to the receiving user, the first portion;
and
in response to the centralized determination indicating that the first portion is inappropriate, transmitting, by the sending device to the receiving user, a blurred first portion of the first portion.

3 more elements

Dependencies are inferred from the claim text.