Video tagging for video communications
AssigneeAgora Lab, Inc.
InventorsSheng Zhong, Yue Feng
Life of this patent
Estimating the term…
Abstract
A method, an apparatus, and a system for video communications include: transmitting, from a first apparatus using a network, a first video stream of a first user to a second apparatus of a second user, wherein the first user is in video communication with the second user; receiving, from the second apparatus using the network, a second video stream of the second user; determining, by a processor, a reaction of the second user to an area of interest in the first video stream using the second video stream; and updating, in response to the reaction of the second user to the area of interest in the first video stream, a parameter for encoding the area of interest in the first video stream at the first apparatus.
Claims20
A method for video communications, comprising:
- transmitting, from a first apparatus using a network, a first video stream of a first user to a second apparatus of a second user, wherein the first user is in video communication with the second user;
- receiving, from the second apparatus using the network, a second video stream of the second user;
- determining, by a processor, a reaction of the second user to an area of interest in the first video stream using the second video stream;
- and
- updating a parameter for encoding the area of interest in the first video stream at the first apparatus based on the reaction of the second user to the area of interest in the first video stream, wherein one or more tags associated with the reaction of the second user to the area of interest in the first video stream are used to train an adaptive encoder to automatically adjust the parameter for encoding the area of interest in the first video stream to optimize video quality based on the reaction of the second user using a machine learning technique.
An apparatus for video communications, comprising:
- a processor;
- and
- a memory coupled to the processor, the memory configured to store instructions which when executed by the processor become operational with the processor to:
- transmit a first video stream of a first user to a second apparatus of a second user,
- wherein the first user is in video communication with the second user;
- receive, from the second apparatus, a second video stream of the second user;
- determine a reaction of the second user to an area of interest in the first video stream using the second video stream;
- and
- update a parameter for encoding the area of interest in the first video stream based on the reaction of the second user to the area of interest in the first video stream, wherein one or more tags associated with the reaction of the second user to the area of interest in the first video stream are used to train an adaptive encoder to automatically adjust the parameter for encoding the area of interest in the first video stream to optimize video quality based on the reaction of the second user using a machine learning technique.
A non-transitory computer-readable medium storing a set of instructions which when executed by a processor of a computer system become operational with the processor for video communications to:
- transmit, from a first apparatus using a network, a first video stream of a first user to a second apparatus of a second user, wherein the first user is in video communication with the second user;
- receive, from the second apparatus using the network, a second video stream of the second user;
- determine a reaction of the second user to an area of interest in the first video stream using the second video stream;
- and
- update a parameter for encoding the area of interest in the first video stream at the first apparatus based on the reaction of the second user to the area of interest in the first video stream, wherein one or more tags associated with the reaction of the second user to the area of interest in the first video stream are used to train an adaptive encoder to automatically adjust the parameter for encoding the area of interest in the first video stream to optimize video quality based on the reaction of the second user using a machine learning technique.
Dependencies are inferred from the claim text.