Back to results
US 2022/0101629 A1Published application
Video quality evaluation method and apparatus, device, and storage medium
AssigneeBigo Technology Pte. Ltd.
InventorsYun LIU, Huichuan LIU, Zhujin LIANG
Life of this patent
Estimating the term…
Abstract
A video quality evaluation method comprises acquiring an image sequence and audio information by decoding a to-be-evaluated video, wherein the to-be-evaluated video is non-offending video; extracting an action feature vector and a face feature vector from the image sequence, and extracting an audio feature vector from the audio information; constructing a video feature vector according to at least one of the action feature vector, the face feature vector and the audio feature vector; and determining a quality score of the to-be-evaluated video according to the video feature vector.
Claims20
A video quality evaluation method, comprising:
- acquiring an image sequence and audio information by decoding a to-be-evaluated video, wherein the to-be-evaluated video is a non-offending video;
- extracting an action feature vector and a face feature vector from the image sequence, and extracting an audio feature vector from the audio information;
- constructing a video feature vector according to at least one of the action feature vector, the face feature vector and the audio feature vector;
- inputting the video feature vector into a first-layer evaluation network, and acquiring, by the first-layer evaluation network, a primary feature vector through recursive and non-linear operations;
- inputting the primary feature vector into a second-layer evaluation network, and acquiring, by the second-layer evaluation network, an advanced feature vector through recursive and non-linear operations;
- and
- acquiring a quality score of the to-be-evaluated video by performing, by an output layer, operations on the primary feature vector and the advanced feature vector,
- wherein constructing the video feature vector according to at least one of the action feature vector, the face feature vector and the audio feature vector comprises:
- setting the feature vector that fails to be extracted among the action feature vector, the face feature vector and the audio feature vector to zero;
- and
- constructing the video feature vector by combining the action feature vector, the face feature vector and the audio feature vector.
8 more elements
10-13. (canceled)
A device, comprising:
- at least one processor;
- and
- a memory storing at least one program therein, wherein
- the at least one program, when run by the at least one processor, causes the at least one processor to perform a video quality evaluation method, comprising:
- acquiring an image sequence and audio information by decoding a to-be-evaluated video, wherein the to-be-evaluated video is a short video recorded by a user of a short video application;
- extracting an action feature vector and a face feature vector from the image sequence, and extracting an audio feature vector from the audio information;
- constructing a video feature vector according to at least one of the action feature vector, the face feature vector and the audio feature vector;
- inputting the video feature vector into a first-layer evaluation network, and acquiring, by the first-layer evaluation network, a primary feature vector through recursive and non-linear operations;
- inputting the primary feature vector into a second-layer evaluation network, and acquiring, by the second-layer evaluation network, an advanced feature vector through recursive and non-linear operations;
- and
- acquiring a quality score of the to-be-evaluated video by performing, by an output layer, operations on the primary feature vector and the advanced feature vector,
- wherein constructing the video feature vector according to at least one of the action feature vector, the face feature vector and the audio feature vector comprises:
- setting the action feature vector, the face feature vector, or the audio feature vector to zero in response its failed extraction;
- and
- constructing the video feature vector by combining the action feature vector, the face feature vector and the audio feature vector.
12 more elements
A non-transitory computer-readable storage medium storing a computer program, wherein the computer program, when run by a processing apparatus, causes the processing apparatus to perform a video quality evaluation method, comprising:
- acquiring an image sequence and audio information by decoding a to-be-evaluated video, wherein the to-be-evaluated video is a non-offending video;
- extracting an action feature vector and a face feature vector from the image sequence, and extracting an audio feature vector from the audio information;
- constructing a video feature vector according to at least one of the action feature vector, the face feature vector and the audio feature vector;
- inputting the video feature vector into a first-layer evaluation network, and acquiring, by the first-layer evaluation network, a primary feature vector through recursive and non-linear operations;
- inputting the primary feature vector into a second-layer evaluation network, and acquiring, by the second-layer evaluation network, an advanced feature vector through recursive and non-linear operations;
- and
- acquiring a quality score of the to-be-evaluated video by performing, by an output layer, operations on the primary feature vector and the advanced feature vector,
- wherein constructing the video feature vector according to at least one of the action feature vector, the face feature vector and the audio feature vector comprises:
- setting the feature vector that fails to be extracted among the action feature vector, the face feature vector and the audio feature vector to zero;
- and
- constructing the video feature vector by combining the action feature vector, the face feature vector and the audio feature vector.
8 more elements
Dependencies are inferred from the claim text.