Method for training convolutional neural network, and method and device for stylizing video
AssigneeGuangdong Oppo Mobile Telecommunications Corp., Ltd.
InventorJenhao HSIAO
Life of this patent
Estimating the term…
Abstract
Provided are a method and device for stylizing video as well as a method for training a convolutional neural network (CNN). In the method, each of a plurality of original frames of the video is transformed into a stylized frame by using a first CNN for stylizing; at least one first loss is determined according to a first original frame and second original frame of the plurality of original frames, the second original frame being next to the first original frame; the first CNN is trained according to at least one first loss; and the video is stylized by using the trained first CNN.
Claims20
A method for training a convolutional neural network (CNN) for stylizing a video, comprising:
- transforming each of a plurality of original frames of the video into a stylized frame by using a first CNN for stylizing;
- determining at least one first loss according to a first original frame and second original frame of the plurality of original frames and results of the transforming, the second original frame being next to the first original frame;
- and
- training the first CNN according to the at least one first loss.
A method for stylizing a video, comprising:
- stylizing a video by using a first convolutional neural network (CNN);
- wherein the first CNN has been trained according to at least one first loss which is determined according to a first original frame and second original frame of a plurality of original frames of the video and results of transforming, the second original frame being next to the first original frame, the transforming comprising:
- transforming each of a plurality of original frames of the video into a stylized frame by using a first CNN for stylizing.
A device for stylizing a video, comprising:
- a memory for storing instructions;
- and
- at least one processor configured to execute the instructions to perform operations of:
- stylizing a video by using a first convolutional neural network (CNN);
- wherein the first CNN has been trained according to at least one first loss which is determined according to a first original frame and second original frame of a plurality of original frames of the video and results of transforming, the second original frame being next to the first original frame, the transforming comprising:
- transforming each of a plurality of original frames of the video into a stylized frame by using a first CNN for stylizing.
Dependencies are inferred from the claim text.