# US 2021/0243493 A1 · Video processing method, video processing device, and storage medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0243493 A1
- Document ID: US20210243493A1
- Status: Published application
- Kind: A1
- Application number: 17/234,741
- Filed: 2021-04-19
- Published: 2021-08-05
- Earliest claimed: 2016-10-17
- Assignees: Tencent Technology (Shenzhen) Company Limited
- Applicants: Tencent Technology (Shenzhen) Company Limited
- Inventors: Qianyi WANG; Yu GAO; Zhibin WANG; En LI; Rong LI
- Web page: https://patentgrep.com/patent/US20210243493A1

## CPC

- H04N 21/4312: {involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations}
- G06T 11/10: Texturing; Colouring; Generation of textures or colours (retouching, inpainting or scratch removal G06T5/77)
- G06T 11/23: using straight lines or curves
- G06T 11/60: Creating or editing images; Combining images with text
- H04N 21/44008: {involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream (arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)}
- H04N 21/44012: {involving rendering scenes according to scene graphs, e.g. MPEG-4 scene graphs}
- H04N 21/4788: communicating with other users, e.g. chatting {(arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104)}
- H04N 21/8549: Creating video summaries, e.g. movie trailer {(retrieval in video databases by using presentations in form of a video summary G06F16/739)}
- G06T 2200/24: involving graphical user interfaces [GUIs]
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A video processing method, a video processing device, and a storage medium are provided. The video processing method includes: determining target image frames corresponding to a dynamic special effect in a video and determining an attribute of a special effect element corresponding to the dynamic special effect in each of the target image frames and coordinates of the special effect element. The video processing method also includes: rendering the special effect element on a drawing interface based on the attribute and the coordinates of the special effect element; filling the target image frames into the drawing interface as a background and forming drawing interface frames with the dynamic special effect; and outputting the drawing interface frames corresponding to each of the target image frames.

## Claims

### Claim 1

A video processing method, comprising:
identifying, by a computing device, a first and a second target image frames decoded from a video;
allocating, by the computing device, a first special effect element for the first target image frame, and allocating a second special effect element for the second target image frame, wherein the first special effect element differs than the second special effect element;
forming, by the computing device, a first drawing interface frame by filling the first target image frame and the first special effect element into a first drawing interface, and forming, by the computing device, a second drawing interface frame by filling the second target image frame and the second special effect element into a second drawing interface, wherein the first target image frame and the second target image frame are each employed as a background; and
outputting, by the computing device, the first and the second drawing interface frames respectively corresponding to the first and the second target image frames.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
presenting, by the computing device, the first and the second target image frames on a graphic interface;
presenting, by the computing device, an identifier identifying a dynamic special effect on the graphic interface, the dynamic special effect including the first and the second special effect elements; and
in response to receiving a selection of the identifier, determining, by the computing device, the first and the second special effect elements of the dynamic special effect are to be added to the first and the second target image frames.

### Claim 3 (depends on 1)

The method of claim 1, further comprising:
detecting, by the computing device, a contact between a fingertip of a user and the graphic interface;
identifying, by the computing device, a moving trace of the contact, the moving trace including a first position and a second position; and
identifying, by the computing device, an image frame corresponding to the first position as the first target image frame and an image frame corresponding to the second position as the second target image frame.

### Claim 4 (depends on 1)

The method of claim 1, further comprising:
detecting, by the computing device, a contact between a fingertip of a user and the graphic interface;
identifying, by the computing device, a first time corresponding to a start of the contact and a second time corresponding to a release of the contact, the first time and the second time defining therebetween a time period; and
identifying, by the computing device, two image frames positioned within the time period of the video as the first and the second target image frames.

### Claim 5 (depends on 1)

The method of claim 1, further comprising:
extracting, by the computing device, a first feature from the first target image frame and a second feature from the second target image frame;
comparing, by the computing device, the first feature and the second feature with a preset action feature to determine whether the first feature and the second feature each correspond to the preset action feature; and
in response to determining the first feature and the second feature each correspond to the preset action feature, determining, by the computing device, the first and the second target image frames are image frames to be identified.

### Claim 6 (depends on 1)

The method of claim 1, wherein the first and the second target image frames both include an object, and wherein the first special effect element is rendered at a first position relative to the object in the first target image frame and the second special effect element is rendered at a second position relative to the object, the second position being different than the first position.

### Claim 7 (depends on 1)

The method of claim 1, further comprising:
after forming the first drawing interface frame, clearing, by the computing device, the first drawing interface to form the second drawing interface, wherein after the first drawing interface is cleared to form the second drawing interface, the second drawing interface frame is formed by filling the second target image frame into the second drawing interface.

### Claim 8 (depends on 1)

The method of claim 1, wherein the first and the second target image frames are positioned in the video between a first and a second non-target image frames, the method further comprising:
performing, by the computing device, video encoding, in a time sequence, of the first non-target image frame, the first and the second drawing interface frames, and the second non-target image frame, to form a video file.

### Claim 9 (depends on 1)

The method of claim 1, further comprising:
normalizing, by the computing device, coordinates of the first or the second special effect element respectively based on a size of the first or the second target image frame.

### Claim 10 (depends on 1)

The method of claim 1, further comprising:
identifying, by the computing device, a feature or an object in the video; and
determining, by the computing device, an image frame identified as having the feature or the object as the first or the second target image frame.

### Claim 11

A video processing device, comprising: a memory storing computer program instructions; and a processor coupled to the memory and configured to execute the computer program instructions and perform:
identifying a first and a second target image frames decoded from a video;
allocating a first special effect element for the first target image frame, and allocating a second special effect element for the second target image frame, wherein the first special effect element differs than the second special effect element;
forming a first drawing interface frame by filling the first target image frame and the first special effect element into a first drawing interface, and forming a second drawing interface frame by filling the second target image frame and the second special effect element into a second drawing interface, wherein the first target image frame and the second target image frame are each employed as a background; and
outputting the first and the second drawing interface frames respectively corresponding to the first and the second target image frames.

### Claim 12 (depends on 11)

The video processing device of claim 11, wherein the processor is further configured to execute the computer program instructions and perform:
presenting the first and the second target image frames on a graphic interface;
presenting an identifier identifying a dynamic special effect on the graphic interface, the dynamic special effect including the first and the second special effect elements; and
in response to receiving a selection of the identifier, determining the first and the second special effect elements of the dynamic special effect are to be added to the first and the second target image frames.

### Claim 13 (depends on 11)

The video processing device of claim 11, wherein the processor is further configured to execute the computer program instructions and perform:
detecting a contact between a fingertip of a user and the graphic interface;
identifying a moving trace of the contact, the moving trace including a first position and a second position; and
identifying an image frame corresponding to the first position as the first target image frame and an image frame corresponding to the second position as the second target image frame.

### Claim 14 (depends on 11)

The video processing device of claim 11, wherein the processor is further configured to execute the computer program instructions and perform:
detecting a contact between a fingertip of a user and the graphic interface;
identifying a first time corresponding to a start of the contact and a second time corresponding to a release of the contact, the first time and the second time defining therebetween a time period; and
identifying two image frames positioned within the time period of the video as the first and the second target image frames.

### Claim 15 (depends on 11)

The video processing device of claim 11, wherein the processor is further configured to execute the computer program instructions and perform:
extracting a first feature from the first target image frame and a second feature from the second target image frame;
comparing the first feature and the second feature with a preset action feature to determine whether the first feature and the second feature each correspond to the preset action feature; and
in response to determining the first feature and the second feature each correspond to the preset action feature, determining the first and the second target image frames are image frames to be identified.

### Claim 16 (depends on 11)

The video processing device of claim 11, wherein the first and the second target image frames both include an object, and wherein the first special effect element is rendered at a first position relative to the object in the first target image frame and the second special effect element is rendered at a second position relative to the object, the second position being different than the first position.

### Claim 17 (depends on 11)

The video processing device of claim 11, wherein the processor is further configured to execute the computer program instructions and perform:
after forming the first drawing interface frame, clearing the first drawing interface to form the second drawing interface, wherein after the first drawing interface is cleared to form the second drawing interface, the second drawing interface frame is formed by filling the second target image frame into the second drawing interface.

### Claim 18 (depends on 11)

The video processing device of claim 11, wherein the first and the second target image frames are positioned in the video between a first and a second non-target image frames, and the processor is further configured to execute the computer program instructions and perform:
performing video encoding, in a time sequence, of the first non-target image frame, the first and the second drawing interface frames, and the second non-target image frame, to form a video file.

### Claim 19

A non-transitory computer-readable storage medium storing computer program instructions executable by at least one processor to perform:
identifying a first and a second target image frames decoded from a video;
allocating a first special effect element for the first target image frame, and allocating a second special effect element for the second target image frame, wherein the first special effect element differs than the second special effect element;
forming a first drawing interface frame by filling the first target image frame and the first special effect element into a first drawing interface, and forming a second drawing interface frame by filling the second target image frame and the second special effect element into a second drawing interface, wherein the first target image frame and the second target image frame are employed as a background; and
outputting the first and the second drawing interface frames respectively corresponding to the first and the second target image frames.

### Claim 20 (depends on 19)

The non-transitory computer-readable storage medium of claim 19, wherein the computer program instructions are further executable by the at least one processor to perform:
presenting the first and the second target image frames on a graphic interface;
presenting an identifier identifying a dynamic special effect on the graphic interface, the dynamic special effect including the first and the second special effect elements; and
in response to receiving a selection of the identifier, determining the first and the second special effect elements of the dynamic special effect are to be added to the first and the second target image frames.