# US 12,192,594 B2 · Method, apparatus, device, and storage medium of video processing > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,192,594 B2 - Document ID: US12192594B2 - Status: Granted - Kind: B2 - Application number: 18/536,092 - Filed: 2023-12-11 - Published: 2024-04-04 - Granted: 2025-01-07 - Earliest claimed: 2021-09-15 - Assignees: Beijing Zitiao Network Technology Co., Ltd. - Applicants: Beijing Zitiao Network Technology Co., Ltd. - Inventors: Yitian Wang; Wozhou He; Mingjie Chen; Peihua Yu - Web page: https://patentgrep.com/patent/US12192594B2 ## CPC - H04N 21/816: {involving special video data, e.g 3D video} - G06F 40/166: Editing, e.g. inserting or deleting - G11B 27/34: Indicating arrangements {(indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D)} - G10L 15/26: Speech to text systems (G10L15/08 takes precedence) - G11B 27/031: Electronic editing of digitised analogue information signals, e.g. audio or video signals - G11B 27/11: by using information not detectable on the record carrier - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R) - G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING ## Abstract The present disclosure provides a video processing method, device, apparatus, and a storage medium. The method includes: displaying a material editing area for video editing based on a first script structure, the material editing area divided into a plurality of sub-areas; displaying a target multimedia material according to a timeline in a target sub-area of the plurality of sub-areas, the target multimedia material being a multimedia material selected for a target script node that is a script node corresponding to the target sub-area in the first script structure; and generating the target video based on multimedia material displayed in the material editing area. Based on a material editing area including a plurality of sub-areas respectively corresponding to script nodes, embodiments of the present disclosure can implement video editing, and diversify the video editing methods to further meet various people's needs for video editing. ## Claims ### Claim 1 A method of video processing, comprising: displaying, based on a first script structure, a material editing area for video editing, wherein the material editing area is divided into a plurality of sub-areas, each of a subset of the plurality of sub-areas corresponding to a script node among a plurality of script nodes in the first script structure, the first script structure is indicative of a content paragraph structure of a target video, and each of the plurality of script nodes is indicative of a content paragraph of the target video; displaying a target multimedia material according to a timeline in a target sub-area of the plurality of sub-areas, wherein the target multimedia material is selected for a target script node which is the script node corresponding to the target sub-area in the first script structure; and generating the target video based on multimedia material displayed in the material editing area, wherein the target multimedia material is filled in a target content paragraph of the target video, and the target content paragraph is corresponding to the target script node. ### Claim 2 (depends on 1) The method of claim 1, wherein an interface layout of the plurality of sub-areas in the material editing area is a vertical alignment arrangement. ### Claim 3 (depends on 1) The method of claim 1, prior to generating the target video based on the multimedia material displayed in the material editing area, the method further comprises: in response to an adjustment operation on a target text content of a first script node in the first script structure, determining a multimedia material corresponding to the first script node in the material editing area, and determining a multimedia clip corresponding to the target text content in the multimedia material; and editing, based on the adjustment operation, the multimedia clip in the multimedia material. ### Claim 4 (depends on 1) The method of claim 1, prior to generating the target video based on the multimedia material displayed in the material editing area, the method further comprises: in response to an operation of adding a text content at a target text position of a second script node in the first script structure, determining a multimedia material corresponding to the second script node in the material editing area, and determining a timeline position corresponding to the target text position in the multimedia material; and adding, based on the operation of adding the text content, adding a multimedia clip corresponding to the text content at the timeline position in the multimedia material. ### Claim 5 (depends on 1) The method of claim 1, prior to generating the target video based on the multimedia material displayed in the material editing area, the method further comprises: in response to an editing operation on a target multimedia clip of a first multimedia material in the material editing area, determining the script node corresponding to the first multimedia material, and determining a text content corresponding to the target multimedia clip in the script node; and adjusting, based on the editing operation, the text content in the script node. ### Claim 6 (depends on 1) The method of claim 1, prior to generating the target video based on the multimedia material displayed in the material editing area, the method further comprises: in response to an operation of adjusting a sequence of a second script node and a third script node in the first script structure, determining sub-areas respectively corresponding to the second script node and the third script node in the material editing area; and adjusting, based on the operation of adjusting the sequence, a sequence of multimedia material in the sub-areas respectively corresponding to the second script node and the third script node in the material editing area. ### Claim 7 (depends on 1) The method of claim 1, wherein the target multimedia material comprises a candidate multimedia material, and prior to generating the target video based on the multimedia material displayed in the material editing area, and the method further comprises: in response to a switching operation from the target multimedia material in the target sub-area to the candidate multimedia material, switching the target multimedia material displayed in the target sub-area to the candidate multimedia material. ### Claim 8 A device comprising a memory, a processor, and computer programs stored in the memory and operable on the processor, the processor, when executing the computer programs, implementing the method of: displaying, based on a first script structure, a material editing area for video editing, wherein the material editing area is divided into a plurality of sub-areas, each of a subset of the plurality of sub-areas corresponding to a script node among a plurality of script nodes in the first script structure, the first script structure is indicative of a content paragraph structure of a target video, and each of the plurality of script nodes is of a content paragraph of the target video; displaying a target multimedia material according to a timeline in a target sub-area of the plurality of sub-areas, wherein the target multimedia material is selected for a target script node which is the script node corresponding to the target sub-area in the first script structure; and generating the target video based on multimedia material displayed in the material editing area, wherein the target multimedia material is filled in a target content paragraph of the target video, and the target content paragraph is corresponding to the target script node. ### Claim 9 (depends on 8) The device of claim 8, wherein an interface layout of the plurality of sub-areas in the material editing area is a vertical alignment arrangement. ### Claim 10 (depends on 8) The device of claim 8, prior to generating the target video based on the multimedia material displayed in the material editing area, the method further comprises: in response to an adjustment operation on a target text content of a first script node in the first script structure, determining a multimedia material corresponding to the first script node in the material editing area, and determining a multimedia clip corresponding to the target text content in the multimedia material; and editing, based on the adjustment operation, the multimedia clip in the multimedia material. ### Claim 11 (depends on 8) The device of claim 8, prior to generating the target video based on the multimedia material displayed in the material editing area, the method further comprises: in response to an operation of adding a text content at a target text position of a second script node in the first script structure, determining a multimedia material corresponding to the second script node in the material editing area, and determining a timeline position corresponding to the target text position in the multimedia material; and adding, based on the operation of adding the text content, adding a multimedia clip corresponding to the text content at the timeline position in the multimedia material. ### Claim 12 (depends on 8) The device of claim 8, prior to generating the target video based on the multimedia material displayed in the material editing area, the method further comprises: in response to an editing operation on a target multimedia clip of a first multimedia material in the material editing area, determining the script node corresponding to the first multimedia material, and determining a text content corresponding to the target multimedia clip in the script node; and adjusting, based on the editing operation, the text content in the script node. ### Claim 13 (depends on 8) The device of claim 8, prior to generating the target video based on the multimedia material displayed in the material editing area, the method further comprises: in response to an operation of adjusting a sequence of a second script node and a third script node in the first script structure, determining sub-areas respectively corresponding to the second script node and the third script node in the material editing area; and adjusting, based on the operation of adjusting the sequence, a sequence of multimedia material in the sub-areas respectively corresponding to the second script node and the third script node in the material editing area. ### Claim 14 A computer program product being stored on a non-transitory computer storage medium and comprising computer programs/instructions which, when executed by a processor, implement the method of: displaying, based on a first script structure, a material editing area for video editing, wherein the material editing area is divided into a plurality of sub-areas, each of a subset of the plurality of sub-areas corresponding to a script node among a plurality of script nodes in the first script structure, the first script structure is indicative of a content paragraph structure of a target video, and each of the plurality of script nodes is indicative of a content paragraph of the target video; displaying a target multimedia material according to a timeline in a target sub-area of the plurality of sub-areas, wherein the target multimedia material is selected for a target script node which is the script node corresponding to the target sub-area in the first script structure; and generating the target video based on multimedia material displayed in the material editing area, wherein the target multimedia material is filled in a target content paragraph of the target video, and the target content paragraph is corresponding to the target script node. ### Claim 15 (depends on 14) The computer program product of claim 14, wherein an interface layout of the plurality of sub-areas in the material editing area is a vertical alignment arrangement. ### Claim 16 (depends on 14) The computer program product of claim 14, prior to generating the target video based on the multimedia material displayed in the material editing area, the method further comprises: in response to an adjustment operation on a target text content of a first script node in the first script structure, determining a multimedia material corresponding to the first script node in the material editing area, and determining a multimedia clip corresponding to the target text content in the multimedia material; and editing, based on the adjustment operation, the multimedia clip in the multimedia material. ### Claim 17 (depends on 14) The computer program product of claim 14, prior to generating the target video based on the multimedia material displayed in the material editing area, the method further comprises: in response to an operation of adding a text content at a target text position of a second script node in the first script structure, determining a multimedia material corresponding to the second script node in the material editing area, and determining a timeline position corresponding to the target text position in the multimedia material; and adding, based on the operation of adding the text content, adding a multimedia clip corresponding to the text content at the timeline position in the multimedia material. ### Claim 18 (depends on 14) The computer program product of claim 14, prior to generating the target video based on the multimedia material displayed in the material editing area, the method further comprises: in response to an editing operation on a target multimedia clip of a first multimedia material in the material editing area, determining the script node corresponding to the first multimedia material, and determining a text content corresponding to the target multimedia clip in the script node; and adjusting, based on the editing operation, the text content in the script node. ### Claim 19 (depends on 14) The computer program product of claim 14, prior to generating the target video based on the multimedia material displayed in the material editing area, the method further comprises: in response to an operation of adjusting a sequence of a second script node and a third script node in the first script structure, determining sub-areas respectively corresponding to the second script node and the third script node in the material editing area; and adjusting, based on the operation of adjusting the sequence, a sequence of multimedia material in the sub-areas respectively corresponding to the second script node and the third script node in the material editing area. ### Claim 20 (depends on 14) The computer program product of claim 14, wherein the target multimedia material comprises a candidate multimedia material, and prior to generating the target video based on the multimedia material displayed in the material editing area, and the method further comprises: in response to a switching operation from the target multimedia material in the target sub-area to the candidate multimedia material, switching the target multimedia material displayed in the target sub-area to the candidate multimedia material.