# US 2022/0279239 A1 · Method and apparatus for generating video, electronic device, and computer readable medium > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2022/0279239 A1 - Document ID: US20220279239A1 - Status: Published application - Kind: A1 - Application number: 17/744,474 - Filed: 2022-05-13 - Published: 2022-09-01 - Earliest claimed: 2019-11-15 - Assignees: Beijing Bytedance Network Technology Co., Ltd. - Applicants: Beijing Bytedance Network Technology Co., Ltd. - Inventors: Ya WANG; Pingfei FU; Wei JIANG; Qifan ZHENG - Web page: https://patentgrep.com/patent/US20220279239A1 ## CPC - H04N 21/4394: {involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams (arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58)} - H04N 21/8549: Creating video summaries, e.g. movie trailer {(retrieval in video databases by using presentations in form of a video summary G06F16/739)} - G06F 16/683: using metadata automatically derived from the content - G06F 16/686: {using information manually generated, e.g. tags, keywords, comments, title or artist information, time, location or usage information, user ratings} - G06F 16/7834: {using audio features} - H04N 21/41407: {embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop (constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57)} - H04N 21/4223: Cameras (H04N23/00 takes precedence) - H04N 21/47205: {for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally} - H04N 21/47217: {for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks (specific graphical features in visual interfaces H04N21/4312)} - H04N 21/8113: {comprising music, e.g. song in MP3 format} - H04N 21/8153: {comprising still images, e.g. texture, background image} - H04N 21/8456: {by decomposing the content in the time domain, e.g. in time segments} - H04N 21/8547: involving timestamps for synchronizing content - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract Disclosed in the embodiments of the present disclosure are a method and apparatus used for generating a video, and an electronic device. The method comprises: while displaying an original video, acquiring audio material by means of background music of the original video, and acquiring image material, determining music points of the audio material, the music points being used for dividing the audio material into a plurality of audio clips; using the image material to generate a video clip for each music clip in the audio material so as to obtain a plurality of video clips, corresponding music clips and video clips having the same duration; and according to the times at which the music clips corresponding to the plurality of video clips appear in the audio material, splicing the plurality of video clips together, and adding the audio material as a video audio track to obtain a synthesized video. ## Claims ### Claim 1 A method for generating a video, comprising: during a display process of an original video, acquiring an audio material through a background music of the original video, and acquiring an image material; determining music points for the audio material, wherein the music points are used to divide the audio material into a plurality of audio clips; generating one video clip for each music clip in the audio material using the image material so as to obtain a plurality of video clips, wherein a music clip and a video clip, which correspond to each other, have a same duration; and splicing the plurality of video clips together according to times when music clips respectively corresponding to the plurality of video clips appear in the audio material, and adding the audio material as a video audio track to obtain a synthesized video. ### Claim 2 (depends on 1) The method according to claim 1, wherein, during the display process of the original video, acquiring the audio material through the background music of the original video, comprises: displaying a playing interface for the original video; and acquiring the background music of the original video as the audio material in response to detecting a first user operation on the playing interface. ### Claim 3 (depends on 2) The method according to claim 2, wherein acquiring the image material comprises: displaying a first display interface for the background music in response to detecting the first user operation on the playing interface; displaying a second display interface for the image material in response to detecting a second user operation on the first display interface; and acquiring the image material based on a selection operation for the image material on the second display interface. ### Claim 4 (depends on 3) The method according to claim 3, wherein displaying the second display interface for the image material in response to detecting the second user operation on the first display interface, comprises: displaying an image shooting interface in response to detecting the second user operation on the first display interface, wherein the image shooting interface comprises a first control and a second control, the first control is used to trigger an image shooting, and the second control is used to trigger an image selection; and displaying the second display interface for the image material in response to detecting a third user operation on the second control. ### Claim 5 (depends on 2) The method according to claim 2, wherein acquiring the image material comprises: displaying a first display interface for the background music in response to detecting the first user operation on the playing interface; displaying an image shooting interface in response to detecting a second user operation on the first display interface, wherein the image shooting interface comprises a first control, and the first control is used to trigger an image shooting; and in response to detecting a fourth user operation on the first control, calling a shooting element to shoot an image so as to obtain the image material. ### Claim 6 (depends on 1) The method according to claim 1, wherein, during the display process of the original video, acquiring the audio material through the background music of the original video, comprises: displaying a playing interface for the original video; displaying a display interface for the background music of the original video in response to detecting a fifth user operation on the playing interface, wherein the display interface comprises a third control and a fourth control, the third control is used to trigger a music manual clipping, and the fourth control is used to trigger a music automatic clipping; clipping the background music in response to detecting a sixth user operation on the display interface; and determining a material clipped from the background music as the audio material. ### Claim 7 (depends on 6) The method according to claim 6, wherein clipping the background music in response to detecting the sixth user operation on the display interface, comprises: in a case where a seventh user operation is a user operation for the third control, displaying an operation interface for an music clipping, wherein the third control is used to trigger the music manual clipping; determining a clipping interval selected by a manual clipping operation from the background music in response to detecting the manual clipping operation for the background music on the operation interface for the music clipping; and clipping the background music according to the clipping interval. ### Claim 8 (depends on 6) The method according to claim 6, wherein clipping the background music, comprises: in a case where a seventh user operation is a user operation for the fourth control, analyzing a clipping interval in the background music which is applicable for being used as the audio material according to an analysis algorithm for the audio material; and clipping the background music according to the clipping interval. ### Claim 9 An apparatus for generating a video, comprising: an acquisition unit, configured to, during a display process of an original video, acquire an audio material through a background music of the original video, and acquire an image material; a determination unit, configured to determine music points for the audio material, wherein the music points are used to divide the audio material into a plurality of audio clips; a generating unit, configured to generate one video clip for each music clip in the audio material using the image material so as to obtain a plurality of video clips, wherein a music clip and a video clip, which correspond to each other, have a same duration; a synthesizing unit, configured to splice the plurality of video clips together according to times when music clips respectively corresponding to the plurality of video clips appear in the audio material, and add the audio material as a video audio track to obtain a synthesized video. ### Claim 10 (depends on 9) The apparatus according to claim 9, wherein the acquisition unit comprises a display sub-unit and an acquisition sub-unit; the display sub-unit is configured to display a playing interface for the original video; and the acquisition sub-unit is configured to acquire the background music of the original video as the audio material in response to detecting a first user operation on the playing interface. ### Claim 11 (depends on 10) The apparatus according to claim 10, wherein the acquisition unit comprises a first module, a second module, a third module; the first module is configured to display a first display interface for the background music in response to detecting the first user operation on the playing interface; the second module is configured to display a second display interface for the image material in response to detecting a second user operation on the first display interface; and the third module is configured to acquire the image material based on a selection operation for the image material on the second display interface. ### Claim 12 (depends on 11) The apparatus according to claim 11, wherein the second module comprises a first sub-module and a second sub-module; the first sub-module is configured to display an image shooting interface in response to detecting the second user operation on the first display interface, wherein the image shooting interface comprises a first control and a second control, the first control is used to trigger an image shooting, and the second control is used to trigger an image selection; and the second sub-module is configured to display the second display interface for the image material in response to detecting a third user operation on the second control. ### Claim 13 (depends on 9) The apparatus according to claim 9, further comprising an adjusting unit and a display unit; the adjusting unit is configured to adjust the synthesized video in response to detecting an adjusting operation by a user on the synthesized video; the display unit is configured to display the adjusted synthesized video. ### Claim 14 (depends on 10) The apparatus according to claim 10, the acquisition unit is further configured to: display a first display interface for the background music in response to detecting the first user operation on the playing interface; display an image shooting interface in response to detecting a second user operation on the first display interface, wherein the image shooting interface comprises a first control, and the first control is used to trigger an image shooting; and in response to detecting a fourth user operation on the first control, call a shooting element to shoot an image so as to obtain the image material. ### Claim 15 (depends on 9) The apparatus according to claim 9, the acquisition unit is further configured to: display a playing interface for the original video; display a display interface for the background music of the original video in response to detecting a fifth user operation on the playing interface, wherein the display interface comprises a third control and a fourth control, the third control is used to trigger a music manual clipping, and the fourth control is used to trigger a music automatic clipping; clip the background music in response to detecting a sixth user operation on the display interface; and determine a material clipped from the background music as the audio material. ### Claim 16 (depends on 15) The apparatus according to claim 15, the acquisition unit is further configured to: in a case where a seventh user operation is a user operation for the third control, display an operation interface for an music clipping, wherein the third control is used to trigger the music manual clipping; determine a clipping interval selected by a manual clipping operation from the background music in response to detecting the manual clipping operation for the background music on the operation interface for the music clipping; and clip the background music according to the clipping interval. ### Claim 17 (depends on 15) The apparatus according to claim 15, the acquisition unit is further configured to: in a case where a seventh user operation is a user operation for the fourth control, analyze a clipping interval in the background music which is applicable for being used as the audio material according to an analysis algorithm for the audio material; and clip the background music according to the clipping interval. ### Claim 18 (depends on 1) An electronic device, comprising: one or more processors; a storage apparatus, having one or more programs stored thereon, wherein in a case where the one or more programs are executed by the one or more processors, the one or more processors implement the method according to claim 1. ### Claim 19 (depends on 1) A computer readable medium, having a computer program stored thereon, wherein in a case where the computer program is executed by a processor, the method according to claim 1 is implemented. ### Claim 20 (depends on 1) A computer program, comprising a program code, wherein in a case where the computer program is executed by a computer, the computer program executes the method according to claim 1.