# US 2026/0065941 A1 · Video editing method and apparatus, computer device, and storage medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0065941 A1
- Document ID: US20260065941A1
- Status: Published application
- Kind: A1
- Application number: 19/386,201
- Filed: 2025-11-11
- Published: 2026-03-05
- Earliest claimed: 2021-11-12
- Assignees: Tencent Technology (Shenzhen) Company Limited
- Applicants: Tencent Technology (Shenzhen) Company Limited
- Inventors: Xin FENG
- Web page: https://patentgrep.com/patent/US20260065941A1

## CPC

- G11B 27/031: Electronic editing of digitised analogue information signals, e.g. audio or video signals
- G11B 27/28: by using information signals recorded by the same method as the main recording {(G11B27/22 takes precedence)}
- G06N 3/04: Architecture, e.g. interconnection topology
- G06N 3/08: Learning methods
- G06V 10/82: using neural networks
- G06V 20/40: in video content (extracting overlay text G06V20/62; video retrieval G06F16/70; processing of video elementary streams in video servers H04N21/234; processing of video elementary streams in video clients H04N21/44)
- H04N 21/44: Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N 21/81: Monomedia components thereof
- H04N 21/845: Structuring of content, e.g. decomposing content into time segments
- G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A video editing method is performed by a computer device. The method includes: performing music recognition on audio data in first video data to obtain a recognition result of each of audio frames in the audio data, the recognition result indicating whether the audio frame belongs to a music audio frame; determining a music segment in the audio data based on the recognition results of the audio frames, the music segment comprising a plurality of music audio frames; and extracting, from the first video data, a video clip with a same playback period as the music segment as second video data comprising the music segment.

## Claims

### Claim 1

A video editing method performed by a computer device, the method comprising:
performing music recognition on audio data in first video data to obtain a recognition result of each of audio frames in the audio data, the recognition result indicating whether the audio frame belongs to a music audio frame or not;
determining a plurality of music audio frame and a plurality of non-music audio frame in the audio data based on the recognition result of each of the audio frames;
organizing a plurality of consecutive music audio frames in the audio data into a music segment and a plurality of consecutive non-music audio frames into a non-music segment, respectively;
correcting the music segment in the audio data based on at least one of playback information of the music segment and playback information of the non-music segment; and
extracting, from the first video data, a video clip with a same playback period as the music segment as second video data comprising the music segment.

### Claim 2 (depends on 1)

The method according to claim 1, wherein the performing music recognition on audio data in first video data to obtain a recognition result of each of audio frames in the audio data comprises:
extracting spectral information from each of the audio frames;
performing feature extraction respectively based on the spectral information of each of the audio frames to obtain an audio feature of each of the audio frames; and
performing feature recognition based on the audio features of the audio frames to obtain the recognition result of each of the audio frames.

### Claim 3 (depends on 2)

The method according to claim 2, wherein the extracting spectral information from each of the audio frames comprises:
performing frequency-domain transformation on each of the audio frames to obtain energy spectrum information of each of the audio frames; and
filtering the energy spectrum information of each of the audio frames to obtain the spectral information of each of the audio frames.

### Claim 4 (depends on 2)

The method according to claim 2, wherein the performing feature extraction respectively based on the spectral information of each of the audio frames to obtain an audio feature of each of the audio frames comprises:
organizing a first number of preceding audio frames of the first audio frame, a first audio frame and a second number of follow-up audio frames of the first audio frame into a frame set, the preceding audio frames being audio frames located before the first audio frame, and the follow-up audio frames being audio frames located after the first audio frame;
performing the feature extraction on the spectral information of a plurality of audio frames in the frame set, and determining the extracted audio feature as the audio feature of the first audio frame,
wherein the first audio frame is any audio frame in the audio data.

### Claim 5 (depends on 4)

The method according to claim 4, further comprising:
filling at least one audio frame before the first audio frame to make the number of the preceding audio frames of the first audio frame equal to the first number in a case where the number of preceding audio frames of the first audio frame is less than the first number; and
filling at least one audio frame after the first audio frame to make the number of follow-up audio frames of the first audio frame equal to the second number in a case where the number of follow-up audio frames of the first audio frame is less than the second number.

### Claim 6 (depends on 2)

The method according to claim 2, wherein the performing feature recognition based on audio features of the audio frames to obtain the recognition result of each of the audio frames comprises:
performing feature transformation based on the audio features of a plurality of audio frames to obtain an associated feature of each of the audio frames, the associated feature of the audio frame indicating an association relationship between the audio frame and the preceding audio frames and the follow-up audio frames; and
performing classification based on the associated feature of each of the audio frames to obtain the recognition result of each of the audio frames.

### Claim 7 (depends on 1)

The method according to claim 1, wherein the performing music recognition on audio data in first video data to obtain a recognition result of each audio frame in the audio data comprises:
invoking a music recognition model to perform music recognition on the audio data in the first video data to obtain the recognition result of each audio frame in the audio data.

### Claim 8 (depends on 1)

The method according to claim 1, wherein the recognition result of the audio frame is a classification numerical value, the classification numerical value indicates a possibility that the audio frame belongs to the music audio frame.

### Claim 9

A computer device, comprising a processor and a memory, the memory storing at least one computer program that, when executed by the processor, causes the computer device to implement a video editing method including:
performing music recognition on audio data in first video data to obtain a recognition result of each of audio frames in the audio data, the recognition result indicating whether the audio frame belongs to a music audio frame or not;
determining a plurality of music audio frame and a plurality of non-music audio frame in the audio data based on the recognition result of each of the audio frames;
organizing a plurality of consecutive music audio frames in the audio data into a music segment and a plurality of consecutive non-music audio frames into a non-music segment, respectively;
correcting the music segment in the audio data based on at least one of playback information of the music segment and playback information of the non-music segment; and
extracting, from the first video data, a video clip with a same playback period as the music segment as second video data comprising the music segment.

### Claim 10 (depends on 9)

The computer device according to claim 9, wherein the performing music recognition on audio data in first video data to obtain a recognition result of each of audio frames in the audio data comprises:
extracting spectral information from each of the audio frames;
performing feature extraction respectively based on the spectral information of each of the audio frames to obtain an audio feature of each of the audio frames; and
performing feature recognition based on the audio features of the audio frames to obtain the recognition result of each of the audio frames.

### Claim 11 (depends on 10)

The computer device according to claim 10, wherein the extracting spectral information from each of the audio frames comprises:
performing frequency-domain transformation on each of the audio frames to obtain energy spectrum information of each of the audio frames; and
filtering the energy spectrum information of each of the audio frames to obtain the spectral information of each of the audio frames.

### Claim 12 (depends on 10)

The computer device according to claim 10, wherein the performing feature extraction respectively based on the spectral information of each of the audio frames to obtain an audio feature of each of the audio frames comprises:
organizing a first number of preceding audio frames of the first audio frame, a first audio frame and a second number of follow-up audio frames of the first audio frame into a frame set, the preceding audio frames being audio frames located before the first audio frame, and the follow-up audio frames being audio frames located after the first audio frame;
performing the feature extraction on the spectral information of a plurality of audio frames in the frame set, and determining the extracted audio feature as the audio feature of the first audio frame,
wherein the first audio frame is any audio frame in the audio data.

### Claim 13 (depends on 12)

The computer device according to claim 12, wherein the method further comprises:
filling at least one audio frame before the first audio frame to make the number of the preceding audio frames of the first audio frame equal to the first number in a case where the number of preceding audio frames of the first audio frame is less than the first number; and
filling at least one audio frame after the first audio frame to make the number of follow-up audio frames of the first audio frame equal to the second number in a case where the number of follow-up audio frames of the first audio frame is less than the second number.

### Claim 14 (depends on 10)

The computer device according to claim 10, wherein the performing feature recognition based on audio features of the audio frames to obtain the recognition result of each of the audio frames comprises:
performing feature transformation based on the audio features of a plurality of audio frames to obtain an associated feature of each of the audio frames, the associated feature of the audio frame indicating an association relationship between the audio frame and the preceding audio frames and the follow-up audio frames; and
performing classification based on the associated feature of each of the audio frames to obtain the recognition result of each of the audio frames.

### Claim 15 (depends on 9)

The computer device according to claim 9, wherein the performing music recognition on audio data in first video data to obtain a recognition result of each audio frame in the audio data comprises:
invoking a music recognition model to perform music recognition on the audio data in the first video data to obtain the recognition result of each audio frame in the audio data.

### Claim 16 (depends on 9)

The computer device according to claim 9, wherein the recognition result of the audio frame is a classification numerical value, the classification numerical value indicates a possibility that the audio frame belongs to the music audio frame.

### Claim 17

A non-transitory computer-readable storage medium, storing at least one computer program that, when executed by a processor of a computer device, causes the computer device to implement a video editing method including:
determining a plurality of music audio frame and a plurality of non-music audio frame in the audio data based on the recognition result of each of the audio frames;
organizing a plurality of consecutive music audio frames in the audio data into a music segment and a plurality of consecutive non-music audio frames into a non-music segment, respectively;
correcting the music segment in the audio data based on at least one of playback information of the music segment and playback information of the non-music segment; and
extracting, from the first video data, a video clip with a same playback period as the music segment as second video data comprising the music segment.

### Claim 18 (depends on 17)

The non-transitory computer-readable storage medium according to claim 17, wherein the performing music recognition on audio data in first video data to obtain a recognition result of each of audio frames in the audio data comprises:
extracting spectral information from each of the audio frames;
performing feature extraction respectively based on the spectral information of each of the audio frames to obtain an audio feature of each of the audio frames; and
performing feature recognition based on the audio features of the audio frames to obtain the recognition result of each of the audio frames.

### Claim 19 (depends on 17)

The non-transitory computer-readable storage medium according to claim 17, wherein the performing music recognition on audio data in first video data to obtain a recognition result of each audio frame in the audio data comprises:
invoking a music recognition model to perform music recognition on the audio data in the first video data to obtain the recognition result of each audio frame in the audio data.

### Claim 20 (depends on 17)

The non-transitory computer-readable storage medium according to claim 17, wherein the recognition result of the audio frame is a classification numerical value, the classification numerical value indicates a possibility that the audio frame belongs to the music audio frame.
