# US 11,443,771 B2 · Systems and methods for modifying videos based on music > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,443,771 B2 - Document ID: US11443771B2 - Status: Granted - Kind: B2 - Application number: 17/239,590 - Filed: 2021-04-24 - Published: 2021-08-05 - Granted: 2022-09-13 - Earliest claimed: 2017-03-02 - Assignees: GoPro, Inc. - Applicants: GoPro, Inc. - Inventors: Jean Patry; Guillaume Oulès - Web page: https://patentgrep.com/patent/US11443771B2 ## CPC - G11B 27/031: Electronic editing of digitised analogue information signals, e.g. audio or video signals - G11B 27/28: by using information signals recorded by the same method as the main recording {(G11B27/22 takes precedence)} - H04N 5/76: Television signal recording - G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R) - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract Video information defining video content may be accessed. Music information defining a music track providing an accompaniment for video content may be accessed. The music track may have pulses and one or more music events. Individual music events may correspond to different moments within the music track. One or more music events may be individually classified into one or more categories based on intensities of one or pulses occurring within the music event. One or more visual effects may be selected for different moments within the music track based on the categories of the music events. One or more visual effects may be applied to the video content. One or more visual effects may be applied to one or more moments within the video content aligned to one or more different moments within the music track. ## Claims ### Claim 1 A system for modifying videos based on music, the system comprising: one or more physical processors configured by machine-readable instructions to: access music information defining a music track, the music track providing an accompaniment for video content, the music track having one or more music events, the individual music events corresponding to different moments within the music track; analyze intensities of one or more pulses occurring within the one or more music events, wherein the analysis of the intensities of the one or more pulses occurring within the one or more music events is performed within separate frequency ranges, the separate frequency ranges including a low frequency range, a middle frequency range, and a high frequency range, the analysis of the intensities of the one or more pulses including analysis of the intensities of the one or more pulses within the low frequency range, analysis of the intensities of the one or more pulses within the middle frequency range, and analysis of the intensities of the one or more pulses within the high frequency range; classify the one or more music events based on combination of the intensities of the one or more pulses analyzed within the low frequency range, the middle frequency range, and the high frequency range; select one or more transition effects for the one or more music events within the music track based on the classification of the one or more music events; and apply the one or more transition effects to the video content. ### Claim 2 (depends on 1) The system of claim 1, wherein the one or more music events are individually classified into one or more categories, the one or more categories including a weak category and a strong category. ### Claim 3 (depends on 1) The system of claim 1, wherein one or more consecutive pulses are grouped based on similarity of the intensities within the separate frequency ranges. ### Claim 4 (depends on 3) The system of claim 3, wherein the one or more transition effects are selected further based on the grouping of the consecutive pulses. ### Claim 5 (depends on 1) The system of claim 1, wherein one or more visual effects are selected for the one or more music events within the music track based on the classification of the one or more music events. ### Claim 6 (depends on 5) The system of claim 5, wherein the one or more visual effects include one or more changes in a perceived speed at which the video content is presented during playback. ### Claim 7 (depends on 1) The system of claim 1, wherein the one or more transition effects include one or more visual transformations of the video content. ### Claim 8 (depends on 7) The system of claim 7, wherein the one or more visual transformations of the video content include one or more of a mix, a dissolve, a crossfade, a fade, a wipe, a rotation, or a shake. ### Claim 9 (depends on 1) The system of claim 1, wherein the one or more physical processors are further configured by machine-readable instructions to analyze the music track to classify the one or more music events. ### Claim 10 A method for modifying videos based on music, the method comprising: accessing music information defining a music track, the music track providing an accompaniment for video content, the music track having one or more music events, the individual music events corresponding to different moments within the music track; analyzing intensities of one or more pulses occurring within the one or more music events, wherein the analysis of the intensities of the one or more pulses occurring within the one or more music events is performed within separate frequency ranges, the separate frequency ranges including a low frequency range, a middle frequency range, and a high frequency range, the analysis of the intensities of the one or more pulses including analysis of the intensities of the one or more pulses within the low frequency range, analysis of the intensities of the one or more pulses within the middle frequency range, and analysis of the intensities of the one or more pulses within the high frequency range; classifying the one or more music events based on combination of the intensities of the one or more pulses analyzed within the low frequency range, the middle frequency range, and the high frequency range; selecting one or more transition effects for the one or more music events within the music track based on the classification of the one or more music events; and applying the one or more transition effects to the video content. ### Claim 11 (depends on 10) The method of claim 10, wherein the one or more music events are individually classified into one or more categories, the one or more categories including a weak category and a strong category. ### Claim 12 (depends on 10) The method of claim 10, wherein one or more consecutive pulses are grouped based on similarity of the intensities within the separate frequency ranges. ### Claim 13 (depends on 12) The method of claim 12, wherein the one or more transition effects are selected further based on the grouping of the consecutive pulses. ### Claim 14 (depends on 10) The method of claim 10, wherein one or more visual effects are selected for the one or more music events within the music track based on the classification of the one or more music events. ### Claim 15 (depends on 14) The method of claim 14, wherein the one or more visual effects include one or more changes in a perceived speed at which the video content is presented during playback. ### Claim 16 (depends on 10) The method of claim 10, wherein the one or more transition effects include one or more visual transformations of the video content. ### Claim 17 (depends on 16) The method of claim 16, wherein the one or more visual transformations of the video content include one or more of a mix, a dissolve, a crossfade, a fade, a wipe, a rotation, or a shake. ### Claim 18 (depends on 10) The method of claim 10, further comprising analyzing the music track to classify the one or more music events. ### Claim 19 A system for modifying videos based on music, the system comprising: one or more physical processors configured by machine-readable instructions to: access music information defining a music track, the music track providing an accompaniment for video content, the music track having one or more music events, the individual music events corresponding to different moments within the music track; analyze intensities of one or more pulses occurring within the one or more music events, wherein the analysis of the intensities of the one or more pulses occurring within the one or more music events is performed within separate frequency ranges, the separate frequency ranges including a low frequency range, a middle frequency range, and a high frequency range, the analysis of the intensities of the one or more pulses including analysis of the intensities of the one or more pulses within the low frequency range, analysis of the intensities of the one or more pulses within the middle frequency range, and analysis of the intensities of the one or more pulses within the high frequency range; classify the one or more music events into one or more categories, the one or more categories including a weak category and a strong category, based on combination of the intensities of the one or more pulses analyzed within the low frequency range, the middle frequency range, and the high frequency range; select one or more transition effects for the one or more music events within the music track based on the classification of the one or more music events; and apply the one or more transition effects to the video content. ### Claim 20 (depends on 19) The system of claim 19, wherein: one or more consecutive pulses are grouped based on similarity of the intensities within the separate frequency ranges; the one or more transition effects are selected further based on the grouping of the consecutive pulses.