# US 12,003,856 B2 · Dynamic synchronization of frame rate to a detected cadence in a time lapse image sequence > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,003,856 B2 - Document ID: US12003856B2 - Status: Granted - Kind: B2 - Application number: 17/708,170 - Filed: 2022-03-30 - Published: 2022-07-14 - Granted: 2024-06-04 - Earliest claimed: 2015-12-16 - Assignees: GoPro, Inc. - Applicants: GoPro, Inc. - Inventors: Charles Weckel; Vishwanatha Bhat - Web page: https://patentgrep.com/patent/US12003856B2 ## CPC - H04N 23/689: {Motion occurring during a rolling shutter mode} - G06T 7/262: using transform domain methods, e.g. Fourier domain methods - H04N 23/68: for stable pick-up of the scene, e.g. compensating for camera body vibrations - H04N 23/6812: {based on additional sensors, e.g. acceleration sensors} - H04N 23/684: {performed by controlling the image sensor readout, e.g. by controlling the integration time} - H04N 23/73: by influencing the exposure time - H04N 23/951: by using two or more images to influence resolution, frame rate or aspect ratio - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL ## Abstract Synchronization of a frame rate to a detected cadence includes receiving a sequence of image frames. Motion data recorded contemporaneously with a capture of the sequence of image frames are also received. At least some of the motion data are converted from time domain data to frequency domain data. A dominant frequency in the frequency domain data is determined. Frames from the sequence of image frames are sampled at a sampling frequency related to the dominant frequency. A new image sequence is created using the sampled frames. ## Claims ### Claim 1 A method for synchronization of a frame rate to a detected cadence, the method comprising: receiving a sequence of image frames; receiving motion data recorded contemporaneously with a capture of the sequence of image frames; converting at least some of the motion data from time domain data to frequency domain data; determining a dominant frequency in the frequency domain data; sampling frames from the sequence of image frames at a sampling frequency related to the dominant frequency; and creating a new image sequence using the sampled frames. ### Claim 2 (depends on 1) The method of claim 1, wherein the motion data are data of sensors that track motion of a camera capturing the sequence of image frames. ### Claim 3 (depends on 1) The method of claim 1, wherein the motion data are motion data of a vehicle to which a camera capturing the sequence of image frames is attached. ### Claim 4 (depends on 1) The method of claim 1, wherein the at least some of the motion data are motion data included in a predefined time window. ### Claim 5 (depends on 1) The method of claim 1, wherein the motion data comprise position data along an axis of oscillation derived from sensed data captured by a motion sensor. ### Claim 6 (depends on 1) The method of claim 1, wherein the motion data are converted from the time domain data to the frequency domain data using Fast Fourier Transform. ### Claim 7 (depends on 1) The method of claim 1, wherein determining the dominant frequency in the frequency domain data comprises: selecting, as the dominant frequency, a frequency value in the frequency domain data that has a largest amplitude amongst frequency values in the frequency domain data. ### Claim 8 (depends on 1) The method of claim 1, wherein the sampling frequency matches the dominant frequency. ### Claim 9 A non-transitory computer-readable storage medium that stores instructions that, when executed by a processor, cause the processor to: receive a sequence of image frames captured by a camera; convert at least some motion data from time domain data to frequency domain data, wherein the motion data are indicative of motion of the camera while the camera captures the sequence of image frames; determine a dominant frequency having a highest magnitude value in the frequency domain data; sample frames from the sequence of image frames and corresponding to the at least some of the motion data at a sampling frequency that is based on the dominant frequency; and create a new image sequence using the sampled frames. ### Claim 10 (depends on 9) The non-transitory computer-readable storage medium of claim 9, wherein the motion data are data of sensors that track motion of the camera. ### Claim 11 (depends on 9) The non-transitory computer-readable storage medium of claim 9, wherein the motion data are motion data of a vehicle to which the camera is attached. ### Claim 12 (depends on 9) The non-transitory computer-readable storage medium of claim 9, wherein the at least some of the motion data are motion data included in a predefined time window. ### Claim 13 (depends on 9) The non-transitory computer-readable storage medium of claim 9, wherein the motion data comprise position data along an axis of oscillation derived from sensed data captured by a motion sensor. ### Claim 14 (depends on 9) The non-transitory computer-readable storage medium of claim 9, wherein the motion data is converted from time domain data to frequency domain data using Fast Fourier Transform. ### Claim 15 (depends on 9) The non-transitory computer-readable storage medium of claim 9, wherein the instructions to determine the dominant frequency comprise to: select, as the dominant frequency, a frequency value in the frequency domain data that has a largest amplitude amongst frequency values in the frequency domain data. ### Claim 16 (depends on 9) The non-transitory computer-readable storage medium of claim 9, wherein the sampling frequency matches the dominant frequency. ### Claim 17 A device, comprising: a processor configured to: receive a sequence of image frames; receive motion data; convert at least some of the motion data to frequency domain data; identify, as a dominant frequency, a highest magnitude value in the frequency domain data; sample frames from the sequence of image frames and corresponding to the at least some of the motion data at a sampling frequency that is based on the dominant frequency; and create a new sequence of image frames using the sampled frames. ### Claim 18 (depends on 17) The device of claim 17, wherein the motion data are indicative of motion of a camera while the camera captured the sequence of image frames. ### Claim 19 (depends on 18) The device of claim 18, wherein the motion data are motion data of a vehicle to which the camera is attached. ### Claim 20 (depends on 18) The device of claim 18, wherein the motion data are obtained in a predefined time window.