# US 11,451,739 B2 · Systems and methods for generating time-lapse videos

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,451,739 B2
- Document ID: US11451739B2
- Status: Granted
- Kind: B2
- Application number: 17/333,405
- Filed: 2021-05-28
- Published: 2021-09-16
- Granted: 2022-09-20
- Earliest claimed: 2019-07-02
- Assignees: GoPro, Inc.
- Applicants: GoPro, Inc.
- Inventors: Thomas Derbanne; Maxim Karpushin; Nicolas Rahmouni
- Web page: https://patentgrep.com/patent/US11451739B2

## CPC

- H04N 5/783: Adaptations for reproducing at a rate different from the recording rate
- H04N 7/0127: {by changing the field or frame frequency of the incoming video signal, e.g. frame rate converter}
- G06T 7/248: {involving reference images or patches}
- G06T 7/269: using gradient-based methods
- G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80)
- H04N 5/2628: {Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation}
- H04N 5/772: {the recording apparatus and the television camera being placed in the same enclosure}
- H04N 23/56: provided with illuminating means
- H04N 23/6811: {based on the image signal}
- H04N 23/6812: {based on additional sensors, e.g. acceleration sensors}
- H04N 23/684: {performed by controlling the image sensor readout, e.g. by controlling the integration time}
- H04N 23/951: by using two or more images to influence resolution, frame rate or aspect ratio
- G06T 2207/10016: Video; Image sequence
- G06T 2207/30244: Camera pose
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

Positions of an image capture device may be used to estimate a time-lapse video frame rate with which time-lapse video frames are generated. The time-lapse video frame rate may be adjusted based on apparent motion between pairs of generated time-lapse video frames. The adjusted time-lapse video frame rate may be used to generate additional time-lapse video frames.

## Claims

### Claim 1

A system for generating time-lapse videos, the system comprising:
one or more physical processors configured by machine-readable instructions to:
obtain visual information, the visual information defining visual content captured by an image capture device;
obtain position information of the image capture device, the position information characterizing positions of the image capture device during the capture of the visual content;
obtain apparent motion information, the apparent motion information characterizing apparent motion between the visual content captured by the image capture device at different moments;
determine a time-lapse video frame rate based on the position information and the apparent motion information, the time-lapse video frame rate defining a rate at which time-lapse video frames are generated based on the visual content; and
generate the time-lapse video frames based on the time-lapse video frame rate.

### Claim 2 (depends on 1)

The system of claim 1, wherein the position information characterizes the positions of the image capture device based on the position information including rotational position information, the rotational position information characterizing rotational positions of the image capture device during the capture of the visual content.

### Claim 3 (depends on 2)

The system of claim 2, wherein the position information characterizes the positions of the image capture device further based on the position information including acceleration information, the acceleration information characterizing accelerations of the image capture device during the capture of the visual content.

### Claim 4 (depends on 1)

The system of claim 1, wherein the one or more physical processors are, to determine the time-lapse video frame rate based on the position information, further configured by the machine-readable instructions to:
determine an amount of field of view overlap between the visual content captured at the different moments based on the position information; and
determine the time-lapse video frame rate based on the amount of field of view overlap between the visual content captured at the different moments.

### Claim 5 (depends on 1)

The system of claim 1, wherein at least some of the time-lapse video frames are stabilized based on a punchout of the at least some of the time-lapse video frames.

### Claim 6 (depends on 1)

The system of claim 1, wherein generation of the time-lapse video frames based on the time-lapse video frame rate includes capture of the time-lapse video frames by the image capture device based on the time-lapse video frame rate.

### Claim 7 (depends on 1)

The system of claim 1, wherein the apparent motion information is determined based on optical flow between the visual content captured by the image capture device at the different moments.

### Claim 8 (depends on 1)

The system of claim 1, wherein the time-lapse video frame rate is initially determined based on an environment in which the visual content is initially captured by the image capture device.

### Claim 9 (depends on 8)

The system of claim 8, wherein the environment in which the visual content is initially captured by the image capture device is determined based on one or more of an exposure, a white balance, and/or a scene classification of the visual content initially captured by the image capture device.

### Claim 10

A method for generating time-lapse videos, the method performed by a computing system including one or more processors, the method comprising:
obtaining, by the computing system, visual information, the visual information defining visual content captured by an image capture device;
obtaining, by the computing system, position information of the image capture device, the position information characterizing positions of the image capture device during the capture of the visual content;
obtaining, by the computing system, apparent motion information, the apparent motion information characterizing apparent motion between the visual content captured by the image capture device at different moments;
determining, by the computing system, a time-lapse video frame rate based on the position information and the apparent motion information, the time-lapse video frame rate defining a rate at which time-lapse video frames are generated based on the visual content; and
generating, by the computing system, the time-lapse video frames based on the time-lapse video frame rate.

### Claim 11 (depends on 10)

The method of claim 10, wherein the position information characterizes the positions of the image capture device based on the position information including rotational position information, the rotational position information characterizing rotational positions of the image capture device during the capture of the visual content.

### Claim 12 (depends on 11)

The method of claim 11, wherein the position information characterizes the positions of the image capture device further based on the position information including acceleration information, the acceleration information characterizing accelerations of the image capture device during the capture of the visual content.

### Claim 13 (depends on 10)

The method of claim 10, wherein determining the time-lapse video frame rate based on the position information includes:
determining an amount of field of view overlap between the visual content captured at the different moments based on the position information; and
determining the time-lapse video frame rate based on the amount of field of view overlap between the visual content captured at the different moments.

### Claim 14 (depends on 10)

The method of claim 10, wherein at least some of the time-lapse video frames are stabilized based on a punchout of the at least some of the time-lapse video frames.

### Claim 15 (depends on 10)

The method of claim 10, wherein generation of the time-lapse video frames based on the time-lapse video frame rate includes capture of the time-lapse video frames by the image capture device based on the time-lapse video frame rate.

### Claim 16 (depends on 10)

The method of claim 10, wherein the apparent motion information is determined based on optical flow between the visual content captured by the image capture device at the different moments.

### Claim 17 (depends on 10)

The method of claim 10, wherein the time-lapse video frame rate is initially determined based on an environment in which the visual content is initially captured by the image capture device.

### Claim 18 (depends on 17)

The method of claim 17, wherein the environment in which the visual content is initially captured by the image capture device is determined based on one or more of an exposure, a white balance, and/or a scene classification of the visual content initially captured by the image capture device.

### Claim 19

A system for generating time-lapse videos, the system comprising:
one or more physical processors configured by machine-readable instructions to:
obtain visual information, the visual information defining visual content captured by an image capture device;
obtain position information of the image capture device, the position information characterizing positions of the image capture device during the capture of the visual content by including rotational position information and acceleration information, the rotational position information characterizing rotational positions of the image capture device during the capture of the visual content, the acceleration information characterizing accelerations of the image capture device during the capture of the visual content;
obtain apparent motion information, the apparent motion information characterizing apparent motion between the visual content captured by the image capture device at different moments;
determine a time-lapse video frame rate based on the position information and the apparent motion information, the time-lapse video frame rate defining a rate at which time-lapse video frames are generated based on the visual content; and
generate the time-lapse video frames based on the time-lapse video frame rate, wherein at least some of the time-lapse video frames are stabilized based on a punchout of the at least some of the time-lapse video frames.

### Claim 20 (depends on 19)

The system of claim 19, wherein the apparent motion information is determined based on optical flow between the visual content captured by the image capture device at the different moments.
