# US 11,310,473 B2 · Generating videos with short audio

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,310,473 B2
- Document ID: US11310473B2
- Status: Granted
- Kind: B2
- Application number: 17/083,705
- Filed: 2020-10-29
- Published: 2021-02-11
- Granted: 2022-04-19
- Earliest claimed: 2019-05-10
- Assignees: GoPro, Inc.
- Applicants: GoPro, Inc.
- Inventors: Nicholas Ryan Gilmour; David Newman; Vadim Polonichko; Tyler Gee; Jessica Bonner
- Web page: https://patentgrep.com/patent/US11310473B2

## CPC

- H04N 9/802: involving processing of the sound signal (H04N9/806, H04N9/835 take precedence)
- G11B 27/005: {Reproducing at a different information rate from the information rate of recording (for television signals H04N5/783)}
- G11B 27/031: Electronic editing of digitised analogue information signals, e.g. audio or video signals
- G11B 27/036: Insert-editing
- H04N 23/51: Housings
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R)

## Abstract

An image capture device may capture visual content during a visual capture duration and audio content during an audio capture duration. The audio capture duration may be shorter than the visual capture duration. The captured audio content may provide audio for playback of the captured visual content.

## Claims

### Claim 1

An image capture device comprising:
a housing;
an image sensor carried by the housing and configured to generate a visual output signal conveying visual information based on light that becomes incident thereon, the visual information defining visual content;
an optical element carried by the housing and configured to guide light within a field of view to the image sensor;
a sound sensor carried by the housing and configured to generate a sound output signal conveying audio information based on sound received by the sound sensor, the audio information defining audio content; and
one or more physical processors carried by the housing, the one or more physical processors configured by machine-readable instructions to:
capture the visual content during a visual capture duration, the visual capture duration extending from a visual capture start point to a visual capture end point;
capture the audio content during a first audio capture duration based on activation of an audio content capture option of the image capture device, the activation of the audio content capture option separately prompting the image capture device to capture the audio content from capture of the visual content, the first audio capture duration extending from a first audio capture start point to a first audio capture end point, the first audio capture duration being shorter than the visual capture duration; and
generate video content of a time-lapse video, the video content of the time-lapse video including the captured visual content and the captured audio content, wherein the captured visual content is defined within video frames of the video content and the captured audio content provides audio for playback of at least some of the video frames such that the captured audio content provides playback for the video frames captured over a duration longer than the first audio capture duration;
wherein the audio content is captured further during a second audio capture duration, the second audio capture duration extending from a second audio capture start point to a second audio capture end point, the captured audio content includes a first captured audio content portion captured during the first audio capture duration and a second captured audio content portion captured during the second audio capture duration, and the first captured audio content portion is mixed with the second captured audio content portion to provide the audio for playback of at least some of the video frames, wherein mixing of the first captured audio content portion and the second captured audio content portion is performed based on both the first capture audio content portion and the second captured audio content portion having been captured from a same type of location.

### Claim 2 (depends on 1)

The image capture device of claim 1, wherein the first audio capture start point coincides with the visual capture start point and the first audio capture end point precedes the visual capture end point.

### Claim 3 (depends on 1)

The image capture device of claim 1, wherein the first audio capture start point follows the visual capture start point and the first audio capture end point coincides with the visual capture end point.

### Claim 4 (depends on 1)

The image capture device of claim 1, wherein the first audio capture start point follows the visual capture start point and the first audio capture end point precedes the visual capture end point.

### Claim 5 (depends on 1)

The image capture device of claim 1, wherein the audio content is captured further based on identification of a depiction of interest within the visual content.

### Claim 6 (depends on 1)

The image capture device of claim 1, wherein the audio content is captured further based on identification of a sound of interest within the audio content.

### Claim 7 (depends on 1)

The image capture device of claim 1, wherein mixing of the first captured audio content portion and the second captured audio content portion is performed based on both the first captured audio content portion and the second captured audio content portion not including speech.

### Claim 8

A method for generating videos, the method performed by an image capture device including one or more processors, an image sensor, and a sound sensor, the image sensor configured to generate a visual output signal conveying visual information based on light that becomes incident thereon, the visual information defining visual content, the sound sensor configured to generate a sound output signal conveying audio information based on sound received by the sound sensor, the audio information defining audio content, the method comprising:
capturing the visual content during a visual capture duration, the visual capture duration extending from a visual capture start point to a visual capture end point;
capturing the audio content during a first audio capture duration based on activation of an audio content capture option of the image capture device, the activation of the audio content capture option separately prompting the image capture device to capture the audio content from capture of the visual content, the first audio capture duration extending from a first audio capture start point to a first audio capture end point, the first audio capture duration being shorter than the visual capture duration; and
generating video content of a time-lapse video, the video content of the time-lapse video including the captured visual content and the captured audio content, wherein the captured visual content is defined within video frames of the video content and the captured audio content provides audio for playback of at least some of the video frames such that the captured audio content provides playback for the video frames captured over a duration longer than the first audio capture duration;
wherein the audio content is captured further during a second audio capture duration, the second audio capture duration extending from a second audio capture start point to a second audio capture end point, the captured audio content includes a first captured audio content portion captured during the first audio capture duration and a second captured audio content portion captured during the second audio capture duration, and the first captured audio content portion is mixed with the second captured audio content portion to provide the audio for playback of at least some of the video frames, wherein mixing of the first captured audio content portion and the second captured audio content portion is performed based on both the first capture audio content portion and the second captured audio content portion having been captured from a same type of location.

### Claim 9 (depends on 8)

The method of claim 8, wherein the first audio capture start point coincides with the visual capture start point and the first audio capture end point precedes the visual capture end point.

### Claim 10 (depends on 8)

The method of claim 8, wherein the first audio capture start point follows the visual capture start point and the first audio capture end point coincides with the visual capture end point.

### Claim 11 (depends on 8)

The method of claim 8, wherein the first audio capture start point follows the visual capture start point and the first audio capture end point precedes the visual capture end point.

### Claim 12 (depends on 8)

The method of claim 8, wherein the audio content is captured further based on identification of a depiction of interest within the visual content.

### Claim 13 (depends on 8)

The method of claim 8, wherein the audio content is captured further based on identification of a sound of interest within the audio content.

### Claim 14 (depends on 8)

The method of claim 8, wherein mixing of the first captured audio content portion and the second captured audio content portion is performed based on both the first captured audio content portion and the second captured audio content portion not including speech.
