# US 2019/0244031 A1 · Systems and methods for determining video highlight based on conveyance positions of video content capture

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0244031 A1
- Document ID: US20190244031A1
- Status: Published application
- Kind: A1
- Application number: 16/388,017
- Filed: 2019-04-18
- Published: 2019-08-08
- Earliest claimed: 2016-10-05
- Assignees: GoPro, Inc.
- Applicants: GoPro, Inc.
- Inventors: Christophe Delachanal
- Web page: https://patentgrep.com/patent/US20190244031A1

## CPC

- G06V 20/47: {Detecting features for summarising video content}
- G06F 16/739: {in form of a video summary, e.g. the video summary being a video sequence, a composite still image or having synthesized frames}
- G06F 16/743: {a collection of video files or sequences}
- G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80)
- G06V 20/49: {Segmenting video sequences, i.e. computational techniques such as parsing or cutting the sequence, low-level clustering or determining units such as shots or scenes}
- G11B 27/10: Indexing; Addressing; Timing or synchronising; Measuring tape travel
- G11B 27/105: {of operating discs}
- G11B 27/28: by using information signals recorded by the same method as the main recording {(G11B27/22 takes precedence)}
- H04N 23/51: Housings
- H04N 23/698: for achieving an enlarged field of view, e.g. panoramic image capture
- H04N 23/90: Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
- G06T 2207/30244: Camera pose
- G06V 20/44: {Event detection}
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

First video information defining first video content may be accessed. The first video content may have been captured by a first image sensor from a first conveyance position. Second video information defining second video content may be accessed. The second video content may have been captured by a second image sensor from a second conveyance position. A first highlight criterion may be selected for the first video content based on the first conveyance position. A second highlight criterion may be selected for the second video content based on the second conveyance position. A first set of highlight moments within the first video content may be identified based on the first criterion. A second set of highlight moments within the second video content may be identified based on the second criterion. The identification of the first set of highlight moments and the second set of highlight moments may be stored.

## Claims

### Claim 1

A system for determining video highlights based on conveyance positions of video content capture, the system comprising:
one or more physical processors configured by machine-readable instructions to:
access video information defining multiple video content, individual ones of the multiple video content captured by a corresponding image sensor from a corresponding conveyance position;
select highlight criterion for the individual ones of the multiple video content based on the corresponding conveyance positions of the corresponding image sensors that captured the individual ones of the multiple video content, wherein different highlight criterion is selected for different conveyance positions such that a first highlight criterion is selected for video content captured from a first conveyance position and a second highlight criterion is selected for video content captured from a second conveyance position different from the first conveyance position, the second highlight criterion being different from the first highlight criterion;
identify sets of highlight moments within the individual ones of the multiple video content based on the selected highlight criterion; and
store the identification of the sets of highlight moments.

### Claim 2 (depends on 1)

The system of claim 1, wherein the one or more physical processors are further configured to generate a video summary based on the sets of highlight moments.

### Claim 3 (depends on 1)

The system of claim 1, wherein at least two of the individual ones of the multiple video content are time synced.

### Claim 4 (depends on 1)

The system of claim 1, wherein a conveyance position of an image sensor indicates a type of the image sensor.

### Claim 5 (depends on 4)

The system of claim 4, wherein the type of the image sensor includes a handheld image sensor, a body-mounted image sensor, a head-mounted image sensor, or an object-mounted image sensor.

### Claim 6 (depends on 1)

The system of claim 1, wherein a conveyance position of an image sensor is determined based on metadata associated with corresponding video content, visual analysis of the corresponding video content, manual identification of the conveyance position, or an image sensor mount for the image sensor.

### Claim 7 (depends on 1)

The system of claim 1, wherein the first highlight criterion includes a visual criterion, an audio criterion, and/or a metadata criterion.

### Claim 8 (depends on 2)

The system of claim 2, wherein the multiple video content includes first video content and second video content, the sets of highlight moments identified within individual ones of the multiple video content include a first set of highlight moments identified within the first video content and a second set of highlight moments identified within the second video content, and generating the video summary based on the first set of highlight moments and the second set of highlight moments includes:
identifying a first set of video segments from the first video content and a second set of video segments from the second video content, the first set of video segments including one or more of the first set of highlight moments and the second set of video segments including one or more of the second set of highlight moments; and
arranging one or more video segments from the first set of video segments and one or more video segments from the second set of video segments in the video summary based on times of capture of the one or more video segments from the first set of video segments and the one or more video segments from the second set of video segments.

### Claim 9 (depends on 2)

The system of claim 2, wherein the multiple video content includes first video content and second video content, the sets of highlight moments identified within individual ones of the multiple video content include a first set of highlight moments identified within the first video content and a second set of highlight moments identified within the second video content, and generating the video summary based on the first set of highlight moments and the second set of highlight moments includes:
identifying a first set of video segments from the first video content and a second set of video segments from the second video content, the first set of video segments including one or more of the first set of highlight moments and the second set of video segments including one or more of the second set of highlight moments; and
including one or more video segments from the first set of video segments and one or more video segments from the second set of video segments in the video summary, the one or more video segments from the first set of video segments and the one or more video segments from the second set of video segments including views of a same scene.

### Claim 10

A method for determining video highlights based on conveyance positions of video content capture, the method comprising:
accessing video information defining multiple video content, individual ones of the multiple video content captured by a corresponding image sensor from a corresponding conveyance position;
selecting highlight criterion for the individual ones of the multiple video content based on the corresponding conveyance positions of the corresponding image sensors that captured the individual ones of the multiple video content, wherein different highlight criterion is selected for different conveyance positions such that a first highlight criterion is selected for video content captured from a first conveyance position and a second highlight criterion is selected for video content captured from a second conveyance position different from the first conveyance position, the second highlight criterion being different from the first highlight criterion;
identifying sets of highlight moments within the individual ones of the multiple video content based on the selected highlight criterion; and
storing the identification of the sets of highlight moments.

### Claim 11 (depends on 10)

The method of claim 10, further comprising generating a video summary based on the sets of highlight moments.

### Claim 12 (depends on 10)

The method of claim 10, wherein at least two of the individual ones of the multiple video content are time synced.

### Claim 13 (depends on 10)

The method of claim 10, wherein a conveyance position of an image sensor indicates a type of the image sensor.

### Claim 14 (depends on 13)

The method of claim 13, wherein the type of the image sensor includes a handheld image sensor, a body-mounted image sensor, a head-mounted image sensor, or an object-mounted image sensor.

### Claim 15 (depends on 10)

The method of claim 10, wherein a conveyance position of an image sensor is determined based on metadata associated with corresponding video content, visual analysis of the corresponding video content, manual identification of the conveyance position, or an image sensor mount for the image sensor.

### Claim 16 (depends on 10)

The method of claim 10, wherein the first highlight criterion includes a visual criterion, an audio criterion, and/or a metadata criterion.

### Claim 17 (depends on 11)

The method of claim 11, wherein the multiple video content includes first video content and second video content, the sets of highlight moments identified within individual ones of the multiple video content include a first set of highlight moments identified within the first video content and a second set of highlight moments identified within the second video content, and generating the video summary based on the first set of highlight moments and the second set of highlight moments includes:
identifying a first set of video segments from the first video content and a second set of video segments from the second video content, the first set of video segments including one or more of the first set of highlight moments and the second set of video segments including one or more of the second set of highlight moments; and
arranging one or more video segments from the first set of video segments and one or more video segments from the second set of video segments in the video summary based on times of capture of the one or more video segments from the first set of video segments and the one or more video segments from the second set of video segments.

### Claim 18 (depends on 11)

The method of claim 11, wherein the multiple video content includes first video content and second video content, the sets of highlight moments identified within individual ones of the multiple video content include a first set of highlight moments identified within the first video content and a second set of highlight moments identified within the second video content, and generating the video summary based on the first set of highlight moments and the second set of highlight moments includes:
identifying a first set of video segments from the first video content and a second set of video segments from the second video content, the first set of video segments including one or more of the first set of highlight moments and the second set of video segments including one or more of the second set of highlight moments; and
including one or more video segments from the first set of video segments and one or more video segments from the second set of video segments in the video summary, the one or more video segments from the first set of video segments and the one or more video segments from the second set of video segments including views of a same scene.

### Claim 19

A system for determining video highlights based on conveyance positions of video content capture, the system comprising:
one or more physical processors configured by machine-readable instructions to:
access video information defining multiple video content, the individual ones of the multiple video content captured by a corresponding image sensor from a corresponding conveyance position, a conveyance position indicating a type of an image sensor, wherein at least two of the individual ones of the multiple video content are time synced;
select highlight criterion for the individual ones of the multiple video content based on the corresponding conveyance positions of the corresponding image sensors that captured the individual ones of the multiple video content such that a first highlight criterion is selected for video content captured from a first conveyance position and a second highlight criterion is selected for video content captured from a second conveyance position different from the first conveyance position, the second highlight criterion being different from the first highlight criterion;
identify sets of highlight moments within the individual ones of the multiple video content based on the selected highlight criterion; and
store the identification of the sets of highlight moments; and
generate a video summary based on the sets of highlight moments.

### Claim 20 (depends on 19)

The system of claim 19, wherein the type of the image sensor includes a handheld image sensor, a body-mounted image sensor, a head-mounted image sensor, or an object-mounted image sensor.
