# US 11,445,110 B2 · Image capture device with a spherical capture mode and a non-spherical capture mode

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,445,110 B2
- Document ID: US11445110B2
- Status: Granted
- Kind: B2
- Application number: 17/153,586
- Filed: 2021-01-20
- Published: 2021-05-13
- Granted: 2022-09-13
- Earliest claimed: 2019-03-08
- Assignees: GoPro, Inc.
- Applicants: GoPro, Inc.
- Inventors: Nicholas Ryan Gilmour; David Newman
- Web page: https://patentgrep.com/patent/US11445110B2

## CPC

- H04N 23/698: for achieving an enlarged field of view, e.g. panoramic image capture
- G03B 37/04: with cameras or projectors providing touching or overlapping fields of view
- G06F 9/30003: {Arrangements for executing specific machine instructions}
- H04N 13/106: Processing image signals (for multi-view video sequence encoding H04N19/597)
- H04N 13/239: using two two-dimensional [2D] image sensors having a relative position equal to or related to the interocular distance (H04N13/243 takes precedence)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G03B: APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR (optical parts of such apparatus G02B; photosensitive materials or processes for photographic purposes G03C; apparatus for processing exposed photographic materials G03D)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

An image capture device may switch operation between a spherical capture mode or a non-spherical capture mode. Operation of the image capture device in the spherical capture mode includes generation of spherical visual content based on the visual content generated by multiple image sensors. Operation of the image capture device in the non-spherical capture mode includes generation of non-spherical visual content based on visual content generated by a single image sensor.

## Claims

### Claim 1

An image capture device comprising:
a housing;
a first image sensor carried by the housing and configured to generate a first output signal conveying first visual information based on light that becomes incident thereon, the first visual information defining first visual content;
a second image sensor carried by the housing and configured to generate a second output signal conveying second visual information based on light that becomes incident thereon, the second visual information defining second visual content;
a first optical element configured to guide light within a first field of view to the first image sensor, the first field of view being greater than 180 degrees, the first optical element being carried by the housing;
a second optical element configured to guide light within a second field of view to the second image sensor, the second field of view being greater than 180 degrees, the second optical element being carried by the housing such that a peripheral portion of the first field of view and a peripheral portion of the second field of view overlap, the overlap of the peripheral portion of the first field of view and the peripheral portion of the second field of view enabling spherical capture of visual content based on the first visual content and the second visual content; and
one or more physical processors carried by the housing, the one or more physical processors configured by machine-readable instructions to:
operate the image capture device in a spherical capture mode, wherein an operation of the image capture device in the spherical capture mode includes generation of spherical visual content based on stitching of the first visual content and the second visual content;
operate the image capture device in a non-spherical capture mode, wherein an operation of the image capture device in the non-spherical capture mode includes generation of non-spherical visual content that includes an extent of the first visual content, wherein the operation of the image capture device in the non-spherical capture mode further includes combination of the extent of the first visual content and an extent of the second visual content within the non-spherical visual content, the extent of the first visual content and the extent of the second visual content being time-synchronized based on operation of the first image sensor and the second image sensor by the image capture device, the extent of the second visual content providing a selfie-view of a user; and
switch between the operation of the image capture device in the spherical capture mode and the operation of the image capture device in the non-spherical capture mode.

### Claim 2 (depends on 1)

The image capture device of claim 1, wherein the extent of the first visual content and the extent of the second visual content are spatially arranged within the non-spherical visual content for simultaneous presentation.

### Claim 3 (depends on 1)

The image capture device of claim 1, wherein the extent of the first visual content and the extent of the second visual content are temporally arranged within the non-spherical visual content for sequential presentation.

### Claim 4 (depends on 3)

The image capture device of claim 3, wherein the extent of the first visual content and the extent of the second visual content are temporally arranged for sequential presentation based on audio associated with the second visual content indicating a depicting of interest occurring within the first visual content.

### Claim 5 (depends on 1)

The image capture device of claim 1, wherein the operation of the image capture device automatically switches from the spherical capture mode to the non-spherical capture mode based on the second optical element being covered, covering of the second optical element determined based on the second visual content being dark.

### Claim 6 (depends on 1)

The image capture device of claim 1, wherein the operation of the image capture device automatically switches between the spherical capture mode and the non-spherical capture mode based on similarity between the first visual content and the second visual content.

### Claim 7 (depends on 6)

The image capture device of claim 6, wherein the operation of the image capture device automatically switches from the non-spherical capture mode to the spherical capture mode based on the first visual content and the second visual content being similar.

### Claim 8 (depends on 6)

The image capture device of claim 6, wherein the operation of the image capture device automatically switches from the spherical capture mode to the non-spherical capture mode based on the first visual content and the second visual content being dissimilar.

### Claim 9

A method for operating an image capture device, the image capture device including a first image sensor configured to generate a first output signal conveying first visual information based on light that becomes incident thereon via a first optical element having a first field of view, the first visual information defining first visual content, a second image sensor configured to generate a second output signal conveying second visual information based on light that becomes incident thereon via a second optical element having a second field of view, the method comprising:
operating the image capture device in a spherical capture mode, wherein an operation of the image capture device in the spherical capture mode includes generation of spherical visual content based on stitching of the first visual content and the second visual content;
operating the image capture device in a non-spherical capture mode, wherein an operation of the image capture device in the non-spherical capture mode includes generation of non-spherical visual content that includes an extent of the first visual content, wherein the operation of the image capture device in the non-spherical capture mode further includes combination of the extent of the first visual content and an extent of the second visual content within the non-spherical visual content, the extent of the first visual content and the extent of the second visual content being time-synchronized based on operation of the first image sensor and the second image sensor by the image capture device, the extent of the second visual content providing a selfie-view of the user; and
switching between the operation of the image capture device in the spherical capture mode and the operation of the image capture device in the non-spherical capture mode.

### Claim 10 (depends on 9)

The method of claim 9, wherein the extent of the first visual content and the extent of the second visual content are spatially arranged within the non-spherical visual content for simultaneous presentation.

### Claim 11 (depends on 9)

The method of claim 9, wherein the extent of the first visual content and the extent of the second visual content are temporally arranged within the non-spherical visual content for sequential presentation.

### Claim 12 (depends on 11)

The method of claim 11, wherein the extent of the first visual content and the extent of the second visual content are temporally arranged for sequential presentation based on audio associated with the second visual content indicating a depicting of interest occurring within the first visual content.

### Claim 13 (depends on 9)

The method of claim 9, wherein the operation of the image capture device automatically switches from the spherical capture mode to the non-spherical capture mode based on the second optical element being covered, covering of the second optical element determined based on the second visual content being dark.

### Claim 14 (depends on 9)

The method of claim 9, wherein the operation of the image capture device automatically switches between the spherical capture mode and the non-spherical capture mode based on similarity between the first visual content and the second visual content.

### Claim 15 (depends on 14)

The method of claim 14, wherein the operation of the image capture device automatically switches from the non-spherical capture mode to the spherical capture mode based on the first visual content and the second visual content being similar.

### Claim 16 (depends on 14)

The method of claim 14, wherein the operation of the image capture device automatically switches from the spherical capture mode to the non-spherical capture mode based on the first visual content and the second visual content being dissimilar.

### Claim 17

An image capture device comprising:
a housing;
a first image sensor carried by the housing and configured to generate a first output signal conveying first visual information based on light that becomes incident thereon, the first visual information defining first visual content;
a second image sensor carried by the housing and configured to generate a second output signal conveying second visual information based on light that becomes incident thereon, the second visual information defining second visual content;
a first optical element configured to guide light within a first field of view to the first image sensor, the first field of view being greater than 180 degrees, the first optical element being carried by the housing;
a second optical element configured to guide light within a second field of view to the second image sensor, the second field of view being greater than 180 degrees, the second optical element being carried by the housing such that a peripheral portion of the first field of view and a peripheral portion of the second field of view overlap, the overlap of the peripheral portion of the first field of view and the peripheral portion of the second field of view enabling spherical capture of visual content based on the first visual content and the second visual content; and
one or more physical processors carried by the housing, the one or more physical processors configured by machine-readable instructions to:
operate the image capture device in a spherical capture mode, wherein an operation of the image capture device in the spherical capture mode includes generation of spherical visual content based on stitching of the first visual content and the second visual content;
operate the image capture device in a non-spherical capture mode, wherein an operation of the image capture device in the non-spherical capture mode includes generation of non-spherical visual content that includes an extent of the first visual content, wherein the operation of the image capture device in the non-spherical capture mode further includes combination of the extent of the first visual content and an extent of the second visual content within the non-spherical visual content, the extent of the first visual content and the extent of the second visual content being time-synchronized based on operation of the first image sensor and the second image sensor by the image capture device, the extent of the second visual content providing a selfie-view of a user, wherein the extent of the first visual content and the extent of the second visual content are spatially arranged within the non-spherical visual content for simultaneous presentation or the extent of the first visual content and the extent of the second visual content are temporally arranged within the non-spherical visual content for sequential presentation; and
switch between the operation of the image capture device in the spherical capture mode and the operation of the image capture device in the non-spherical capture mode.

### Claim 18 (depends on 17)

The image capture device of claim 17, wherein the extent of the first visual content and the extent of the second visual content are temporally arranged for sequential presentation based on audio associated with the second visual content indicating a depicting of interest occurring within the first visual content.

### Claim 19 (depends on 17)

The image capture device system of claim 17, wherein the operation of the image capture device automatically switches from the spherical capture mode to the non-spherical capture mode based on the second optical element being covered, covering of the second optical element determined based on the second visual content being dark.

### Claim 20 (depends on 17)

The image capture device of claim 17, wherein the operation of the image capture device automatically switches between the spherical capture mode and the non-spherical capture mode based on similarity between the first visual content and the second visual content, wherein:
the operation of the image capture device automatically switches from the non-spherical capture mode to the spherical capture mode based on the first visual content and the second visual content being similar; and
the operation of the image capture device automatically switches from the spherical capture mode to the non-spherical capture mode based on the first visual content and the second visual content being dissimilar.
