# US 2021/0082085 A1 · Methods and apparatus for optimized stitching of overcapture content

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0082085 A1
- Document ID: US20210082085A1
- Status: Published application
- Kind: A1
- Application number: 16/237,089
- Filed: 2018-12-31
- Published: 2021-03-18
- Earliest claimed: 2018-12-31
- Assignees: GoPro, Inc.
- Applicants: GoPro, Inc.
- Inventors: Daryl Stimm; David Newman; Kyler William Schwartz; William Edward MacDonald
- Web page: https://patentgrep.com/patent/US20210082085A1

## CPC

- G06T 3/4038: Image mosaicing, e.g. composing plane images from plane sub-images
- G06T 3/12: Panospheric to cylindrical image transformations
- G06T 3/18: Image warping, e.g. rearranging pixels individually
- G06T 7/13: Edge detection
- H04N 7/08: Systems for the simultaneous or sequential transmission of more than one television signal, e.g. additional information signals, the signals occupying wholly or partially the same frequency band {, e.g. by time division (H04N7/007 takes precedence)}
- H04N 23/698: for achieving an enlarged field of view, e.g. panoramic image capture
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Apparatus and methods for optimized stitching of overcapture content. In one embodiment, the optimized stitching of the overcapture content includes capturing the overcapture content; producing overlap bands associated with the captured overcapture content; downsampling the produced overlap bands; generating derivative images from the downsampled overlap bands; generating a cost map associated with the generated derivative images; determining shortest path information for the generated cost map; generating a warp file based on the determined shortest path information, the generated warp file being utilized for the optimized stitching of the overcapture content. Camera apparatus and a non-transitory computer-readable apparatus are also disclosed.

## Claims

### Claim 1

A method for optimized stitching of overcapture content, the method comprising:
capturing the overcapture content;
producing overlap bands associated with the captured overcapture content;
downsampling the produced overlap bands;
generating derivative images from the downsampled overlap bands;
generating a cost map associated with the generated derivative images;
determining shortest path information for the generated cost map;
generating a warp file based on the determined shortest path information, the generated warp file being utilized for the optimized stitching of the overcapture content.

### Claim 2 (depends on 1)

The method of claim 1, further comprising generating a plurality of fisheye images from the captured overcapture content.

### Claim 3 (depends on 2)

The method of claim 2, further comprising projecting the produced overlap bands into an equirectangular projection.

### Claim 4 (depends on 2)

The method of claim 2, further comprising transmitting the generated warp file and the generated plurality of fisheye images to another device.

### Claim 5 (depends on 2)

The method of claim 2, further comprising stitching the plurality of fisheye images from the captured overcapture content and transmitting the stitched fisheye images and the generated warp file to another device.

### Claim 6 (depends on 5)

The method of claim 5, wherein the transmitting of the generated warp file to the another device enables re-stitching of the stitched fisheye images.

### Claim 7 (depends on 1)

The method of claim 1, wherein the generating of the warp file comprises generating a plurality of integer values, the generated plurality of integer values being associated with displacement values associated with a stitch line for the captured overcapture content.

### Claim 8

A camera apparatus comprising:
two or more image capture devices;
a network interface in data communication with the two or more image capture devices; and
an image processing pipeline that is configured to:
receive captured content from the two or more image capture devices;
perform edge detection on the received captured content; and
generate a warp track file associated with the received captured content the generated warp track file being utilized for stitching of the received captured content.

### Claim 9 (depends on 8)

The camera apparatus of claim 8, wherein the generation of the warp track file by the image processing pipeline comprises:
production of overlap bands associated with the received captured content;
downsample of the produced overlap bands;
generation of derivative images from the downsampled overlap bands;
generation of a cost map associated with the generated derivative images; and
determination of shortest path information for the generated cost map.

### Claim 10 (depends on 9)

The camera apparatus of claim 9, wherein the generated warp track file and the captured content from the two or more image capture devices are transmitted via the network interface to another device.

### Claim 11 (depends on 10)

The camera apparatus of claim 10, wherein the transmission of the generated warp track file and the transmission of the captured content to the another device enables re-stitching of the captured content.

### Claim 12 (depends on 10)

The camera apparatus of claim 10, wherein the generation of the warp file comprises generation of a plurality of integer values, the generated plurality of integer values being associated with displacement values associated with a stitch line for the captured content.

### Claim 13 (depends on 8)

The camera apparatus of claim 8, wherein the receipt of the captured content comprises receipt of fisheye projections.

### Claim 14 (depends on 13)

The camera apparatus of claim 13, wherein the image processing pipeline is further configured to stitch the fisheye projections and the camera apparatus is configured to transmit the stitched fisheye projections and the generated warp file to another device via the network interface.

### Claim 15 (depends on 14)

The camera apparatus of claim 14, wherein the transmission of the generated warp track file and the transmission of the stitched fisheye projections to the another device enables a re-stitch of the stitched fisheye projections.

### Claim 16

A non-transitory computer-readable apparatus comprising a storage medium having a computer program stored thereon, the computer program comprising a plurality of instructions configured to, when executed by a processor apparatus, cause an apparatus to:
receive captured content from two or more image capture devices;
perform edge detection on the received captured content; and
generate a warp file associated with the received captured content, the generated warp file being utilized for stitching of the received captured content.

### Claim 17 (depends on 16)

The non-transitory computer-readable apparatus of claim 16, wherein the receipt of the captured content comprises receipt of fisheye projections.

### Claim 18 (depends on 17)

The non-transitory computer-readable apparatus of claim 17, wherein the plurality of instructions, when executed by the processor apparatus, are further configured to stitch the fisheye projections and transmit the stitched fisheye projections and the generated warp file to another device via a network interface.

### Claim 19 (depends on 18)

The non-transitory computer-readable apparatus of claim 18, wherein the transmission of the generated warp file and the transmission of the stitched fisheye projections to the another device enables a re-stitch of the stitched fisheye projections.

### Claim 20 (depends on 16)

The non-transitory computer-readable apparatus of claim 16, wherein the generation of the warp file comprises:
production of overlap bands associated with the received captured content;
downsample of the produced overlap bands;
generation of derivative images from the downsampled overlap bands;
generation of a cost map associated with the generated derivative images; and
determination of shortest path information for the generated cost map.
