# US 12,003,692 B2 · Systems, methods and apparatus for compressing video content

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,003,692 B2
- Document ID: US12003692B2
- Status: Granted
- Kind: B2
- Application number: 17/545,156
- Filed: 2021-12-08
- Published: 2022-03-31
- Granted: 2024-06-04
- Earliest claimed: 2016-04-11
- Assignees: GoPro, Inc.
- Applicants: GoPro, Inc.
- Inventors: Adeel Abbas; Balineedu Chowdary Adsumilli; David Newman
- Web page: https://patentgrep.com/patent/US12003692B2

## CPC

- H04N 13/161: Encoding, multiplexing or demultiplexing different image signal components (for multi-view video sequence encoding H04N19/597)
- H04N 13/111: Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation
- H04N 13/194: Transmission of image signals
- H04N 13/243: using three or more two-dimensional [2D] image sensors
- H04N 13/282: for generating image signals corresponding to three or more geometrical viewpoints, e.g. multi-view systems
- H04N 13/344: with head-mounted left-right displays
- H04N 19/597: specially adapted for multi-view video sequence encoding
- H04N 23/51: Housings
- H04N 23/698: for achieving an enlarged field of view, e.g. panoramic image capture
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A device includes a processor that is configured to obtain first facets of a first wide field-of-view image. An object is identified in a facet of the first facets. A second wide field-of-view image is obtained. A location of the object is identified in the second wide field-of-view image. Using the location of the object, the second wide field-of-view image is partitioned into second facets such that no boundary of any of the second facets overlaps the object. The second facets are then encoded in a compressed bitstream.

## Claims

### Claim 1

A device, comprising:
a processor configured to:
obtain first facets of a first wide field-of-view image;
identify an object in a facet of the first facets;
obtain a second wide field-of-view image;
identify a location of the object in the second wide field-of-view image;
partition, using the location of the object, the second wide field-of-view image into second facets such that no boundary of any of the second facets overlaps the object; and
encode the second facets in a compressed bitstream.

### Claim 2 (depends on 1)

The device of claim 1, wherein to encode the second facets in the compressed bitstream comprises to:
duplicate one of the second facets to obtain a duplicate facet;
obtain a frame, wherein the frame comprises the duplicate facet and the second facets, and wherein the frame comprises the one of the second facets and the duplicate facet as distinct facets; and
encode the frame.

### Claim 3 (depends on 2)

The device of claim 2, wherein to duplicate the one of the second facets to obtain the duplicate facet comprises to:
obtain a transformed facet from the one of the second facets; and
combine the transformed facet with the second facets to obtain the frame.

### Claim 4 (depends on 3)

The device of claim 3, wherein the transformed facet is obtained from the one of the second facets using at least one of a rotation operation or a translation operation.

### Claim 5 (depends on 4)

The device of claim 4, wherein the rotation operation is one of a 900 counterclockwise rotation operation, a 90° clockwise rotation operation, or a 1800 rotation operation.

### Claim 6 (depends on 2)

The device of claim 2, wherein a number of facets in the second facets is 6 and a number of facets in the frame is 12.

### Claim 7 (depends on 6)

The device of claim 6, wherein the facets of the frame are arranged in 3 rows and 4 columns.

### Claim 8 (depends on 2)

The device of claim 2, wherein a number of facets in the second facets is 6 and a number of facets in the frame is 18.

### Claim 9 (depends on 8)

The device of claim 8, wherein the facets of the frame are arranged in 3 rows and 6 columns.

### Claim 10 (depends on 1)

The device of claim 1, wherein the second wide field-of-view image is partitioned into the second facets using a projection operation.

### Claim 11

A method for reducing decoding artefacts, comprising:
performing a first cube projection operation on a first wide field-of-view image to obtain first facets;
identifying an object in one of the first facets;
performing a second cube projection operation on a second wide field-of-view image to obtain second facets,
wherein the second cube projection operation is such that no boundary of any of the second facets overlaps the object, and
wherein the second wide field-of-view image is obtained at a different time from the first wide field-of-view image; and
encoding at least one of the second facets using at least one of the first facets.

### Claim 12 (depends on 11)

The method of claim 11, wherein encoding at least one of the second facets using at least one of the first facets comprises:
obtaining a reference frame using the first facets; and
encoding the first facets using the reference frame.

### Claim 13 (depends on 12)

The method of claim 12, wherein obtaining the reference frame using the first facets comprises:
duplicating at least one of the first facets to obtain a duplicate facet; and
obtaining the reference frame, wherein the reference frame comprises the duplicate facet and the first facets, and wherein the reference frame comprises the at least one of the first facets and the duplicate facet as distinct facets.

### Claim 14 (depends on 13)

The method of claim 13, wherein the duplicate facet is obtained using at least one of a rotation operation or a translation operation.

### Claim 15 (depends on 14)

The method of claim 14, wherein the rotation operation is one of a 900 counterclockwise rotation operation, a 90° clockwise rotation operation, or a 1800 rotation operation.

### Claim 16 (depends on 13)

The method of claim 13, wherein a number of the first facets is smaller than a number of facets in the reference frame.

### Claim 17 (depends on 16)

The method of claim 16, wherein the number of the first facets is 6 and the number of facets in the reference frame is at least 10.

### Claim 18

A non-transitory computer readable medium storing instructions operable to cause one or more processors to perform operations to reduce decoding artefacts, the operations comprising to:
obtain a first image and a second image, wherein the first image and the second image are images of a wide field-of-view image;
use parallax information obtained using an overlap region between the first image and the second image to detect relative distances of a first object and a second object in at least one of the first image or the second image from one or more imaging devices used to obtain the first image and the second image, wherein the first object is detected to be farther away than the second object;
partition the wide field-of-view image into facets based on the relative distances such that no boundary of any of the facets overlaps the second object; and
encode the facets of the wide field-of-view image.

### Claim 19 (depends on 18)

The non-transitory computer readable medium of claim 18, wherein to encode the facets of the wide field-of-view image comprises to:
obtain, from one of the facets, a transformed facet, wherein the transformed facet is obtained using at least one of a rotation operation or a translation operation; and
encode at least one of the facets using the transformed facet.

### Claim 20 (depends on 19)

The non-transitory computer readable medium of claim 19, wherein the rotation operation is one of a 90° counterclockwise rotation operation, a 90° clockwise rotation operation, or a 180° rotation operation.
