US 2018/0027226 A1 · SYSTEMS AND METHODS FOR PROVIDING A CUBIC TRANSPORT FORMAT FOR MULTI-LENS SPHERICAL IMAGING

Abstract

Apparatus and methods for providing a frame packing arrangement for the encoding/decoding of, for example, panoramic content. In one embodiment, the frame packing arrangement utilizes overlapping imaging data so as to enable, for example, a post-decode stitching operation to be performed. The frame packing arrangement may utilize a number of projection formats, such as a cubemap projection, and may utilize any number of differing aspect ratios such as, without limitation, 4×3, 3×2, 4×2, 2×4 aspect ratios. Additionally, the overlapping imaging data may be positioned within the frame packing arrangement chosen so as to improve upon coding efficiency. For example, the overlapping imaging data may be positioned within the frame packing arrangement so as to emphasize image continuity. An encoder apparatus and decoder apparatus for use with the aforementioned frame packing arrangements are also disclosed.

Claims20

Dependent claims

A method for encoding a panoramic image, the method comprising:

receiving a panoramic image that has been captured by two or more image capture devices, the panoramic image comprising an overlapping portion that has been captured by at least two of the two or more image capture devices;
arranging non-overlapping portions of the panoramic image into a transport format;
arranging the overlapping portion of the panoramic image within the transport format;
and
encoding the arranged non-overlapping portions and the arranged overlapping portion of the panoramic image.

2 more elements

An encoder apparatus, the encoder apparatus comprising:

a processor apparatus;
and
a non-transitory computer-readable storage apparatus, the computer-readable storage apparatus comprising a storage medium comprising computer-readable instructions, the computer-readable instructions being configured to, when executed by the processor apparatus:
receive a panoramic image that has been captured by two or more image capture devices, the panoramic image comprising an overlapping portion that has been captured by at least two of the two or more image capture devices;
arrange non-overlapping portions of the panoramic image into a transport format;
arrange the overlapping portion of the panoramic image within the transport format;
and
encode the arranged non-overlapping portions and the arranged overlapping portion of the panoramic image in order to produce an encoded image.

5 more elements

Dependencies are inferred from the claim text.

Facts

Application

15/654,617Filed 19 Jul 2017

Priority

19 Jul 2016

Published

25 Jan 2018

Term ends

Not estimatedThe source records don’t support an estimate.

Classification27 codes

G06T 3/073
Topological mapping of higher dimensional structures onto lower dimensional surfaces: transforming surfaces of revolution to planar images, e.g.…
G06F 18/22
Analysing: matching criteria, e.g. proximity measures
G06T 3/14
Geometric image transformations in the plane of the image: transformations for image registration, e.g. adjusting or mapping for alignment of images
G06T 3/20
Geometric image transformations in the plane of the image: linear translation of whole images or parts thereof, e.g. panning

Systems and methods for providing a cubic transport format for multi-lens spherical imaging

Life of this patent

Systems and methods for providing a cubic transport format for multi-lens spherical imaging

Life of this patent

Abstract

Claims20