US 2021/0264565 A1 · APPARATUS AND METHODS FOR MULTI-RESOLUTION IMAGE STITCHING

Abstract

Systems and methods for providing panoramic image and/or video content using multi-resolution stitching. Panoramic content may include stitched spherical (360-degree) images and/or VR video. In some implementations, multi-resolution stitching functionality may be embodied in a spherical image capture device that may include two lenses configured to capture pairs of hemispherical images. The capture device may obtain images (e.g., representing left and right hemispheres) that may be characterized by 180-degree (or greater) field of view. Source images may be combined using multi-resolution stitching methodology. Source images may be transformed to obtain multiple image components characterized by two or more image resolutions. The stitched image may be encoded using selective encoding methodology including: partitioning source images into a low resolution/frequency and a high resolution/frequency components; stitching low resolution/frequency components using coarse stitching operation, stitching high resolution/high frequency components using a refined stitch operation; combining stitched LF components and stitched HF components.

Claims20

Dependent claims

A non-transitory computer-readable medium comprising a plurality of computer-readable instructions configured to, when executed by one or more processor apparatus, cause a device configured to provide a panoramic image to:

receive at least one high-resolution input image from a capture device;
generate a first downsampled image, a second downsampled image, a first residual image, and a second residual image by transforming the at least one high-resolution input image;
generate a combined downsampled image by combining the first downsampled image with the second downsampled image;
generate a combined residual image by combining the first residual image with the second residual image;
and
generate the panoramic image by combining the combined downsampled image with the combined residual image.

3 more elements

A device for providing a panoramic image, the device comprising:

a non-transitory computer-readable medium comprising computer-readable instructions configured to, when executed by processor apparatus, cause the device to:
obtain a high-resolution input image from a capture device;
obtain a first image component from a decomposition of the high-resolution input image, the first image component having a resolution;
obtain a second image component, a third image component, and a fourth image component from the decomposition of the high-resolution input image, the second image component, the third image component, and the fourth image component having another resolution;
and
generate a multi-resolution image by combining the first, second, third, and fourth image components.

3 more elements

Dependencies are inferred from the claim text.

Apparatus and methods for multi-resolution image stitching

Life of this patent

Apparatus and methods for multi-resolution image stitching

Life of this patent

Abstract

Claims20