US 12,462,333 B2Granted

Systems and methods for fusing images

AssigneeQUALCOMM Incorporated

InventorsJames Wilson Nash, Kalin Mitkov Atanassov, Sergiu Radu Goma

Life of this patent

Estimating the term…

Loading patent…

Abstract

A method performed by an electronic device is described. The method includes obtaining a first image from a first camera, the first camera having a first focal length and a first field of view. The method also includes obtaining a second image from a second camera, the second camera having a second focal length and a second field of view disposed within the first field of view. The method further includes aligning at least a portion of the first image and at least a portion of the second image to produce aligned images. The method additionally includes fusing the aligned images based on a diffusion kernel to produce a fused image. The diffusion kernel indicates a threshold level over a gray level range. The method also includes outputting the fused image. The method may be performed for each of a plurality of frames of a video feed.

Claims20

Dependent claims

An apparatus comprising:

at least one memory;
and
at least one processor coupled to the at least one memory and configured to:
select, for a fused image, pixels from a first area of a first image obtained using a first type of lens;
select, for the fused image, pixels from a first area of a second image obtained using a second type of lens that is different than the first type of lens, wherein the first area of the first image and the first area of the second image are within a region of interest, wherein a portion of the region of interest is outside of the first image and is smaller than the second image, and wherein the first area of the second image obtained using the second type of lens is used to fill in the portion of the region of interest not captured in the first area of the first image obtained using the first type of lens;
blend pixels in a second area of the first image and pixels in a second area of the second image to obtain blended pixels;
and
include the pixels from the first area of the first image, the pixels from the first area of the second image, and the blended pixels in the fused image.

5 more elements

Dependencies are inferred from the claim text.

Facts

Application: 18/463,179Filed 7 Sep 2023 · continuation
Priority: 30 Sep 2016
Published: US 2023/0419437 A128 Dec 2023
Granted: 4 Nov 2025
Term ends: Not estimatedThe source records don’t support an estimate.

Classification22 codes

G06T 3/053
Context-preserving transformations, e.g. by using an importance map: detail-in-context presentations
G06F 18/22
Analysing: matching criteria, e.g. proximity measures
G06T 3/4038
Scaling of whole images or parts thereof, e.g. expanding or contracting: image mosaicing, e.g. composing plane images from plane sub-images
G06T 5/20
Image enhancement or restoration: using local operators

Family

Application62/402,182Us provisional application · filed 30 Sep 2016
Application15/498,905Parent of this continuation · filed 27 Apr 2017
Application16/375,795Parent of this continuation · filed 4 Apr 2019
US 2023/0419437 A1Pre-grant publication · published 28 Dec 2023
US 11,790,481 B2Parent of this continuation
US 10,297,034 B2Parent of this continuation
US 2018/0096487 A1Published application
US 2019/0236794 A1Published application
US 12,462,333 B2This patent

From the US filing history. Foreign family members aren’t listed.