US 2022/0101488 A1 · Image Processing Method and Device Therefor

Abstract

An image processing device according to one embodiment estimates optical flow information, pixel by pixel, on the basis of a reference image and input images of consecutive frames, and estimates a term corresponding to temporal consistency between the frames of the input images. The image processing device determines a mesh on the basis of the term corresponding to temporal consistency and the optical flow information, and transforms the reference image on the basis of the mesh. The image processing device preforms image blending on the basis of the input image, the transformed reference image, and mask data.

Claims20

Dependent claims

An image processing method, comprising:

receiving an input image of sequential frames;
receiving a reference image corresponding to the input image;
estimating pixel-wise optical flow information based on the input image and the reference image;
estimating a term corresponding to temporal consistency between the frames of the input image;
determining a mesh based on the term corresponding to the temporal consistency and the optical flow information;
transforming the reference image based on the mesh;
and
performing image blending based on the input image, the transformed reference image, and mask data indicating a hole comprised in the frames of the input image.

5 more elements

Dependencies are inferred from the claim text.

Facts

Application

17/429,254Filed 21 Feb 2019

Published

31 Mar 2022

Term ends

Not estimatedThe source records don’t support an estimate.

Classification17 codes

G06T 3/20
Geometric image transformations in the plane of the image: linear translation of whole images or parts thereof, e.g. panning
G06T 3/4038
Scaling of whole images or parts thereof, e.g. expanding or contracting: image mosaicing, e.g. composing plane images from plane sub-images
G06F 18/22
Analysing: matching criteria, e.g. proximity measures
G06F 18/253
Fusion techniques: of extracted features

Image Processing Method and Device Therefor

Life of this patent

Image Processing Method and Device Therefor

Life of this patent

Abstract

Claims20