US 2016/0253784 A1Published application

System for video super resolution using semantic components

AssigneeSharp Laboratories of America, Inc.

InventorsXu CHEN, Anustup Kumar A. CHOUDHURY, Christopher A. SEGALL, Petrus J.L. VAN BEEK

Life of this patent

Estimating the term…

Loading patent…

Abstract

A method for increasing the resolution of a series of low resolution frames of a low resolution video sequence to a series of high resolution frames of a high resolution video sequence includes receiving the series of low resolution frames of the video sequence. The system determines a first plurality of semantically relevant key points of a first low resolution frame of the series of low resolution frames and determines a second plurality of semantically relevant key points of a second low resolution frame of the series of low resolution frames. The system temporally processes the first plurality of key points based upon the second plurality of key points to determine a more temporally consistent set of key points for the first plurality of key points.

Claims13

Dependent claims

A method for modifying the resolution of a series of frames of a video sequence using an image processing system comprising:

(a) receiving said series of frames of said video sequence by said image processing system;
(b) determining a first plurality of key points of a first frame of said series of frames based upon semantic content of said first frame of said series of frames by said image processing system;
(c) based on said first plurality of key points, determining a first set of candidate images in a database that match a semantic region of said first frame;
(d) determining a second plurality of key points of a second frame of said series of frames based upon semantic content of said second frame of said series of frames by said image processing system;
(e) based on said second plurality of key points, determining a second set of candidate images in said database that match a semantic region of said second frame;
(f) selecting a selected candidate image in said database, based on said first set of candidate images and said second set of candidate images;
(g) modifying said resolution of said second frame of said series of frames based on said selected candidate image in said database.

4 more elements

Dependencies are inferred from the claim text.

Facts

Application: 15/154,058Filed 13 May 2016
Priority: 11 Dec 2014
Published: 1 Sep 2016
Term ends: Not estimatedThe source records don’t support an estimate.

Classification10 codes

G06T 3/10
Geometric image transformations in the plane of the image: selection of transformation methods according to the characteristics of the input images
G06T 3/4007
Scaling of whole images or parts thereof, e.g. expanding or contracting: based on interpolation, e.g. bilinear interpolation
G06T 5/73
Image enhancement or restoration: deblurring; Sharpening
G06T 7/33
Determination of transform parameters for the alignment of images, i.e. image registration: using feature-based methods

Family

Application14/567,891Continuation · filed 11 Dec 2014
Application15/154,058Continuation
US 2016/0171656 A1Published application
US 9,367,897 B1Related patent
US 9,727,974 B2Related patent
US 2016/0253784 A1This patent

From the US filing history. Foreign family members aren’t listed.

Timeline

Citations

Open elsewhere

Building an agent or pulling many patents? Use the API or MCP server instead of scraping pages. Get an API key