Back to results
US 2024/0177279 A1Published application
Method and System for Deblurring Non-Uniformly Blurred Images
AssigneeMorgan State University
InventorsArlene Cole-Rhodes, Greig Richmond
Life of this patent
Estimating the term…
Abstract
A patch-based deblurring method to deblur images blurred in a non-uniform manner (e.g., motion blur or camera shake) uses a modified total-variation (TV) minimization algorithm to make a network specifically designed to handle non-uniform blur.
Claims3
A computer-implemented method for removing uniform or non-uniform blur from a blurred image, comprising:
- a. using a processor to pass said blurred image through a first set of C 3D-convolutional filters trained on a neural network to identify image features that are characteristic of a high-resolution image and produce a first plurality of C filtered images in which potentially high-resolution features are emphasized;
- b. using said processor to pass said first plurality of C filtered images through a second set of C 3D-convolutional filters trained on said neural network to identify said features to produce a second set of filtered images;
- c. repeating step b with subsequent sets of 3D-convolutional filters trained on said neural network to identify said features to produce subsequent sets of filtered images until a final set of filtered images is produced following a predetermined (L) repetitions of step b;
- d. using said processor to pass said final set of C filtered images (denoted Y1) to a first layer of said neural network, inputting to said first layer of said neural network a plurality of delta function filters (initial estimate of a blurring filters) (K0), and a filtered image initial estimate (G0), said first layer of said neural network generating a first set of revised estimates of the blurring filters (K1) and a first layer estimate (Z1) of said final set of filtered images (Y1), using an overlapping patch based approach,
- i. wherein said first set of C revised estimates of the blurring filters (K1) correspond to different, but overlapping regions of said original image (Y), which are fused/assembled into a first layer blurring filter solution, and
- ii. wherein said first layer of said neural network also fuses/assembles said first revised estimates of the first layer estimate (Z1) of said original image (Y);
- e. using said processor to pass a penultimate set of C filtered images (Y2) to a second layer of said neural network, inputting to said second layer of said neural network said first set of revised estimates of the blurring filters (K1) and said first set of estimates (Z1), said second layer of said neural network generating a set of second revised estimates of the blurring filters (K2) and a second set of estimates (Z2) of said penultimate set of filtered images (Y2), using said overlapping patch based approach,
- i. wherein said second set of revised estimates of the blurring filters (K2) correspond to said different but overlapping regions of said original image, and
- ii. wherein said second layer of said neural network fuses/assembles said second revised estimates of the blurring filter into a second layer blurring filter solution (K2) and a second layer estimate (Z2) of said original images (Y);
- f. repeating step e with subsequent layers of said neural network a number of times corresponding to said repetitions (L) of step b to produce a final blurring filter solutions (KL) and a final estimate (ZL) of said original images (Y);
- g. using said processor to pass said blurred original image (Y), said first set of C 3D-convolutional filters, said final blurring filter solution (KL) and said final estimate (ZL) of said original blurred image (Y) through an inverse filter to produce a final deblurred image X.
8 more elements
Dependencies are inferred from the claim text.