US 2018/0122052 A1Published application

Method for deblurring a video, corresponding device and computer program product

OwnerMarc Lebrun, Pierre Hellier +1inventors

InventorsMarc Lebrun, Pierre Hellier, Tomas Enrique Crivelli

Life of this patent

Estimating the term…

Loading patent…

Abstract

A method and a device for deblurring a frame of a video are provided. The method includes obtaining (10) a set of neighboring frames of a current frame wherein a global score of sharpness is greater than a sharpness threshold, generating (20) of a local blur map, delivering the local blur map, performing (30) a local warping of at least one frame of the set and of the local blur map as a function of a local motion estimation between the current frame and the at least one frame of the set, delivering at least one locally warped frame and an associated locally warped blur map and performing (40) a weighted aggregation of a part of the at least one locally warped frame and a corresponding part the current frame, based on the at least one locally warped blur map and the local blur map of the current frame.

Claims27

Dependent claims

A method for deblurring a frame (FC) of a video, the video comprising a plurality of frames (F0 . . . FX), said method comprising:

obtaining (10), from the plurality of frames (F0 . . . FX), a set of neighboring frames of the current frame wherein a global score of sharpness is greater than a predetermined sharpness threshold, called set of selected frames (FS0 . . . FSX);
for at least one of the frames of the set of selected frames (FS0, . . . FSX) and for the current frame (FC), generating (20) of a local blur map, delivering a local blur map of the at least one frame (LBM FS0 . . . LBM FSX) and a local blur map of the current frame (LBMFC);
performing (30) a local warping of the at least one frame of the set of selected frames (FS0, . . . FSX) and of the local blur map (LBM FS0 . . . LBM FSX) associated with the at least one frame as a function of a local motion estimation between the current frame (FC) and the at least one frame of the set of selected frames (FS0, . . . FSX), delivering at least one locally warped frame (LWFS0, . . . LWFSX) and an associated locally warped blur map (LWBM FS0 . . . LWBM FSX);
performing (40) a weighted aggregation of a part of the at least one locally warped frame (LWFS0, . . . LWFSX) and a corresponding part the current frame (FC), based on the at least one locally warped blur map and the local blur map of the current frame (LBMFC).

1 more element

An apparatus for deblurring a frame (FC) of a video, the video comprising a plurality of frames (F0 . . . FX), said apparatus comprising at least one processor and memory, wherein the at least one processor is configured to:

obtain (10), from the plurality of frames (F0 . . . FX), a set of neighboring frames of the current frame wherein a global score of sharpness is greater than a predetermined sharpness threshold, called set of selected frames (FS0 . . . FSX);
for at least one of the frames of the set of selected frames (FS0, . . . FSX) and for the current frame (FC), generate (20) of a local blur map, delivering a local blur map of the at least one frame (LBM FS0 . . . LBM FSX) and a local blur map of the current frame (LBMFC);
perform (30) a local warping of the at least one frame of the set of selected frames (FS0, . . . FSX) and of the local blur map (LBM FS0 . . . LBM FSX) associated with the at least one frame as a function of a local motion estimation between the current frame (FC) and the at least one frame of the set of selected frames (FS0, . . . FSX), providing at least one locally warped frame (LWFS0, . . . LWFSX) and an associated locally warped blur map (LWBM FS0 . . . LWBM FSX);
perform (40) a weighted aggregation of a part of the at least one locally warped frame (LWFS0, . . . LWFSX) and a corresponding part the current frame (FC), based on the at least one locally warped blur map and the local blur map of the current frame (LBMFC).

1 more element

Dependencies are inferred from the claim text.