Selective masking in optical flow block matching
AssigneeArm Limited
InventorsLiam James O’Neil, Yanxiang Wang, Carlos Barragán del Rey, Joshua James Sowerby, Samuel James Edward Martin
Life of this patent
Estimating the term…
Abstract
An optical flow mask is generated based, at least in part, on a calculated degree of confidence of one or more motion vectors relating a prior frame and a current frame in a rendered image sequence. A pyramidal block matching algorithm is applied to calculate an optical flow relating the prior image frame and the current image frame, where applying the pyramidal block matching excludes portions of an image sequence masked by the generated optical flow mask.
Claims20
A method, comprising:
- generating an optical flow mask based, at least in part, on a calculated degree of confidence of one or more motion vectors relating a prior frame and a current frame in a rendered image sequence;
- and
- applying a pyramidal block matching to calculate an optical flow relating the prior image frame and the current image frame, wherein applying the pyramidal block matching comprises applying the pyramidal block matching differently for portions of an image sequence masked by the generated optical flow mask.
A computing device, comprising:
- a memory comprising one more storage devices;
- and
- one or more processors coupled to the memory, the one or more processors operable to execute instructions stored in the memory to, for a rendered image sequence:
- generate an optical flow mask based, at least in part, on a calculated degree of confidence of one or more motion vectors relating a prior frame and a current frame in a rendered image sequence;
- applying a pyramidal block matching to calculate an optical flow relating the prior frame and the current frame, wherein applying the pyramidal block matching comprises applying the pyramidal block matching differently for portions of an image sequence masked by the generated optical flow mask.
A method of generating an optical flow mask for use in indicating areas of an image for which optical flow is to be calculated by:
- warping color parameters and depth parameters from a prior frame into a current frame;
- creating a color difference mask based, at least in part, on differences between warped color parameters from the prior frame and color parameters from the current frame;
- creating a depth difference mask based, at least in part, on differences between the warped depth parameters from the prior frame and depth parameters from the current frame;
- converting the depth difference mask and the color difference mask to binary masks;
- and
- calculating a difference between the depth difference mask and the color difference mask to generate the optical flow mask.
Dependencies are inferred from the claim text.