Intermediate frame occlusion estimation system using projected vectors
AssigneeSTMicroelectronics S.r.l.
InventorGordon Petrides
Life of this patent
Estimating the term…
Abstract
In one embodiment, a method is provided for performing motion compensated interpolation wherein, for any pixels in the interpolated frame to which there is neither a forward vector nor a backward vector projecting: including the pixel in an intermediate frame conceal area if it is not located within the full frame reveal area; including the pixel in an intermediate frame reveal area if it is not located within the full frame conceal area; and using the intermediate frame conceal and reveal areas to interpolate values for pixels within an area of the interpolated frame.
Claims18
A method for performing motion compensated interpolation using a previous frame and a current frame of a displayable output, the method comprising:
- determining full frame occlusion areas of the displayable output by locating full frame conceal areas where pixels of the previous frame have no match in the current frame and full frame reveal areas where pixels of the current frame have no match in the previous frame;
- determining intermediate frame occlusion areas of an interpolated frame of the displayable output by locating intermediate frame conceal areas based on projected locations of pixels within the full frame conceal areas using forward motion vectors and information about a time slot for the interpolated frame, and by locating intermediate frame reveal areas based on projected locations of pixels within the full frame reveal areas using backward motion vectors and information about the time slot for the interpolated frame;
- for any pixels in the interpolated frame to which there is neither a forward vector nor a backward vector projecting:
- including the pixel in an intermediate frame conceal area if it is not located within the full frame reveal area;
- including the pixel in an intermediate frame reveal area if it is not located within the full frame conceal area;
- and
- using the intermediate frame conceal and reveal areas to interpolate values for pixels within an area of the interpolated frame.
An intermediate frame occlusion estimation system comprising:
- a forward data store containing an entry for each pixel in an intermediate frame to be interpolated from a current and previous frame of displayable output;
- a backward data store containing an entry for each pixel in the intermediate frame;
- a full frame occlusion generator configured to:
- determine full frame occlusion areas of the displayable output by locating full frame conceal areas where pixels of the previous frame have no match in the current frame and full frame reveal areas where pixels of the current frame have no match in the previous frame;
- an intermediate frame occlusion generator configured to:
- determine intermediate frame occlusion areas of the interpolated frame by locating intermediate frame conceal areas based on projected locations of pixels within the full frame conceal areas using motion vectors and information about a time slot for the interpolated frame, and by locating intermediate frame reveal areas based on projected locations of pixels within the full frame reveal areas using backward motion vectors and information about the time slot for the interpolated frame;
- for any pixels in the interpolated frame to which there is neither a forward vector nor a backward vector projecting:
- include the pixel in an intermediate frame conceal area if it is not located within the full frame reveal area;
- and
- include the pixel in an intermediate frame reveal area if it is not located within the full frame conceal area.
The intermediate frame occlusion estimation system of claim 13, further comprising a histogram filter coupled to the intermediate frame occlusion generator, the forward data store and the backward data store.
An apparatus for performing motion compensated interpolation using a previous frame and a current frame of a displayable output, the apparatus comprising:
- means for determining full frame occlusion areas of the displayable output by locating full frame conceal areas where pixels of the previous frame have no match in the current frame and full frame reveal areas where pixels of the current frame have no match in the previous frame;
- means for determining intermediate frame occlusion areas of an interpolated frame of the displayable output by locating intermediate frame conceal areas based on projected locations of pixels within the full frame conceal areas using motion vectors and information about a time slot for the interpolated frame, and by locating intermediate frame reveal areas based on projected locations of pixels within the full frame reveal areas using backward motion vectors and information about the time slot for the interpolated frame;
- means for, for any pixels in the interpolated frame to which there is neither a forward vector nor a backward vector projecting:
- including the pixel in an intermediate frame conceal area if it is not located within the full frame reveal area;
- including the pixel in an intermediate frame reveal area if it is not located within the full frame conceal area;
- and
- means for using the intermediate frame conceal and reveal areas to interpolate values for pixels within an area of the interpolated frame.
A computer chip configured to:
- determine full frame occlusion areas of the displayable output by locating full frame conceal areas where pixels of the previous frame have no match in the current frame and full frame reveal areas where pixels of the current frame have no match in the previous frame;
- determine intermediate frame occlusion areas of an interpolated frame of the displayable output by locating intermediate frame conceal areas based on projected locations of pixels within the full frame conceal areas using motion vectors and information about a time slot for the interpolated frame, and by locating intermediate frame reveal areas based on projected locations of pixels within the full frame reveal areas using backward motion vectors and information about the time slot for the interpolated frame;
- for any pixels in the interpolated frame to which there is neither a forward vector nor a backward vector projecting:
- include the pixel in an intermediate frame conceal area if it is not located within the full frame reveal area;
- include the pixel in an intermediate frame reveal area if it is not located within the full frame conceal area;
- and
- use the intermediate frame conceal and reveal areas to interpolate values for pixels within an area of the interpolated frame.
Dependencies are inferred from the claim text.