Adaptive dewarping of wide angle video frames
AssigneeMeta Platforms, Inc.
InventorsJosiah Vincent Vivona, Ted Taejin Kim, Eric W. Hwang
Life of this patent
Estimating the term…
Abstract
A video system processes video frames from a wide angle camera to dewarp the video frames in a manner that preserves conformity of an object of interest. A crop region of a video frame corresponding to the object of interest is determined. An input parameter to a dewarping function is generated based on the detected crop region. The dewarping function is applied to the crop region using the input parameter to generate a dewarped video frame and the dewarped video frame is outputted. The input parameter may be generated in a manner that causes the dewarped video frame to have higher conformity and lower distortion in the region around the object of interest than in a region distant from the object of interest.
Claims20
A method comprising:
- receiving an image captured by a camera including an object;
- determining a vertical distance between a position of the object in the image and a top of the image;
- determining a tilt parameter as a function of the vertical distance and as a difference between a first tilt parameter component associated with the object and a second tilt parameter component associated with the camera, wherein, for at least a middle range of vertical distances, the tilt parameter increases non-linearly with an increasing vertical distance between a first predefined tilt parameter value and a second predefined tilt parameter value;
- applying a dewarping function to project a point representing the object in the image to a projected point in a dewarped image such that a vertical position of the point is adjusted using the tilt parameter and is projected to an output vertical position of the projected point in the dewarped image;
- and
- outputting the dewarped image.
A non-transitory computer-readable storage medium storing instructions executable by one or more processors, the instructions when executed causing the one or more processors to perform steps including:
- receiving an image captured by a camera including an object;
- determining a vertical distance between a position of the object in the image and a top of the image;
- determining a tilt parameter as a function of the vertical distance and as a difference between a first tilt parameter component associated with the object and a second tilt parameter component associated with the camera, wherein for at least a middle range of vertical distances, the tilt parameter increases non-linearly with increasing vertical distance between a first predefined tilt parameter value and a second predefined tilt parameter value;
- applying a dewarping function to project a point representing the object in the image to a projected point in a dewarped image such that a vertical position of the point is adjusted using the tilt parameter and is projected to an output vertical position of the projected point in the dewarped image;
- and
- outputting the dewarped image.
A computer system comprising:
- one or more processors;
- and
- a non-transitory computer-readable storage medium storing instructions executable by the one or more processors, the instructions when executed causing the one or more processors to perform steps including:
- receiving an image captured by a camera including an object;
- determining a vertical distance between a position of the object in the image and a top of the image;
- determining a tilt parameter as a function of the vertical distance and as a difference between a first tilt parameter component associated with the object and a second tilt parameter component associated with the camera, wherein for at least a middle range of vertical distances, the tilt parameter increases non-linearly with increasing vertical distance between a first predefined tilt parameter value and a second predefined tilt parameter value;
- applying a dewarping function to project a point representing the object in the image to a projected point in a dewarped image such that a vertical position of the point is adjusted using the tilt parameter and is projected to an output vertical position of the projected point in the dewarped image;
- and
- outputting the dewarped image.
Dependencies are inferred from the claim text.