US 10,652,472 B2 · Enhanced automatic perspective and horizon correction

Abstract

Embodiments relate to automatic perspective and horizon correction. Generally, a camera captures an image as an image file. Capture-time orientation data from one or more sensors is used to determine the camera's attitude with respect to a defined reference frame. The orientation data and/or attitude can be registered into metadata of the image file and used to generate axis lines representative of the camera's reference frame. A reference line such as a horizon can be automatically identified from detected line segments in the image that align with one of the axis lines within a predetermined angular threshold. The reference line can be used to generate a camera transformation from a starting orientation reflected by the camera attitude to a transformed orientation that aligns the reference line with the reference frame. The transformation can be applied to the image to automatically correct perspective distortion and/or horizon tilt in the image.

Claims20

Dependent claims

One or more computer storage media storing computer-useable instructions that, when used by one or more computing devices, cause the one or more computing devices to perform operations comprising:

capturing an image as an image file with the one or more computing devices;
accessing capture-time orientation data from one or more sensors associated with the one or more computing devices;
determining, based on the capture-time orientation data, a capture-time attitude of the one or more computing devices with respect to a defined reference frame;
automatically identifying a reference line from the image using the capture-time attitude of the one or more computing devices;
and
generating target parameters for a camera transformation from a starting orientation reflected by the capture-time attitude to a transformed orientation that aligns the reference line with the reference frame.

3 more elements

A computer system comprising:

one or more hardware processors and memory configured to provide computer program instructions to the one or more hardware processors;
a camera module comprising a photo sensor, wherein the camera module is configured to capture an image as an image file;
an attitude component configured to:
access capture-time orientation data from one or more sensors associated with the camera module;
and
determine, based on the capture-time orientation data, a capture-time attitude of the one or more computing devices with respect to a defined reference frame;
and
a means for automatically generating target parameters for a camera transformation based on the capture-time orientation data.

5 more elements

Dependencies are inferred from the claim text.

Enhanced automatic perspective and horizon correction

Life of this patent

Enhanced automatic perspective and horizon correction

Life of this patent

Abstract

Claims20