# US 10,313,596 B2 · Method and apparatus for correcting tilt of subject ocuured in photographing, mobile terminal, and storage medium > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,313,596 B2 - Document ID: US10313596B2 - Status: Granted - Kind: B2 - Application number: 15/538,502 - Filed: 2015-05-21 - Published: 2017-12-07 - Granted: 2019-06-04 - Earliest claimed: 2014-12-22 - Assignees: Zte Corporation - Applicants: Zte Corporation - Inventors: Yu Zhang; Jie Zhou - Web page: https://patentgrep.com/patent/US10313596B2 ## CPC - G06T 3/60: Rotation of whole images or parts thereof - G06T 5/80: Geometric correction - G06T 7/194: involving foreground-background segmentation - H04N 5/2621: {Cameras specially adapted for the electronic generation of special effects during image pickup, e.g. digital cameras, camcorders, video cameras having integrated special effects capability} - H04N 5/2628: {Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation} - H04N 23/63: by using electronic viewfinders - H04N 23/632: {for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters} - H04N 23/69: Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming - H04N 23/80: Camera processing pipelines; Components thereof - G06T 2207/10024: Color image - H04N 23/67: Focus control based on electronic image sensor signals - H04N 2201/0084: Digital still camera - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract A method and an apparatus for correcting a tilt of a subject occurred in photographing, as well as a mobile terminal and a computer storage medium are provided. In some embodiments, the method includes: after it is detected by a mobile terminal that the subject enters a viewfinder interface, identifying a boundary of a profile of the subject to obtain the profile of the subject; analyzing the profile of the subject to determine whether the subject is tilted; and performing a process for straightening and photographing on the subject to obtain a picture in which the subject is straightened if the subject is determined to be tilted. ## Claims ### Claim 1 A method for correcting a tilt of a subject occurred in photographing, comprising: in response to detecting, by a mobile terminal, the subject entering a viewfinder interface displayed on the mobile terminal, identifying a boundary of a profile of the subject to obtain the profile of the subject; analyzing the profile of the subject to determine whether the subject is tilted; and performing straightening and photographing on the subject to obtain a picture in which the subject is straightened in response to determining that the subject is tilted, wherein the performing comprises: after performing a first operation on the subject in response to determining to perform straightening and photographing, obtaining a picture in which the subject is tilted according to a received photographing instruction; and performing a second operation on the picture in which the subject is tilted to obtain the picture in which the subject is straightened; wherein performing the first operation on the subject in response to determining to perform straightening and photographing comprises: providing auxiliary lines, wherein the auxiliary lines are perpendicular to a longer side in the parallel sides of the profile of the subject, and the auxiliary lines pass through two corner points of the longer side in the parallel sides respectively; and providing arrows, wherein the arrows are directed to the auxiliary lines from two corner points of a shorter side in the parallel sides of the profile of the subject respectively, and are indicative of movement directions of the two corner points of the shorter side in the parallel sides. ### Claim 2 (depends on 1) The method according to claim 1, wherein identifying the boundary of the profile of the subject to obtain the profile of the subject comprises: comparing the subject with a background based on color and brightness, and identifying the boundary of the profile of the subject in accordance with differences between the subject and the background based on color and brightness and obtaining the profile of the subject. ### Claim 3 (depends on 2) The method according to claim 2, wherein analyzing the profile of the subject to determine whether the subject is tilted comprises: determining whether the subject is photographed as a trapezoidal subject by determining whether the profile of the subject includes parallel sides and determining that a total number of the parallel sides is two; and further determining whether to perform straightening and photographing in response to determining that the subject is photographed as the trapezoidal subject. ### Claim 4 (depends on 3) The method according to claim 3, wherein further determining whether to perform straightening and photographing in response to determining that the subject is photographed as the trapezoidal subject comprises: determining whether the subject is at a center position of the viewfinder interface and whether an area of the subject exceeds a preset percentage of the viewfinder interface; and determining to perform straightening and photographing on the trapezoidal subject in response to determining that the subject is at the center position of the viewfinder interface and the area of the subject exceeds the preset percentage of the viewfinder interface. ### Claim 5 (depends on 1) The method according to claim 1, wherein performing the second operation on the picture in which the subject is tilted to obtain the picture in which the subject is straightened comprises: based on the profile of the subject, separating the subject from the background to obtain an image in which the subject is tilted; and straightening the image in which the subject is tilted according to the arrows indicative of the movement directions of the two corner points of the shorter side in the parallel sides and obtaining the picture in which the subject is straightened. ### Claim 6 An apparatus for correcting a tilt of a subject occurred in photographing, comprising a processor configured to: identify, in response to detecting, by a mobile terminal, the subject entering a viewfinder interface displayed on the mobile terminal, a boundary of a profile of the subject to obtain the profile of the subject; analyze the profile of the subject to determine whether the subject is tilted; and perform straightening and photographing on the subject to obtain a picture in which the subject is straightened in response to determining that the subject is tilted; obtain, after performing a first operation on the subject in response to determining to perform straightening and photographing, a picture in which the subject is tilted according to a received photographing instruction; and perform a second operation on the picture in which the subject is tilted and obtain the picture in which the subject is straightened; wherein the processor is configured to perform the first operation on the subject in response to determining to perform straightening and photographing by: providing auxiliary lines, wherein the auxiliary lines are perpendicular to a longer side in the parallel sides of the profile of the subject, and the auxiliary lines pass through two corner points of the longer side in the parallel sides respectively; and providing arrows, wherein the arrows are directed to the auxiliary lines from two corner points of a shorter side in the parallel sides of the profile of the subject respectively, and are indicative of movement directions of the two corner points of the shorter side in the parallel sides. ### Claim 7 (depends on 6) The apparatus according to claim 6, wherein the processor is further configured to: determine whether the subject is photographed as a trapezoidal subject by determining whether the profile of the subject includes parallel sides and determining that a total number of the parallel sides is two; and further determine whether to perform straightening and photographing in response to determining that the subject is photographed as the trapezoidal subject. ### Claim 8 A mobile terminal, comprising a camera and a processor, wherein the processor is configured to: identify, in response to detecting, by the processor, a subject entering a viewfinder interface of the camera, a boundary of a profile of the subject to obtain the profile of the subject; to analyze the profile of the subject to determine whether the subject is tilted; perform straightening and photographing on the subject to obtain a picture in which the subject is straightened in response to determining that the subject is tilted; obtain, after performing a first operation on the subject in response to determining to perform straightening and photographing, a picture in which the subject is tilted according to a received photographing instruction; and perform a second operation on the picture in which the subject is tilted and obtain the picture in which the subject is straightened; wherein the processor is further configured to perform the first operation on the subject in response to determining to perform straightening and photographing by: providing auxiliary lines, wherein the auxiliary lines are perpendicular to a longer side in the parallel sides of the profile of the subject, and the auxiliary lines pass through two corner points of the longer side in the parallel sides respectively; and providing arrows, wherein the arrows are directed to the auxiliary lines from two corner points of a shorter side in the parallel sides of the profile of the subject respectively, and are indicative of movement directions of the two corner points of the shorter side in the parallel sides. ### Claim 9 (depends on 1) A non-transitory computer storage medium storing a plurality of computer-executable instructions, wherein the plurality of computer-executable instructions are used for executing the method according to claim 1. ### Claim 10 (depends on 9) The non-transitory computer storage medium according to claim 9, wherein identifying the boundary of the profile of the subject to obtain the profile of the subject comprises: comparing the subject with a background based on color and brightness, and identifying the boundary of the profile of the subject in accordance with differences between the subject and the background based on color and brightness and obtaining the profile of the subject. ### Claim 11 (depends on 10) The non-transitory computer storage medium according to claim 10, wherein analyzing the profile of the subject to determine whether the subject is tilted comprises: determining whether the subject is photographed as a trapezoidal subject by determining whether the profile of the subject includes parallel sides and determining that a total number of the parallel sides as two; and further determining whether to perform straightening and photographing in response to determining that the subject is photographed as the trapezoidal subject. ### Claim 12 (depends on 11) The non-transitory computer storage medium according to claim 11, wherein further determining whether to perform straightening and photographing in response to determining that the subject is photographed as the trapezoidal subject comprises: determining whether the subject is at a center position of the viewfinder interface and whether an area of the subject exceeds a preset percentage of the viewfinder interface; and determining to perform straightening and photographing on the trapezoidal subject in response to determining that the subject is at the center position of the viewfinder interface and the area of the subject exceeds the preset percentage of the viewfinder interface. ### Claim 13 (depends on 9) The non-transitory computer storage medium according to claim 9, wherein performing the second operation on the picture in which the subject is tilted to obtain the picture in which the subject is straightened comprises: based on the profile of the subject, separating the subject from the background to obtain an image in which the subject is tilted; and straightening the image in which the subject is tilted according to the arrows indicative of the movement directions of the two corner points of the shorter side in the parallel sides and obtaining the picture in which the subject is straightened.