Image processing apparatus, image capturing apparatus, image processing method, and storage medium

An image capturing apparatus comprising one or more processors and a memory storing a program which, when executed by the one or more processors, causes the image capturing apparatus to function as:

• an image capturing unit configured to generate an image;
• a line segment detecting unit configured to detect line segments from an image;
• an obtainment unit configured to obtain distance information indicating a distance in a depth direction of the image;
• a selecting unit configured to select a line segment for vanishing point detection from the line segments detected by the line segment detecting unit;
• a vanishing point detecting unit configured to detect a vanishing point of the image on a basis of the line segment for vanishing point detection, wherein the vanishing point detecting unit detects a point of intersection of straight lines including the line segment for vanishing point detection as the vanishing point;
• and
• a determining unit configured to determine a confidence level of the vanishing point on a basis of a number of the line segments for vanishing point detection constituting the vanishing point detected by the vanishing point detecting unit,
• wherein for each line segment detected by the line segment detecting unit, the selecting unit selects the line segment in a case where the distance indicated by the distance information is in a monotonically changing trend along the line segment, and
• wherein in a case where the line segment for vanishing point detection constituting the vanishing point reaches a distance less than or equal to a first threshold from the vanishing point, the determining unit determines the confidence level of the vanishing point further on a basis of the distance indicated by the distance information corresponding to the vanishing point.

An image processing method comprising:

• detecting line segments from an image;
• obtaining distance information indicating a distance in a depth direction of the image;
• selecting a line segment for vanishing point detection from the line segments detected by the line segment detecting step;
• detecting a vanishing point of the image on a basis of the line segment for vanishing point detection, wherein a point of intersection of straight lines including the line segment for vanishing point detection is detected as the vanishing point;
• and
• determining a confidence level of the vanishing point on a basis of a number of the line segments for vanishing point detection constituting the vanishing point detected by the vanishing point detecting step,
• wherein for each line segment detected by the line segment detecting step, the selecting step selects the line segment in a case where the distance indicated by the distance information is in a monotonically changing trend along the line segment, and
• wherein in a case where the line segment for vanishing point detection constituting the vanishing point reaches a distance less than or equal to a first threshold from the vanishing point, the determining step determines the confidence level of the vanishing point further on a basis of the distance indicated by the distance information corresponding to the vanishing point.

A non-transitory computer-readable storage medium which stores a program for causing a computer to execute an image processing method comprising:

• detecting line segments from an image;
• obtaining distance information indicating a distance in a depth direction of the image;
• selecting a line segment for vanishing point detection from the line segments detected by the line segment detecting step;
• detecting a vanishing point of the image on a basis of the line segment for vanishing point detection, wherein a point of intersection of straight lines including the line segment for vanishing point detection is detected as the vanishing point;
• and
• determining a confidence level of the vanishing point on a basis of a number of the line segments for vanishing point detection constituting the vanishing point detected by the vanishing point detecting step,
• wherein for each line segment detected by the line segment detecting step, the selecting step selects the line segment in a case where the distance indicated by the distance information is in a monotonically changing trend along the line segment, and
• wherein in a case where the line segment for vanishing point detection constituting the vanishing point reaches a distance less than or equal to a first threshold from the vanishing point, the determining step determines the confidence level of the vanishing point further on a basis of the distance indicated by the distance information corresponding to the vanishing point.