Method and apparatus for obtaining three dimensional distance information stereo vision

A method of obtaining three-dimensional distance information, comprising the steps of:

• forming images of an object system on an image sensing surface by using at least three image focusing systems so that at least three object images of the object system are formed on respective image sensing areas;
• correlating the image points of an object point which are formed on said respective image sensing areas by said image focusing systems by using a relationship which exists between the geometrical positional relationships among said image points and the geometrical positional relationships among said image focusing systems themselves and between said image focusing systems and said image sensing areas;
• and
• obtaining the three-dimensional distance information of said object point by using information relating to the positions of at least two of the corresponding image points on the image sensing areas and information relating to the geometrical positional relationship between said two corresponding image points and the image focusing systems, wherein correlating of the image points comprises detecting image points in respective image sensing areas which satisfy the relationship that the ratio of the distance between first and second image points of the same object point in respective first and second image sensing areas to the distance between said second and a third image point of the same object point in respective second and third sensing areas is equal to the ratio of the distance between first and second focusing system to the distance between said second and a third focusing system.

A method of obtaining three-dimensional distance information, comprising the steps of:

• forming images of an objection at least one image sensing surface by using at least three image focusing systems so that at least three object images of the object are formed on said image sensing surface;
• determining correspondence between image points of said images formed on said image sensing surface and object points on said object by using a geometrical relationship in which a shape is formed by joining said at least three image focusing systems, which shape moves toward said image sensing surface in parallel while maintaining a similar form so as to form a similar shape disposed between said shape and said image sensing surface, each of the image points corresponding to the object points existing on points of intersection of said image sensing surface and straight lines passing through vertices of said shape and the corresponding vertices of said similar shape;
• and
• obtaining three-dimensional distance information of said object points by using information relating to the positions of at least two of said image points formed on said image sensing surface corresponding to a certain object point and information relating to the geometrical positional relationship between said two corresponding image points and said image focusing systems.

A method of obtaining three-dimensional distance information, comprising the steps of:

• forming images of an object system on an image sensing surface by using at least three image focusing systems so that at least three object images of the object system are formed on respective image sensing areas;
• correlating the image points of an object point which are formed on said respective image sensing areas by said image focusing systems by using a relationship which exists between the geometrical positional relationships among said image points and the geometrical positional relationships among said image focusing systems themselves and between said image focusing systems and said image sensing areas;
• and
• obtaining the three-dimensional distance information of said object point by using information relating to the positions of at least two of the corresponding image points on the image sensing areas and information relating to the geometrical positional relationship between said two corresponding image points and the image focusing systems, wherein said image focusing systems are arranged in a plane surface so as to form a regular polygon.

A method of obtaining three-dimensional distance information, comprising the steps of:

• forming images of an object system on an image sensing surface by using at least three image focusing systems so that at least three object images of the object system are formed on respective image sensing areas;
• correlating the image points of an object point which are formed on said respective image sensing areas by said image focusing systems by using a relationship which exists between the geometrical positional relationships among said image points and the geometrical positional relationships among said image focusing systems themselves and between said image focusing systems and said image sensing areas;
• and
• obtaining the three-dimensional distance information of said object point by using information relating to the positions of at least two of the corresponding image points on the image sensing areas and information relating to the geometrical positional relationship between said two corresponding image points and the image focusing systems, wherein said image focusing systems are arranged on a straight line at random.

A method of obtaining three-dimensional distance information, comprising the steps of:

• forming images of an object system on an image sensing surface by using at least three image focusing systems so that at least three object images of the object system are formed on respective image sensing areas;
• correlating the image points of an object point which are formed on said respective image sensing areas by said image focusing systems by using a relationship which exists between the geometrical positional relationships among said image points and the geometrical positional relationships among said image focusing systems themselves and between said image focusing systems and said image sensing areas;
• and
• obtaining the three-dimensional distance information of said object point by using information relating to the positions of at least two of the corresponding image points on the image sensing areas and information relating to the geometrical positional relationship between said two corresponding image points and the image focusing systems, wherein said image focusing systems are arranged in a plane surface so as to form a ordinary polygon.

A method of obtaining three-dimensional distance information, comprising the steps of:

• forming images of an object system on an image sensing surface by using at least three image focusing systems so that at least three object images of the object system are formed on respective image sensing areas;
• correlating the image points of an object point which are formed on said respective image sensing areas by said image focusing systems by using a relationship which exists between the geometrical positional relationships among said image points and the geometrical positional relationships among said image focusing systems themselves and between said image focusing systems and said image sensing areas;
• and
• obtaining the three-dimensional distance information of said object point by using information relating to the positions of at least two of the corresponding image points on the image sensing areas and information relating to the geometrical positional relationship between said two corresponding image points and the image focusing systems, wherein said image focusing systems are arranged in a plane surface parallel to said image sensing surfaces.

A method of obtaining three-dimensional distance information, comprising the steps of:

• forming images of an object system on an image sensing surface by using at least three image focusing systems so that at least three object images of the object system are formed on respective image sensing areas;
• correlating the image points of an object point which are formed on said respective image sensing areas by said image focusing systems by using a relationship which exists between the geometrical positional relationships among said image points and the geometrical positional relationships among said image focusing systems themselves and between aaid image focusing systems and said image sensing areas;
• and
• obtaining the three-dimensional distance information of said object point by using information relating to the positions of at least two of the corresponding image points on the image sensing areas and information relating to the geometrical positional relationship between said two corresponding image points and the image focusing systems, wherein said image focusing systems are arranged in a plane surface which is oblique with respect to said image sensing surfaces.

A method of obtaining three-dimensional distance information, comprising the steps of:

• forming images of an object system on an image sensing surface by using at least three image focusing systems so that at least three object images of the object system are formed on respective image sensing areas;
• correlating the image points of an object point which are formed on said respective image sensing areas by said image focusing systems by using a relationship which exists between the geometrical positional relationships among said image points and the geometrical positional relationships among said image focusing systems themselves and between said image focusing systems and said image sensing areas;
• and
• obtaining the three-dimensional distance information of said object point by using information relating to the positions of at least two of the corresponding image points on the image sensing areas and information relating to the geometrical positional relationship between said two corresponding image points and the image focusing systems, wherein a plurality of operations corresponding to a range of vertical azimuth angles for correlating points are performed in parallel.

A method of obtaining three-dimensional distance information, comprising the steps of:

• forming images of an object system on an image sensing surface by using at least three image focusing systems so that at least three object images of the object system are formed on respective image sensing areas;
• correlating the image points ff an object point which are formed on said respective image sensing areas by said image focusing systems by using a relationship which exists between the geometrical positional relationships among said image points and the geometrical positional relationships among said image focusing systems themselves and between said image focusing systems and said image sensing areas;
• and
• obtaining the three-dimensional distance information of said object point by using information relating to the positions of at least two of the corresponding image points on the image sensing areas and information relating to the geometrical positional relationship between said two corresponding image points and the image focusing systems, wherein a plurality of operations corresponding to a range of horizontal azimuth angles and a range of vertical azimuth angles for correlating points are performed in parallel.

A method of obtaining three-dimensional distance information, comprising the steps of:

• forming images of an object system on an image sensing surface by using at least three image focusing systems so that at least three object images of the object system are formed on respective image sensing areas;
• correlating the image points of an object point which are formed on said respective image sensing areas by said image focusing systems by using a relationship which exists between the geometrical positional relationships among said image points and the geometrical positional relationships among said image focusing systems themselves and between said image focusing systems and said image sensing areas;
• and
• obtaining the three-dimensional distance information of said object point by using information relating to the positions of at least two of the corresponding image points on the image sensing areas and information relating to the geometrical positional relationship between said two corresponding image points and the image focusing systems, wherein corresponding points are determined in a limited range of vertical azimuth angles and in a limited range of horizontal azimuth angles.

A method of obtaining three-dimensional distance information, comprising the steps of:

• forming images of an object system on an image sensing surface by using at least three image focusing systems so that at least three object images of the object system are formed on respective image sensing areas;
• correlating the image points of an object point which are formed on said respective image sensing areas by said image focusing systems by using a relationship which exists between the geometrical positional relationships among said image points and the geometrical positional relationships among said image focusing systems themselves and between said image focusing systems and said image sensing areas;
• and
• obtaining the three-dimensional distance information of said object point by using information relating to the positions of at least two of the corresponding image points on the image sensing areas and information relating to the geometrical positional relationship between said two corresponding image points and the image focusing systems, wherein a plurality of limited ranges of vertical azimuth angles and a plurality of limited ranges of horizontal azimuth angles are specified in a desired order, and corresponding points are obtained in each specified, limited range of vertical azimuth angles and in each specified, limited range of horizontal azimuth angles.

A method of obtaining three-dimensional distance information, comprising the steps of:

• forming images of an object system on an image sensing surface by using at least three image focusing systems so that at least three object images of the object system are formed on respective image sensing areas;
• correlating the image points of an object point which are formed on said respective image sensing areas by said image focusing systems by using a relationship which exists between the geometrical positional relationships among said image points and the geometrical positional relationships among said image focusing systems themselves and between said image focusing systems and said image sensing areas;
• and
• obtaining the three-dimensional distance information of said object point by using information relating to the positions of at least two of the corresponding image points on the image sensing areas and information relating to the geometrical positional relationship between said two corresponding image points and the image focusing systems, wherein image points corresponding to a non-existing object point are removed on the basis of brightness information obtained on said image sensing areas.

An apparatus for obtaining three-dimensional distance information, comprising:

• three color filtering means corresponding to three primary colors and spaced apart from one another, for dividing light from an object system into three light means;
• an image focusing system for forming the image of an object system by using said light means of said object system received from said color filtering means;
• image sensing means formed of a color image sensor, said color image sensor being provided with three kinds of color filters corresponding to said three color filtering means in such a manner that the three color filters are repeatedly mounted on pixels which form said color image sensor, in a horizontal direction, to detect said three light beams separately, said pixels being scanned in a horizontal direction;
• optical deflection means for making the optical axes of said light beams from said three color filtering means parallel to the axis of said image focusing system, for juxtaposing said optical axes of said 1ight beams in a direction parallel to a horizontal pixel layer of said color image sensor so that said optical axes deviate from one another, and for providing the same optical path length between each of said three color filtering means and the image sensing surface of said image sensing means;
• horizontal addressing means for taking out information from pixels included in a horizontal pixel layer of said color image sensor in such a manner that a plurality of pixel groups each including three pixels which are provided with said three color filters, are successively addressed in a predetermined order, and the ouputs of said three pixels of each pixel group are simultaneously taken out;
• detection means for delivering ON-information when said three light beams from said three color filtering means have a brightness value within a predetermined range, at those three pixels of a horizontal pixel layer which are addressed by said horizontal addressing means, and for delivering OFF-information when at least one of said three light beams does not have a brightness value within said predetermined range at one of said three pixels;
• two-dimensional distance information calculation means for obtaining two-dimensional distance information which includes the distance from said image sensing surface to said object system in the direction of depth and at least one horizontal azimuth angle, from the horizontal address information on said color image sensor;
• and
• three-dimensional distance information calculation means for obtaining three-dimensional distance information which includes said two-dimensional distance information of said object system and a vertical azimuth angle, by using the vertical address information on said color image sensor.

An apparatus for obtaining three-dimensional distance information, comprising:

• three color filtering means corresponding to three primary colors and spaced apart from one another, for dividing light from an object system into three light means;
• an image focusing system for forming the image of an object system by using said light means of said object system received from said color filtering means;
• image sensing means formed of a color image sensor, said color image sensor being provided with three kinds of color filters corresponding to said three color filtering means in such a manner that the three color filters are repeatedly mounted on pixels which form said color image sensor, in a horizontal direction, to detect said three light beams separately, said pixels being scanned nn a horizontal direction;
• optical deflection means for making the optical axes of said light beams from said three color filtering means parallel to the axis of said image focusing system, for juxtaposing said optical axes of said light beams in a direction parallel to a horizontal pixel layer of said color image sensor so that said optical axes deviate from one another, and for providing the same optical path length between each of said three color filtering means and the image sensing surface of said image sensing means;
• horizontal addressing means for taking out information from pixels included in a horizontal pixel layer of said color image sensor in such a manner that a plurality of pixel groups each including three pixels which are provided with said three color filters, are successively addressed in a predetermined order, and the outputs of said three pixels of each pixel group are simultaneously taken out;
• detection means for delivering ON-information when said three light beams from said three color filtering means have a brightness value within a predetermined range, at those three pixels of a horizontal pixel layer which are addressed by said horizontal addressing means, and for delivering OFF-information when at least one of said three light beams does not have a brightness value within said predetermined range at one of said three pixels;
• two-dimensional distance information calculation means for obtaining two-dimensional distance information which includes two horizontal azimuth angles, from the horizontal address information on said color image sensor;
• and
• three-dimensional distance information calculation means for obtaining three-dimensional distance information which includes said two-dimensional distance information of said object system and a vertical azimuth angle, by using the vertical address information on said color image sensor.