Image processing apparatus
AssigneeOMRON Corporation
InventorsDaisuke Mitsumoto, Tomoyoshi Aizawa, Atsuko Tani
Life of this patent
Estimating the term…
Abstract
At the time of installing an image processing apparatus using a stereo camera, the plane estimation process cannot be executed in the case where the reference plane is crowded with moving objects. The three-dimensional moving vector of a plurality of feature points extracted from an object moving on the plane is used to determine the normal vector on the plane and calculate the parameter describing the relation between the plane and the camera.
Claims9
An image processing apparatus comprising:
- a feature point extractor for extracting the feature points in an arbitrary image;
- a corresponding point searcher for establishing the correspondence between the feature points of one of two arbitrary images and the feature points of the other image;
- a plane estimator for estimating the parameters to describe the relative positions of a plane and an image pickup section in the three-dimensional space;
- and
- a standard image pickup unit and at least one reference image pickup unit, both of which are connected to the image pickup section arranged to pickup up an image of the plane;
- wherein the plane estimator includes:
- a camera coordinate acquisition unit for supplying the corresponding point searcher, through the feature point extractor, with a standard image picked up by the standard image pickup unit and a reference image picked up by the reference image pickup unit at one time point, and determining the relative positions, on the camera coordinate system, between the image pickup section and the points representing the feature points at the time point based on the parallax between the corresponding feature points;
- a moving vector acquisition unit for supplying the corresponding point searcher, through the feature point extractor, with a first standard image picked up by the standard image pickup unit at a first time point and a second standard image picked up by the standard image pickup unit at a second time point, and determining the three-dimensional moving vectors of the points representing the feature points in the camera coordinate space based on the three-dimensional position of the corresponding feature points in the camera coordinate space at different time points;
- and
- a moving vector storage unit for storing, by relating to each other, the first time point, the feature points in the standard images, the camera coordinate of the feature points and the moving vectors;
- wherein a plane is estimated using the moving vectors stored in the moving vector storage unit.
A method of estimating a plane from a stereo image in an image processing apparatus, comprising the steps of:
- picking up the stereo image repeatedly;
- determining the three-dimensional coordinate of a feature point in the image picked up at one time point on the camera coordinate system using the principle of triangulation from the parallax of the stereo image and the image coordinate;
- searching the image picked up at the other time point for a point corresponding to a feature point in the image, and determining a moving vector the feature point on the camera coordinate system within the time interval;
- and
- acquiring a parameter defining the plane position using the moving vector.
Dependencies are inferred from the claim text.