Methods and apparatus for matching multiple images
AssigneeSTMicroelectronics S.r.l.
InventorGeorge Q. Chen
Life of this patent
Estimating the term…
Abstract
An image processing system detects a plurality of image features in a first image corresponding to a first view of a scene, and a plurality of image features in a second image corresponding to a second view of the scene. The second image deviates from the first image as a result of camera relative motion. The system determines a two-view correspondence resulting in a potential match set having a maximum average strength of correspondence based at least in part on the total number of matching neighbor candidate image features. Additionally, a multiple-view correspondence between images results in a potential match set based at least in part on a computation of reprojection error for matched points that resulted from a projective reconstruction of the potential match set.
Claims23
A method of matching image features between a plurality of images, the method comprising the steps of:
- detecting a plurality of image features in a first image corresponding to a first view of a scene;
- detecting a plurality of image features in a second image corresponding to a second view of the scene, wherein the second image deviates from the first image as a result of camera relative motion;
- determining a first two-view correspondence between the plurality of detected features in the first image and the plurality of detected image features in the second image resulting in a first potential match set of candidate image features between the first and second images;
- and
- determining a second two-view correspondence, that is a refinement of the first two-view correspondence, resulting in a second potential match set of candidate image features between the first and second images, wherein the second potential match set is determined to have a maximum average strength of correspondence based at least in part on the total number of matching neighbor candidate image features for each match of the second potential match set.
A method of matching image features between a plurality of images, the method comprising the steps of:
- detecting a plurality of image features in a first image corresponding to a first view of a scene;
- detecting a plurality of image features in at least a second image corresponding to a respective at least a second view of the scene, wherein the at least a second image deviates from the first image as a result of camera relative motion;
- determining a first two-view correspondence between the plurality of detected features in the first image and a plurality of detected image features in one of the at least a second image resulting in a first potential match set of candidate image features between the first image and the one of the at least a second image;
- and
- determining a multiple-view correspondence between the plurality of detected features in the first image and the plurality of detected image features in the at least a second image, the multiple-view correspondence being a refinement of the first two-view correspondence, resulting in a second potential match set of candidate image features between the first image and the at least a second image, wherein the second potential match set is based at least in part on a computation of reprojection error for matched points that resulted from a projective reconstruction of the second potential match set.
An image processing system comprising:
- a memory;
- a controller/processor electrically coupled to the memory;
- an image feature detector, electrically coupled to the controller/processor and to the memory, for detecting a plurality of image features in a first image corresponding to a first view of a scene, and for detecting a plurality of image features in at least a second image corresponding to a respective at least a second view of the scene, wherein the at least a second image deviates from the first image as a result of camera relative motion;
- and
- an image matching module, electrically coupled to the controller/processor and to the memory, for determining a multiple-view correspondence between the plurality of detected features in the first image and the plurality of detected image features in the at least a second image, resulting in a potential match set of candidate image features between the first image and the at least a second image, wherein the potential match set is based at least in part on a computation of reprojection error for matched points that resulted from a projective reconstruction of the potential match set.
An image processing system comprising:
- a memory;
- a controller/processor electrically coupled to the memory;
- an image feature detector, electrically coupled to the controller/processor and to the memory, for detecting a plurality of image features in a first image corresponding to a first view of a scene, and for detecting a plurality of image features in at least a second image corresponding to a respective at least a second view of the scene, wherein the at least a second image deviates from the first image as a result of camera relative motion;
- and
- an image matching module, electrically coupled to the controller/processor and to the memory, for determining a two-view correspondence resulting in a potential match set of candidate image features between the first image and the at least a second image, wherein the potential match set is determined to have a maximum average strength of correspondence based at least in part on the total number of matching neighbor candidate image features for each match of the potential match set.
A computer readable medium including computer instructions for matching image features between a plurality of images, the computer instructions comprising instructions for:
- detecting a plurality of image features in a first image corresponding to a first view of a scene;
- detecting a plurality of image features in a second image corresponding to a second view of the scene, wherein the second image deviates from the first image as a result of camera relative motion;
- determining a first two-view correspondence between the plurality of detected features in the first image and the plurality of detected image features in the second image resulting in a first potential match set of candidate image features between the first and second images;
- and
- determining a second two-view correspondence, that is a refinement of the first two-view correspondence, resulting in a second potential match set of candidate image features between the first and second images, wherein the second potential match set is determined to have a maximum average strength of correspondence based at least in part on the total number of matching neighbor candidate image features for each match of the second potential match set.
A computer readable medium including computer instructions for matching image features between a plurality of images, the computer instructions comprising instructions for:
- detecting a plurality of image features in a first image corresponding to a first view of a scene;
- detecting a plurality of image features in at least a second image corresponding to a respective at least a second view of the scene, wherein the at least a second image deviates from the first image as a result of camera relative motion;
- determining a first two-view correspondence between the plurality of detected features in the first image and a plurality of detected image features in one of the at least a second image resulting in a first potential match set of candidate image features between the first image and the one of the at least a second image;
- and
- determining a multiple-view correspondence between the plurality of detected features in the first image and the plurality of detected image features in the at least a second image, the multiple-view correspondence being a refinement of the first two-view correspondence, resulting in a second potential match set of candidate image features between the first image and the at least a second image, wherein the second potential match set is based at least in part on a computation of reprojection error for matched points that resulted from a projective reconstruction of the second potential match set.
Dependencies are inferred from the claim text.