Stereo matching method and image processing device performing same
AssigneeSamsung Electronics Co., Ltd.
InventorsTaehwa Hong, Dowan Kim, Kimin Kim
Life of this patent
Estimating the term…
Abstract
An image processing device is provided. The image processing device includes a camera configured to obtain a stereo image, an eye-tracking sensor configured to obtain gaze information of a user, a memory storing one or more instructions, and at least one processor. The at least one processor is configured to, by executing one or more instructions, extract feature points from the stereo image and generate gaze coordinate information in which gaze coordinates corresponding to the gaze information of the user are accumulated on the stereo image, and perform stereo matching based on the feature points and the gaze coordinate information.
Claims17
An image processing device comprising:
- a camera system including a first camera and a second camera, the camera system configured to obtain a stereo image;
- an eye-tracking sensor configured to obtain gaze information of a user;
- memory storing one or more instructions;
- and
- at least one processor communicatively coupled to the camera system, the eye-tracking sensor and the memory,
- wherein the one or more instructions, when executed by the at least one processor individually or collectively, cause the image processing device to:
- extract feature points from the stereo image, the feature points comprising first image feature points of a first image captured by the first camera and second image feature points of a second image captured by the second camera,
- generate gaze coordinate information including gaze coordinates corresponding to gaze information of the user relative to the first image and the second image, and
- perform stereo matching between the first image and the second image based on a first feature point from among the first image feature points and a second feature point from among the second image feature points, and
- wherein the second feature point is searched within a search range on the second image, the search range being restricted based on a second gaze coordinate corresponding to a first gaze coordinate associated with the first feature point.
A stereo matching method performed by an image processing device, the stereo matching method comprising:
- obtaining, by the image processing device, a stereo image by using a camera system including a first camera and a second camera;
- extracting, by the image processing device, feature points from the stereo image, the feature points comprising first image feature points of a first image captured by the first camera and second image feature points of a second image captured by the second camera;
- generating, by the image processing device, gaze coordinate information including gaze coordinates corresponding to gaze information of a user relative to the first image and the second image;
- and
- performing, by the image processing device, stereo matching between the first image and the second image based on a first feature point from among the first image feature points and a second feature point from among the second image feature points,
- wherein the second feature point is searched within a search range on the second image, the search range being restricted based on a second gaze coordinate corresponding to a first gaze coordinate associated with the first feature point.
A non-transitory computer-readable storage medium storing instructions that, when executed by at least one processor of an image processing device individually or collectively, cause the image processing device to perform operations, the operations comprising:
- obtaining, by the image processing device, a stereo image by using a camera system including a first camera and a second camera;
- extracting, by the image processing device, feature points from the stereo image, the feature points comprising first image feature points of a first image captured by the first camera and second image feature points of a second image captured by the second camera;
- generating, by the image processing device, gaze coordinate information including gaze coordinates corresponding to gaze information of a user relative to the first image and the second image;
- and
- performing, by the image processing device, stereo matching between the first image and the second image based on a first feature point from among the first image feature points and a second feature point from among the second image feature points,
- wherein the second feature point is searched within a search range on the second image, the search range being restricted based on a second gaze coordinate corresponding to a first gaze coordinate associated with the first feature point.
Dependencies are inferred from the claim text.