Stereo matching method and apparatus, image processing apparatus, and training method therefor
AssigneeSamsung Electronics Co., Ltd.
InventorsWonhee Lee, Hyun Sung Chang, Young Hun Sung, KyungBoo Jung
Life of this patent
Estimating the term…
Abstract
A stereo matching method includes obtaining a first feature map associated with a first view image and a second feature map associated with a second view image using a neural network model-based feature extractor, determining respective matching costs between a reference pixel of the first view image and candidate pixels of the second view image using the first feature map and the second feature map, and determining a pixel corresponding to the reference pixel among the candidate pixels based on the determined matching costs.
Claims20
A stereo matching method, the method comprising:
- obtaining a first feature map associated with a first view image and a second feature map associated with a second view image using a neural network model-based feature extractor;
- determining respective matching costs between a reference pixel of the first view image and candidate pixels of the second view image using the first feature map and the second feature map;
- and
- determining a pixel corresponding to the reference pixel among the candidate pixels based on the determined matching costs,
- wherein the determining of the respective matching costs comprises:
- determining an initial matching cost between the reference pixel and a current candidate pixel;
- and
- adjusting the initial matching cost based on matching cost information associated with another reference pixel adjacent to the reference pixel.
A stereo matching method, the method comprising:
- extracting a first feature vector of a reference pixel included in a first view image and respective second feature vectors of each of candidate pixels included in a second view image using a neural network model-based feature extractor;
- and
- determining a pixel corresponding to the reference pixel among the candidate pixels based on the first feature vector and the second feature vectors obtained from the neural network model-based feature extractor, wherein determining comprises:
- determining an initial matching cost between the reference pixel and a current candidate pixel;
- adjusting the initial matching cost based on matching cost information associated with another reference pixel adjacent to the reference pixel;
- and
- determining the pixel corresponding to the reference pixel among the candidate pixels based on the respective matching costs.
An image processing apparatus, comprising:
- a processor configured to:
- obtain a first feature map associated with a first view image and a second feature map associated with a second view image using a neural network model-based feature extractor;
- determine respective matching costs between a reference pixel of the first view image and candidate pixels of the second view image using the first feature map and the second feature map;
- determine a pixel corresponding to the reference pixel among the candidate pixels based on the determined matching costs;
- determine an initial matching cost between the reference pixel and a current candidate pixel;
- and
- adjust the initial matching cost based on matching cost information associated with another reference pixel adjacent to the reference pixel.
Dependencies are inferred from the claim text.