Adaptive sampling of training views
AssigneeSeiko Epson Corporation
InventorsDibyendu Mukherjee, Jia Li, Mikhail Brusnitsyn, Irina Kezele
Life of this patent
Estimating the term…
Abstract
A head-mounted display, a method, and a non-transitory computer readable medium are provided. An embodiment of a method for obtaining training sample views of an object includes the step of storing, in a memory, multiple views of an object. The method also includes the step of deriving similarity scores between adjacent views and then a sampling density is varied based on the similarity scores.
Claims20
A non-transitory computer-readable medium storing thereon a computer program that, when executed by one or more processors, performs a method comprising the steps of:
- (a) receiving, in a memory, feature data sets of (i) a reference object or (ii) a 3D model, each feature data set being obtained from an image captured or generated from a primary set of views within a view range around the reference object or the 3D model,
- (b) deriving similarity scores between each pair of adjacent views among the primary set of views using the feature data sets,
- (c) sampling a secondary set of views disposed between each pair of the adjacent primary views that have the similarity score being equal to or less than a threshold so that sampling density varies across the view range, and
- (d) generating data corresponding to (i) the primary set of views including each pair of the adjacent primary views that have the similarity score being equal to or less than the threshold and (ii) the secondary set of views.
A method comprising the steps of:
- (a) receiving, in a memory, feature data sets of (i) a reference object or (ii) a 3D model, each feature data set being obtained from an image captured or generated from a primary set of views within a view range around the reference object or the 3D model,
- (b) deriving similarity scores between each pair of adjacent views among the primary set of views using the feature data sets,
- (c) sampling a secondary set of views disposed between each pair of the adjacent primary views that have the similarity score being equal to or less than a threshold so that sampling density varies across the view range, and
- (d) generating data corresponding to (i) the primary set of views including each pair of the adjacent primary views that have the similarity score being equal to or less than the threshold and (ii) the secondary set of views.
A head-mounted display device comprising:
- memory configured to store data used as training data for detecting an object, the data derived from multiple views of the object;
- a processing device configured to utilize the training data to detect the object;
- and
- a display component configured to display images of the detected object;
- wherein, before object detection, the multiple views are obtained using a varying sampling density based on similarity scores of adjacent views by the steps of:
- (a) receiving feature data sets of (i) a reference object or (ii) a 3D model, each feature data set being obtained from an image captured or generated from a primary set of views within a view range around the reference object or the 3D model,
- (b) deriving similarity scores between each pair of adjacent views among the primary set of views using the feature data sets,
- (c) sampling a secondary set of views disposed between each pair of the adjacent primary views that have the similarity score being equal to or less than a threshold so that sampling density varies across the view range, and
- (d) generating the data corresponding to (i) the primary set of views including each pair of the adjacent primary views that have the similarity score being equal to or less than the threshold and (ii) the secondary set of views.
Dependencies are inferred from the claim text.