Back to results
US 2021/0174529 A1Published application
System and method for identifying items
AssigneeMashgin Inc.
InventorsAbhinai Srivastava, Mukul Dhankhar
Life of this patent
Estimating the term…
Abstract
The method for item recognition can include: optionally calibrating a sampling system, determining visual data using the sampling system, determining a point cloud, determining region masks based on the point cloud, generating a surface reconstruction for each item, generating image segments for each item based on the surface reconstruction, and determining a class identifier for each item using the respective image segments.
Claims20
A method for item identification, comprising:
- determining an image set of a set of items, wherein the image set is captured by a set of cameras;
- generating a point cloud for the set of items;
- generating a height map of the items using the point cloud;
- determining a region mask for each item based on the height map using a segmentation classifier;
- generating a coarse mesh for each item using the respective region mask;
- determining an image segment set for each item by projecting the respective coarse mesh into each image of the image set;
- and
- determining an item identifier for each item using the respective image segment set.
5 more elements
A system for item identification, comprising:
- a set of sensors configured to sample measurements of a set of items within a measurement volume, wherein the set of sensors comprise a set of cameras, each camera is associated with a camera field of view, and the measurements comprise a set of images captured by the set of cameras;
- and
- a processing system configured to:
- generate a point cloud using the measurements;
- generate a height map using the point cloud;
- determine a region mask for each item using a segmentation classifier that ingests the height map as input;
- generate a coarse mesh for each item using the respective region mask;
- determine an image segment set for each item by projecting the respective coarse mesh into each image of the set of images;
- and
- determine an item identifier for each item using the respective image segment set.
7 more elements
Dependencies are inferred from the claim text.