System and method for pose tolerant feature extraction using generated pose-altered images
AssigneeCarnegie Mellon University
InventorsMarios Savvides, Kai Hu, Yutong Zheng, Ahmed Uzair, Sreena Nallamothu
Life of this patent
Estimating the term…
Abstract
Disclosed herein is a system and method for augmenting data by generating a plurality of pose-altered images of an item from one or more 2D images of the item and using the augmented data to train a train a feature extractor. In other aspects of the invention, the trained feature extractor is used to enroll features extracted from images of new products in a library database of known products or to identify images of unknown products by matching features of an image of the unknown product with features stored in the library database.
Claims20
A method comprising:
- generating a plurality of synthetic pose-altered images of a plurality of items based on one or more 2D images of each of the plurality of items;
- and
- training a feature extractor to extract features of the synthetic pose-altered images;
- wherein the synthetic pose-altered images include views of the items which are modified from the one or more 2D images of the items, the modifying including presenting the items at arbitrary angles, rotating the items, translating the items, crumpling the items, modifying the colors of the items, over-exposing the items and under-exposing the items.
A system comprising:
- a processor;
- and
- a memory storing software that, when executed by the processor, causes the system to:
- generate a plurality of synthetic pose-altered images of a plurality of items based on one or more 2D images of each of the plurality of items;
- and
- train a feature extractor to extract features of the pose-altered images;
- wherein the synthetic pose-altered images include views of the items which are modified from the one or more 2D images of the items, the modifying including presenting the item at arbitrary angles, rotating the item, translating the item, crumpling the item, modifying the colors of the item, over-exposing the item and under-exposing the item.
Dependencies are inferred from the claim text.