Few-shot logo recognition system
AssigneeSnap Inc.
InventorsKevin Sarabia Dela Rosa, Hao Hu, Pengxiang Wu
Life of this patent
Estimating the term…
Abstract
Methods and systems are disclosed for building a few-shot logo recognition system that includes accessing an image with several regions of interest and identifying several objects within the regions of interest using a logo detector neural network. For each object, the logo detector neural network indicates whether the object is a logo. The methods and systems also generate a first and second set of image feature data and a first and second ranked list of logos. A final ranked list of logos is generated based on the first and second ranked list of logos and a category associated with each logo in the final ranked list of logos is identified.
Claims20
A system for few-shot logo recognition comprising:
- one or more processors;
- at least one memory component storing instructions that, when executed by the one or more processors, cause the one or more processors to perform operations comprising:
- accessing an image comprising a plurality of regions of interest;
- identifying a plurality of objects within the plurality of regions of interest using a logo detector neural network, wherein for each object of the plurality of objects, the logo detector neural network is trained to generate an indication that the object is a logo;
- generating a first set of image feature data for the image and a second set of image feature data for the plurality of regions of interest;
- generating a first ranked list of logos from the identified plurality of objects, the first ranked list of logos generated based on matching the first set of image feature data with image feature data associated with a database of logos;
- generating a second ranked list of logos from the identified plurality of objects, the second ranked list of logos based on matching the second set of image feature data with the image feature data associated with the database of logos;
- generating a final ranked list of logos based on the first ranked list of logos and the second ranked list of logos;
- and
- identifying a category associated with each logo in the final ranked list of logos.
A method for few-shot logo recognition comprising:
- accessing, by one or more processors, an image comprising a plurality of regions of interest;
- identifying, by the one or more processors, a plurality of objects within the plurality of regions of interest using a logo detector neural network, wherein for each object of the plurality of objects, the logo detector neural network is trained to generate an indication that the object is a logo;
- generating a first set of image feature data for the image and a second set of image feature data for the plurality of regions of interest;
- generating a first ranked list of logos from the identified plurality of objects, the first ranked list of logos generated based on matching the first set of image feature data with image feature data associated with a database of logos;
- generating a second ranked list of logos from the identified plurality of objects, the second ranked list of logos based on matching the second set of image feature data with the image feature data associated with the database of logos;
- generating a final ranked list of logos based on the first ranked list of logos and the second ranked list of logos;
- and
- identifying a category associated with each logo in the final ranked list of logos.
A non-transitory computer-readable storage medium storing instructions that, when executed by at least one processor, cause the at least one processor to perform operations for few-shot logo recognition comprising:
- accessing an image comprising a plurality of regions of interest;
- identifying a plurality of objects within the plurality of regions of interest using a logo detector neural network, wherein for each object of the plurality of objects, the logo detector neural network is trained to generate an indication that the object is a logo;
- generating a first set of image feature data for the image and a second set of image feature data for the plurality of regions of interest;
- generating a first ranked list of logos from the identified plurality of objects, the first ranked list of logos generated based on matching the first set of image feature data with image feature data associated with a database of logos;
- generating a second ranked list of logos from the identified plurality of objects, the second ranked list of logos based on matching the second set of image feature data with the image feature data associated with the database of logos;
- generating a final ranked list of logos based on the first ranked list of logos and the second ranked list of logos;
- and
- identifying a category associated with each logo in the final ranked list of logos.
Dependencies are inferred from the claim text.