Hybrid detection recognition system
AssigneeRicoh Company, Ltd.
InventorsJunghyun Kwon, Ramya Narasimha, Edward L. Schwartz, Max McFarland, Silvio Savarese, Kathrin Berkner
Life of this patent
Estimating the term…
Abstract
A system and method for determining an object or product represented in an image is disclosed. The system receives a first image, determines a region of interest in the first image, determines a classification score for the region of interest using a convolutional neural network that assigns the region of interest the classification score corresponding to a class, and identifies a first product in the first image based on the classification score.
Claims12
A method comprising:
- receiving, by one or more processors, a first image;
- determining, by the one or more processors, a plurality of regions of interest that share a similar spatial location in the first image;
- ranking, by the one or more processors, the plurality of regions of interest;
- selecting, from the plurality of regions of interest, a predetermined number of regions of interest for the similar spatial location based on the ranking;
- determining, by the one or more processors, classification scores for the predetermined number of regions of interest using a convolutional neural network, the convolutional neural network assigning the predetermined number of regions of interest the classification scores corresponding to a product class;
- matching, by the one or more processors, the predetermined number of regions of interest in the first image to indexed images using model-based features to determine a second image and a matching score associated with the second image;
- adjusting, by the one or more processors, the classification scores based on the matching score;
- and
- identifying, by the one or more processors, a first product in the first image based on the adjusted classification scores.
A system comprising:
- one or more processors;
- and
- a memory, the memory storing instructions, which when executed cause the one or more processors to:
- receive a first image;
- determine a plurality of regions of interest that share a similar spatial location in the first image;
- rank the plurality of regions of interest;
- select, from the plurality of regions of interest, a predetermined number of regions of interest for the similar spatial location based on the ranking;
- determine classification scores for the predetermined number of regions of interest using a convolutional neural network, the convolutional neural network assigning the predetermined number of regions of interest the classification scores corresponding to a product class;
- match the predetermined number of regions of interest in the first image to indexed images using model-based features to determine a second image and a matching score associated with the second image;
- adjust the classification scores based on the matching score;
- and
- identify a first product in the first image based on the adjusted classification scores.
A computer program product comprising a non-transitory computer readable medium storing a computer readable program, wherein the computer readable program when executed on a computer causes the computer to:
- receive a first image;
- determine a plurality of regions of interest that share a similar spatial location in the first image;
- rank the plurality of regions of interest;
- select, from the plurality of regions of interest, a predetermined number of regions of interest for the similar spatial location based on the ranking;
- determine classification scores for the predetermined number of regions of interest using a convolutional neural network, the convolutional neural network assigning the predetermined number of regions of interest the classification scores corresponding to a product class;
- match the predetermined number of regions of interest in the first image to indexed images using model-based features to determine a second image and a matching score associated with the second image;
- adjust the classification scores based on the matching score;
- and
- identify a first product in the first image based on the adjusted classification scores.
Dependencies are inferred from the claim text.