# US 10,482,447 B2 · Recognition system, information processing apparatus, and information processing method > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,482,447 B2 - Document ID: US10482447B2 - Status: Granted - Kind: B2 - Application number: 15/603,662 - Filed: 2017-05-24 - Published: 2017-11-30 - Granted: 2019-11-19 - Earliest claimed: 2016-05-31 - Assignees: Toshiba Tec Kabushiki Kaisha - Applicants: Toshiba Tec Kabushiki Kaisha - Inventors: Yuta Sasaki - Web page: https://patentgrep.com/patent/US10482447B2 ## CPC - G06Q 20/208: {Input by product or record sensing, e.g. weighing or scanner processing} - G06F 18/22: Matching criteria, e.g. proximity measures - G06F 18/2413: based on distances to training or reference patterns - G06Q 20/201: {Price look-up processing, e.g. updating} - G06V 10/40: Extraction of image or video features - G06V 30/224: of printed characters having additional code marks or containing code marks - G06V 30/248: {involving plural approaches, e.g. verification by template match; Resolving confusion among similar patterns, e.g. "O" versus "Q" (G06V30/242 takes precedence)} - G07G 1/0063: {with means for detecting the geometric dimensions of the article of which the code is read, such as its size or height, for the verification of the registration} - G06F 16/5854: {using shape and object relationship} - G06V 20/68: Food, e.g. fruit or vegetables - G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - G07G: REGISTERING THE RECEIPT OF CASH, VALUABLES, OR TOKENS ## Abstract In one embodiment, a recognition system has an imaging device, a storage device, and a first processor. The first processor extracts a feature amount of an article contained in image data outputted by the imaging device. The first processor recognizes a commodity to which the detected article corresponds, based on similarities between feature amounts for collation of a first commodity and a second commodity stored in the storage device and the extracted feature amount, and selects the recognized commodity from the storage device, as the commodity to which the detected article corresponds, provided that the recognized corresponding commodity is not the first commodity. ## Claims ### Claim 1 A recognition system, comprising: an imaging device which images a prescribed imaging area and outputs image data; a storage device which stores a commodity file including identification information for a plurality of commodities, feature values for the plurality of commodities, and a predetermined recognition classification for each commodity in the plurality indicating the commodity is one of a first commodity type or a second commodity type, the first commodity type being commodities to be recognized using a code symbol associated with the commodity in the commodity file and the second commodity type being commodities to be recognized using a feature value associated with the commodity in the commodity file; and a processor which is configured to: determine whether a code symbol can be detected in the image data from the imaging device, detect an article in the image data from the imaging device if a code symbol cannot be detected in the image data, extract a feature value of the detected article from the image data, calculate similarities between the stored feature values in the commodity file for commodities of the first commodity type and the second commodity type and the extracted feature value, recognize commodities in the commodity file as candidates corresponding to the detected article based on the calculated similarities, exclude commodities of the first commodity type from the candidates based on the predetermined recognition classification included in the commodity file, and select a commodity from the candidates as a recognized commodity based on calculated similarity provided that the calculated similarity for the commodity is above a threshold value. ### Claim 2 (depends on 1) The recognition system according to claim 1, wherein the processor comprises a first processor and a second processor, the first processor is configured to determine whether the code symbol can be detected in the image data from the imaging device, and the second processor is configured to detect the article in the image data from the imaging device if the code symbol cannot be detected in the image data, extract the feature value of the detected article from the image data, calculate the similarities between the stored feature values in the commodity file for commodities of the first commodity type and the second commodity type and the extracted feature value, recognize the commodities in the commodity file as candidates corresponding to the detected article based on the calculated similarities, exclude commodities of the first commodity type from the candidates based on the predetermined recognition classification includes in the commodity file, and select the commodity from the candidates as the recognized commodity based on the calculated similarity provided that the calculated similarity for the commodity is above a threshold value. ### Claim 3 (depends on 2) The recognition system according to claim 2, wherein the second processor detects the code symbol in the image data. ### Claim 4 (depends on 3) The recognition system according to claim 3, wherein: the first processor decodes the code symbol. ### Claim 5 (depends on 1) The recognition system according to claim 1, wherein: the processor stores the extracted feature value in the storage device when the detected article is a commodity of the first commodity type. ### Claim 6 (depends on 5) The recognition system according to claim 5, wherein: the processor stores the extracted feature value in the storage device as the feature value of a commodity in the commodity file when the calculated similarity is at or above a prescribed threshold value. ### Claim 7 An information processing apparatus, comprising: an interface to receive image data; a storage device which stores a commodity file including identification information for a plurality of commodities, feature values for the plurality of commodities, and a predetermined recognition classification for each commodity in the plurality indicating the commodity is one of a first commodity type or a second commodity type, the first commodity type being commodities to be recognized using a code symbol associated with the commodity in the commodity file and the second commodity type being commodities to be recognized using a feature value associated with the commodity in the commodity file; and a processor which is configured to: determine whether a code symbol can be detected in the image data, detect an article in the image data if a code symbol cannot be detected in the image data extract a feature value of the detected article from the image data, calculate similarities between the stored feature values in the commodity file for commodities of the first commodity type and the second commodity type and the extracted feature value, recognize commodities in the commodity file as candidates corresponding to the detected article based on the calculated similarities, exclude commodities of the first commodity type from the candidates based on the predetermined recognition classification included in the commodity file, and select a commodity from the candidates as a recognized commodity based on calculated similarity provided that the calculated similarity for the commodity is above a threshold value. ### Claim 8 (depends on 7) The information processing apparatus according to claim 7, wherein: the processor stores the extracted feature value in the storage device when the detected article is a commodity of the first commodity type. ### Claim 9 (depends on 8) The information processing apparatus according to claim 8, wherein: the processor stores the extracted feature value in the storage device as the feature value of a commodity in the commodity file when the calculated similarity is at or above a prescribed threshold value. ### Claim 10 An information processing method for an information processing apparatus having an interface to receive image data, a storage device which stores a commodity file including identification information for a plurality of commodities, feature values for the plurality of commodities, and a predetermined recognition classification for each commodity in the plurality indicating the commodity is one of a first commodity type or a second commodity type, the first commodity type being commodities to be recognized using a code symbol associated with the commodity in the commodity file and the second commodity type being commodities to be recognized using a feature value associated with the commodity in the commodity file, and a processor, the method comprising: determining whether a code symbol can be detected in the image data, detecting an article in the image data if a code symbol cannot be detected in the image data, extracting a feature value of the detected article from the image data, calculating similarities between the stored feature values in the commodity file for commodities of the first commodity type and the second commodity type and the extracted feature value, recognizing commodities in the commodity file as candidates corresponding to the detected article based on the calculated similarities, excluding commodities of the first commodity type from the candidates based on the predetermined recognition classification included in the commodity file, and selecting a commodity from the candidates as a recognized commodity based on calculated similarity provided that the calculated similarity for the commodity is above a threshold value.