# US 12,602,199 B2 · Registration apparatus, registration method, and non-transitory storage medium with audio output for products imaged and sensed by any of size and kind > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,602,199 B2 - Document ID: US12602199B2 - Status: Granted - Kind: B2 - Application number: 18/221,799 - Filed: 2023-07-13 - Published: 2023-11-09 - Granted: 2026-04-14 - Earliest claimed: 2023-07-13 - Assignees: NEC Corporation - Applicants: NEC Corporation - Inventors: Soma Shiraishi; Kota Iwamoto; Hideo Yokoi; Tsugunori Takata; Emi Kitagawa - Web page: https://patentgrep.com/patent/US12602199B2 ## CPC - G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback} - G06F 3/16: Sound input; Sound output (speech processing G10L) - G06Q 20/208: {Input by product or record sensing, e.g. weighing or scanner processing} - G06V 20/52: Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69) - G07G 1/0063: {with means for detecting the geometric dimensions of the article of which the code is read, such as its size or height, for the verification of the registration} - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - G07G: REGISTERING THE RECEIPT OF CASH, VALUABLES, OR TOKENS ## Abstract The invention addresses the problem of improving labor of a registration operation of a product and enabling a checkout operator to recognize a recognition result. In order to solve the problem, the invention provides a registration apparatus (10) including: an image acquisition unit (11) that acquires an image obtained by imaging a placement surface of a table, on which a product is placed; an analysis unit (12) that recognizes the product included in the image, a registration unit (14) that registers the recognized product as a checkout target, and an output unit (13) that outputs a name of the recognized product by voice. ## Claims ### Claim 1 A registration apparatus comprising: at least one memory configured to store one or more instructions; and at least one processor configured to execute the one or more instructions to: acquire an image obtained by imaging a placement surface of a table, on which a product is placed; recognize, as a recognized product, the product included in the image; determine whether the recognized product satisfies a predetermined condition, the predetermined condition including: a reliability of a recognition result of the recognized product is lower than a first reference value, a price of the recognized product is equal to or higher than a second reference value, and whether there exists an other product that is different from the recognized product, is of a same kind as the recognized product, and has a different size from the recognized product; and output a name of the recognized product by voice when the recognized product satisfies the predetermined condition. ### Claim 2 (depends on 1) The registration apparatus according to claim 1, wherein the at least one processor is further configured to execute the one or more instructions to: register the recognized product as a checkout target. ### Claim 3 (depends on 1) The registration apparatus according to claim 1, wherein the at least one processor is further configured to execute the one or more instructions to: display information for highlighting a placed position of the product on the table while the name of the product is being output by voice. ### Claim 4 (depends on 1) The registration apparatus according to claim 1, wherein the at least one processor is further configured to execute the one or more instructions to: determine whether the recognized product is on a list of products to be a voice processing target; and output the name of the recognized product by voice when the recognized product is on the list. ### Claim 5 (depends on 4) The registration apparatus according to claim 4, wherein the at least one processor is further configured to execute the one or more instructions to: receive, by user operation, selection of target product to be output by voice; and generate the list as further including information of the target product. ### Claim 6 (depends on 1) The registration apparatus according to claim 1, wherein the at least one processor is further configured to execute the one or more instructions to: while a name of a first product is being output by voice, in response to recognition of the other product, interrupt processing for outputting the name of the first product by voice, and start processing for outputting a name of the other product by voice. ### Claim 7 A registration method executed by a computer, the registration method comprising: acquiring an image obtained by imaging a placement surface of a table, on which a product is placed; recognizing, as a recognized product, the product included in the image; determining whether the recognized product satisfies a predetermined condition, the predetermined condition including: a reliability of a recognition result of the recognized product is lower than a first reference value, a price of the recognized product is equal to or higher than a second reference value, and whether there exists an other product that is different from the recognized product, is of a same kind as the recognized product, and has a different size from the recognized product; and outputting a name of the recognized product by voice when the recognized product satisfies the predetermined condition. ### Claim 8 (depends on 7) The registration method according to claim 7, wherein the computer registers the recognized product as a checkout target. ### Claim 9 (depends on 7) The registration method according to claim 7, wherein the computer displays information for highlighting a placed position of the product on the table while the name of the product is being output by voice. ### Claim 10 (depends on 7) The registration method according to claim 7, wherein the computer: determines whether the recognized product is on a list of products to be a voice processing target; and outputs the name of the recognized product by voice when the recognized product is on the list. ### Claim 11 (depends on 10) The registration method according to claim 10, wherein the computer: receives, by user operation, selection of target product to be output by voice; and generates the list as further including information of the target product. ### Claim 12 (depends on 7) The registration method according to claim 7, wherein the computer: while a name of a first product is being output by voice, in response to recognition of the other product, interrupts processing for outputting the name of the first product by voice, and starts processing for outputting a name of the other product by voice. ### Claim 13 A non-transitory storage medium storing a program that causes a computer to: acquire an image obtained by imaging a placement surface of a table, on which a product is placed; recognize, as a recognized product, the product included in the image; determine whether the recognized product satisfies a predetermined condition, the predetermined condition including: a reliability of a recognition result of the recognized product is lower than a first reference value, a price of the recognized product is equal to or higher than a second reference value, and whether there exists an other product that is different from the recognized product, is of a same kind as the recognized product, and has a different size from the recognized product; and output a name of the recognized product by voice when the recognized product satisfies the predetermined condition. ### Claim 14 (depends on 13) The non-transitory storage medium according to claim 13, wherein the program further cause the computer to register the recognized product as a checkout target. ### Claim 15 (depends on 13) The non-transitory storage medium according to claim 13, wherein the program further cause the computer to display information for highlighting a placed position of the product on the table while the name of the product is being output by voice. ### Claim 16 (depends on 13) The non-transitory storage medium according to claim 13, wherein the program further cause the computer to: determine whether the recognized product is on a list of products to be a voice processing target; and output the name of the recognized product by voice when the recognized product is on the list. ### Claim 17 (depends on 16) The non-transitory storage medium according to claim 16, wherein the program further cause the computer to: receive, by user operation, selection of target product to be output by voice; and generate the list as further including information of the target product.