# US 12,223,724 B2 · Fraudulent act recognition device, control program therefor, and fraudulent act recognition method > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,223,724 B2 - Document ID: US12223724B2 - Status: Granted - Kind: B2 - Application number: 17/520,138 - Filed: 2021-11-05 - Published: 2022-07-14 - Granted: 2025-02-11 - Earliest claimed: 2021-01-14 - Assignees: Toshiba Tec Kabushiki Kaisha - Applicants: Toshiba Tec Kabushiki Kaisha - Inventors: Daisuke Miyagi - Web page: https://patentgrep.com/patent/US12223724B2 ## CPC - G06V 20/52: Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69) - G06V 40/172: {Classification, e.g. identification} - G06V 40/28: {Recognition of hand or arm movements, e.g. recognition of deaf sign language (static hand signs G06V40/113)} - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING ## Abstract A fraudulent act recognition device is configured to be operatively coupled to a camera that monitors operation of a settlement terminal by a purchaser. The fraudulent act recognition device includes a controller configured to recognize a commodity registration operation of the settlement terminal initiated by the purchaser. The controller is configured to review imaging data provided by the camera to recognize an action of the purchaser who performs the commodity registration operation. The controller is configured to determine whether an action of the purchaser is indicative of a fraudulent act. The controller is configured to provide a notification in response to a determination that the action of the purchaser is indicative of the fraudulent act. ## Claims ### Claim 1 A fraudulent act recognition device configured to be operatively coupled to a camera that monitors operation of a settlement terminal by a purchaser, the fraudulent act recognition device comprising a controller configured to: recognize a commodity registration operation of the settlement terminal initiated by the purchaser; review imaging data provided by the camera to recognize an action of the purchaser who performs the commodity registration operation based on a position of a component of the settlement terminal and a position of a hand of the purchaser while the purchaser faces the settlement terminal; determine that a movement of the hand of the purchaser holding a commodity for which the commodity registration operation is recognized is a movement associated with replacing the commodity in response to a determination, based on the imaging data, that the movement of the hand includes at least one of (a) movement of the hand toward a floor or (b) movement of the hand toward an area behind the purchaser; determine that the action of the purchaser is indicative of the fraudulent act in response to a determination that the movement of the hand of the purchaser is the movement associated with replacing the commodity; and provide a notification in response to a determination that the action of the purchaser is indicative of the fraudulent act. ### Claim 2 (depends on 1) The fraudulent act recognition device of claim 1, wherein the commodity registration operation includes the purchaser scanning a barcode of a commodity using a scanner of the settlement terminal. ### Claim 3 (depends on 1) The fraudulent act recognition device of claim 1, wherein the commodity registration operation includes the purchaser operating a user interface of the settlement terminal to provide a selection of a commodity. ### Claim 4 (depends on 1) The fraudulent act recognition device of claim 1, wherein the controller is configured to recognize the commodity registration operation by reviewing data provided by the settlement terminal, the data relating to a current state of the settlement terminal. ### Claim 5 (depends on 1) The fraudulent act recognition device of claim 1, wherein the controller is configured to provide the notification by commanding a display of attendant terminal to display a message. ### Claim 6 (depends on 1) The fraudulent act recognition device of claim 1, wherein the controller is configured to determine that the movement of the hand of the purchaser is the movement associated with replacing the commodity in response to a determination, based on the imaging data, that the movement of the hand includes the movement of the hand toward the floor. ### Claim 7 (depends on 1) The fraudulent act recognition device of claim 1, wherein the controller is configured to determine that the movement of the hand of the purchaser is the movement associated with replacing the commodity in response to a determination, based on the imaging data, that the movement of the hand includes the movement of the hand toward the area behind the purchaser. ### Claim 8 A checkout system comprising: a settlement terminal configured to be operated by a purchaser to register a commodity for purchase; a camera positioned to generate imaging data representing operation of the settlement terminal by the purchaser; and a fraudulent act recognition device operatively coupled to the settlement terminal and the camera, the fraudulent act recognition device comprising a controller configured to: receive data from the settlement terminal, the data indicating a current state of the settlement terminal; review the imaging data provided by the camera to recognize an action of the purchaser, the action including a movement of a hand of the purchaser holding the commodity; determine that the action of the purchaser is indicative of a fraudulent act in response to a determination that both (a) the settlement terminal has recognized a commodity registration operation for the commodity and (b) the movement of the hand of the purchaser is a movement associated with replacing the commodity including at least one of (i) movement of the hand toward a floor or (ii) movement of the hand toward an area behind the purchaser; and provide a notification in response to a determination that the action of the purchaser is indicative of the fraudulent act. ### Claim 9 (depends on 8) The checkout system of claim 8, wherein the controller is configured to determine that the action of the purchaser is indicative of the fraudulent act in response to a determination that both (a) the settlement terminal has recognized the commodity registration operation for the commodity and (b) the movement of the hand of the purchaser includes the movement of the hand toward the floor. ### Claim 10 (depends on 8) The checkout system of claim 8, wherein the controller is configured to determine that the action of the purchaser is indicative of the fraudulent act in response to a determination that both (a) the settlement terminal has recognized the commodity registration operation for the commodity and (b) the movement of the hand of the purchaser includes the movement of the hand toward the area behind the purchaser. ### Claim 11 A fraudulent act recognition method comprising: recognizing a commodity registration operation of a settlement terminal initiated by a purchaser; reviewing imaging data provided by a camera to recognize an action of the purchaser who performs the commodity registration operation for a commodity, the camera being positioned to monitor operation of the settlement terminal by the purchaser, and the action including a movement of a purchaser holding the commodity; determining that the action of the purchaser is indicative of a fraudulent act in response to a determination that the movement of the purchaser is a movement associated with replacing the commodity including at least one of (a) movement by the purchaser of the commodity toward a floor or (b) movement by the purchaser of the commodity toward an area behind the purchaser; and providing a notification to an attendant in response to a determination that the action of the purchaser is indicative of the fraudulent act. ### Claim 12 (depends on 11) The fraudulent act recognition method of claim 11, wherein: recognizing the commodity registration operation includes receiving data from the settlement terminal, the data indicating a status of the settlement terminal; and determining whether the action of the purchaser is indicative of the fraudulent act includes determining whether the action of the purchaser is indicative of the fraudulent act based on the status of the settlement terminal and the imaging data. ### Claim 13 (depends on 11) The fraudulent act recognition method of claim 11, wherein the movement associated with replacing the commodity is the movement by the purchaser of the commodity toward the floor. ### Claim 14 (depends on 11) The fraudulent act recognition method of claim 11, wherein the movement associated with replacing the commodity is the movement by the purchaser of the commodity toward the area behind the purchaser.