# US 2010/0166324 A1 · Method and apparatus for detecting suspicious activity using video analysis

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2010/0166324 A1
- Document ID: US20100166324A1
- Status: Published application
- Kind: A1
- Application number: 12/625,046
- Filed: 2009-11-24
- Published: 2010-07-01
- Earliest claimed: 2004-06-21
- Assignees: Stoplift, Inc.
- Inventors: Malay Kundu; Vikram Srinivasan; Joshua Migdal; Xiaowei Chen
- Web page: https://patentgrep.com/patent/US20100166324A1

## CPC

- G06V 20/52: Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69)
- G06Q 20/00: Payment architectures, schemes or protocols (apparatus for performing or posting payment transactions G07F7/08, G07F19/00; electronic cash registers G07G1/12)
- G06Q 20/20: Point-of-sale [POS] network systems
- G06Q 20/208: {Input by product or record sensing, e.g. weighing or scanner processing}
- G06Q 20/4016: {involving fraud or risk level assessment in transaction processing}
- G06Q 20/403: {Solvency checks}
- G06T 7/00: Image analysis
- G06V 20/41: {Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items (segmenting video sequences G06V20/49)}
- G07F 17/3241: {Security aspects of a gaming system, e.g. detecting cheating, device integrity, surveillance (computer security G06F21/00)}
- G07F 19/207: {Surveillance aspects at ATMs}
- G07G 3/00: Alarm indicators, e.g. bells
- H04N 7/181: {for receiving images from a plurality of remote sources}
- G06Q 20/206: {comprising security or operator identification provisions, e.g. password entry}
- G06T 2207/10016: Video; Image sequence
- G06T 2207/30232: Surveillance
- G06V 20/44: {Event detection}
- G08B 13/246: {Check out systems combined with EAS, e.g. price information stored on EAS tag (anti-theft systems in point of sale systems G07G3/003)}
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G07F: COIN-FREED OR LIKE APPARATUS (coin sorting G07D3/00; coin testing G07D5/00; {handling coins or paper currencies apart from payment activated apparatus G07D; payment architectures, schemes or protocols G06Q20/00})
- G07G: REGISTERING THE RECEIPT OF CASH, VALUABLES, OR TOKENS
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G08B: SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS

## Abstract

A system detects a transaction outcome by obtaining video data associated with a transaction area and analyzing the video data to obtain at least one video transaction parameter concerning transactions associated with the transaction area. The transaction area can be a video count of items indicated in the video data as detected by an automated item detection algorithm applied to the video data. The system obtains at least one expected transaction parameter concerning an expected transaction that occurs in the transaction area, such as a scan count of items scanned at a point of sale terminal. The system automatically compares the video transaction parameter(s) to the expected transaction parameter(s) to identify a transaction outcome that may indicate fraudulent activity such as sweethearting in a retail environment.

## Claims

### Claim 1

A method of detecting suspicious activity, the method comprising:
obtaining video data originating from at least one video camera that monitors a transaction area;
analyzing frames of video from a region of interest in the video data to identify a respective event indicating the presence of an item associated with the transaction; and
analyzing a sequence of items identified as being transacted in the transaction from a transaction data in comparison to events produced from analysis of the video data to determine if the item represented by at least one event produced from the analysis of the video data is indicated as an item for transacting in the at least a portion of transaction data;
correlating video timestamps to identify events indicating an item in the video data that does not have a corresponding record in the transaction data.