# US 2023/0410588 A1 · Investigation generation in an observation and surveillance system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0410588 A1
- Document ID: US20230410588A1
- Status: Published application
- Kind: A1
- Application number: 18/458,215
- Filed: 2023-08-30
- Published: 2023-12-21
- Earliest claimed: 2013-03-15
- Inventors: James Carey
- Web page: https://patentgrep.com/patent/US20230410588A1

## CPC

- G07F 9/026: {for alarm, monitoring and auditing in vending machines or means for indication, e.g. when empty}
- G06Q 20/20: Point-of-sale [POS] network systems
- G07G 3/003: {Anti-theft control (theft alarms G08B13/00)}
- G08B 13/19613: {Recognition of a predetermined image pattern or behaviour pattern indicating theft or intrusion}
- H04N 7/181: {for receiving images from a plurality of remote sources}
- G06V 20/52: Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69)
- G07F: COIN-FREED OR LIKE APPARATUS (coin sorting G07D3/00; coin testing G07D5/00; {handling coins or paper currencies apart from payment activated apparatus G07D; payment architectures, schemes or protocols G06Q20/00})
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G07G: REGISTERING THE RECEIPT OF CASH, VALUABLES, OR TOKENS
- G08B: SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

The present disclosure is directed to systems and methods for generating investigations of user behavior. In an example embodiment, the system includes a video camera configured to capture video of user activity, a video analytic module to perform real-time video processing of the captured video to generate non-video data from video, and a computer configured to receive the video and the non-video data from the video camera. The computer includes a video analytics module configured to analyze one of video and non-video data to identify occurrences of particular user behavior, and an investigation generation module configured to generate an investigation containing at least one video sequence of the particular user behavior. In some embodiments, the investigation is generated in near real time. The particular user behavior may be defined as an action, an inaction, a movement, a plurality of event occurrences, a temporal event and/or an externally-generated event.

## Claims

### Claim 1

A system to generate real-time investigations of user behavior comprising:
a video camera configured to capture video of user activity;
a video analytic module to perform real-time video processing of the captured video to generate non-video data from video; and
a computer configured to receive the video and the non-video data from the video camera, the computer including:
a video analytics module configured to analyze one of video and non-video data to identify occurrences of particular user behavior; and
an investigation generation module configured to generate an investigation containing at least one video sequence of the particular user behavior.

### Claim 2 (depends on 1)

The system according to claim 1, wherein the investigation is generated in near real time.

### Claim 3 (depends on 1)

The system according to claim 1, wherein the investigation generation module assigns externally-generated data to the investigation.

### Claim 4 (depends on 3)

The system according to claim 3, wherein the computer receives the externally-generated data from a POS system and the externally-generated data includes at least one POS transaction.

### Claim 5 (depends on 1)

The system according to claim 1, wherein the investigation generation module is configured to simultaneously manage and populate a plurality of investigations.

### Claim 6 (depends on 1)

The system according to claim 1, wherein the particular user behavior is defined as at least one of an action, an inaction, a movement, a plurality of event occurrences, a temporal event and an externally-generated event.

### Claim 7 (depends on 1)

The system according to claim 1, wherein the particular user behavior is defined by a model of the particular user behavior and the video analytics module further includes:
a comparator module configured to compare the model of the particular user behavior and the non-video data.

### Claim 8

A system to generate real-time investigations of user behavior comprising:
a video camera configured to capture video of user activity;
a video analytic module to perform real-time video processing of the captured video to generates non-video data from video; and
a computer configured to receive the video and the non-video data from the video camera, the computer including:
a video analytics module configured to analyze one of video and non-video data to identify occurrences of particular user behavior; and
an investigation generation module configured to assign a video sequence related to the identified occurrence of particular user behavior to an investigation.

### Claim 9 (depends on 8)

The system according to claim 8, wherein the investigation is generated in near real time.

### Claim 10 (depends on 8)

The system according to claim 8, wherein the investigation generation module assigns externally-generated data to the investigation.

### Claim 11 (depends on 8)

The system according to claim 8, wherein the computer receives the externally-generated data from a POS system and the externally-generated data includes at least one POS transaction.

### Claim 12 (depends on 8)

The system according to claim 8, wherein the investigation generation module is configured to simultaneously manage and populate a plurality of investigations.

### Claim 13 (depends on 8)

The system according to claim 8, wherein the particular user behavior is defined as at least one of an action, an inaction, a movement, a plurality of event occurrences, a temporal event and an externally-generated event.

### Claim 14 (depends on 8)

The system according to claim 8, wherein the particular user behavior is defined by a model of the particular user behavior and the video analytics module further includes:
a comparator module configured to compare the model of the particular user behavior and the non-video data.

### Claim 15

A method of observing behavior comprising the steps of:
receiving video from a camera;
generating non-video data from the video wherein the non-video data includes non-video data related to user behavior;
identifying a particular user behavior;
identifying at least one occurrence of the particular user behavior within the video data; and
generating an investigation related to the particular user behavior.

### Claim 16 (depends on 15)

The method according to claim 15, wherein the identifying step further includes the step of:
defining the particular user behavior as at least one of an action, an inaction, a movement, a plurality of event occurrences, a temporal event, and an externally-generated event.
