# US 2019/0172293 A1 · Investigation generation in an observation and surveillance system > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2019/0172293 A1 - Document ID: US20190172293A1 - Status: Published application - Kind: A1 - Application number: 16/251,233 - Filed: 2019-01-18 - Published: 2019-06-06 - Earliest claimed: 2013-03-15 - Inventors: James Carey - Web page: https://patentgrep.com/patent/US20190172293A1 ## CPC - G07F 9/026: {for alarm, monitoring and auditing in vending machines or means for indication, e.g. when empty} - G06Q 20/20: Point-of-sale [POS] network systems - G06V 20/13: Satellite images - G06V 20/17: taken from planes or by drones - G06V 20/52: Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69) - G07F 19/207: {Surveillance aspects at ATMs} - G07G 3/003: {Anti-theft control (theft alarms G08B13/00)} - G08B 13/19608: {Tracking movement of a target, e.g. by detecting an object predefined as a target, using target direction and or velocity to predict its new position} - G08B 13/19613: {Recognition of a predetermined image pattern or behaviour pattern indicating theft or intrusion} - H04N 7/181: {for receiving images from a plurality of remote sources} - G08B 13/1965: {the vehicle being an aircraft} - G07F: COIN-FREED OR LIKE APPARATUS (coin sorting G07D3/00; coin testing G07D5/00; {handling coins or paper currencies apart from payment activated apparatus G07D; payment architectures, schemes or protocols G06Q20/00}) - G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - G07G: REGISTERING THE RECEIPT OF CASH, VALUABLES, OR TOKENS - G08B: SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract The present disclosure is directed to systems and methods for generating investigations of user behavior. In an example embodiment, the system includes a video camera configured to capture video of user activity, a video analytic module to perform real-time video processing of the captured video to generate non-video data from video, and a computer configured to receive the video and the non-video data from the video camera. In some embodiments, the video camera is at least one of a traffic camera or an aerial drone camera. The computer includes a video analytics module configured to analyze one of video and non-video data to identify occurrences of particular user behavior, and an investigation generation module configured to generate an investigation containing at least one video sequence of the particular user behavior. In some embodiments, the investigation is generated in near real time. The particular user behavior may be defined as an action, an inaction, a movement, a plurality of event occurrences, a temporal event and/or an externally-generated event. ## Claims ### Claim 1 A system to generate real-time investigations of user behavior comprising: a video camera configured to capture video of user activity to generate video data, wherein the video camera is at least one of a traffic camera or an aerial drone camera; and a computer configured to receive the video data from the video camera, the computer including: a video analytics module configured to: perform real-time video processing of the video data to generate non-video data; and analyze one of video and non-video data to identify occurrences of particular user behavior; and an investigation generation module configured to generate an investigation containing at least one video sequence of the particular user behavior. ### Claim 2 (depends on 1) The system according to claim 1, wherein the investigation is generated in real time. ### Claim 3 (depends on 1) The system according to claim 1, wherein the investigation generation module is configured to assign externally-generated data to the investigation. ### Claim 4 (depends on 3) The system according to claim 3, further comprising a POS system, wherein the computer receives the externally-generated data from the POS system and the externally-generated data includes at least one POS transaction. ### Claim 5 (depends on 1) The system according to claim 1, wherein the investigation generation module is configured to simultaneously manage and populate a plurality of investigations. ### Claim 6 (depends on 1) The system according to claim 1, wherein the particular user behavior is defined as at least one of an action, an inaction, a movement, a plurality of event occurrences, a temporal event and an externally-generated event. ### Claim 7 (depends on 1) The system according to claim 1, wherein the particular user behavior is defined by a model of the particular user behavior and the video analytics module further includes: a comparator module configured to compare the model of the particular user behavior and the non-video data. ### Claim 8 A system to generate real-time investigations of user behavior comprising: a video camera configured to capture video of user activity to generate video data, wherein the video camera is at least one of a traffic camera or an aerial drone camera; and a computer configured to receive the video data from the video data from the video camera, the computer including: a video analytics module configured to: perform real-time video processing of the video data to generate non-video data; and analyze one of video and non-video data to identify at least one occurrence of particular user behavior; and an investigation generation module configured to assign a video sequence related to the at least one identified occurrence of particular user behavior to an investigation. ### Claim 9 (depends on 8) The system according to claim 8, wherein the investigation is generated in near real time. ### Claim 10 (depends on 8) The system according to claim 8, wherein the investigation generation module is configured to assign externally-generated data to the investigation. ### Claim 11 (depends on 10) The system according to claim 10, further comprising a POS system, wherein the computer receives the externally-generated data from the POS system and the externally-generated data includes at least one POS transaction. ### Claim 12 (depends on 8) The system according to claim 8, wherein the investigation generation module is further configured to simultaneously manage and populate a plurality of investigations. ### Claim 13 (depends on 8) The system according to claim 8, wherein the particular user behavior is defined as at least one of an action, an inaction, a movement, a plurality of event occurrences, a temporal event and an externally-generated event. ### Claim 14 (depends on 8) The system according to claim 8, wherein the particular user behavior is defined by a model of the particular user behavior and the computer further includes: a comparator module configured to compare the model of the particular user behavior and the non-video data. ### Claim 15 A method of observing behavior comprising the steps of: receiving video from a camera, wherein the camera is at least one of a traffic camera or an aerial drone camera; generating non-video data from the video wherein the non-video data includes non-video data related to user behavior; identifying a particular user behavior; identifying at least one occurrence of the particular user behavior within the video data; and generating an investigation related to the particular user behavior. ### Claim 16 (depends on 15) The method according to claim 15, wherein the identifying the particular user behavior further includes: defining the particular user behavior as at least one of an action, an inaction, a movement, a plurality of event occurrences, a temporal event, and an externally-generated event. ### Claim 17 Non-transitory computer-readable medium comprising software for monitoring a point of sale (POS) transaction, which software, when executed by a computer system, causes the computer system to perform operations comprising a method of: receiving video from a camera, wherein the camera is at least one of a traffic camera or an aerial drone camera; generating non-video data from the video; identifying a particular user behavior; identifying an occurrence of the particular user behavior contained within the non-video data; and generating an investigation related to the identified occurrence of the particular user behavior. ### Claim 18 (depends on 17) The medium as set forth in claim 17, wherein the investigation includes video of the occurrence of the particular user behavior contained within the non-video data. ### Claim 19 (depends on 17) The medium as set forth in claim 17, wherein the method further includes the steps of: receiving externally-generated POS transaction data from a POS systems wherein the POS transaction data includes at least one individual transaction; identifying the particular user behavior temporally related to the at least one individual transaction; and providing data related to the at least one individual transaction to the investigation. ### Claim 20 (depends on 17) The medium as set forth in claim 17, wherein the method further includes the step of: defining the particular user behavior as at least one of an action, an inaction, a movement, a plurality of event occurrences, a temporal event and an externally-generated event.