# US 12,190,693 B2 · Video analytics system for identifying events > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,190,693 B2 - Document ID: US12190693B2 - Status: Granted - Kind: B2 - Application number: 18/309,679 - Filed: 2023-04-28 - Published: 2024-02-29 - Granted: 2025-01-07 - Earliest claimed: 2017-10-26 - Assignees: Raptor Vision, LLC - Applicants: Raptor Vision, LLC - Inventors: Scott Charles Mullins - Web page: https://patentgrep.com/patent/US12190693B2 ## CPC - G08B 13/19613: {Recognition of a predetermined image pattern or behaviour pattern indicating theft or intrusion} - G08B 13/19: using infrared-radiation detection systems {(G08B13/194 takes precedence)} - G08B 13/19615: {wherein said pattern is defined by the user} - G08B 13/19652: {Systems using zones in a single scene defined for different treatment, e.g. outer zone gives pre-alarm, inner zone gives alarm} - G08B 13/1968: {Interfaces for setting up or customising the system} - G08B 13/19682: {Graphic User Interface [GUI] presenting system data to the user, e.g. information on a screen helping a user interacting with an alarm system} - G08B 25/14: Central alarm receiver or annunciator arrangements - G08B 29/188: {Data fusion; cooperative systems, e.g. voting among different detectors} - H04R 27/00: Public address systems (circuits for preventing acoustic reaction H04R3/02; circuits for distributing signals to loudspeakers H04R3/12; {monitoring or testing arrangements for public address systems H04R29/007}; amplifiers H03F) - G08B 13/19695: {Arrangements wherein non-video detectors start video recording or forwarding but do not generate an alarm themselves} - G08B 15/00: Identifying, scaring or incapacitating burglars, thieves or intruders, e.g. by explosives - H04R 2227/003: Digital PA systems using, e.g. LAN or internet - G08B: SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS - H04R: LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS (producing sounds with frequency not determined by supply frequency G10K) ## Abstract A security system can use video analytics and/or other input parameters to identify a theft event. Optionally, the security system can take remedial action in response. For example, the security system can use video analytics to determine that a person has reached into a shelf multiple times at a rate above a threshold, which can indicate that a thief is quickly removing items from the shelf. The security system can also use video analytics to determine that a person has reached into a shelf via a sweeping action, which can indicate that a thief is gathering and removing a large quantity of items from the shelf in one motion. In response, the security system can alert security personnel, cause a speaker to output an audible message in the target area, flag portions of the video relating to the theft event, activate or ready other sensors or systems, and/or the like. ## Claims ### Claim 1 A system, comprising: a camera positioned to provide video footage of a region that includes a monitored area; and a controller comprising: at least one hardware processor; and computer-readable memory in communication with the at least one hardware processor, the memory containing a threshold breach count value, a threshold breach time value, and instructions executable by the at least one processor to cause the controller to: receive the video footage of the region that includes the monitored area; perform video analysis on the video footage to identify one or more persons in the region that includes the monitored area; perform video analysis on the video footage to identify a first breach into the monitored area; perform video analysis on the video footage to determine that the first breach into the monitored area was performed by a first identified person; perform video analysis on the video footage to identify a second breach into the monitored area; perform video analysis on the video footage to determine that the second breach into the monitored area was performed by the first identified person; and determine an event based at least in part on detecting a threshold number of breaches performed by the same first identified person, wherein the threshold number of breaches satisfies the threshold breach count value within a time that satisfies the threshold breach time value; perform video analysis on the video footage to identify a third breach into the monitored area; and perform video analysis on the video footage to determine that the third breach into the monitored area was performed by a second identified person different from first identified person, wherein the controller does not count the third breach towards the threshold number of breaches. ### Claim 2 (depends on 1) The system of claim 1, wherein the monitored area comprises merchandise shelves in a retail store. ### Claim 3 (depends on 1) The system of claim 1, wherein the first breach is on a first merchandise shelf and the second breach is on a second merchandise shelf. ### Claim 4 (depends on 1) The system of claim 1, wherein the instructions are configured to cause the controller to provide a user interface configured to receive user input to change the threshold breach count value and the threshold breach time value. ### Claim 5 (depends on 1) The system of claim 1, wherein the instructions are configured to cause the controller to provide a user interface configured to receive user input to indicate a person size for the video footage. ### Claim 6 (depends on 1) The system of claim 1, wherein the instructions are configured to cause the controller to issue a notification in response to the determination of the event. ### Claim 7 (depends on 6) The system of claim 6, wherein the controller is configured to determine a number of people in a monitored location, and the controller can determine whether to issue the notification based at least in part on the determined number of people. ### Claim 8 A method comprising: receiving video footage of a region that includes a monitored area; processing the video footage using at least one hardware processor to identify one or more persons in the region that includes the monitored area; processing the video footage using the at least one hardware processor to identify a plurality of breaches into the monitored area; processing the video footage using the at least one hardware processor to determine which of the one or more persons performed each of the plurality of identified breaches; accessing a threshold breach count value, and a threshold breach time value stored in computer-readable memory in communication with the at least one hardware processor; determining an event using the at least one hardware processor by at least identifying a threshold number of breaches performed by the same person that satisfies the threshold breach count value at times within the threshold breach time value; processing the video footage to identify an additional breach into the monitored area; and processing the video footage to determine that the additional breach into the monitored area was performed by a second identified person different from first identified person, wherein the method does not count the additional breach towards the threshold number of breaches. ### Claim 9 (depends on 8) The method of claim 8, wherein the monitored area comprises merchandise shelves in a retail store. ### Claim 10 (depends on 8) The method of claim 8, wherein the first breach is on a first merchandise shelf and the second breach is on a second merchandise shelf. ### Claim 11 A non-transitory computer-readable medium comprising: a threshold breach count value; a threshold breach time value; and instructions executable by at least one processor to: receive video footage of a region that includes a monitored area; perform video analysis on the video footage to identify one or more persons in the region that includes the monitored area; perform video analysis on the video footage to identify a plurality of breaches into the monitored area; perform video analysis on the video footage to determine which of the one or more persons performed each of the plurality of identified breaches; identify an event at least in part by determining that a single person performed a threshold number of breaches that satisfies the threshold breach count value at times within the threshold breach time value; perform video analysis on the video footage to identify an additional breach into the monitored area; and perform video analysis on the video footage to determine that the additional breach into the monitored area was performed by a second identified person different from first identified person, wherein the processor does not count the additional breach towards the threshold number of breaches. ### Claim 12 (depends on 11) The computer-readable medium of claim 11, wherein the monitored area comprises merchandise shelves in a retail store. ### Claim 13 (depends on 11) The computer-readable medium of claim 11, wherein the instructions are configured to provide a user interface configured to receive user input to change the threshold breach count value and the threshold breach time value. ### Claim 14 (depends on 11) The computer-readable medium of claim 11, wherein the instructions are configured to provide a user interface configured to receive user input to indicate a person size for the video footage. ### Claim 15 (depends on 11) The computer-readable medium of claim 11, wherein the instructions are configured to issue a notification in response to the determination of the event. ### Claim 16 (depends on 11) The computer-readable medium of claim 11, wherein the instruction are configured to cause the processor to determine a number of people in a monitored location, and the controller can determine whether to issue the notification based at least in part on the determined number of people.