Back to results
US 12,711,767 B2Granted
System and method for identifying events in a video stream
AssigneeHoneywell International Inc.
InventorsManjuprakash Rama Rao, Sayantan Das, Sambasivarao Karlakunta, Shrihari Eknath Gunjal
Life of this patent
Estimating the term…
Abstract
Events may be identified in a video stream using a first video analytics algorithm and the identified events may be validated using a second video analytics algorithm that is more comprehensive than the first video analytics algorithm. The event as identified by the first video analytics algorithm may be reported when the identified event is validated by the second video analytics algorithm.
Claims12
A method for identifying events in a video stream, the method comprising:
- processing the video stream using a first video analytics algorithm to identify a candidate event in the video stream;
- extracting one or more images from the video stream that represent the candidate event;
- processing the one or more images extracted from the video stream that represent the candidate event using a second video analytics algorithm which is more computationally intensive than the first video analytics algorithm to validate the candidate event identified by the first video analytics algorithm, wherein the second video analytics algorithm identifies an event in the one or more images extracted from the video stream, and includes a Visual Transformer Large Language Model (ViTLLM) that outputs a textual description of the event identified by the second video analytics algorithm;
- determining whether the event identified by the second video analytics algorithm matches the candidate event as determined by the first video analytics algorithm;
- reporting the candidate event to a monitoring station if the event identified by the second video analytics algorithm matches the candidate event as determined by the first video analytics algorithm;
- and
- not reporting the candidate event to the monitoring station if the event identified by the second video analytics algorithm does not match the candidate event as determined by the first video analytics algorithm.
4 more elements
A system comprising:
- one or more memories for storing a first video analytics algorithm and a second video analytics algorithm, wherein the second video analytics algorithm is more computationally intensive than the first video analytics algorithm;
- one or more controllers operatively coupled to the one or more memories, the one or more controllers configured to:
- receive a video stream;
- process the video stream using the first video analytics algorithm to identify a candidate event in the video stream;
- extract one or more images from the video stream that represent the candidate event;
- process the one or more images extracted from the video stream that represent the candidate event using the second video analytics algorithm to validate the candidate event identified by the first video analytics algorithm, wherein the second video analytics algorithm identifies an event in the one or more images extracted from the video stream, and includes a Visual Transformer Large Language Model (ViTLLM) that outputs a textual description of the event identified by the second video analytics algorithm;
- determine whether the event identified by the second video analytics algorithm matches the candidate event as determined by the first video analytics algorithm;
- report the candidate event if the event identified by the second video analytics algorithm matches the candidate event as determined by the first video analytics algorithm;
- and
- not report the candidate event if the event identified by the second video analytics algorithm does not match the candidate event as determined by the first video analytics algorithm.
7 more elements
A method for identifying events in a video stream, the method comprising:
- identifying an event in a video stream using a first video analytics algorithm;
- validating the identified event in the video stream using a second video analytics algorithm, wherein the second video analytics algorithm is more comprehensive than the first video analytics algorithm, and includes a Visual Transformer Large Language Model (ViTLLM) that outputs a textual description of an event identified by the second video analytics algorithm;
- reporting the event as identified by the first video analytics algorithm when the identified event is validated by the second video analytics algorithm;
- and
- not reporting the event as identified by the first video analytics algorithm when the identified event is not validated by the second video analytics algorithm.
2 more elements
Dependencies are inferred from the claim text.