Security alert generation using sensor data
AssigneeZoom Communications, Inc.
InventorsJin Fang, Hainan Wang, Qing Wang
Life of this patent
Estimating the term…
Abstract
A computing device receives streaming data from one or more security sensors at a geographic location, the one or more security sensors comprising at least one of a camera, a microphone, or a thermal sensor. The computing device determines, by an artificial intelligence engine, an event occurring at the geographic location based on the streaming data based on receiving the streaming data, the artificial intelligence engine including at least one convolutional neural network and at least one transformer. The computing device transmits, to an output device, an alert corresponding to the event.
Claims20
A method, comprising:
- receiving, by one or more computing devices, streaming data from one or more security sensors at a geographic location, the one or more security sensors comprising at least one of a camera, a microphone, or a thermal sensor;
- determining, by an artificial intelligence engine at the one or more computing devices, an event occurring at the geographic location based on the streaming data, the artificial intelligence engine including at least one convolutional neural network and at least one transformer, wherein determining the event comprises processing visual data using the at least one convolutional neural network and processing audio data using the at least one transformer, and wherein the artificial intelligence engine determines the event based on transmission of a predicted event based on visual data from a visual processing engine that includes the at least one convolutional neural network to an audio processing engine that includes the at least one transformer;
- and
- transmitting, to an output device, an alert corresponding to the event.
A non-transitory computer readable medium storing instructions operable to cause one or more processors to perform operations comprising:
- receiving, by one or more computing devices, streaming data from one or more security sensors at a geographic location, the one or more security sensors comprising at least one of a camera, a microphone, or a thermal sensor;
- determining, by an artificial intelligence engine at the one or more computing devices, an event occurring at the geographic location based on the streaming data, the artificial intelligence engine including at least one convolutional neural network and at least one transformer, wherein determining the event comprises processing visual data using the at least one convolutional neural network and processing audio data using the at least one transformer, and wherein the artificial intelligence engine determines the event based on transmission of a predicted event based on visual data from a visual processing engine that includes the at least one convolutional neural network to an audio processing engine that includes the at least one transformer;
- and
- transmitting, to an output device, an alert corresponding to the event.
A system, comprising:
- a memory subsystem;
- and
- processing circuitry configured to execute instructions stored in the memory subsystem to:
- receiving, by one or more computing devices, streaming data from one or more security sensors at a geographic location, the one or more security sensors comprising at least one of a camera, a microphone, or a thermal sensor;
- determining, by an artificial intelligence engine at the one or more computing devices, an event occurring at the geographic location based on the streaming data, the artificial intelligence engine including at least one convolutional neural network and at least one transformer, wherein determining the event comprises processing visual data using the at least one convolutional neural network and processing audio data using the at least one transformer, and wherein the artificial intelligence engine determines the event based on transmission of a predicted event based on visual data from a visual processing engine that includes the at least one convolutional neural network to an audio processing engine that includes the at least one transformer;
- and
- transmitting, to an output device, an alert corresponding to the event.
Dependencies are inferred from the claim text.