Automatic visual and acoustic analytics for event detection
AssigneeExxonMobil Research and Engineering Company
InventorChristopher S. Gurciullo
Life of this patent
Estimating the term…
Abstract
Systems and methods are provided for detecting events in industrial processes. An acquisition system may include one of a camera and an audio recorder to acquire monitoring data in the form of one of imaging data and acoustic data, respectively. A computer system, may include a machine learning engine and may be programmed to classify the monitoring data under a classifier, quantify, based on the classifier, the monitoring data with at least one quantifier, and detect an event when the at least one quantifier satisfies a predetermined rule corresponding to the at least one quantifier.
Claims9
A method for automatic visual analytic detection of events for an industrial environment, comprising:
- acquiring visual monitoring data from an acquisition system for the industrial environment of interest, wherein the monitoring data is imaging data;
- analyzing historical data to generate a library of expected events, wherein each of the expected events is associated with one of an alert and a control signal;
- identifying a relevant portion of the visual monitoring data;
- classifying the relevant portion of the visual monitoring data under a classifier utilizing a machine learning engine operated by a computer system, wherein the classifier classifies at least one of thermal content and movement;
- quantifying, based on the classifier, the visual monitoring data with at least one quantifier utilizing the machine learning engine operated by the computer system;
- detecting utilizing the machine learning engine operated by the computer system an event when the at least one quantifier satisfies a predetermined rule corresponding to the at least one quantifier,
- wherein when an event is detected, matching the detected event to one of the expected events in the library of expected events, wherein if there is a match, transmitting one of the alert and the control signal, and wherein if there is no match, generating and transmitting another alert;
- and
- augmenting the historical data by historizing the acquired visual monitoring data,
- wherein when an event is detected, historizing the detected event, and associating the detected event with the acquired visual monitoring data,
- wherein if there is a match, historizing one of the alert and the control signal, and associating one of the alert and the control signal with the detected event, and
- wherein if there is no match, historizing the another alert, and associating the another alert with the detected event.
A system for automatic visual analytic detection of events for an industrial environment, comprising:
- an acquisition system to acquire visual monitoring data, wherein the acquisition system includes at least one of a camera, wherein the visual monitoring data is imaging data;
- and
- a computer system including a machine learning engine programmed to:
- identify a relevant portion of the visual monitoring data;
- classify the relevant portion of the visual monitoring data under a classifier, wherein the classifier classifies at least one of thermal content and movement;
- analyze historical data stored in a database to generate a library of expected events, wherein each of the expected events is associated with one of an alert and a control signal;
- quantify, based on the classifier, the visual monitoring data with at least one quantifier;
- detect an event when the at least one quantifier satisfies a predetermined rule corresponding to the at least one quantifier,
- wherein when an event is detected, match the detected event to one of the expected events, wherein if there is a match, transmit one of the alert and the control signal, and wherein if there is no match, generate and transmit another alert;
- and
- augment the historical data in the database by historizing the acquired visual monitoring data,
- wherein when an event is detected, historizing the detected event, associating the detected event with the acquired visual monitoring data;
- wherein if there is a match, historizing one of the alert and the control signal, and associating one of the alert and the control signal with the detected event, and
- wherein if there is no match, historizing the another alert, and associating the another alert with the detected event.
Dependencies are inferred from the claim text.