System and method for automatic environmental data validation
AssigneeAquatic Informatics (139811)
InventorsPeter Hudson, Touraj Farahmand, Edward J. Quilty
Life of this patent
Estimating the term…
Abstract
A method for identifying anomalies in time series data, the method comprising the steps of computing parity vectors for one or more data points in a predetermined sample of data points in the time series, the parity vector representing redundancy between an estimated true value and an error term for each of the said one or more data points, evaluating the parity vectors to determine a set of the parity vectors in a selected direction; and evaluating a statistical distribution of the set according to a predetermined criterion to determine a data point to be corrected whose parity vectors satisfy the criterion in the distribution.
Claims17
A method for identifying anomalies in time series data, said method comprising the steps of:
- (a) computing parity vectors for one or more data points in a predetermined sample of data points in said time series, the parity vector representing redundancy between an estimated true value and an error term for each of said one or more data points;
- (b) evaluating said parity vectors to determine a set of said parity vectors in a selected direction;
- and
- (c) evaluating a statistical distribution of said set according to a predetermined criterion to determine a data point anomaly to be corrected whose parity vectors satisfy said criterion in said distribution.
A system for identifying anomalies in time series data, said system comprising:
- (a) a first module for computing parity vectors for a data points in a predetermined sample of data points in said time series, the parity vector representing redundancy between an estimated true value and an error term for each said data points;
- (b) a second module for evaluating said parity vectors to determine a set of said parity vectors in a selected direction;
- and
- (c) a third module for evaluating a statistical distribution of said set according to a predetermined criterion to determine a data point to be corrected whose parity vectors satisfy said criterion in said distribution.
A system comprising:
- (a) a network of sensors, for sensing one or more environmental conditions and at least one sensor in the network generating at least one time series data sequence;
- (b) a data validation module associated with at least one sensor in the network for validating the time series data generated by the at least one sensor, by determining a distribution of parity vectors computed on said time series data points and by using redundant data obtained from the network, the distribution being used to identify data points to be validated in the time series.
A computer-readable storage medium having stored therein a program which executes the steps of:
- (a) computing parity vectors for a data points in a predetermined sample of data points in a time series, the parity vector representing redundancy between an estimated true value and an error term for each said data points;
- (b) evaluating said parity vectors to determine a set of said parity vectors in a selected direction;
- and
- (c) evaluating a statistical distribution of said set according to a predetermined criterion to determine a data point to be corrected whose parity vectors satisfy said criterion in said distribution.
Dependencies are inferred from the claim text.