Back to results
US 2026/0087361 A1Published application
Systems, methods, and media for anomaly detection
OwnerXiao-Yang Liu, Xiaodong Wang +1inventors
InventorsXiao-Yang Liu, Xiaodong Wang, Zhenyan Huang
Life of this patent
Estimating the term…
Abstract
Mechanism for anomaly detection are provided, the mechanisms including: initializing a policy network; sampling a mini-batch of data from a training data set, wherein each mini-batch has a plurality of sample sequences, each having a plurality of time steps; for each time step of each sample sequence in each mini-batch: determining an action to be taken based on the policy of the network; and determining a reward; determining a gradient of an expected discounted cumulative reward; and updating the policy network.
Claims1
A method for anomaly detection, comprising:
- initializing a policy network;
- sampling a mini-batch of data from a training data set, wherein each mini-batch has a plurality of sample sequences, each having a plurality of time steps;
- for each time step of each sample sequence in each mini-batch:
- determining an action to be taken based on the policy of the network;
- and
- determining a reward;
- determining a gradient of an expected discounted cumulative reward;
- and
- updating the policy.
6 more elements
Dependencies are inferred from the claim text.