Correlation recurrent unit for improving prediction performance of time-series data and correlation recurrent neural network
AssigneePusan National University Industry-University Cooperation Foundation
InventorsHye Rim Bae, Sung-hyun Sim, Do Hee Kim, Han Seok Kang
Life of this patent
Estimating the term…
Abstract
A correlation recurrent unit and a correlation recurrent neural network are provided. An aspect provides a new neural network structure for training each decomposed time-series component by decomposing input time-series data xt into a plurality of time-series components (e.g., trend, seasonal, and remainder components) and improving the prediction performance of time-series data by training a relation between different time-series components.
Claims8
A correlation recurrent unit comprised in a correlation recurrent neural network, the correlation recurrent unit comprising:
- a seasonal-trend decomposition using LOESS (STL) cell configured to decompose time-series data (xt) corresponding to a time (t) when the time-series data (xt) is input, based on a selected time-series composition algorithm, into a plurality of time-series components;
- an autocorrelation gate configured to obtain an autocorrelation degree with a hidden state value corresponding to a previous time (t−1) of each of the plurality of time-series components with respect to each of the plurality of time-series components;
- a correlation gate configured to obtain a correlation degree with a hidden state value corresponding to a previous time (t−1) of another time-series component different from each of the plurality of time-series components with respect to each of the plurality of time-series components;
- and
- a generation gate configured to determine whether to update the hidden state value of the previous time (t−1) generated for each of the plurality of time-series components, based on the autocorrelation degree and the correlation degree, when previous time-series data (xt-1) prior to the time-series data (xt) is input.
A correlation recurrent neural network comprising a plurality of correlation recurrent units for predicting time-series data, wherein each of the plurality of correlation recurrent units comprises:
- a seasonal-trend decomposition using LOESS (STL) cell configured to decompose, into a trend component (xt_trend), a seasonal component (xt_seasonal), and a remainder component (xt_remainder), time-series data (xt) at a time (t) when the time-series data (xt) is input;
- an autocorrelation gate configured to estimate and obtain, with respect to the trend component (xt_trend) at the time (t), a first autocorrelation degree (âtt) with a first hidden state value relevant to a trend component (xt-1_trend) corresponding to a previous time (t−1) prior to the time (t) and estimate and obtain, for the seasonal component (xt_seasonal) at the time (t), a second autocorrelation degree (âts) with a second hidden state value relevant to the seasonal component (xt-1_seasonal) corresponding to the time (t−1);
- a correlation gate configured to estimate and obtain a first correlation degree (ĉtt) with the second hidden state value with respect to the trend component (xt_trend) at the time (t) and estimate and obtain a second correlation degree (ĉts) with the first hidden state value with respect to the seasonal component (xt_seasonal) at the time (t);
- and
- a generation gate configured to, when generating a hidden state value of each of a plurality of time-series components at the time (t), increase a proportion of using the first hidden state value and the second hidden state value that are generated when previous time-series data (xt-1) at the previous time (t−1) is input as the first and second autocorrelation degrees (âtt) and (âts) and the first and second correlation degrees (ĉtt) and (ĉts) increase.
Dependencies are inferred from the claim text.