Method for temporal knowledge graph reasoning based on distributed attention

Abstract

The present invention relates to a method for temporal knowledge graph reasoning based on distributed attention, comprising: recombining a temporal knowledge graph in a temporal serialization manner, accurately expressing the structural dependencies between time-evolution features and temporal subgraphs, and then extracting historical repetition facts and historical frequency information based on the sparse matrix storing historical subgraph information; assigning, by the query fact, initial first-layer attention to the facts that are historically repeated using an attention mechanism, and then by capturing the latest changes in the historical frequency information, assigning attention reward and punishment of the second-layer attention to the scores of the first-layer attention, respectively, to make attention more adaptable to time-varying features; finally, using the scores of the two layers of attention to make reasoning-based prediction about future events. Compared with traditional prediction methods, the present invention endows learnable distributed attention on different historical timestamps instead of obtaining a fixed embedding representation through an encoder, so that the model has better ability to solve time-varying problems.

Dependencies are inferred from the claim text.