Retrieval augmented video understanding with compositional reasoning over graph
AssigneeFujitsu Limited
InventorsSameer MALIK, Moyuru YAMADA
Life of this patent
Estimating the term…
Loading patent…
AssigneeFujitsu Limited
InventorsSameer MALIK, Moyuru YAMADA
Estimating the term…
According to an aspect, operations include acquiring a sequence of video frames associated with video data and a query. The operations further include acquiring a temporal graph associated with the sequence of video frames. The temporal graph includes a set of subgraphs corresponding to the sequence of video frames, with a set of nodes and edges in each subgraph representing the set of entities and relationships between the set of nodes, respectively. The operations further include converting the query into a set of retrieval functions and applying the set of retrieval functions on the temporal graph to retrieve a query response including at least one video frame of the set of video frames.
A method, executable by a system, the method comprising:
One or more non-transitory computer-readable storage media storing instructions that, in response to being executed, cause a system to perform operations, the operations comprising:
A system, comprising:
Dependencies are inferred from the claim text.