Method for building and extracting entity networks from video

An apparatus for deriving an attribute entity network (AEN) from video data, comprising:

• at least one camera for generating the video data;
• a processor communicatively connected to said at least one camera, said processor being configured for:
• extracting at least two entities from the video data;
• tracking the trajectories of the at least two entities to form at least two tracks;
• deriving at least one association between at least two entities by detecting at least one event involving the at least two entities, said detecting of at least one event being based on detecting at least one spatio-temporal motion correlation between the at least two entities;
• and
• constructing the AEN by creating a graph wherein the at least two objects form at least two nodes and the at least one association forms a link between the at least two nodes;
• and
• a display for displaying the AEN.

A computer-readable medium carrying one or more sequences for deriving an attribute entity network (AEN) from video data, wherein execution of the one of more sequences of instructions by one or more processors causes the one or more processors to perform the steps of:

• extracting at least two entities from the video data;
• tracking the trajectories of the at least two entities to form at least two tracks;
• deriving at least one association between at least two entities by detecting at least one event involving the at least two entities, said detecting of at least one event being based on detecting at least one spatio-temporal motion correlation between the at least two entities;
• and
• constructing the AEN by creating a graph wherein the at least two objects form at least two nodes and the at least one association forms a link between the at least two nodes.