Reasoning from surveillance video via computer vision-based multi-object tracking and spatiotemporal proximity graphs
AssigneeCACI, Inc.—Federal
InventorsZachary Jorgensen, Tyler Staudinger, Charles Viss
Life of this patent
Estimating the term…
Abstract
Methods, systems, and apparatuses, among other things, may detect and store activity in videos based on a spatiotemporal graph representation. Spatiotemporal proximity graphs may be built based on one or more received tracks and may include one or more nodes and each node may include one or more attributes associated with a corresponding entity. One or more spatiotemporal relationships may be identified between the entities based on each spatiotemporal proximity graph one or more activities of the entities may be identified based on the spatiotemporal relationships.
Claims20
A method comprising:
- receiving a scene including a plurality of tracks, each track of the plurality of tracks corresponding to an entity;
- building a spatiotemporal proximity graph based on the plurality of tracks;
- and
- identifying, based on the spatiotemporal proximity graph, a spatiotemporal relationship between a plurality of the entities.
A system comprising:
- one or more processors;
- and
- memory including instructions that, when executed by the one or more processors, cause the system to:
- receive a spatiotemporal proximity graph including a plurality of tracks, each track of the plurality of tracks corresponding to an entity;
- execute one or more subgraph matching queries;
- detect one or more activities based on the executed one or more subgraph matching queries;
- and
- build an activity graph based on the one or more activities.
A computer program product comprising:
- a computer-readable storage medium;
- and
- instructions stored on the computer-readable storage medium that, when executed by a processor, causes the processor to:
- receive overhead video footage;
- receive a scene associated with the overhead video footage including a plurality of tracks, each track of the plurality of tracks corresponding to an entity;
- build a spatiotemporal proximity graph based on the plurality of tracks;
- and
- identify one or more portions of the overhead video footage that correspond to the spatiotemporal proximity graph.
Dependencies are inferred from the claim text.