Video analysis using a deep fusion reasoning engine (DFRE)
AssigneeCisco Technology, Inc.
InventorsHugo Latapie, Enzo Fenoglio, David Delano Ward, Guillaume Sauvage De Saint Marc, Carole Gridley
Life of this patent
Estimating the term…
Abstract
In one embodiment, a video analysis service receives video data captured by one or more cameras at a particular location. The service applies a neural network-based model to portions of the video data, to identify objects within the video data. The service maps outputs of the neural network-based model to symbols using a conceptual space. The outputs of the model comprise the identified objects. The service applies a symbolic reasoning engine to the symbols, to generate an alert. The service sends the alert to a user interface in conjunction with the video data.
Claims20
A method comprising:
- receiving, at a video analysis service, video data captured by one or more cameras at a particular location;
- applying, by the service, a neural network-based model to each of a plurality of segmented regions of a frame from the video data, to identify objects within one or more of the plurality of segmented regions of the frame;
- mapping, by the service, outputs of the neural network-based model to symbols using a conceptual space that is a geometrical representation defined by one or more quality dimensions, wherein the outputs of the model comprise the identified objects;
- applying, by the service, a symbolic reasoning engine to the symbols, to generate an alert;
- and
- sending, by the service, the alert to a user interface in conjunction with the video data.
An apparatus, comprising:
- one or more network interfaces to communicate with a network;
- a processor coupled to the network interfaces and configured to execute one or more processes;
- and
- a memory configured to store a process executable by the processor, the process when executed configured to:
- receive video data captured by one or more cameras at a particular location;
- apply a neural network-based model to each of a plurality of segmented regions of a frame from the video data, to identify objects within one or more of the plurality of segmented regions of the frame;
- map outputs of the neural network-based model to symbols using a conceptual space that is a geometrical representation defined by one or more quality dimensions, wherein the outputs of the model comprise the identified objects;
- apply a symbolic reasoning engine to the symbols, to generate an alert;
- and
- send the alert to a user interface in conjunction with the video data.
A tangible, non-transitory, computer-readable medium storing program instructions that cause a video analysis service to execute a process comprising:
- receiving, at the video analysis service, video data captured by one or more cameras at a particular location;
- applying, by the service, a neural network-based model to each of a plurality of segmented regions of a frame from the video data, to identify objects within one or more of the plurality of segmented regions of the frame;
- mapping, by the service, outputs of the neural network-based model to symbols using a conceptual space that is a geometrical representation defined by one or more quality dimensions, wherein the outputs of the model comprise the identified objects;
- applying, by the service, a symbolic reasoning engine to the symbols, to generate an alert;
- and
- sending, by the service, the alert to a user interface in conjunction with the video data.
Dependencies are inferred from the claim text.