Back to results
US 10,768,769 B2Granted
Automatic event detection, text generation, and use thereof
AssigneeAvigilon Fortress Corporation
InventorsTae Eun Choe, Mun Wai Lee, Kiran Gunda, Niels Haering
Life of this patent
Estimating the term…
Abstract
A system and method for video surveillance and searching are disclosed. Video is analyzed and events are automatically detected. Based on the automatically detected events, textual descriptions are generated. The textual descriptions may be used to supplement video viewing and event viewing, and to provide for textual searching for events.
Claims31
A video surveillance system, comprising:
- a first video camera configured to capture at least a first video sequence including a plurality of video images;
- a processing system configured to automatically detect events;
- a storage system configured to receive and store records of the automatically detected events with respective geographical locations in association with the automatically detected events, the associated geographical location being at least in part based on map data;
- and
- a text generator configured to automatically generate textual descriptions of the automatically detected events, and
- wherein the automatically detected events are events that relate to the map data and are based on rules that relate to the map data, such that the text generator generates text that combines the map data with the automatically detected events into a report;
- and
- wherein a Geographical Information System (GIS) database is used to extract a name of a static scene feature in the video sequence and the name is included in the report.
5 more elements
A video surveillance system comprising:
- a first video camera configured to capture a first video sequence including a plurality of video images;
- a processing system configured to automatically detect events in the video sequence;
- a storage system configured to receive and store records of the automatically detected events and to associate each automatically detected event with a geographical location where the automatically detected event occurred, wherein the records of the automatically detected events are searchable using one or more dropdown lists;
- a text generator configured to automatically generate a textual description of a first event of the automatically detected events, the textual description enhanced to include text that reflects the geographical location;
- a file generator configured to generate a file including the first video sequence and including embedded text that reflects the textual description and that is inserted in the video sequence;
- and
- a display system,
- wherein for each automatically detected event, and based on the textual description for the event, the display system is configured to display information for the event, the information including the text that reflects the geographical location, and to overlay the information on a map of a geographical area that includes the geographical location, such that the information for the event including the text that reflects the geographical location is visually associated with a particular location on the map, and wherein a Geographical Information System (GIS) database is used to extract the text that reflects the geographical location.
5 more elements
A video surveillance method, comprising:
- analyzing a first video sequence including a plurality of video images;
- automatically detecting events in the first video sequence;
- receiving and storing records of the automatically detected events and associating each of the automatically detected events with a geographical location at which the event occurs, wherein the records of the automatically detected events are searchable using one or more dropdown lists;
- automatically generating a textual description of a first event of the automatically detected events, the textual description including text describing an actor, an action, and the geographical location;
- and
- for the first event of the automatically detected events, causing a display system to display information based on the textual description and overlay the information on a map of a geographical area, such that the text describing the actor, the action, and the geographical location is visually associated with a particular geographical location depicted in the map, and wherein a Geographical Information System (GIS) database is used to extract the text describing the geographical location.
3 more elements
A video searching method, comprising:
- capturing a plurality of video sequences from a plurality of respective video sources, each video sequence including a plurality of video images;
- for each video sequence, automatically detecting an event associated with a set of video images;
- for each detected event, storing a record of the event and associating with the record geographical information about the event;
- receiving a search request related to one or more events, the search request generated using at least one drop down menu, the search request including one or more natural language terms;
- searching from among the stored records for events that satisfy the search request;
- based on the results of the search, providing a natural language description for each automatically detected event, the natural language description for each automatically detected event including the geographical information about that event;
- and
- based on the results of the search, for each automatically detected event, causing a display device to display a map of a geographical area with the natural language description including the geographical information overlaid on the map and wherein a Geographical Information System (GIS) database is used to extract text that reflects the geographical information.
5 more elements
Dependencies are inferred from the claim text.