US 8,803,975 B2Granted

Interactive system for recognition analysis of multiple streams of video

Assignee3VR Security, Inc.

InventorsGordon T. Haupt, J. Andrew Freeman, Stephen D. Fleischer, Robert P. Vallone, Stephen G. Russell, Timothy B. Frederick

Life of this patent

Estimating the term…

patentgrep

Loading patent…

Abstract

A method of identifying an object captured in a video image in a multi-camera video surveillance system is disclosed. Sets of identifying information are stored in profiles, each profile being associated with one object. The disclosed method of identifying an object includes comparing identifying information extracted from images captured by the video surveillance system to one or more stored profiles. A confidence score is calculated for each comparison and used to determine a best match between the extracted set of identifying information and an object. In one embodiment, the method is used as part of a facial recognition system incorporated into a video surveillance system.

Claims34

Dependent claims

A method for maintaining associations between profiles and objects in an object recognition system, wherein a profile comprises a set of identifying information extracted from an image set associated with the profile, comprising the computer-implemented steps of:

receiving a first image set;
generating a stored profile based on the first image set;
causing to be displayed, to a user, first data that identifies one or more objects that are automatically determined by the object recognition system to be possible matches to the stored profile;
wherein the one or more objects includes a particular object that is associated with a particular stored profile;
after the first data is displayed to the user, receiving, from the user, feedback that indicates that the particular object does not match the stored profile;
in response to receiving the feedback from the user, updating a running score that is (a) maintained for the particular stored profile and (b) based on how often the object recognition system identified the particular object as a possible match but a user indicated the particular object was not a match;
receiving a second image set;
generating a second stored profile based on the second image set;
determining a confidence score in a subsequent possible match that involves the particular stored profile and the second stored profile;
weighting the confidence score based, at least in part, on the running score;
causing to be displayed, to a user, second data that identifies one or more second objects that are automatically determined by the object recognition system to be possible matches to the second stored profile, wherein the object recognition system determines whether to include the particular object in the one or more second objects based on the weighted confidence score;
wherein the method is performed by one or more computing devices.

9 more elements

receiving a particular image set;
generating a stored profile based on the particular image set;
causing to be displayed, to a user, a list of identities of one or more objects that are automatically determined to be possible matches to the stored profile;
receiving, from the user, feedback that indicates that a particular object of the one or more objects is not a possible match;
in response to receiving the feedback, updating a possible match score that is (a) associated with a particular stored profile of the particular object and (b) based on how often the object recognition system identified the particular stored profile as a possible match but a user indicated the particular stored profile as not a possible match;
determining a confidence score in a subsequent possible match that involves the particular stored profile;
weighting the confidence score based, at least in part, on the possible match score;
receiving a first image set;
generating a first stored profile based on the first image set;
receiving a second image set;
generating a second stored profile based on the second image set;
comparing the second stored profile with the first stored profile to generate a second confidence score;
determining whether the second confidence score satisfies one or more criteria;
in response to determining that the second confidence score satisfies the one or more criteria, causing to be displayed, to a second user, a second list of identities of one or more second objects that includes a first object and the second image set that is associated with the second stored profile;
receiving, from the second user, feedback that indicates that the first stored profile and the second stored profile are profiles of the same object;
and
storing confirmation information that indicates that the second stored profile is of the first object;
wherein the method is performed by one or more computing devices.

15 more elements

One or more non-transitory computer-readable media storing instructions for maintaining associations between profiles and objects in an object recognition system, wherein a profile comprises a set of identifying information extracted from an image set associated with the profile, wherein the instructions, when executed by one or more processors, cause:

receiving a first image set;
generating a stored profile based on the first image set;
wherein the one or more objects includes a particular object that is associated with a particular stored profile;
causing to be displayed, to a user, first data that identifies one or more objects that are automatically determined by the object recognition system to be possible matches to the stored profile;
after the first data is displayed to the user, receiving, from the user, feedback that indicates that the particular object does not match the stored profile;
in response to receiving the feedback from the user, updating a running score that is (a) maintained for the particular stored profile and (b) based on how often the object recognition system identified the particular object as a possible match but a user indicated the particular object was not a match;
receiving a second image set;
generating a second stored profile based on the second image set;
determining a confidence score in a subsequent possible match that involves the particular stored profile;
weighting the confidence score based, at least in part, on the possible match score;
causing to be displayed, to a user, second data that identifies one or more second objects that are automatically determined by the object recognition system to be possible matches to the second stored profile, wherein the object recognition system determines whether to include the particular object in the one or more second objects based on the weighted confidence score.

8 more elements

receiving a particular image set;
generating a stored profile based on the particular image set;
causing to be displayed, to a user, a list of identities of one or more objects that are automatically determined to be possible matches to the stored profile;
receiving, from the user, feedback that indicates that a particular object of the one or more objects is not a possible match;
in response to receiving the feedback, updating a possible match score that is (a) associated with a particular stored profile of the particular object and (b) based on how often the object recognition system identified the particular stored profile as a possible match but a user indicated the particular stored profile as not a possible match;
determining a confidence score in a subsequent possible match that involves the particular stored profile;
weighting the confidence score based, at least in part, on the possible match score;
receiving a first image set;
generating a first stored profile based on the first image set;
receiving a second image set;
generating a second stored profile based on the second image set;
comparing the second stored profile with the first stored profile to generate a second confidence score;
determining whether the second confidence score satisfies one or more criteria;
in response to determining that the second confidence score satisfies the one or more criteria, causing to be displayed, to a second user, a second list of identities of one or more second objects that includes a first object and the second image set that is associated with the second stored profile;
receiving, from the second user, feedback that indicates that the first stored profile and the second stored profile are profiles of the same object;
and
storing confirmation information that indicates that the second stored profile is of the first object.

14 more elements

Dependencies are inferred from the claim text.

Facts

Application: 12/261,554Filed 30 Oct 2008 · division
Priority: 16 Mar 2004
Published: US 2009/0074261 A119 Mar 2009
Granted: 12 Aug 2014
Term ends: Not estimatedThe source records don’t support an estimate.

Classification10 codes

G06V 40/172
Human faces, e.g. facial parts, sketches or expressions: classification, e.g. identification
G06V 20/40
Scenes; Scene-specific elements: in video content
G06V 20/52
Context or environment of the image: surveillance or monitoring of activities, e.g. for recognising suspicious objects
G06V 40/168
Human faces, e.g. facial parts, sketches or expressions: feature extraction; Face representation

Family

Application60/554,050Us provisional application · filed 16 Mar 2004
Application10/965,687Parent of this continuation-in-part · filed 13 Oct 2004
Application11/081,753Parent of this division · filed 15 Mar 2005
US 2009/0074261 A1Pre-grant publication · published 19 Mar 2009
US 7,529,411 B2Parent of this division
US 7,697,026 B2Parent of this continuation-in-part
Application11/081,753Parent of this continuation-in-part
US 2005/0207622 A1Published application
US 2005/0232462 A1Published application
US 8,803,975 B2This patent

From the US filing history. Foreign family members aren’t listed.