System and method of visual detection of group multi-sensor gateway traversals using a stereo camera
AssigneeXtract One Technologies Inc.
InventorTimothy Frederic Beatty
Life of this patent
Estimating the term…
Abstract
A system and method of visual detection for a multi-sensor gateway using a stereo camera system. The system consists of two pillars and a stereo camera that build a gateway for patrons to pass through. Threat detection relies on artificial intelligence to analyze the sensors' data and assess the presence of a threat. The AI is performed on an edge device contained within the gateway. The gateway can consist of a number of peripherals that enhance the sensing capability of the gateway, such as a camera, or an accelerometer; or provide the security guard with information around alerts and threat locations such as with displays or audible alerts or manage the operations such as displays to control throughput.
Claims12
A multi-sensor gateway system for visual detection of patrons passing through, the system comprising:
- a first pillar having a plurality of first sensors;
- a second pillar having a plurality of second sensors;
- a stereo camera positioned to capture image data of a passage region between the pillars;
- a display screen configured to present a user interface (UI);
- and
- a processor configured to:
- receive stereo image data from the stereo camera;
- identify a patron in the stereo image data and generate a three-dimensional bounding box for the patron;
- automatically identify a gate traversal plane between the first and second pillars;
- determine a closest point on the gate traversal plane to a geometric center of the three-dimensional bounding box;
- classify the patron as having successfully traversed the multi-sensor gateway when the geometric center of the three-dimensional bounding box is less than 35 cm from the closest point on the gate traversal plane;
- determine inadequate spacing by identifying another person whose three-dimensional bounding-box centroid is within 75 cm of a person traversing the gate traversal plane;
- and
- display the three-dimensional bounding box on the user interface with a first color before traversal, a second color for successful traversal, and a third color for inadequate spacing.
A method of visual detection of patrons passing through a multi-sensor gateway system having first and second pillars, the method comprising the steps of:
- capturing stereo image data of a passage region between the pillars;
- identifying a patron in the stereo image data and generating a three-dimensional bounding box for the patron;
- automatically identifying a gate traversal plane between the pillars;
- determining a closest point on the gate traversal plane to a geometric center of the three-dimensional bounding box;
- classifying the patron as having successfully traversed the gateway when the geometric center of the three-dimensional bounding box is less than 35 cm from the closest point on the gate traversal plane;
- determining inadequate spacing by identifying another person whose bounding-box centroid is within 75 cm of a person traversing the gate traversal plane;
- and
- displaying the three-dimensional bounding box on a user interface in a first color before traversal, a second color for successful traversal, and a third color for inadequate spacing.
Dependencies are inferred from the claim text.