# US 11,501,541 B2 · Imaging systems for facial detection, license plate reading, vehicle overview and vehicle make, model and color detection

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,501,541 B2
- Document ID: US11501541B2
- Status: Granted
- Kind: B2
- Application number: 17/119,777
- Filed: 2020-12-11
- Published: 2021-04-01
- Granted: 2022-11-15
- Earliest claimed: 2019-07-10
- Assignees: Gatekeeper Ltd.
- Applicants: Gatekeeper Inc.
- Inventors: Marc Hansen; Jonathan Nazemi; Robert Rozploch
- Web page: https://patentgrep.com/patent/US11501541B2

## CPC

- G06V 40/166: {using acquisition arrangements}
- G06V 10/507: {Summing image-intensity values; Histogram projection analysis}
- G06V 20/593: {Recognising seat occupancy}
- G06V 20/63: {Scene text, e.g. street names}
- G08G 1/0175: {by photographing vehicles, e.g. when violating traffic rules}
- H04N 23/56: provided with illuminating means
- H04N 23/61: based on recognised objects
- H04N 23/611: where the recognised objects include parts of the human body
- H04N 23/74: by influencing the scene brightness using illuminating means
- H04N 23/90: Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
- G06V 20/625: {License plates}
- G06V 2201/08: Detecting or categorising vehicles
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G08G: TRAFFIC CONTROL SYSTEMS (guiding railway traffic, ensuring the safety of railway traffic B61L; arrangement of road signs or traffic signals E01F9/00; radar or analogous systems, sonar systems, lidar systems specially adapted for traffic control G01S13/91, G01S15/88, G01S17/88; {radar or analogous systems, sonar systems, lidar systems specially adapted for anti-collision purposes G01S13/93, G01S15/93, G01S17/93})
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A system includes a camera defining an optical axis and a field of view defined about the optical axis. An illuminator is mounted offset from the optical axis and directed to illuminate at least a portion of the field of view, wherein the illuminator is operatively connected to the camera to provide illumination during an image capturing exposure of the camera. An image processer is operatively connected to the camera and includes machine readable instructions configured to receive image data representative of an image captured with the camera, perform facial detection to detect at least one face in the image, perform license plate detection to detect at least one license plate in the image, and to provide a vehicle overview image.

## Claims

### Claim 1

A system comprising:
a camera defining an optical axis and a field of view defined about the optical axis;
at least one illuminator mounted offset from the optical axis and directed to illuminate at least a portion of the field of view, wherein the at least one illuminator is operatively connected to the camera to provide illumination during an image capturing exposure of the camera; and
an image processor operatively connected to the camera and including machine readable instructions configured to:
receive image data representative of an image of a vehicle captured with the camera, perform facial detection of individuals in the vehicle to detect at least one face in the image, to perform license plate detection and/or decoding for at least one license plate coupled to the vehicle in the image, wherein the at least one license plate has a retroreflectance cone associated therewith, and to provide an overview image of the vehicle, wherein the at least one illuminator is separated from the optical axis by a standoff distance, wherein the camera is positioned outside the retroreflectance cone of the at least one license plate, and wherein the at least one illuminator is configured to illuminate the individuals with a first level of illumination and configured to illuminate the at least one license plate with a second level of illumination, where the second level of illumination is less than the first level of illumination.

### Claim 2 (depends on 1)

The system as recited in claim 1, wherein the machine readable instructions are configured to output facial detection data for use in facial recognition.

### Claim 3 (depends on 1)

The system as recited in claim 1, wherein the machine readable instructions are configured to perform license plate reading and to output at least one of a license plate number, region, state, country, or color of license plate.

### Claim 4 (depends on 1)

The system as recited in claim 1, wherein the machine readable instructions are configured to generate data indicative of at least one of a make, model, color, year, class or, type of the vehicle in the image.

### Claim 5 (depends on 1)

The system as recited in claim 1, wherein the machine readable instructions are configured to output data indicative of a make, model, and color of the vehicle, wherein the data indicative of the model is determined based on at least one of geography detected in license plate detection or a geographical location of the camera.

### Claim 6 (depends on 5)

The system as recited in claim 5, further comprising a global positioning sensor operatively connected to the image processor, wherein the machine readable instructions are configured to output model name based on location data from the global positioning sensor.

### Claim 7 (depends on 1)

The system as recited in claim 1, wherein the camera comprises optics optically coupled to a sensor, wherein the optics and sensor are collectively configured to provide at least 5 megapixels of image data at 280 pixels per foot.

### Claim 8 (depends on 7)

The system as recited in claim 7, wherein the optics and sensor are configured to provide a field of view angle of 32.5° by 27.5° (width by height) for imaging vehicles at a distance of 15 feet.

### Claim 9 (depends on 7)

The system as recited in claim 7, wherein the optics and sensor are configured to provide a field of view angle of 24.5° by 20.5° (width by height) for imaging vehicles at a distance of 20 feet.

### Claim 10 (depends on 7)

The system as recited in claim 7, wherein the sensor is configured for sensitivity in at least one of visible and/or near infrared.

### Claim 11 (depends on 1)

The system as recited in claim 1, wherein the standoff distance is two feet and wherein the optical axis is angled to capture license plate images wherein the license plates are between 15 to 20 feet away from the camera.

### Claim 12 (depends on 1)

The system as recited in claim 1, wherein the camera and at least one illuminator are configured to properly expose faces through vehicle glass, properly expose retroreflective license plates, and properly expose vehicle body features all in a single exposure regardless of whether the exposure occurs under noon-day sun or dark night conditions.

### Claim 13 (depends on 1)

The system as recited in claim 1, wherein the camera is programmed to expose for image capture using an f/1.2 aperture setting, and a 200 microsecond shutter speed day or night.

### Claim 14 (depends on 1)

The system as recited in claim 1, wherein the at least one illuminator is configured to illuminate at 10° full width at half maximum (FWHM) to illuminate faces inside a vehicle with relatively intense illumination and at the same time illuminate retroreflective license plate of the vehicle with relatively reduced illumination.

### Claim 15 (depends on 1)

The system as recited in claim 1, wherein the camera is a first camera of a plurality of cameras, wherein the at least one illuminator is a first illuminator of a plurality of illuminators, and wherein the image processor is configured to control timing of the cameras and the plurality of illuminators so the first camera exposes for image capture only under illumination from the first illuminator.

### Claim 16 (depends on 15)

The system as recited in claim 15, wherein the first camera and the first illuminator are mounted to a main pole positioned to face oncoming traffic.

### Claim 17 (depends on 16)

The system as recited in claim 16, wherein the plurality of cameras includes three cameras, wherein a first of the three cameras is mounted on a pole positioned on a common side of a lane of the oncoming traffic with the main pole, wherein a second of the three cameras is mounted on a pole and a third of the three cameras is mounted on a pole positioned on opposing sides of the lane.

### Claim 18 (depends on 16)

The system as recited in claim 16, wherein the plurality of cameras includes a rear camera, wherein the plurality of illuminators includes a rear illuminator, and wherein the rear camera and rear illuminator are mounted to a rear pole positioned on an opposite side of a ground loop trigger point from the main pole for imaging rear license plates.

### Claim 19 (depends on 1)

The system as recited in claim 1, wherein the imaging processor comprises a connectivity interface configured to allow remote activation and deactivation of at least one of facial detection services, license plate reading services, vehicle overview services, or vehicle make, model, and color services without needing to change any camera hardware.

### Claim 20

A system comprising:
a camera defining an optical axis and a field of view defined about the optical axis;
at least one illuminator mounted offset from the optical axis and directed to illuminate at least a portion of the field of view, wherein the at least one illuminator is operatively connected to the camera to provide illumination during an image capturing exposure of the camera; and
an image processor operatively connected to the camera and including machine readable instructions configured to:
receive image data representative of an image of a vehicle captured with the camera, perform facial detection to detect at least one face in the image, perform license plate detection and/or decoding for at least one license plate in the image, and to provide an overview image of the vehicle,
wherein the at least one license plate has a retroreflectance cone associated therewith, wherein the camera is positioned outside the retroreflectance cone of the at least one license plate, and wherein the camera and the at least one illuminator are configured to properly expose faces through vehicle glass, retroreflective license plates, and vehicle body features all in a single exposure regardless of whether the exposure occurs under noon-day sun or dark night conditions.
