# US 9,652,666 B2 · Human review of an image stream for a parking camera system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 9,652,666 B2
- Document ID: US9652666B2
- Status: Granted
- Kind: B2
- Application number: 14/263,916
- Filed: 2014-04-28
- Published: 2014-08-21
- Granted: 2017-05-16
- Earliest claimed: 2012-08-06
- Assignees: Cloudparc, Inc.
- Applicants: Cloudparc, Inc.
- Inventors: Steven David Nerayoff; Thompson S. Wong
- Web page: https://patentgrep.com/patent/US9652666B2

## CPC

- G08G 1/0175: {by photographing vehicles, e.g. when violating traffic rules}
- G06F 18/22: Matching criteria, e.g. proximity measures
- G06Q 20/02: involving a neutral party, e.g. certification authority, notary or trusted third party [TTP]
- G06Q 20/145: {Payments according to the detected use or quantity}
- G06Q 30/0284: {Time or distance, e.g. usage of parking meters or taximeters}
- G06Q 30/04: Billing or invoicing
- G06Q 50/265: {Personal security, identity or safety}
- G06Q 50/40: Business processes related to the transportation industry (shipping G06Q10/083)
- G06T 7/20: Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51)
- G06T 7/292: Multi-camera tracking
- G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80)
- G06T 7/73: using feature-based methods
- G06T 7/90: Determination of colour characteristics
- G06V 20/52: Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69)
- G06V 20/54: of traffic, e.g. cars on the road, trains or boats
- G06V 20/56: exterior to a vehicle by using sensors mounted on the vehicle
- G06V 20/593: {Recognising seat occupancy}
- G06V 20/62: Text, e.g. of license plates, overlay texts or captions on TV images
- G06V 30/224: of printed characters having additional code marks or containing code marks
- G06V 40/23: {Recognition of whole body movements, e.g. for sport training}
- G07B 15/00: Arrangements or apparatus for collecting fares, tolls or entrance fees at one or more control points (handling coins or valuable papers, e.g. banknotes, G07D; apparatus for vending or hiring articles or services activated by coins, credit cards, paper currency or the like G07F7/00, G07F17/00)
- G07B 15/02: taking into account a variable factor such as distance or time, e.g. for passenger transport, parking systems or car rental systems (G07B15/06 takes precedence; taximeters G07B13/00; parking meters per se G07F17/24)
- G08G 1/00: Traffic control systems for road vehicles (arrangement of road signs or traffic signals E01F9/00 {; automatic vehicle control B62D})
- G08G 1/017: identifying vehicles (G08G1/015, G08G1/054 take precedence)
- G08G 1/052: with provision for determining speed or overspeed {(speed measuring in general G01P)}
- G08G 1/056: with provision for distinguishing direction of travel
- G08G 1/133: within the vehicle {; Indicators inside the vehicles or at stops}
- G08G 1/14: indicating individual free spaces in parking areas
- G08G 1/142: {external to the vehicles}
- G08G 1/144: {on portable or mobile units, e.g. personal digital assistant [PDA]}
- G08G 1/148: {Management of a network of parking areas}
- H04N 7/181: {for receiving images from a plurality of remote sources}
- H04N 23/62: Control of parameters via user interfaces
- H04N 23/66: Remote control of cameras or camera parts, e.g. by remote control devices
- H04N 23/90: Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
- G06T 2207/10004: Still image; Photographic image
- G06T 2207/30236: Traffic on road, railway or crossing
- G06T 2207/30264: Parking
- G06V 20/625: {License plates}
- G07F 17/24: for parking meters
- G08G 1/143: {inside the vehicles}
- G08G 1/146: {where the parking area is a limited parking space, e.g. parking garage, restricted space}
- H04N 7/18: Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N 23/69: Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming
- G08G: TRAFFIC CONTROL SYSTEMS (guiding railway traffic, ensuring the safety of railway traffic B61L; arrangement of road signs or traffic signals E01F9/00; radar or analogous systems, sonar systems, lidar systems specially adapted for traffic control G01S13/91, G01S15/88, G01S17/88; {radar or analogous systems, sonar systems, lidar systems specially adapted for anti-collision purposes G01S13/93, G01S15/93, G01S17/93})
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G07B: TICKET-ISSUING APPARATUS; FARE-REGISTERING APPARATUS; FRANKING APPARATUS
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G07F: COIN-FREED OR LIKE APPARATUS (coin sorting G07D3/00; coin testing G07D5/00; {handling coins or paper currencies apart from payment activated apparatus G07D; payment architectures, schemes or protocols G06Q20/00})

## Abstract

Providing human review of an image stream for a parking camera system is disclosed. Initially, a first image stream is received from a first camera having a first field of view showing a first vehicle or at least one destination location. Next, it is determined that a value for the at least one type of information relating to the at least one destination location or the first vehicle has failed to be automatically detected. In response, an exemption event is generated. Presentation of the at least part of the first image stream to a human operator is then enabled. Finally, the value for the at least one type of information relating to the at least one destination location or the first vehicle is received from the human operator.

## Claims

### Claim 1

A method of providing human review of an image stream for a parking camera system, the method comprising:
receiving a first image stream from a first camera having a first field of view, at least part of the first image stream showing a first vehicle or at least one destination location;
receiving a second image stream from a second camera having a second field of view, the second field of view being different from and at least partially overlapping with the first field of view, and at least part of the second image stream showing the first vehicle or the at least one destination location;
determining that an alphanumeric value for at least one type of information relating to the first vehicle or the at least one destination location is not automatically identified based on the at least part of the first image stream;
generating, in response to the determination that the alphanumeric value for the at least one type of information relating to the first vehicle or the at least one destination location has failed to be automatically identified, an exemption event;
enabling, in response to the generation of the exemption event, presentation of the at least part of the second image stream to a human operator;
receiving, from the human operator in response to enablement of the presentation of the at least part of the second image stream, a request to adjust the field of view of the second camera by changing a pan, tilt, or zoom of the second camera;
receiving, in response to reception of the request to adjust the field of view of the second camera, a third image stream from the second camera having a third field of view that is different from the second field of view, the third image stream being captured by the second camera temporally after the second image stream;
enabling, in response to the reception of the third image stream from the second camera, presentation of at least part of the third image stream to the human operator; and
receiving, from the human operator in response to enablement of the presentation of the at least part of the third image stream, the alphanumeric value for the at least one type of information relating to the first vehicle or the at least one destination location,
wherein the steps of receiving, determining, generating, and enabling are performed by one or more processors.

### Claim 2 (depends on 1)

The method of claim 1, wherein:
the alphanumeric value for the at least one type of information relating to the first vehicle or the at least one destination location is a license plate identifier of the first vehicle; and
receiving the alphanumeric value for the at least one type of information relating to the first vehicle or the at least one destination location comprises receiving alphanumeric characters of the license plate identifier of the first vehicle.

### Claim 3 (depends on 1)

The method of claim 1, wherein:
the third field of view includes a parking meter adjacent to the at least one destination location;
the alphanumeric value for the at least one type of information relating to the first vehicle or the at least one destination location is a status of an expiration flag of the parking meter adjacent to the at least one destination location; and
receiving the alphanumeric value for the at least one type of information relating to the first vehicle or the at least one destination location comprises receiving the status of the expiration flag of the parking meter adjacent to the at least one destination location.

### Claim 4 (depends on 1)

The method of claim 1, wherein:
the third field of view includes a pay-and-display ticket visible within the first vehicle;
the alphanumeric value for the at least one type of information relating to the first vehicle or the at least one destination location is a bar code or printed information on the pay-and-display ticket visible within the first vehicle; and
receiving the alphanumeric value for the at least one type of information relating to the first vehicle or the at least one destination location comprises receiving an image of the bar code or alphanumeric characters of the printed information on the pay-and-display ticket visible within the first vehicle.

### Claim 5 (depends on 4)

The method of claim 4, wherein the printed information on the pay-and-display ticket is a parking expiration time.

### Claim 6 (depends on 1)

The method of claim 1, wherein:
the third field of view includes a handicap parking decal, a handicap parking mirror-hanger, a resident parking decal, or a vehicle registration decal visible within the first vehicle; and
the alphanumeric value for the at least one type of information relating to the first vehicle or the at least one destination location is information visible on the handicap parking decal, information visible on the handicap parking mirror-hanger, information visible on the resident parking decal, or information visible on the vehicle registration decal.

### Claim 7 (depends on 1)

The method of claim 1, further comprising receiving, from the human operator in response to enablement of the presentation of the at least part of the second image stream, a request to rewind, fast forward, pause, or freeze-frame the at least part of the second image stream.

### Claim 8 (depends on 1)

The method of claim 1, further comprising receiving, from the human operator in response to enablement of the presentation of the at least part of the second image stream, a request to zoom in or zoom out on an area of interest within the at least part of the second image stream.

### Claim 9 (depends on 1)

The method of claim 1, further comprising receiving, from the human operator in response to enablement of the presentation of the at least part of the third image stream, a request for personnel to perform an inspection relating to the first vehicle or the at least one destination location.

### Claim 10 (depends on 9)

The method of claim 9, further comprising:
identifying, in response to reception of the request for the personnel to perform the inspection relating to the first vehicle or the at least one destination location, the personnel to perform the inspection based on the location of the at least one destination location; and
notifying the personnel that the first vehicle is at the at least one destination location.

### Claim 11 (depends on 9)

The method of claim 9, further comprising receiving, from a mobile phone carried by the personnel, one or more images of an area surrounding the first vehicle or the at least one destination location.

### Claim 12 (depends on 1)

The method of claim 1, wherein enabling presentation of the at least part of the third image stream to the human operator comprises simultaneously forwarding the at least part of the third image stream to multiple different locations.

### Claim 13 (depends on 1)

The method of claim 1, wherein enabling presentation of the at least part of the third image stream to the human operator comprises forwarding the at least part of the third image stream using an Internet Protocol communications protocol.

### Claim 14 (depends on 1)

The method of claim 1, wherein enabling presentation of the at least part of the third image stream to the human operator comprises displaying the at least part of the third image stream to the human operator.

### Claim 15 (depends on 1)

The method of claim 1, further comprising enabling presentation of a unique identifier of the at least one destination location.

### Claim 16 (depends on 1)

The method of claim 1, further comprising:
determining, based on the first image stream, one or more static characteristics of the first vehicle that do not change over time.

### Claim 17 (depends on 16)

The method of claim 16, wherein the one or more static characteristics are one or more of a vehicle make, a vehicle model, a vehicle year, a vehicle color, a vehicle outline, a vehicle size, and a vehicle dimension.

### Claim 18 (depends on 1)

The method of claim 1, further comprising:
determining, based on at least one frame of the first image stream, that the first vehicle is stopped within the at least one destination location at a first time;
determining, based on at least another frame of the first image stream, that the first vehicle has left the at least one destination location at a second time that is after the first time;
indicating that the first vehicle began use of the destination location at the first time; and
indicating that the first vehicle completed use of the destination location at the second time.

### Claim 19 (depends on 1)

The method of claim 1, further comprising indicating, in response to the reception of the alphanumeric value for the at least one type of information relating to the first vehicle or the at least one destination location, a first unique identifier of the first vehicle, an identifier of the at least one destination location, and a type of parking violation by the first vehicle within the at least one destination location.

### Claim 20 (depends on 1)

The method of claim 1, wherein the first vehicle is stopped within the at least one destination location, the method further comprising determining, in response to the reception of the alphanumeric value for the at least one type of information relating to the first vehicle or the at least one destination location, a cost for the first vehicle to occupy the at least one destination location or a fine for violation of one or more rules associated with the at least one destination location.

### Claim 21 (depends on 20)

The method of claim 20, wherein the cost for the first vehicle to occupy the at least one destination location is determined, the method further comprising:
identifying a mailing address associated with an owner of the first vehicle; and
automatically generating, in response to identification of the mailing address associated with the owner of the first vehicle, a citation requesting payment of the cost for the first vehicle to occupy the at least one destination location or the fine for violation of one or more rules associated with the at least one destination location.

### Claim 22 (depends on 21)

The method of claim 21, wherein identifying the mailing address associated with the owner of the first vehicle comprises automatically determining a license plate identifier of the first vehicle based on the at least part of the first image stream without human interaction.

### Claim 23 (depends on 21)

The method of claim 21, wherein identifying the mailing address associated with the owner of the first vehicle comprises receiving a license plate identifier of the first vehicle from the human operator.

### Claim 24 (depends on 20)

The method of claim 20, further comprising charging, in response to the determination of the cost for the first vehicle to occupy the at least one destination location or the fine for violation of one or more rules associated with the at least one destination location, the cost or the fine to an account associated with the first vehicle.

### Claim 25 (depends on 24)

The method of claim 24, wherein charging the cost or the fine to the account associated with the first vehicle comprises charging the cost or the fine to a stored credit card in the account associated with the first vehicle.

### Claim 26

A system for providing human review of an image stream for a parking camera system, the system comprising one or more processors connected to at least one storage device, and the system being configured to:
receive a first image stream from a first camera having a first field of view, at least part of the first image stream showing a first vehicle or at least one destination location;
receive a second image stream from a second camera having a second field of view, the second field of view being different from and at least partially overlapping with the first field of view, and at least part of the second image stream showing the first vehicle or the at least one destination location;
determine that an alphanumeric value for at least one type of information relating to the first vehicle or the at least one destination location is not automatically identified based on the at least part of the first image stream;
generate, in response to the determination that the alphanumeric value for the at least one type of information relating to the first vehicle or the at least one destination location has failed to be automatically identified, an exemption event;
enable, in response to the generation of the exemption event, presentation of the at least part of the second image stream to a human operator;
receive, from the human operator in response to enablement of the presentation of the at least part of the second image stream, a request to adjust the field of view of the second camera by changing a pan, tilt, or zoom of the second camera;
receive, in response to reception of the request to adjust the field of view of the second camera, a third image stream from the second camera having a third field of view that is different from the second field of view, the third image stream being captured by the second camera temporally after the second image stream;
enable, in response to the reception of the third image stream from the second camera, presentation of at least part of the third image stream to the human operator; and
receive, from the human operator in response to enablement of the presentation of the at least part of the third image stream, the alphanumeric value for the at least one type of information relating to the first vehicle or the at least one destination location.

### Claim 27

A storage device storing a computer program for providing human review of an image stream for a parking camera system, the computer program comprising one or more code segments that, when executed, cause one or more processors to:
receive a first image stream from a first camera having a first field of view, at least part of the first image stream showing a first vehicle or at least one destination location;
receive a second image stream from a second camera having a second field of view, the second field of view being different from and at least partially overlapping with the first field of view, and at least part of the second image stream showing the first vehicle or the at least one destination location;
determine that an alphanumeric value for at least one type of information relating to the first vehicle or the at least one destination location is not automatically identified based on the at least part of the first image stream;
generate, in response to the determination that the alphanumeric value for the at least one type of information relating to the first vehicle or the at least one destination location has failed to be automatically identified, an exemption event;
enable, in response to the generation of the exemption event, presentation of the at least part of the second image stream to a human operator;
receive, from the human operator in response to enablement of the presentation of the at least part of the second image stream, a request to adjust the field of view of the second camera by changing a pan, tilt, or zoom of the second camera;
receive, in response to reception of the request to adjust the field of view of the second camera, a third image stream from the second camera having a third field of view that is different from the second field of view, the third image stream being captured by the second camera temporally after the second image stream;
enable, in response to the reception of the third image stream from the second camera, presentation of at least part of the third image stream to the human operator; and
receive, from the human operator in response to enablement of the presentation of the at least part of the third image stream, the alphanumeric value for the at least one type of information relating to the first vehicle or the at least one destination location.
