# US 9,489,839 B2 · Tracking a vehicle using an unmanned aerial vehicle

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 9,489,839 B2
- Document ID: US9489839B2
- Status: Granted
- Kind: B2
- Application number: 14/943,029
- Filed: 2015-11-17
- Published: 2016-03-17
- Granted: 2016-11-08
- Earliest claimed: 2012-08-06
- Assignees: Cloudparc, Inc.
- Applicants: Cloudparc, Inc.
- Inventors: Steven David Nerayoff; Thompson S. Wong
- Web page: https://patentgrep.com/patent/US9489839B2

## CPC

- G06Q 30/04: Billing or invoicing
- G05D 1/0094: {involving pointing a payload, e.g. camera, weapon, sensor, towards a fixed or moving target}
- G06F 18/22: Matching criteria, e.g. proximity measures
- G06Q 20/02: involving a neutral party, e.g. certification authority, notary or trusted third party [TTP]
- G06Q 20/145: {Payments according to the detected use or quantity}
- G06Q 30/0284: {Time or distance, e.g. usage of parking meters or taximeters}
- G06Q 50/265: {Personal security, identity or safety}
- G06T 7/248: {involving reference images or patches}
- G06T 7/32: using correlation-based methods
- G06T 7/74: {involving reference images or patches}
- G06V 20/182: {Network patterns, e.g. roads or rivers}
- G06V 20/52: Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69)
- G06V 20/54: of traffic, e.g. cars on the road, trains or boats
- G06V 20/56: exterior to a vehicle by using sensors mounted on the vehicle
- G06V 20/593: {Recognising seat occupancy}
- G06V 20/62: Text, e.g. of license plates, overlay texts or captions on TV images
- G06V 30/224: of printed characters having additional code marks or containing code marks
- G06V 40/23: {Recognition of whole body movements, e.g. for sport training}
- G07B 15/00: Arrangements or apparatus for collecting fares, tolls or entrance fees at one or more control points (handling coins or valuable papers, e.g. banknotes, G07D; apparatus for vending or hiring articles or services activated by coins, credit cards, paper currency or the like G07F7/00, G07F17/00)
- G07B 15/02: taking into account a variable factor such as distance or time, e.g. for passenger transport, parking systems or car rental systems (G07B15/06 takes precedence; taximeters G07B13/00; parking meters per se G07F17/24)
- G08G 1/0175: {by photographing vehicles, e.g. when violating traffic rules}
- G08G 1/052: with provision for determining speed or overspeed {(speed measuring in general G01P)}
- G08G 1/056: with provision for distinguishing direction of travel
- G08G 1/133: within the vehicle {; Indicators inside the vehicles or at stops}
- G08G 1/142: {external to the vehicles}
- G08G 1/143: {inside the vehicles}
- G08G 1/144: {on portable or mobile units, e.g. personal digital assistant [PDA]}
- G08G 1/148: {Management of a network of parking areas}
- G08G 5/55: for a single aircraft
- G08G 5/57: for unmanned aircraft
- H04N 7/181: {for receiving images from a plurality of remote sources}
- H04N 23/62: Control of parameters via user interfaces
- H04N 23/66: Remote control of cameras or camera parts, e.g. by remote control devices
- H04N 23/90: Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
- B64U 2101/31: for surveillance
- G06T 2207/10032: Satellite or aerial image; Remote sensing
- G06T 2207/30244: Camera pose
- G06T 2207/30256: Lane; Road marking
- G06T 2207/30264: Parking
- G06V 20/625: {License plates}
- H04N 7/18: Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N 23/69: Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G05D: SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G07B: TICKET-ISSUING APPARATUS; FARE-REGISTERING APPARATUS; FRANKING APPARATUS
- G08G: TRAFFIC CONTROL SYSTEMS (guiding railway traffic, ensuring the safety of railway traffic B61L; arrangement of road signs or traffic signals E01F9/00; radar or analogous systems, sonar systems, lidar systems specially adapted for traffic control G01S13/91, G01S15/88, G01S17/88; {radar or analogous systems, sonar systems, lidar systems specially adapted for anti-collision purposes G01S13/93, G01S15/93, G01S17/93})
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- B64U: UNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR

## Abstract

Tracking a vehicle using an unmanned aerial vehicle is disclosed. One or more first images may be received from a first camera of the first unmanned aerial vehicle located at a first location. A unique identifier of a first vehicle may be determined to be not identifiable in at least one of the one or more first images. The first unmanned aerial vehicle may be then repositioned. One or more second images having the second field of view and showing the first vehicle may then be received. The unique identifier of the first vehicle may then be determined based on at least one of the one or more second images.

## Claims

### Claim 1

A method of tracking a vehicle using an unmanned aerial vehicle, the method comprising:
receiving, at a first time, one or more first images from a first camera of a first unmanned aerial vehicle located at a first location, the one or more first images having a first field of view and showing a first vehicle;
determining, based on at least one of the one or more first images, a first characteristic of the first vehicle;
determining that a unique identifier of the first vehicle is not identifiable in at least one of the one or more first images;
causing repositioning, in response to the determination that the unique identifier of the first vehicle is not identifiable in the at least one of the one or more first images, of the first unmanned aerial vehicle from the first location to a second location, the second location being different from the first location;
receiving, at a second time that is after the first time, one or more second images from the first camera of the first unmanned aerial vehicle, the one or more second images having a second field of view and showing the first vehicle, the second field of view being different from the first field of view;
determining, based on at least one of the one or more second images, a second characteristic of the first vehicle;
comparing the second characteristic of the first vehicle to the first characteristic of the first vehicle;
determining, in response to the comparison of the second characteristic of the first vehicle to the first characteristic of the first vehicle, that the second characteristic of the first vehicle is approximately equal to the first characteristic of the first vehicle;
determining, in response to the approximate equivalence of the second characteristic of the first vehicle and the first characteristic of the first vehicle, that the first vehicle is present in the one or more second images;
determining, based on at least one of the one or more second images, the unique identifier of the first vehicle; and
identifying the unique identifier,
wherein the steps of receiving, determining, causing repositioning, comparing and identifying are performed by one or more processors.

### Claim 2 (depends on 1)

The method of claim 1, wherein causing repositioning of the first unmanned aerial vehicle from the first location to the second location comprises:
determining a dynamic characteristic of the first vehicle; and
determining, based on the dynamic characteristic of the first vehicle, the second location of the first unmanned aerial vehicle.

### Claim 3 (depends on 2)

The method of claim 2, wherein the dynamic characteristic of the first vehicle is at least one of a lane identifier, a direction, a ground speed, and an acceleration of the first vehicle.

### Claim 4 (depends on 2)

The method of claim 2, wherein determining the second location of the first unmanned aerial vehicle comprises estimating a location of the first vehicle at the second time based on the dynamic characteristic of the first vehicle.

### Claim 5 (depends on 2)

The method of claim 2, wherein determining the second location of the first unmanned aerial vehicle comprises determining a location of the unique identifier of the first vehicle at the second time based on the dynamic characteristic of the first vehicle.

### Claim 6 (depends on 1)

The method of claim 1, wherein causing repositioning of the first unmanned aerial vehicle from the first location to the second location comprises:
determining the second location of the first unmanned aerial vehicle; and
forwarding instructions to the first unmanned aerial vehicle to reposition to the second location.

### Claim 7 (depends on 1)

The method of claim 1, wherein a distance between the first unmanned aerial vehicle and the first vehicle is the same when the first unmanned aerial vehicle is at the first location and when the first unmanned aerial vehicle is at the second location.

### Claim 8 (depends on 1)

The method of claim 1, wherein the at least one of the one or more second images shows a front region of the first vehicle or a rear region of the first vehicle.

### Claim 9 (depends on 1)

The method of claim 1, wherein causing repositioning of the first unmanned aerial vehicle from the first location to the second location comprises:
determining a dynamic characteristic of the first vehicle;
determining that a magnitude of the dynamic characteristic exceeds a first threshold; and
causing repositioning, in response to the determination that the magnitude of the dynamic characteristic exceeds the first threshold, of the first unmanned aerial vehicle from the first location to the second location.

### Claim 10 (depends on 9)

The method of claim 9, wherein the dynamic characteristic is a ground speed of the first vehicle.

### Claim 11 (depends on 1)

The method of claim 1, wherein causing repositioning of the first unmanned aerial vehicle from the first location to the second location comprises:
determining, based on at least one of the one or more first images, that the first vehicle has committed a parking violation; and
causing repositioning, in response to the determination that the first vehicle has committed the parking violation, of the first unmanned aerial vehicle from the first location to the second location.

### Claim 12 (depends on 11)

The method of claim 11, wherein determining that the first vehicle has committed the parking violation comprises determining, based on at least one of the one or more first images, that the first vehicle is parked in a restricted parking zone.

### Claim 13 (depends on 11)

The method of claim 11, wherein determining that the first vehicle has committed the parking violation comprises determining, based on at least one of the one or more first images, that the first vehicle has a missing or expired parking permit.

### Claim 14 (depends on 1)

The method of claim 1, wherein the unique identifier of the first vehicle is a license plate number, a one-dimensional bar code, a matrix bar code, a parking permit identification number, a disabled placard identification number, or a vehicle registration tag associated with the first vehicle.

### Claim 15 (depends on 1)

The method of claim 1, wherein the one or more first images show the first vehicle and a second vehicle, the method further comprising:
determining, based on at least one of the one or more first images, that a second unique identifier of the second vehicle is identifiable in at least one of the one or more first images.

### Claim 16 (depends on 1)

The method of claim 1, further comprising:
receiving, at a third time before the first time, one or more third images from a second camera, the one or more third images having a third field of view and showing the first vehicle, and the third field of view being different from and at least partially overlapping with the first field of view;
determining an overlap area that defines the overlap between the one or more first images and the one or more third images; and
determining a handoff zone within the overlap area, wherein tracking of the first vehicle is passed from the second camera to the first camera after the first vehicle enters the handoff zone.

### Claim 17 (depends on 16)

The method of claim 16, wherein the second camera is located on a second unmanned aerial vehicle different from the first unmanned aerial vehicle.

### Claim 18 (depends on 1)

The method of claim 1, wherein causing repositioning of the first unmanned aerial vehicle from the first location to the second location having the second field of view comprises:
determining a first path to the second location from the first location;
determining that an obstruction is present along the first path; and
determining, in response to the determination that the obstruction is present along the first path, a second path to the second location from the first location that does not overlap with the obstruction, the second path being different from the first path.

### Claim 19 (depends on 1)

The method of claim 1, wherein:
receiving the one or more first images from the first camera of the first unmanned aerial vehicle located at the first location comprises receiving two or more first images from the first camera of the first unmanned aerial vehicle located at the first location;
determining the first characteristic of the first vehicle comprises:
determining, based on at least one of the two or more first images, a first static characteristic of the first vehicle, and
determining, based on at least two of the two or more first images, a first dynamic characteristic of the first vehicle;
receiving the one or more second images from the first camera of the first unmanned aerial vehicle located at the second location comprises receiving two or more second images from the first camera of the first unmanned aerial vehicle at the second location;
determining the second characteristic of the first vehicle comprises:
determining, based on at least one of the two or more second images, a second static characteristic of the first vehicle, and
determining, based on at least two of the two or more second images, a second dynamic characteristic of the first vehicle;
comparing the second characteristic of the first vehicle to the first characteristic of the first vehicle comprises:
comparing the second static characteristic of the first vehicle to the first static characteristic of the first vehicle, and
comparing the second dynamic characteristic of the first vehicle to the first dynamic characteristic of the first vehicle;
determining that the second characteristic of the first vehicle is approximately equal to the first characteristic of the first vehicle comprises:
determining, in response to the comparison of the second static characteristic to the first static characteristic, that the second static characteristic is approximately equal to the first static characteristic, and
determining, in response to the comparison of the second dynamic characteristic to the first dynamic characteristic, that the second dynamic characteristic is approximately equal to the first dynamic characteristic; and
determining that the first vehicle is present in the second field of view of the first camera comprises determining, in response to the approximate equivalence between the second static characteristic and the first static characteristic and the approximate equivalence between the second dynamic characteristic and the first dynamic characteristic, that the first vehicle is present in the two or more second images,
wherein:
the first static characteristic and the second static characteristic are characteristics of the first vehicle that are constant over time, and
the first dynamic characteristic and the second dynamic characteristic are characteristics of the first vehicle that change over time.

### Claim 20 (depends on 19)

The method of claim 19, wherein:
the first static characteristic and the second static characteristic are each one or more of a vehicle make, a vehicle model, a vehicle year, a vehicle color, a vehicle outline, a vehicle size, and a vehicle dimension of the first vehicle, and
the first dynamic characteristic and the second dynamic characteristic are each one or more of a lane identifier, a direction, a ground speed, and an acceleration of the first vehicle.

### Claim 21 (depends on 1)

The method of claim 1, wherein the one or more first images show at least one destination location, the method further comprising:
determining, based on at least one of the one or more first images, that the first vehicle is stopped within the at least one destination location at the first time.

### Claim 22 (depends on 21)

The method of claim 21, further comprising:
receiving, at a third time that is after the second time, one or more third images from the first camera of the first unmanned aerial vehicle, the one or more third images having a third field of view and showing the first vehicle and the at least one destination location;
determining, based on at least one of the one or more third images, that the first vehicle has left the at least one destination location at the third time;
indicating that the first vehicle began use of the at least one destination location at the first time; and
indicating that the first vehicle completed use of the at least one destination location at the third time.

### Claim 23 (depends on 22)

The method of claim 22, further comprising:
determining a cost for the first vehicle to occupy the at least one destination location from the first time to the third time; and
charging the cost to an account associated with the first vehicle.

### Claim 24 (depends on 22)

The method of claim 22, further comprising:
determining a cost for the first vehicle to occupy the at least one destination location from the first time to the third time; and
receiving payment information for the cost from a third-party parking payment system.

### Claim 25 (depends on 24)

The method of claim 24, wherein the third-party parking payment system is a third-party pay-by-phone parking payment system, a third-party pay-by-space parking payment system, a third-party pay-and-display parking payment system, a third-party pay-by-plate payment system, or a third-party curbside parking meter payment system.

### Claim 26 (depends on 22)

The method of claim 22, further comprising:
obtaining payment information for the at least one destination location from a third-party parking payment system, the payment information specifying a period of time for which payment was received by the third-party parking payment system for use of the at least one destination location by the first vehicle; and
determining that the use of the at least one destination location by the first vehicle from the first time to the third time is outside of the period of time received from the third-party parking payment system.

### Claim 27 (depends on 26)

The method of claim 26, further comprising:
providing, in response to the determination that the use of the at least one destination location by the first vehicle from the first time to the third time is outside of the period of time received from the third-party parking payment system, data comprising a unique identifier of the first vehicle, the period of time received from the third-party parking payment system, an identifier of the destination location, the first time, and the third time.

### Claim 28 (depends on 22)

The method of claim 22, further comprising:
obtaining a description of one or more restrictions for use of the at least one destination location;
determining that the use of the at least one destination location by the first vehicle from the first time to the third time violates at least one of the one or more restrictions; and
indicating the at least one of the one or more restrictions violated by the first vehicle.

### Claim 29

A method of tracking a vehicle using an unmanned aerial vehicle, the method comprising:
capturing, at a first time, one or more first images from a first camera of a first unmanned aerial vehicle located at a first location, the one or more first images having a first field of view and showing a first vehicle;
determining, based on at least one of the one or more first images, a first characteristic of the first vehicle;
determining that a unique identifier of the first vehicle is not identifiable in at least one of the one or more first images;
repositioning, in response to the determination that the unique identifier of the first vehicle is not identifiable in at least one of the one or more first images, the first unmanned aerial vehicle from the first location to a second location, the second location being different from the first location;
capturing, at a second time that is after the first time, one or more second images from the first camera of the first unmanned aerial vehicle, the one or more second images having a second field of view and showing the first vehicle, the second field of view being different from the first field of view;
determining, based on at least one of the one or more second images, a second characteristic of the first vehicle;
comparing the second characteristic of the first vehicle to the first characteristic of the first vehicle;
determining, in response to the comparison of the second characteristic of the first vehicle to the first characteristic of the first vehicle, that the second characteristic of the first vehicle is approximately equal to the first characteristic of the first vehicle;
determining, in response to the approximate equivalence of the second characteristic of the first vehicle and the first characteristic of the first vehicle, that the first vehicle is present in the one or more second images;
determining, based on at least one of the one or more second images, the unique identifier of the first vehicle; and
identifying the unique identifier,
wherein the steps of capturing, determining, repositioning, comparing and identifying are performed by one or more processors.

### Claim 30

A storage device storing a computer program for tracking a vehicle using an unmanned aerial vehicle, the computer program comprising one or more code segments that, when executed, cause one or more processors to:
receive, at a first time, one or more first images from a first camera of a first unmanned aerial vehicle located at a first location, the one or more first images having a first field of view and showing a first vehicle;
determine, based on at least one of the one or more first images, a first characteristic of the first vehicle;
determine that a unique identifier of the first vehicle is not identifiable in at least one of the one or more first images;
cause repositioning, in response to the determination that the unique identifier of the first vehicle is not identifiable in the at least one of the one or more first images, of the first unmanned aerial vehicle from the first location to a second location, the second location being different from the first location;
receive, at a second time that is after the first time, one or more second images from the first camera of the first unmanned aerial vehicle, the one or more second images having a second field of view and showing the first vehicle, the second field of view being different from the first field of view;
determine, based on at least one of the one or more second images, a second characteristic of the first vehicle;
compare the second characteristic of the first vehicle to the first characteristic of the first vehicle;
determine, in response to the comparison of the second characteristic of the first vehicle to the first characteristic of the first vehicle, that the second characteristic of the first vehicle is approximately equal to the first characteristic of the first vehicle;
determine, in response to the approximate equivalence of the second characteristic of the first vehicle and the first characteristic of the first vehicle, that the first vehicle is present in the one or more second images;
determine, based on at least one of the one or more second images, the unique identifier of the first vehicle; and
identify the unique identifier.
