# US 2023/0410539 A1 · Method and system for reducing manual review of license plate images for assessing toll charges

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0410539 A1
- Document ID: US20230410539A1
- Status: Published application
- Kind: A1
- Application number: 18/223,436
- Filed: 2023-07-18
- Published: 2023-12-21
- Earliest claimed: 2020-07-06
- Assignees: Geotoll, Inc.
- Applicants: Geotoll, Inc.
- Inventors: Jaime Andres Borras; Wyatt Drake Geist
- Web page: https://patentgrep.com/patent/US20230410539A1

## CPC

- G06V 20/62: Text, e.g. of license plates, overlay texts or captions on TV images
- G01C 21/3461: {Preferred or disfavoured areas, e.g. dangerous zones, toll or emission zones, intersections, manoeuvre types or segments such as motorways, toll roads or ferries}
- G06V 20/20: in augmented reality scenes
- G06V 20/54: of traffic, e.g. cars on the road, trains or boats
- H04W 4/021: Services related to particular areas, e.g. point of interest [POI] services, venue services or geofences
- H04W 4/40: for vehicles, e.g. vehicle-to-pedestrians [V2P]
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S)
- H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72)

## Abstract

A tolling system is operable to reduce the number of manual reviews of a toll point images needed to process toll fee charges by separately reporting from both toll points and mobile device in vehicles running a tolling application program the lane and crossing time when traversing a toll point. A tolling service can match records produced by the toll points with records providing by the mobile device when the toll point cannot immediately determine the identity of the toll customer passing through the toll point.

## Claims

### Claim 1

A method for avoiding manual image review to determine an identity of a toll subscriber, comprising:
at a mobile device associated with a vehicle;
determining, based on a location of the mobile device, that the vehicle has entered a local geofenced zone of a tolling location on a toll roadway;
responsive to determining that the vehicle has entered the local geofenced zone, attempting to determine a geofenced lane in which the vehicle is traveling;
determining a time, based on a location determination by the mobile device, at which the vehicle crosses an imaging location of the tolling location; and
transmitting to a tolling server a message including data indicating the time and tolling location information at which the vehicle crossed the imaging location;
responsive to receiving the time and lane information, the tolling server attempting to match a license plate in an image taken by a toll camera at the tolling location of the imaging location at the time and failing to find a match; and
responsive to failing to find a match, the tolling server applying a reconciliation process to identity a toll account to be billed.

### Claim 2 (depends on 1)

The method of claim 1, wherein the reconciliation process comprises receiving toll account information from the mobile device and directly billing a toll account indicated by the toll account information.

### Claim 3 (depends on 1)

The method of claim 1, wherein the reconciliation process comprises:
determining that the geofenced lane was successfully determined;
comparing at least one crossing time as indicated by at least one image taken by the toll camera with the time at which the vehicle crossed the imaging location as determined by the mobile device; and
determining a best match between the time at which the vehicle crossed the imaging location as determined by the mobile device and the at least one crossing time as indicated by at least one image taken by the toll camera and deleting the at least one image.

### Claim 4 (depends on 1)

The method of claim 1, wherein the reconciliation process comprises:
determining that the geofenced lane was not successfully determined by the mobile device;
determining whether there is a crossing time as indicated by an image taken by the toll camera that is sufficiently identical to the time at which the vehicle crossed the imaging location as determined by the mobile device.

### Claim 5 (depends on 4)

The method of claim 4, wherein:
when there is a crossing time as indicated by an image taken by the toll camera that is sufficiently identical to the time at which the vehicle crossed the imaging location as determined by the mobile device, using license tag information provided by the mobile device to identify the toll account to be billed; and
when there is no crossing time as indicated by an image taken by the toll camera that is sufficiently identical to the time at which the vehicle crossed the imaging location as determined by the mobile device, comparing license tag numbers several images taken by the toll camera within a preselected time interval around the time at which the vehicle crossed the imaging location as determined by the mobile device and determining a best match of the license tag numbers and the license tag information provided by the mobile device.

### Claim 6 (depends on 1)

The method of claim 1, wherein determining the time, based on location determination by the mobile device while in the geofenced lane comprises:
in response to determining that the vehicle is in the geofenced lane, increasing a rate at which location determinations are made;
performing a plurality of location determinations at the increased rate while in the geofenced lane;
determining one of the plurality of location determinations to be a location closest to the imaging location;
determining a time offset based on a speed of the vehicle and a distance between the location of the one of the plurality of location determinations and the imaging location; and
applying the time offset to the time at which the one of the plurality of location determinations was made.

### Claim 7

A method for reducing the need for automatic license plate recognition at a tolling location, comprising:
failing to receive a toll transponder response at a toll reader of a tolling location upon a vehicle passing through the tolling location;
receiving, at a server of a toll agency from a plurality of mobile devices, a plurality of toll event log message indicating a tolling location and a time of passing through the tolling location; and
responsive to failing to receive the toll transponder response, performing a reconciliation process to determine a toll account associated with the vehicle, and then billing the toll account.

### Claim 8 (depends on 7)

The method of claim 7, wherein the reconciliation process comprises:
determining that one of the plurality of toll event log messages include a corresponding tolling location and time value matching that of the vehicle passing through the tolling location; and
using the time value and tolling location to determine the toll account associated with the vehicle.

### Claim 9 (depends on 7)

The method of claim 7, wherein the reconciliation process comprises receiving toll account information from the mobile device and directly billing a toll account indicated by the toll account information.

### Claim 10 (depends on 7)

The method of claim 7, wherein the reconciliation process comprises:
determining that the geofenced lane was not successfully determined by the mobile device;
determining whether there is a crossing time as indicated by an image taken by the toll camera that is sufficiently identical to the time at which the vehicle crossed the imaging location as determined by the mobile device.

### Claim 11 (depends on 10)

The method of claim 10, wherein:
when there is a crossing time as indicated by an image taken by the toll camera that is sufficiently identical to the time at which the vehicle crossed the imaging location as determined by the mobile device, using license tag information provided by the mobile device to identify the toll account to be billed; and
when there is no crossing time as indicated by an image taken by the toll camera that is sufficiently identical to the time at which the vehicle crossed the imaging location as determined by the mobile device, comparing license tag numbers several images taken by the toll camera within a preselected time interval around the time at which the vehicle crossed the imaging location as determined by the mobile device and determining a best match of the license tag numbers and the license tag information provided by the mobile device.

### Claim 12

A method of reducing revenue loss in vehicle tolling, comprising:
at a tolling location, detecting an approach of a vehicle, wherein the tolling location is one tolling location of a plurality of tolling locations;
determining a time at which the vehicle passes the tolling location;
receiving, at a server of a toll agency from a plurality of mobile devices, a plurality of toll event log messages, each one of the plurality of event log message indicating a particular tolling location of the plurality of tolling locations and a time of passing through the particular tolling location; and
performing a reconciliation process to determine a toll account associated with the vehicle, and then billing the toll account.

### Claim 13 (depends on 12)

The method of claim 12, wherein the reconciliation process comprises:
determining that one of the plurality of toll event log messages includes a corresponding tolling location and time value matching that of the vehicle passing through the tolling location; and
determining the toll account associated with the vehicle based on matching the time value and tolling location.

### Claim 14 (depends on 13)

The method of claim 13, further comprising:
responsive to detecting the approach of the vehicle, capturing an image of the vehicle as the vehicle passes the tolling location; and
responsive to determining the toll account, deleting the image of the vehicle.

### Claim 15 (depends on 12)

The method of claim 12, further comprising:
responsive to detecting the approach of the vehicle, attempting to read a toll transponder in the vehicle at the tolling location; and
wherein performing the reconciliation process is performed response to failing to receive a transponder response from the vehicle.
