# US 2021/0241405 A1 · Method, system and computer program product for automated processing, enforcement and intelligent management of vehicle operation violations

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0241405 A1
- Document ID: US20210241405A1
- Status: Published application
- Kind: A1
- Application number: 16/782,770
- Filed: 2020-02-05
- Published: 2021-08-05
- Earliest claimed: 2020-02-05
- Assignees: Motorola Solutions, Inc.
- Applicants: Motorola Solutions, Inc.
- Inventors: MARIYA BONDAREVA; ZILI LI; PIETRO RUSSO
- Web page: https://patentgrep.com/patent/US20210241405A1

## CPC

- G06Q 50/265: {Personal security, identity or safety}
- G06F 16/583: using metadata automatically derived from the content
- G06N 3/04: Architecture, e.g. interconnection topology
- G06N 3/0464: Convolutional networks [CNN, ConvNet]
- G06N 3/09: Supervised learning
- G06N 3/091: Active learning
- G06Q 40/02: Banking, e.g. interest calculation or account maintenance (credit or loans G06Q40/03)
- G06V 20/52: Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69)
- G06N 3/08: Learning methods
- G06V 20/625: {License plates}
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

Automated processing, enforcement and intelligent management of vehicle operation violations is disclosed. A method, that is also disclosed, includes obtaining at least one image within which is shown at least a portion of a vehicle. The method also includes receiving image data for the at least one image, and analyzing the image data to generate a violation score for each of one or more potential vehicle operation violations for the vehicle. When the violation score is in-between an upper violation threshold and a lower consideration threshold, user input is obtained that either affirms or rejects existence of a violation and then, once the user input is obtained, a violation notification is generated only when the user input affirms the existence of the violation. When the violation score is higher than the violation threshold, the violation notification is generated without the user input being obtained.

## Claims

### Claim 1

A method comprising:
obtaining at least one image within which is shown at least a portion of a vehicle;
receiving, at an at least one processor, image data for the at least one image;
analyzing, using the at least one processor, the image data to generate a violation score for each of one or more potential vehicle operation violations for the vehicle;
when the violation score is in-between an upper violation threshold and a lower consideration threshold, prompting to obtain user input that either affirms or rejects existence of a violation and then, once the user input is obtained, generating a violation notification only when the user input affirms the existence of the violation; and
when the violation score is higher than the upper violation threshold, generating the violation notification without the user input being obtained.

### Claim 2 (depends on 1)

The method as claimed in claim 1 further comprising:
capturing, using a camera, at least one additional image within which is shown a license plate of the vehicle; and
carrying out Optical Character Recognition (OCR) on the at least one additional image to identify a license plate number corresponding to the license plate.

### Claim 3 (depends on 2)

The method as claimed in claim 2 wherein the camera is a License Plate Recognition (LPR) camera pointed at a road.

### Claim 4 (depends on 1)

The method as claimed in claim 1 wherein the potential vehicle operation violation relates to window or windshield structural integrity.

### Claim 5 (depends on 1)

The method as claimed in claim 1 wherein the potential vehicle operation violation relates to window, windshield or mirror visibility impairment.

### Claim 6 (depends on 1)

The method as claimed in claim 1 wherein at least one neural network and a database of reference images for affirmed and dismissed historical violations are employed in generating the violation score.

### Claim 7 (depends on 6)

The method as claimed in claim 6 wherein the analyzing includes comparing the image data for the at least one image against image data for a number of the reference images.

### Claim 8 (depends on 6)

The method as claimed in claim 6 further comprising:
obtaining additional information indicating that either a fine associated with the potential vehicle operation violation was paid or that the potential vehicle operation violation was dismissed; and
updating, once the additional information has been obtained, the database to include the at least one image as a new reference image.

### Claim 9

A system comprising:
a camera configured to obtain at least one image within which is shown at least a portion of a vehicle;
at least one processor configured to receive image data for the at least one image; and
at least one tangible, non-transitory, computer-readable storage medium having instructions encoded therein, wherein the instructions, when executed by the at least one processor, causes a carrying out of a method that includes:
analyzing the image data to generate a violation score for each of one or more potential vehicle operation violations for the vehicle;
when the violation score is in-between an upper violation threshold and a lower consideration threshold, prompting to obtain user input that either affirms or rejects existence of a violation and then, once the user input is obtained, generating a violation notification only when the user input affirms the existence of the violation; and
when the violation score is higher than the upper violation threshold, generating the violation notification without the user input being obtained.

### Claim 10 (depends on 9)

The system as claimed in claim 9 further comprising:
a License Plate Recognition (LPR) camera configured to capture at least one additional image within which is shown a license plate of the vehicle, and
wherein the method further includes:
carrying out Optical Character Recognition (OCR) on the at least one additional image to identify a license plate number corresponding to the license plate.

### Claim 11 (depends on 9)

The system as claimed in claim 9 wherein the potential vehicle operation violation relates to window or windshield structural integrity.

### Claim 12 (depends on 9)

The system as claimed in claim 9 wherein the potential vehicle operation violation relates to window, windshield or mirror visibility impairment.

### Claim 13 (depends on 9)

The system as claimed in claim 9 further comprising:
at least one neural network; and
a database of reference images for affirmed and dismissed historical violations, the database being coupled to the at least one neural network for cooperative operation therewith in generating the violation score.

### Claim 14 (depends on 13)

The system as claimed in claim 13 wherein the analyzing includes comparing the image data for the at least one image against image data for a number of the reference images.

### Claim 15 (depends on 13)

The system as claimed in claim 13 wherein the method further includes:
obtaining additional information indicating that either a fine associated with the potential vehicle operation violation was paid or that the potential vehicle operation violation was dismissed; and
updating, once the additional information has been obtained, the database to include the at least one image as a new reference image.

### Claim 16 (depends on 9)

The system as claimed in claim 9 further comprising a client device having a display, and wherein the client device is configured to output the violation notification onto the display.

### Claim 17 (depends on 16)

The system as claimed in claim 16 further comprising a server remote from the client device, and wherein the computer-readable storage medium is contained in the server.
