# US 2026/0065685 A1 · Vehicle Position Recognition Using Modified Neural Network

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0065685 A1
- Document ID: US20260065685A1
- Status: Published application
- Kind: A1
- Application number: 19/312,873
- Filed: 2025-08-28
- Published: 2026-03-05
- Earliest claimed: 2024-08-30
- Assignees: The Regents of the University of Michigan; Budapest University of Technologies and Economics
- Applicants: The Regents of The University of Michigan; Budapest University of Technologies and Economics
- Inventors: Gabor OROSZ; Tian MI; Denes TAKACS
- Web page: https://patentgrep.com/patent/US20260065685A1

## CPC

- G06V 20/54: of traffic, e.g. cars on the road, trains or boats
- G06T 7/20: Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51)
- G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80)
- G06V 10/25: Determination of region of interest [ROI] or a volume of interest [VOI]
- G06V 10/764: using classification, e.g. of video objects
- G06V 10/82: using neural networks
- G06V 20/17: taken from planes or by drones
- G06T 2207/10016: Video; Image sequence
- G06T 2207/10032: Satellite or aerial image; Remote sensing
- G06T 2207/20081: Training; Learning
- G06T 2207/20084: Artificial neural networks [ANN]
- G06T 2207/30236: Traffic on road, railway or crossing
- G06V 2201/08: Detecting or categorising vehicles
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A methodology is developed to extract vehicle kinematic information from roadside cameras at an intersection using deep learning. The ground truth data of top view bounding boxes are collected with the help of unmanned aerial vehicles (UAVs). These top view bounding boxes containing vehicle position, size, and orientation information, are converted to the roadside view bounding boxes using homography transformation. The ground truth data and the roadside view images are used to train a modified YOLOv5 neural network, and thus, to learn the homography transformation matrix. The output of the neural network is the vehicle kinematic information, and it can be visualized in both the top view and the roadside view. In this algorithm, the top view images are only used in training, and once the neural network is trained, only the roadside cameras are needed to extract the kinematic information.

## Claims

### Claim 1

A method for detecting a vehicle passing through a region of interest, comprising:
capturing, by a side view camera, a set of images for a region of interest on the ground from a perspective on side of the region of interest;
providing a neural network model configured to receive images of the region of interest captured from a perspective on side of the region of interest and trained to output vectors representing bonding boxes for each vehicle detected in the region of interest from a perspective above the region of interest, where the vectors include a yaw angle for the bounding boxes and the yaw angle defines orientation of a vehicle on ground plane; and
detecting, by a computer processor, vehicles in the region of interest by inputting the set of images into the neural network model.

### Claim 2 (depends on 1)

The method of claim 1 further comprises determining kinematic information for the detected vehicles and broadcasting the kinematic information over a wireless network to vehicles in or near the region of interest.

### Claim 3 (depends on 1)

The method of claim 1 wherein the vectors output by the neural network are comprised of a center position of a given bounding box relative to a grid; a width of the given bounding box, a length of the given bounding box, a confidence of the vehicle being present in the given bounding box and the yaw angle for the given bounding box.

### Claim 4 (depends on 1)

The method of claim 1 further comprises
capturing, by a top view camera, a first set of images of a region of interest on the ground from a perspective above the region of interest;
from the first set of images, creating a plurality of bounding boxes for each vehicle moving in the region of interest, and extracting kinematic data for each vehicle moving in the region of interest using the plurality of bounding boxes;
capturing, by the side view camera, a second set of images of the region of interest from a perspective on side of the region of interest; and
training the neural network model using the second set of images and a ground truth, where the kinematic data and the plurality of bounding boxes projected to onto the region of interest on the ground serve as the ground truth.

### Claim 5 (depends on 4)

The method of claim 4 wherein the neural network model is trained using a loss function and the loss function accounts for the yaw angle of the bonding boxes.

### Claim 6 (depends on 5)

The method of claim 5 wherein the loss function is further defined as
loss
=
obj_loss
+
pos_loss
+
size_loss
+
yaw_loss
where obj_loss indicates confidence of the vehicle being present in a cell, pos_loss accounts for disparity of center point of bounding boxes between the output and the ground truth, size_loss indicates a size difference of bounding boxes between the output and the ground truth, and yaw_loss indicates a difference between the yaw angle and the ground truth.

### Claim 7

A method for detecting a vehicle passing through a region of interest, comprising:
receiving a first set of images of a region of interest on the ground from a perspective above the region of interest;
from the first set of images, creating a plurality of bounding boxes for each vehicle moving in the region of interest, and extracting kinematic data for each vehicle moving in the region of interest using the plurality of bounding boxes;
capturing, by a side view camera, a second set of images of the region of interest from a perspective on side of the region of interest; and
training a machine learning algorithm to detect moving vehicles in images captured by the side view camera, where the machine learning algorithm is trained using the second set of images, a loss function, and a ground truth, such that the loss function accounts for a yaw angle of the bonding boxes, the yaw angle defines orientation of a vehicle on ground plane, and the kinematic data and the plurality of bounding boxes projected onto the region of interest serve as the ground truth.

### Claim 8 (depends on 7)

The method of claim 7 further comprises
capturing, by the side view camera, an additional set of images of the region of interest; and
detecting, by a computer processor, vehicles in the region of interest by inputting the set of images into the trained machine learning algorithm.

### Claim 9 (depends on 8)

The method of claim 8 further comprises determining kinematic information for the detected vehicles and broadcasting the kinematic information over a wireless network to vehicles in or near the region of interest.

### Claim 10 (depends on 7)

The method of claim 7 wherein the loss function is further defined as
loss
=
obj_loss
+
pos_loss
+
size_loss
+
yaw_loss
where obj_loss indicates confidence of the vehicle being present in a cell, pos_loss accounts for disparity of center point of bounding boxes between the output and the ground truth, size_loss indicates a size difference of bounding boxes between the output and the ground truth, and yaw_loss indicates a difference between the yaw angle and the ground truth.

### Claim 11

A non-transitory computer-readable medium having computer-executable instructions that, upon execution of the instructions by a processor of a computer, cause the computer to
receive a first set of images of a region of interest on the ground from a perspective above the region of interest;
from the first set of images, create a plurality of bounding boxes for each vehicle moving in the region of interest, and extract kinematic data for each vehicle moving in the region of interest using the plurality of bounding boxes;
capture a second set of images of the region of interest from a perspective on side of the region of interest using a side view camera; and
training a machine learning algorithm to detect moving vehicles in images captured by the side view camera, where the machine learning algorithm is trained using the second set of images, a loss function, and a ground truth, such that the loss function accounts for a yaw angle of the bonding boxes, the yaw angle defines orientation of a vehicle on ground plane, and the kinematic data and the plurality of bounding boxes projected onto the region of interest serve as the ground truth.
