# US 12,002,225 B2 · System and method for transforming video data into directional object count

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,002,225 B2
- Document ID: US12002225B2
- Status: Granted
- Kind: B2
- Application number: 17/650,744
- Filed: 2022-02-11
- Published: 2022-05-26
- Granted: 2024-06-04
- Earliest claimed: 2018-06-09
- Assignees: Pushpin Technology, L.L.C.
- Applicants: Pushpin Technology, L.L.C.
- Inventors: Terrance Edward Boult
- Web page: https://patentgrep.com/patent/US12002225B2

## CPC

- G06T 7/254: involving subtraction of images
- G06N 20/00: Machine learning
- G06T 5/50: using two or more images, e.g. averaging or subtraction
- G06T 7/215: Motion-based segmentation
- G06V 20/52: Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69)
- G06T 2207/20081: Training; Learning
- G06T 2207/30236: Traffic on road, railway or crossing
- G06T 2207/30242: Counting objects in image
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

The present invention is a computer-implemented system and method for transforming video data into directional object counts. The method of transforming video data is uniquely efficient in that it uses only a single column or row of pixels in a video camera to define the background from a moving object, count the number of objects and determine their direction. By taking an image of a single column or row every frame and concatenating them together, the result is an image of the object that has passed, referred to herein as a sweep image. In order to determine the direction, two different methods can be used. Method one involves constructing another image using the same method. The two images are then compared, and the direction is determined by the location of the object in the second image compared to the location of the object in the first image. Due to this recording method, elongation or compression of the objects can occur because of acceleration or deceleration of the objects and can be uniquely utilized to determine the speed or movement path of the objects. The second method of determining direction involves comparing the object in the image to an established marker. The transformations can also be used to produce labeled data for training machine learning models: bounding-boxes provided in sweep image can be transformed to bound boxes in video, and boxes in video can be transformed into boxes in the sweep image.

## Claims

### Claim 1

A system for transforming a sequence of image data into moving object counts comprising:
a video camera including a video sensor, a video processor, and input/output for sequentially entering input images representing a one frame of a video captured by the video camera, the input images consisting of a single column containing a moving object region to be counted;
a computer system receiving the input images consisting of the single column containing the moving object region to be counted from the video camera and combining them into a sweep image;
the computer system further storing the sweep image, processing the sweep image to detect object locations and a direction of motion, processing the detected object locations and determining object counts by counting objects in the sweep image to count how many objects passed under the object region, and
communicating an object count to an external system.

### Claim 2 (depends on 1)

The system according to claim 1, wherein the computer system esimates an expected signal when no object is present and compares that with signals in the sweep image to detect and localize each object.

### Claim 3 (depends on 1)

The system according to claim 1, wherein the computer system estimates edge features perpendicular to the signal of the sweep image and uses the estimated edge features to detect and localize each object.

### Claim 4 (depends on 1)

The system according to claim 1, wherein the computer system further combines the object locations and the direction of motion is estimated based on the relative object position within a slice.

### Claim 5 (depends on 1)

The system according to claim 1, wherein each input image represents only one frame of a video captured by the video camera.

### Claim 6 (depends on 1)

The system according to claim 1, wherein combining the input images to produce the sweep image includes concatenating the input images to form the sweep image.