# US 2024/0203111 A1 · Machine learning-based video analytics using cameras with different frame rates

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0203111 A1
- Document ID: US20240203111A1
- Status: Published application
- Kind: A1
- Application number: 18/081,049
- Filed: 2022-12-14
- Published: 2024-06-20
- Earliest claimed: 2022-12-14
- Assignees: Cisco Technology, Inc.
- Applicants: Cisco Technology, Inc.
- Inventors: Bogdan Ionut Tudosoiu
- Web page: https://patentgrep.com/patent/US20240203111A1

## CPC

- G06V 10/82: using neural networks
- G06T 3/40: Scaling of whole images or parts thereof, e.g. expanding or contracting
- G06T 3/608: by skew deformation, e.g. two-pass or three-pass rotation
- G06T 5/70: Denoising; Smoothing
- G06V 20/44: {Event detection}
- G06V 40/20: Movements or behaviour, e.g. gesture recognition (recognition of facial expressions G06V40/16)
- H04N 5/265: Mixing
- G06T 2207/20036: Morphological image processing
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

In one embodiment, a device makes an inference about video data from a first camera using a machine learning model. The device processes video data from a second camera that has a lower frame rate than that of the video data from the first camera. The device performs a mapping of the inference about the video data from the first camera to the video data from the second camera processed by the device. The device provides an indication of the mapping for display.

## Claims

### Claim 1

A method comprising:
making, by a device, an inference about video data from a first camera using a machine learning model;
processing, by the device, video data from a second camera that has a lower frame rate than that of the video data from the first camera;
performing, by the device, a mapping of the inference about the video data from the first camera to the video data from the second camera processed by the device; and
providing, by the device, an indication of the mapping for display.

### Claim 2 (depends on 1)

The method as in claim 1, wherein the device executes the machine learning model using a first processor and processes the video data from the second camera using a second processor.

### Claim 3 (depends on 1)

The method as in claim 1, wherein the mapping is based in part on a physical distance between the first camera and the second camera.

### Claim 4 (depends on 1)

The method as in claim 1, wherein the machine learning model detects an event or behavior depicted in the video data from the first camera.

### Claim 5 (depends on 1)

The method as in claim 1, wherein the video data from the first camera has lower resolution than that of the video data from the second camera.

### Claim 6 (depends on 1)

The method as in claim 1, wherein performing the mapping comprises:
mapping coordinates output by the machine learning model relative to the video data from the first camera to coordinates of the video data from the second camera.

### Claim 7 (depends on 1)

The method as in claim 1, wherein processing the video data from the second camera comprises:
performing rescaling, noise reduction, de-skewing, thresholding, or a morphological operation on the video data from the second camera.

### Claim 8 (depends on 1)

The method as in claim 1, wherein the device comprises the first camera and the second camera.

### Claim 9 (depends on 1)

The method as in claim 1, wherein the indication comprises an overlay for the video data from the second camera processed by the device.

### Claim 10 (depends on 1)

The method as in claim 1, wherein the machine learning model comprises a neural network.

### Claim 11

An apparatus, comprising:
a network interface to communicate with a computer network;
one or more processors coupled to the network interface and configured to execute one or more processes; and
a memory configured to store a process that is executed by the one or more processors, the process when executed configured to:
make an inference about video data from a first camera using a machine learning model;
process video data from a second camera that has a lower frame rate than that of the video data from the first camera;
perform a mapping of the inference about the video data from the first camera to the video data from the second camera processed by the apparatus; and
provide an indication of the mapping for display.

### Claim 12 (depends on 11)

The apparatus as in claim 11, wherein the apparatus executes the machine learning model using a first processor and processes the video data from the second camera using a second processor.

### Claim 13 (depends on 11)

The apparatus as in claim 11, wherein the mapping is based in part on a physical distance between the first camera and the second camera.

### Claim 14 (depends on 11)

The apparatus as in claim 11, wherein the machine learning model detects an event or behavior depicted in the video data from the first camera.

### Claim 15 (depends on 11)

The apparatus as in claim 11, wherein the video data from the first camera has lower resolution than that of the video data from the second camera.

### Claim 16 (depends on 11)

The apparatus as in claim 11, wherein the apparatus performs the mapping by:
mapping coordinates output by the machine learning model relative to the video data from the first camera to coordinates of the video data from the second camera.

### Claim 17 (depends on 11)

The apparatus as in claim 11, wherein the apparatus processes the video data from the second camera by:
performing rescaling, noise reduction, de-skewing, thresholding, or a morphological operation on the video data from the second camera.

### Claim 18 (depends on 11)

The apparatus as in claim 11, wherein the apparatus comprises the first camera and the second camera.

### Claim 19 (depends on 11)

The apparatus as in claim 11, wherein the indication comprises an overlay for the video data from the second camera processed by the apparatus.

### Claim 20

A tangible, non-transitory, computer-readable medium storing program instructions that cause a device to execute a process comprising:
making, by the device, an inference about video data from a first camera using a machine learning model;
processing, by the device, video data from a second camera that has a lower frame rate than that of the video data from the first camera;
performing, by the device, a mapping of the inference about the video data from the first camera to the video data from the second camera processed by the device; and
providing, by the device, an indication of the mapping for display.
