# US 2022/0036569 A1 · Method for tracking image objects

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0036569 A1
- Document ID: US20220036569A1
- Status: Published application
- Kind: A1
- Application number: 17/389,458
- Filed: 2021-07-30
- Published: 2022-02-03
- Earliest claimed: 2020-07-30
- Assignees: Nadi System Corp.
- Applicants: Nadi System Corp.
- Inventors: SYUAN-PEI CHANG
- Web page: https://patentgrep.com/patent/US20220036569A1

## CPC

- G06T 7/292: Multi-camera tracking
- G06T 3/4038: Image mosaicing, e.g. composing plane images from plane sub-images
- G06T 7/187: involving region growing; involving region merging; involving connected component labelling
- G06T 7/97: {Determining parameters from multiple pictures (depth or shape recovery from multiple images G06T7/55; stereo camera calibration G06T7/85)}
- H04N 23/695: Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects
- G06T 2207/10004: Still image; Photographic image
- G06T 2207/20084: Artificial neural networks [ANN]
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

The present invention provides a method for tracking image objects, adopting at least one first camera and at least one second camera, wherein the first camera shoots a physical environment to obtain a first image, and the second camera shoots the physical environment to obtain a second image that partially overlaps the first image The method comprises the steps of: (a) merging the first image with the second image, in order to form a composite image; and (b) framing and tracking at least one object of the composite image.

## Claims

### Claim 1

A method for tracking image objects, adopting at least one first camera and at least one second camera, wherein the first camera shoots a physical environment to obtain a first image, and the second camera shoots the physical environment to obtain a second image that partially overlaps the first image, comprising the steps of:
(a) merging the first image with the second image, in order to form a composite image; and
(b) framing and tracking at least one object of the composite image.

### Claim 2 (depends on 1)

The method for tracking the image objects according to claim 1 further comprising the steps of:
(c) building up a three-dimensional space model that corresponds to the actual environment;
(d) using a height, a shooting angle and a focal length of the first camera to build up a corresponding first view cone model, and determining a first shooting coverage area where the first camera is in the physical environment based on the first view cone model;
(e) using a height, a shooting angle and a focal length of the second camera to build up a corresponding second view cone model, and determining a second shooting coverage area where the second camera is in the physical environment based on the second cone model;
(f) searching a first virtual coverage area that corresponds to the first shooting coverage area in the three-dimensional space model;
(g) searching a second virtual coverage area that corresponds to the second shooting coverage area in the three-dimensional space model;
(h) integrating the first virtual coverage area with the second virtual coverage area to form a third virtual coverage area; and
(i) introducing the composite image to the three-dimensional space model, and projecting the composite image to the third virtual coverage area.

### Claim 3 (depends on 1)

The method for tracking the image objects according to claim 1, wherein the first image being merged with the second image in step (a) is through an image stitching algorithm that has an SIFT algorithm.

### Claim 4 (depends on 1)

The method for tracking the image objects according to claim 1, wherein framing and tracking the at least one object of the composite image in step (b) is through an image analysis module that has a neural network model.

### Claim 5 (depends on 4)

The method for tracking the image objects according to claim 4, wherein the neural network model is to execute deep learning algorithms.

### Claim 6 (depends on 4)

The method for tracking the image objects according to claim 4, wherein the neural network model is a convolutional neural network model.

### Claim 7 (depends on 5)

The method for tracking the image objects according to claim 5, wherein the convolutional neural network model is selected from the group consisting of: VGG model, ResNet model and DenseNet model.

### Claim 8 (depends on 4)

The method for tracking the image objects according to claim 4, wherein the neural network model is selected from the group consisting of: YOLO model, CTPN model, EAST model, and RCNN model.
