# US 2024/0193805 A1 · Systems and methods for two-stage objection detection

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0193805 A1
- Document ID: US20240193805A1
- Status: Published application
- Kind: A1
- Application number: 18/063,819
- Filed: 2022-12-09
- Published: 2024-06-13
- Earliest claimed: 2022-12-09
- Assignees: Johnson Controls Tyco IP Holdings LLP
- Applicants: Johnson Controls Tyco IP Holdings LLP
- Inventors: Ran LEVY; Amit ROZNER; Yohai FALIK
- Web page: https://patentgrep.com/patent/US20240193805A1

## CPC

- G06T 7/73: using feature-based methods
- G06T 3/02: Affine transformations (for image registration G06T3/147; for image mosaicing G06T3/4038)
- G06T 7/13: Edge detection
- G06V 40/161: {Detection; Localisation; Normalisation}
- G06V 40/167: {using comparisons between temporally consecutive images}
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

Example implementations include a method, apparatus and computer-readable medium for detecting an object in an image, by applying, on a first input image, a first object detector configured to generate a bounding box around the object in the first input image. The implementations further include identifying a first bounding box having a first bounding box size around the object in the first input image and determining that the first bounding box size is less than a threshold size. Additionally, the implementations further include generating a second input image by cropping an area of the original image corresponding to the first bounding box and identifying, by applying a second object detector on the second input image, a second bounding box around the object in the second input image. Additionally, the implementations further include performing an image analysis function on the object using information from the second bounding box.

## Claims

### Claim 1

An apparatus for detecting an object in an image, comprising:
a memory; and
a processor coupled with the memory and configured to:
generate a first input image for a first object detector by adjusting an original image size of an original image depicting the object to a first input image size, wherein the first object detector is a classifier configured to generate a bounding box around the object in the first input image;
identify, by applying the first object detector on the first input image, a first bounding box having a first bounding box size around the object in the first input image;
determine whether the first bounding box size is less than a threshold size;
generate, in response to determine that the first bounding box size is less than the threshold size, a second input image by cropping an area of the original image corresponding to the first bounding box, wherein a second input image size of the second input image is greater than the first bounding box size;
identify, by applying a second object detector on the second input image, a second bounding box around the object in the second input image; and
perform an image analysis function on the object using information from the second bounding box in the second input image.

### Claim 2 (depends on 1)

The apparatus of claim 1, wherein adjusting the original image size comprises one or more of resizing, cropping, padding, or rotating.

### Claim 3 (depends on 1)

The apparatus of claim 1, wherein the threshold size is a ratio of the first bounding box size relative to the first input image size.

### Claim 4 (depends on 3)

The apparatus of claim 3, wherein the ratio is between 5%-20%.

### Claim 5 (depends on 1)

The apparatus of claim 1, wherein the second object detector and first object detector are a same classifier.

### Claim 6 (depends on 1)

The apparatus of claim 1, wherein the second object detector is a second classifier having a second processing speed that is faster than a first processing speed of the first object detector.

### Claim 7 (depends on 1)

The apparatus of claim 1, wherein the first input image size is less than the original image size and wherein the first input image size is larger than the second input image size.

### Claim 8 (depends on 1)

The apparatus of claim 1, wherein adjusting the original image size comprises adjusting to meet first dimension requirements for the first object detector, and wherein to generate the second input image the processor is further configured to adjust the second input image size to meet second dimension requirements for the second object detector.

### Claim 9 (depends on 1)

The apparatus of claim 1, wherein a second ratio of an object size of the object relative to the second bounding box is greater than a first ratio of the object size relative to the first bounding box.

### Claim 10 (depends on 1)

The apparatus of claim 1, wherein the processor is further configured to:
perform, in response to determine that the first bounding box size is not less than the threshold size, the image analysis function on the object using information from the first bounding box in the first input image.

### Claim 11 (depends on 1)

The apparatus of claim 1, wherein the image analysis function comprises one or more of keypoint detection, object classification, edge detection, segmentation, pose estimation, or noise filtering.

### Claim 12 (depends on 1)

The apparatus of claim 1, wherein to identify, by applying the second object detector on the second input image, the second bounding box around the object in the second input image the processor is further configured to identify a set of keypoints associated with the object in the second image.

### Claim 13 (depends on 1)

The apparatus of claim 1, wherein the object is a face of a person and wherein the image analysis function is a facial recognition algorithm, wherein the processor is further configured to:
compare, using the facial recognition algorithm, the face in the second bounding box with another face; and
generate an alert indicative of a match in response to determining, based on the comparing, that the face and the another face match.

### Claim 14 (depends on 13)

The apparatus of claim 13, wherein to identify, by applying the second object detector on the second input image, the second bounding box around the object in the second input image the processor is further configured to identify a set of keypoints associated with the object in the second image, and wherein comparing, using the facial recognition algorithm, the face in the second bounding box with the another face the processor is further configured to compare the set of keypoints with a known set of keypoints associated with the another face.

### Claim 15

A method for detecting an object in an image, comprising:
generating a first input image for a first object detector by adjusting an original image size of an original image depicting the object to a first input image size, wherein the first object detector is a classifier configured to generate a bounding box around the object in the first input image;
identifying, by applying the first object detector on the first input image, a first bounding box having a first bounding box size around the object in the first input image;
determining whether the first bounding box size is less than a threshold size;
generating, in response to determining that the first bounding box size is less than the threshold size, a second input image by cropping an area of the original image corresponding to the first bounding box, wherein a second input image size of the second input image is greater than the first bounding box size;
identifying, by applying a second object detector on the second input image, a second bounding box around the object in the second input image; and
performing an image analysis function on the object using information from the second bounding box in the second input image.

### Claim 16 (depends on 15)

The method of claim 15, wherein adjusting the original image size comprises one or more of resizing, cropping, padding, or rotating.

### Claim 17 (depends on 15)

The method of claim 15, wherein the threshold size is a ratio of the first bounding box size relative to the first input image size.

### Claim 18 (depends on 17)

The method of claim 17, wherein the ratio is between 5%-20%.

### Claim 19 (depends on 15)

The method of claim 15, wherein the second object detector and first object detector are a same classifier.

### Claim 20 (depends on 15)

The method of claim 15, wherein the second object detector is a second classifier having a second processing speed that is faster than a first processing speed of the first object detector.

### Claim 21 (depends on 15)

The method of claim 15, wherein the first input image size is less than the original image size and wherein the first input image size is larger than the second input image size.

### Claim 22 (depends on 15)

The method of claim 15, wherein adjusting the original image size comprises adjusting to meet first dimension requirements for the first object detector, and wherein generating the second input image further comprises adjusting the second input image size to meet second dimension requirements for the second object detector.

### Claim 23 (depends on 15)

The method of claim 15, wherein a second ratio of an object size of the object relative to the second bounding box is greater than a first ratio of the object size relative to the first bounding box.

### Claim 24 (depends on 15)

The method of claim 15, further comprising:
performing, in response to determining that the first bounding box size is not less than the threshold size, the image analysis function on the object using information from the first bounding box in the first input image.

### Claim 25 (depends on 15)

The method of claim 15, wherein the image analysis function comprises one or more of keypoint detection, object classification, edge detection, segmentation, pose estimation, or noise filtering.

### Claim 26 (depends on 15)

The method of claim 15, wherein identifying, by applying the second object detector on the second input image, the second bounding box around the object in the second input image further comprises identifying a set of keypoints associated with the object in the second image.

### Claim 27 (depends on 15)

The method of claim 15, wherein the object is a face of a person and wherein the image analysis function is a facial recognition algorithm, further comprising:
comparing, using the facial recognition algorithm, the face in the second bounding box with another face; and
generating an alert indicative of a match in response to determining, based on the comparing, that the face and the another face match.

### Claim 28 (depends on 27)

The method of claim 27, wherein identifying, by applying the second object detector on the second input image, the second bounding box around the object in the second input image further comprises identifying a set of keypoints associated with the object in the second image, and wherein comparing, using the facial recognition algorithm, the face in the second bounding box with the another face further comprises comparing the set of keypoints with a known set of keypoints associated with the another face.
