# US 2025/0095318 A1 · Object localization in video

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0095318 A1
- Document ID: US20250095318A1
- Status: Published application
- Kind: A1
- Application number: 18/964,827
- Filed: 2024-12-02
- Published: 2025-03-20
- Earliest claimed: 2021-01-19
- Assignees: ObjectVideo Labs, LLC
- Applicants: ObjectVideo Labs, LLC
- Inventors: Sima Taheri; Gang Qian; Allison Beach
- Web page: https://patentgrep.com/patent/US20250095318A1

## CPC

- G06V 10/247: {by affine transforms, e.g. correction due to perspective effects; Quadrilaterals, e.g. trapezoids}
- G06T 7/55: from multiple images
- G06T 7/74: {involving reference images or patches}
- G06V 10/225: {based on a marking or identifier characterising the area}
- G06V 10/25: Determination of region of interest [ROI] or a volume of interest [VOI]
- G06V 20/52: Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69)
- G06T 2207/20084: Artificial neural networks [ANN]
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

Disclosed are methods, systems, and apparatus for object localization in video. A method includes obtaining a reference image of an object; generating, from the reference image, homographic adapted images showing the object at various locations with various orientations; determining interest points from the homographic adapted images; determining locations of an object center in the homographic adapted images relative to the interest points; obtaining a sample image of the object; identifying matched pairs of interest points, each matched pair including an interest point from the homographic adapted images and a matching interest point in the sample image; and determining a location of the object in the sample image based on the locations of the object center in the homographic adapted images relative to the matched pairs. The method includes generating a homography matrix; and projecting the reference image of the object to the sample image using the homography matrix.

## Claims

### Claim at position 1

1-20. (canceled)

### Claim 21

A computer-implemented method comprising:
maintaining a digital representation of an object including a first set of interest points;
maintaining a sample image including a second set of interest points;
identifying matched pairs of interest points using the digital representation and the sample image, each matched pair comprising:
a first interest point from the first set of interest points; and
a second interest point from the second set of interest points;
generating, using the matched pairs of interest points, a homography matrix; and
determining a position of the object in the sample image using the homography matrix.

### Claim 22 (depends on 21)

The method of claim 21, wherein generating the homography matrix comprises:
computing homography scores for each group of a plurality of groups of matched pairs;
selecting, from the plurality of groups of matched pairs, a particular group of matched pairs using the homography scores; and
generating the homography matrix from the particular group of matched pairs.

### Claim 23 (depends on 22)

The method of claim 22, wherein computing a homography score for a group of matched pairs comprises:
receiving data indicating a first estimated size of the object;
determining a second estimated size of the object using the group of matched pairs; and
computing a ratio between the first estimated size of the object and the second estimated size of the object.

### Claim 24 (depends on 22)

The method of claim 22, wherein computing a homography score for a group of matched pairs comprises:
receiving data that identifies:
a first side of the object; and
a second side of the object that has an equal length to the first side of the object;
determining an estimated length of the first side of the object using the group of matched pairs;
determining an estimated length of the second side of the object using the group of matched pairs;
computing a ratio between the estimated length of the first side of the object and the estimated length of the second side of the object; and
determining a difference between the computed ratio and a value of one.

### Claim 25 (depends on 21)

The method of claim 21, wherein the sample image comprises an image captured by a camera, the method comprising:
identifying an area of a field of view of the camera that corresponds to the position of the object; and
classifying the identified area of the field of view of the camera as an area of interest.

### Claim 26 (depends on 25)

The method of claim 25, comprising:
obtaining additional images captured by the camera; and
performing an action in response to detecting motion within the area of interest of the additional images.

### Claim 27 (depends on 21)

The method of claim 21, wherein each interest point from the first set of interest points and from the second set of interest points is associated with one or more descriptors, wherein identifying the matched pairs of interest points comprises:
matching the first interest point from the first set of interest points with the second interest point from the second set of interest points by determining a similarity of the respective associated one or more descriptors.

### Claim 28 (depends on 21)

The method of claim 21, wherein determining the position of the object in the sample image comprises determining:
a location of the center of the object in the sample image; and
locations of one or more corners of the object in the sample image.

### Claim 29 (depends on 21)

The method of claim 21, wherein the digital representation of the object comprises a photometric adapted representation of the object that represents the object at various lighting conditions.

### Claim 30 (depends on 21)

The method of claim 21, wherein the digital representation of the object comprises a homographic adapted representation of the object that represents the object at various orientations relative to a particular location.

### Claim 31 (depends on 21)

The method of claim 21, wherein:
the sample image comprises an image captured by a camera,
wherein the digital representation of the object includes two or more homographic adapted images that each depict a simulated appearance of the object at a particular position and a particular orientation relative to the camera.

### Claim 32 (depends on 21)

The method of claim 21, wherein the digital representation of the object includes two or more homographic adapted images that were generated by projecting a reference image of the object to a multi-dimensional model of a field of view of a camera.

### Claim 33 (depends on 32)

The method of claim 32, wherein determining the position of the object in the sample image using the homography matrix comprises projecting the reference image of the object to the sample image.

### Claim 34 (depends on 32)

The method of claim 32, wherein the two or more homographic adapted images include a first homographic adapted image depicting the object at a different location, orientation, or both, relative to the camera, than a second homographic adapted image.

### Claim 35 (depends on 21)

The method of claim 21, wherein the digital representation of the object comprises:
the first set of interest points; and
for each interest point of the first set of interest points:
one or more descriptors associated with the interest point; and
a location of the center of the object relative to the interest point.

### Claim 36 (depends on 21)

The method of claim 21, wherein the homography matrix comprises a matrix that transforms planar points of a reference image of the object to planar points in the sample image.

### Claim 37

A system comprising:
one or more computers and one or more storage devices storing instructions that are operable, when executed by the one or more computers, to cause the one or more computers to perform operations comprising:
maintaining a digital representation of an object including a first set of interest points;
maintaining a sample image including a second set of interest points;
identifying matched pairs of interest points using the digital representation and the sample image, each matched pair comprising:
a first interest point from the first set of interest points; and
a second interest point from the second set of interest points;
generating, using the matched pairs of interest points, a homography matrix; and
determining a position of the object in the sample image using the homography matrix.

### Claim 38 (depends on 37)

The system of claim 37, wherein generating the homography matrix comprises:
computing homography scores for each group of a plurality of groups of matched pairs; selecting, from the plurality of groups of matched pairs, a particular group of matched pairs using the homography scores; and
generating the homography matrix from the particular group of matched pairs.

### Claim 39 (depends on 38)

The system of claim 38, wherein computing a homography score for a group of matched pairs comprises:
receiving data indicating a first estimated size of the object;
determining a second estimated size of the object using the group of matched pairs; and
computing a ratio between the first estimated size of the object and the second estimated size of the object.

### Claim 40

A non-transitory computer-readable medium storing software comprising instructions executable by one or more computers which, upon such execution, cause the one or more computers to perform operations comprising:
maintaining a digital representation of an object including a first set of interest points;
maintaining a sample image including a second set of interest points;
identifying matched pairs of interest points using the digital representation and the sample image, each matched pair comprising:
a first interest point from the first set of interest points; and
a second interest point from the second set of interest points;
generating, using the matched pairs of interest points, a homography matrix; and
determining a position of the object in the sample image using the homography matrix.
