# US 2017/0256057 A1 · Systems and Methods for Re-Identifying Objects in Images

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2017/0256057 A1
- Document ID: US20170256057A1
- Status: Published application
- Kind: A1
- Application number: 15/061,784
- Filed: 2016-03-04
- Published: 2017-09-07
- Earliest claimed: 2016-03-04
- Assignees: Disney Enterprises, Inc.
- Applicants: Disney Enterprises, Inc.
- Inventors: Slawomir W. Bak; George Peter Carr
- Web page: https://patentgrep.com/patent/US20170256057A1

## CPC

- G06T 7/73: using feature-based methods
- G06V 20/52: Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69)
- G06V 40/103: {Static body considered as a whole, e.g. static pedestrian or occupant recognition}
- G06T 2207/20221: Image fusion; Image merging
- G06T 2207/30196: Human being; Person
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

There is provided a system including a memory and a processor configured to receive a first image depicting a first object and a second image depicting a second object, divide the first image into a first plurality of patches and the second image into a second plurality of patches, extract plurality of feature vectors from each of the first plurality of patches and a second plurality of feature vectors from the second plurality of patches, determine dissimilarities based on a plurality of patch metrics, each patch dissimilarity measure being a dissimilarity between corresponding patches of the first plurality of patches and the second plurality of patches, compute an image dissimilarity between the first image and the second image based on an aggregate of the plurality of patch dissimilarity measures, evaluate the image dissimilarity to determine a probability of whether the first object and the second object are the same.

## Claims

### Claim 1

A method for use by a system comprising a non-transitory memory and a hardware processor, the method comprising:
receiving, using the hardware processor, a first image depicting a first object and a second image depicting a second object;
dividing, using the hardware processor, the first image into a first plurality of patches and the second image into a second plurality of patches, wherein each patch of the second plurality of patches corresponds to one of the first plurality of patches at a same corresponding location;
extracting, using the hardware processor, a first plurality of feature vectors from each of the first plurality of patches and a second plurality of feature vectors from each of the second plurality of patches;
determining, using the hardware processor, a plurality of patch dissimilarity measures based on a plurality of patch metrics, each patch dissimilarity measure being a dissimilarity between corresponding patches of the first plurality of patches and the second plurality of patches;
computing, using the hardware processor, an image dissimilarity between the first image and the second image based on an aggregate of the plurality of patch dissimilarity measures; and
evaluating, using the hardware processor, the image dissimilarity to determine a probability of whether the first object and the second object are the same.

### Claim 2 (depends on 1)

The method of claim 1, wherein, prior to determining the plurality of patch dissimilarity measures, the method further comprises:
repositioning, using the hardware processor, each patch of the first plurality of patches based on a deformation cost for each patch of the first plurality of patches.

### Claim 3 (depends on 2)

The method of claim 2, wherein the deformation cost is different for each patch of the first plurality of patches.

### Claim 4 (depends on 1)

The method of claim 1, wherein the first plurality of feature vectors and the second plurality of feature vectors each include a plurality of descriptors.

### Claim 5 (depends on 4)

The method of claim 4, wherein the plurality of descriptors includes a color descriptor and a texture descriptor.

### Claim 6 (depends on 5)

The method of claim 5, wherein the color descriptor is one of a red, green, blue (RGB) color descriptor, a Lab color descriptor, and a hue, saturation, value (HSV) color descriptor.

### Claim 7 (depends on 5)

The method of claim 5, wherein the texture descriptor is a color scale invariant feature transform (SIFT) descriptor.

### Claim 8 (depends on 1)

The method of claim 1, wherein, prior to determining the dissimilarity measure, the method further comprises:
applying, using the hardware processor, a dimensionality reduction to the first plurality of feature vectors and the second plurality of feature vectors.

### Claim 9 (depends on 1)

The method of claim 1, wherein the first image is obtained from a first camera and the first image is obtained from a second camera.

### Claim 10 (depends on 1)

The method of claim 1, wherein the first object is a person.

### Claim 11

A system comprising:
a non-transitory memory storing an executable code; and
a hardware processor executing the executable code to:
receive a first image depicting a first object and a second image depicting a second object;
divide the first image into a first plurality of patches and the second image into a second plurality of patches, wherein each patch of the second plurality of patches corresponds to one of the first plurality of patches at a same corresponding location;
extract a first plurality of feature vectors from each of the first plurality of patches and a second plurality of feature vectors from each of the second plurality of patches;
determine a plurality of patch dissimilarity measures based on a plurality of patch metrics, each patch dissimilarity measure being a dissimilarity between corresponding patches of the first plurality of patches and the second plurality of patches;
compute an image dissimilarity between the first image and the second image based on an aggregate of the plurality of patch dissimilarity measures; and
evaluate the image dissimilarity to determine a probability of whether the first object and the second object are the same.

### Claim 12 (depends on 11)

The system of claim 11, wherein, prior to determining the plurality of patch dissimilarity measures, the processor further executes the executable code to:
reposition each patch of the first plurality of patches based on a deformation cost for each patch of the first plurality of patches.

### Claim 13 (depends on 12)

The system of claim 12, wherein the deformation cost is different for each patch of the first plurality of patches.

### Claim 14 (depends on 11)

The system of claim 11, wherein the first plurality of feature vectors and the second plurality of feature vectors each include a plurality of descriptors.

### Claim 15 (depends on 14)

The system of claim 14, wherein the plurality of descriptors includes a color descriptor and a texture descriptor.

### Claim 16 (depends on 15)

The system of claim 15, wherein the color descriptor is one of a red, green, blue (RGB) color descriptor, a Lab color descriptor, and a hue, saturation, value (HSV) color descriptor.

### Claim 17 (depends on 15)

The system of claim 15, wherein the texture descriptor is a color scale invariant feature transform (SIFT) descriptor.

### Claim 18 (depends on 11)

The system of claim 11, wherein, prior to determining the dissimilarity measure, the hardware processor further executes the executable code to:
apply a dimensionality reduction to the first plurality of feature vectors and the second plurality of feature vectors.

### Claim 19 (depends on 11)

The system of claim 11, wherein the first image is obtained from a first camera and the first image is obtained from a second camera.

### Claim 20 (depends on 11)

The system of claim 11, wherein the first object is a person.
