# US 2002/0176001 A1 · Object tracking based on color distribution

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2002/0176001 A1
- Document ID: US20020176001A1
- Status: Published application
- Kind: A1
- Application number: 09/854,044
- Filed: 2001-05-11
- Published: 2002-11-28
- Earliest claimed: 2001-05-11
- Inventors: Miroslav Trajkovic
- Web page: https://patentgrep.com/patent/US20020176001A1

## CPC

- G06T 7/20: Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51)
- G06V 10/56: relating to colour
- G06V 10/758: {Involving statistics of pixels or of feature values, e.g. histogram matching}
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

A color modeling and color matching process and system is provided that uses the hue and saturation of color pixels, in conjunction with the intensity of gray or near-gray pixels, to characterize targets and images. A target is characterized by a histogram of hues and saturation within the target image, with a greater distinction being provided to the hues. Recognizing that the hue of gray, or near-gray, picture elements is highly sensitive to noise, the gray or near-gray pixels are encoded as a histogram of intensity, rather than hue or saturation. The target tracking system searches for the occurrence of a similar set of coincident color-hue-saturation and gray-intensity histograms within each of the image frames of a series of image frames.

## Claims

### Claim 1

A video processing system for characterizing an image, comprising:
a characterizing device that is configured to partition pixels of the image into a first set of color pixels and a second set of non-color pixels, and to create at least one of:
a histogram of chromatic components within the first set of color pixels, and
a histogram of brightness components within the second set of non-color pixels.

### Claim 2 (depends on 1)

The video processing system of claim 1, wherein
the characterizing device is further configured to create a composite histogram that includes the histogram of chromatic components and the histogram of brightness components.

### Claim 3 (depends on 2)

The video processing system of claim 2, wherein
the composite histogram corresponds to a target histogram, and
the video processing system further includes
a color-matching device that is configured to compare one or more other composite histograms to the target histogram.

### Claim 4 (depends on 3)

The video processing system of claim 3, wherein
a limited number of different chromatic component values and brightness component values are used to create a target histogram vector corresponding to the target histogram, and
the color-matching device is configured to create one or more other histogram vectors corresponding to the other composite histograms based on the limited number of different chromatic component values and brightness component values corresponding to the target histogram.

### Claim 5 (depends on 1)

The video processing system of claim 1, wherein at least one of:
the chromatic components include at least one of a hue and a saturation component of a hue-saturation-intensity color model, and
the brightness components include an intensity component of the hue-saturation-intensity color model.

### Claim 6 (depends on 1)

The video processing system of claim 1, wherein
the histogram of chromatic components corresponds to a target histogram, and
the video processing system further includes
a color-matching device that is configured to compare one or more other histograms of chromatic components to the target histogram.

### Claim 7 (depends on 6)

The video processing system of claim 6, wherein
a limited number of different chromatic component values are used to create a target histogram vector corresponding to the target histogram, and
the color-matching device is configured to create one or more other histogram vectors corresponding to the other histograms based on the limited number of different chromatic component values.

### Claim 8 (depends on 1)

The video processing system of claim 1, wherein
the second set of non-color pixels are defined based as pixels having color values that lie within a specified distance from a line of gray values in a defined color space.

### Claim 9 (depends on 1)

The video processing system of claim 1, further including
a color modeler that is configured to convert a red-green-blue representation of each pixel value into a hue-saturation-intensity representation of the pixel value.

### Claim 10 (depends on 1)

The video processing system of claim 1, further including
a target tracker that is configured to track a target in one or more images, based on the histogram of chromatic components.

### Claim 11

A method of characterizing an image comprising:
partitioning pixels comprising the image into a first set of color pixels and a second set of non-color pixels, and
creating at least one of:
a histogram of chromatic components comprising the first set of color pixels, and
a histogram of brightness components within the second set of non-color pixels.

### Claim 12 (depends on 11)

The method of claim 11, further including
creating a composite histogram based on the histograms of chromatic components and brightness components.

### Claim 13 (depends on 12)

The method of claim 12, wherein
the composite histogram corresponds to a target histogram, and
the method further includes
comparing one or more other composite histograms to the target histogram.

### Claim 14 (depends on 13)

The method of claim 13, wherein
a limited number of different chromatic component values and brightness component values are used to create a target histogram vector corresponding to the target histogram, and
comparing the one or more other composite histograms includes
creating one or more other histogram vectors corresponding to the other histograms based on the limited number of different chromatic component values and brightness component values of the target histogram vector.

### Claim 15 (depends on 11)

The method of claim 11, wherein at least one of:
the chromatic components correspond to at least one of a hue component and a saturation component of a hue-saturation-intensity color model of each color pixel, and
the brightness components include an intensity component of the hue-saturation-intensity color model.

### Claim 16 (depends on 11)

The method of claim 11, wherein
the histogram of chromatic components correspond to a target histogram, and
the method further includes
comparing one or more other histograms of chromatic components to the target histogram.

### Claim 17 (depends on 16)

The method of claim 16, wherein
a limited number of different chromatic component values are used to create a target histogram vector corresponding to the target histogram, and
comparing the one or more other histograms includes
creating one or more other histogram vectors corresponding to the other histograms based on the limited number of different chromatic component values.

### Claim 18 (depends on 11)

The method of claim 11, wherein
the second set of non-color pixels are defined based as pixels having color values that lie within a specified distance from a line of gray values in a defined color space.

### Claim 19 (depends on 11)

The method of claim 11, further including
converting a red-green-blue representation of each pixel value into a hue-saturation-intensity representation of the pixel value.
