# US 2012/0075440 A1 · Entropy based image separation

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2012/0075440 A1
- Document ID: US20120075440A1
- Status: Published application
- Kind: A1
- Application number: 12/892,764
- Filed: 2010-09-28
- Published: 2012-03-29
- Earliest claimed: 2010-09-28
- Assignees: QUALCOMM Incorporated
- Inventors: Disha Ahuja; I-Ting Fang; Bolan Jiang; Aditya Sharma
- Web page: https://patentgrep.com/patent/US20120075440A1

## CPC

- G06T 7/44: using image operators, e.g. filters, edge density metrics or local histograms
- G06T 7/11: Region-based segmentation
- G06T 7/136: involving thresholding
- G06T 7/143: involving probabilistic approaches, e.g. Markov random field [MRF] modelling
- G06T 2207/10004: Still image; Photographic image
- G06T 2207/20036: Morphological image processing
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

Entropy based image segmentation determines entropy values for pixels in an image based on intensity or edge orientation. One or more threshold values are determined as a fraction of the entropy distribution over the image. For example, high and/or low thresholds may be generated to identify regions in the image associated with trees or sky, respectively. The entropy values are compared to the threshold(s) from which regions within the image can be segmented. Intensity based entropy has no structural information, and thus, proximity based clustering and pruning of the entropy points is performed. A mask may be applied to the segmented regions to remove the regions from the image, which is useful in, e.g., objection recognition processes. Additionally, separate buildings may be identified and segmented using edge orientation entropy with clustering and pruning.

## Claims

### Claim 1

A method comprising:
producing a gray scale image that includes a background and vegetation;
segmenting the image to remove the background and vegetation from the image to produce a segmented image, wherein segmenting the image comprises:
determining entropy values for pixels in the image;
comparing the entropy values to a threshold value for maximum entropy;
removing regions in the image having entropy values greater than the threshold value for maximum entropy to remove vegetation from the image;
wherein the background is removed using a minimum threshold value that is compared to at least one of the entropy values for pixels in the image and an edge strength value calculated for each pixel while determining entropy values; and
storing the segmented image.

### Claim 2 (depends on 1)

The method of claim 1, using the segmented image with the background and vegetation removed for object recognition.

### Claim 3 (depends on 1)

The method of claim 1, wherein determining entropy values is based on pixel intensities and the background is removed using the minimum threshold value that is compared to at least one of the entropy values for pixels in the image.

### Claim 4 (depends on 3)

The method of claim 3, wherein determining entropy values based on pixel intensities comprises:
generating a window of pixels around each of the pixels; and
calculating the entropy values of each of the pixels using the intensity values of the pixels in the window around each of the pixels.

### Claim 5 (depends on 4)

The method of claim 4, further comprising:
determining clusters of entropy regions based on proximity; and
statistically analyzing each cluster to determine whether to retain or remove the cluster.

### Claim 6 (depends on 5)

The method of claim 5, wherein statistically analyzing each cluster uses at least one of entropy density, mean, variance, variance, and skewness.

### Claim 7 (depends on 5)

The method of claim 5, wherein segmenting the image comprises masking clusters of pixels based on entropy thresholds and the statistical analysis.

### Claim 8 (depends on 5)

The method of claim 5, wherein clusters of regions are determined using k-means clustering.

### Claim 9 (depends on 1)

The method of claim 1, wherein determining entropy values is based on edge orientation and the background is removed using the minimum threshold value that is compared to the edge strength value calculated for each pixel while determining entropy values.

### Claim 10 (depends on 9)

The method of claim 9, wherein determining entropy values based on edge orientation comprises:
convolving the image with an edge filter;
calculating the edge strength value and orientation for each pixel;
discarding pixels with an edge strength value below the minimum threshold; and
generating a histogram of orientation of remaining pixels, wherein determining entropy values uses the histogram of orientation.

### Claim 11 (depends on 10)

The method of claim 10, further comprising:
partitioning areas of the image that are not removed into clusters based on color and location;
removing outliers based on color and location; and
merging clusters based on at least one of overlap area, distance, color, and vertical overlay ratio to separate buildings in the image.

### Claim 12

A mobile platform comprising:
a camera for capturing an image;
a processor connected to the camera to receive the image;
memory connected to the processor;
a display connected to the memory; and
software held in the memory and run in the processor to produce a gray scale image from a captured image that includes a background and vegetation, to segment the image to remove the background and vegetation to produce a segmented image by determining entropy values for pixels in the image; comparing the entropy values to a threshold value for maximum entropy; removing regions in the image having entropy values greater than the threshold value for maximum entropy to remove vegetation from the image; wherein the background is removed using a minimum threshold value that is compared to at least one of the entropy values for pixels in the image and an edge strength value calculated for each pixel while determining entropy values; and to store the segmented image in the memory.

### Claim 13 (depends on 12)

The mobile platform of claim 12, wherein the software causes the processor to using the segmented image with the background and vegetation removed for object recognition.

### Claim 14 (depends on 12)

The mobile platform of claim 12, wherein entropy values are determined based on pixel intensities and the software causes the processor to remove the background using the minimum threshold value that is compared to the entropy values for pixels in the image.

### Claim 15 (depends on 14)

The mobile platform of claim 14, wherein the software causes the processor to determine entropy values based on pixel intensities by causing the processor to generate a window of pixels around each of the pixels, and to calculate the entropy values of each of the pixels using the intensity values of the pixels in the window around each of the pixels.

### Claim 16 (depends on 15)

The mobile platform of claim 15, wherein the software causes the processor to determining clusters of entropy regions based on proximity; and to statistically analyze each cluster to determine whether to retain or remove the cluster.

### Claim 17 (depends on 16)

The mobile platform of claim 16, wherein each cluster is statistically analyzed with at least one of entropy density, mean, variance, variance, and skewness.

### Claim 18 (depends on 16)

The mobile platform of claim 16, wherein the image is segmented to remove regions by masking clusters of pixels based on entropy thresholds and the statistical analysis.

### Claim 19 (depends on 16)

The mobile platform of claim 16, wherein clusters of regions are determined using k-means clustering.

### Claim 20 (depends on 12)

The mobile platform of claim 12, wherein entropy values are determined based on edge orientation and the background is removed using the minimum threshold value that is compared to the edge strength value calculated for each pixel while determining entropy values.

### Claim 21 (depends on 20)

The mobile platform of claim 20, wherein the software causes the processor to determine entropy values based on edge orientation by causing the processor to convolve the image with an edge filter; calculate the edge strength value and orientation for each pixel; discard pixels with edge strength below the minimum threshold; and generate a histogram of orientation of remaining pixels, wherein entropy values are determined using the histogram of orientation.

### Claim 22 (depends on 21)

The mobile platform of claim 21, wherein the software further causes the processor to partition areas of the image that are not removed into clusters based on color and location; remove outliers based on color and location; and merge clusters based on at least one of overlap area, distance, color, and vertical overlay ratio to separate buildings in the image.

### Claim 23

A system comprising:
means for producing a gray scale image that includes a background and vegetation;
means for segmenting the image to remove the background and vegetation from the image to produce a segmented image, the means for segmenting the image comprising:
means for determining entropy values for pixels in the image;
means for comparing the entropy values to a threshold value for maximum entropy;
means for removing regions in the image having entropy values greater than the threshold value for maximum entropy to remove vegetation from the image;
wherein the background is removed using a minimum threshold value that is compared to at least one of the entropy values for pixels in the image and an edge strength value calculated for each pixel while determining entropy values; and
means for storing the segmented image.

### Claim 24 (depends on 23)

The system of claim 23, means for using the segmented image with the background and vegetation removed for object recognition.

### Claim 25 (depends on 23)

The system of claim 23, wherein the means for determining entropy values generates a window of pixels around each of the pixels and calculates the entropy values of each of the pixels using intensity values of the pixels in the window around each of the pixels; and the background is removed using the minimum threshold value that is compared to at least one of the entropy values for pixels in the image.

### Claim 26 (depends on 25)

The system of claim 25, further comprising:
means for determining clusters of entropy regions based on proximity; and
means for statistically analyzing each cluster to determine whether to retain or remove the cluster.

### Claim 27 (depends on 26)

The system of claim 26, wherein the means for segmenting the image to remove regions masks clusters of pixels based on entropy thresholds and the statistical analysis.

### Claim 28 (depends on 23)

The system of claim 23, wherein the means for determining entropy values convolves the image with an edge filter; calculates the edge strength value and orientation for each pixel; discards pixels with edge strength below the minimum threshold value to remove the background; and generates a histogram of orientation of remaining pixels, wherein the means for determining entropy values uses the histogram of orientation.

### Claim 29 (depends on 28)

The system of claim 28, further comprising:
means for partitioning areas of the image that are not removed into clusters based on color and location;
means for removing outliers based on color and location; and
means for merging clusters based on at least one of overlap area, distance, color, and vertical overlay ratio to separate buildings in the image.

### Claim 30

A computer-readable medium including program code stored thereon, comprising:
program code to produce a gray scale image from a captured image that includes a background and vegetation;
program code to segment the image to remove the background and vegetation to produce a segmented image, comprising:
program code to determine entropy values for pixels in the image;
program code to compare the entropy values to a threshold value for maximum entropy;
program code to remove regions in the image having entropy values greater than the threshold value for maximum entropy to remove vegetation from the image;
wherein the background is removed using a minimum threshold value that is compared to at least one of the entropy values for pixels in the image and an edge strength value calculated for each pixel while determining entropy values; and
program code to store the segmented image in a memory.

### Claim 31 (depends on 30)

The computer-readable medium of claim 30, further comprising program code to use the segmented image with the background and vegetation removed for object recognition.

### Claim 32 (depends on 30)

The computer-readable medium of claim 30, wherein the program code to determine entropy values uses pixel intensities and includes program code to generate a window of pixels around each of the pixels, and program code to calculate the entropy values of each of the pixels using the intensity values of the pixels in the window around each of the pixels and program code to remove the background using the minimum threshold value that is compared to the entropy values for pixels in the image.

### Claim 33 (depends on 32)

The computer-readable medium of claim 32, further comprising program code to determine clusters of entropy regions based on proximity; and program code to statistically analyze each cluster to determine whether to retain or remove the cluster.

### Claim 34 (depends on 30)

The computer-readable medium of claim 30, wherein the program code to determine entropy values uses edge orientation and includes program code to convolve the image with an edge filter; program code to calculate the edge strength value and orientation for each pixel; program code to discard pixels with an edge strength below the minimum threshold to remove the background; and program code to generate a histogram of orientation of remaining pixels, wherein entropy values are determined using the histogram of orientation.

### Claim 35 (depends on 34)

The computer-readable medium of claim 34, further comprising program code to partition areas of the image that are not removed into clusters based on color and location; program code to remove outliers based on color and location; and program code to merge clusters based on at least one of overlap area, distance, color, and vertical overlay ratio to separate buildings in the image.
