# US 2002/0159106 A1 · Image processing apparatus

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2002/0159106 A1
- Document ID: US20020159106A1
- Status: Published application
- Kind: A1
- Application number: 09/843,844
- Filed: 2001-04-30
- Published: 2002-10-31
- Earliest claimed: 2001-04-30
- Assignees: Toshiba Tec Kabushiki Kaisha
- Inventors: Takahiro Fuchigami; Naofumi Yamamoto
- Web page: https://patentgrep.com/patent/US20020159106A1

## CPC

- H04N 1/6072: {adapting to different types of images, e.g. characters, graphs, black and white image portions}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A number of character string determination sections determine whether a pixel of interest corresponds to a character or a line drawing. The character string determination sections use mutually different determination methods. A character determination selector section selects a determination result output from the character determination section that uses a determination method most suited to a background sensing result obtained by a background sensing section. In this manner, either the character or the line drawing can be determined using an efficient method in accordance with the background state of a color image.

## Claims

### Claim 1

An image processing apparatus for processing color images, comprising:
a feature amount calculation section for calculating a feature amount with respect to a pixel of interest;
a background sensing section for sensing a background density or a background color with respect to a region surrounding the pixel of interest whose feature amount is calculated by the feature amount calculation section;
a plurality of character determination sections for determining whether the pixel of interest corresponds to a character or a line drawing on the basis of the feature amount calculated by the feature amount calculation section, said plurality of character determination sections using mutually different determination methods; and
a character determination selector section for selecting one of determination results output from the character determination sections in accordance with a sensing result output from the background sensing section.

### Claim 2 (depends on 1)

An image processing apparatus according to claim 1, wherein different reference values are set to said character determination sections, and each of said character determination sections compares a reference value assigned thereto with the feature amount calculated by the feature amount calculation section, thereby determining whether the pixel of interest corresponds to the character or the line drawing.

### Claim 3 (depends on 1)

An image processing apparatus according to claim 1, wherein said feature amount calculation section calculates a feature amount of the pixel of interest by using a first region defined surrounding the pixel of interest, and said background sensing section senses a background density or a background color regarding a region surrounding the pixel of interest by using a second region which is similar in size to the first region or greater than the first region.

### Claim 4 (depends on 1)

An image processing apparatus according to claim 1, wherein said background sensing section senses the background density or background color by using only those pixels which the determination result selected by the character determination selector section regards as an object other than the character or line drawing.

### Claim 5 (depends on 1)

An image processing apparatus according to claim 1, wherein said feature amount calculation section calculates the feature amount on the basis of density gradients or distances in a color space between pixels detected in different directions with respect to a predetermined region surrounding the pixel of interest.

### Claim 6 (depends on 1)

An image processing apparatus according to claim 1, wherein said background sensing section prepares a histogram regarding a density detected in a predetermined region surrounding the pixel of interest, and determines that a sensed density is a background density when the sensed density is within a range that is lower than a predetermined value, and when the sensed density repeatedly appears more than a predetermined number of times and the number of times the sensed density appears is largest.

### Claim 7 (depends on 1)

An image processing apparatus according to claim 1, wherein:
when the background sensing section fails to detect the background density or background color of a character, the background sensing section outputs a sensing result signal indicating that a background sensing operation results in failure;
said plurality of character determination sections include at least one character determination section that determines whether the pixel of interest represents a character or a line drawing by using a determination method suited to a case where the background density or the background color cannot be detected; and
when said character determination selector section receives from the background sensing section the signal indicating that the background sensing operation results in failure, said character determination selector section selects a determination result output from said at least one character determination section, which determines whether the pixel of interest represents a character or a line drawing by using a determination method suited to a case where the background density or the background color cannot be detected.

### Claim 8 (depends on 1)

An image processing apparatus according to claim 1, wherein:
said background sensing section senses whether the background of a character is white or a color other than white;
said plurality of character determination sections include a character determination section for determining whether a pixel represents a character or a line drawing by using a determination method suited to a case where the background is white, and a character determination section for determining whether a pixel represents a character or a line drawing by using a determination method suited to a case where the background is other than white; and
said character determination selector section selects a determination result output from the character determination section that determines whether a pixel represents a character or a line drawing by using the determination method suited to the case where the background is white, when the background of the character is sensed as being white by the background sensing section, and selects a determination result output from the character determination section that determines whether a pixel represents a character or a line drawing by using the determination method suited to the case where the background is other than white, when the background of the character is sensed as being other than white by the background sensing section.

### Claim 9 (depends on 1)

An image processing apparatus according to claim 1, wherein said background sensing section is a low-pass filter, and said feature amount calculation section is a high-pass filter.

### Claim 10

An image processing apparatus for processing color images, comprising:
a plurality of feature amount calculation sections for determining feature amounts with respect to a pixel of interest by using mutually different determination methods;
a background sensing section for sensing a background density or a background color with respect to a region surrounding the pixel of interest whose feature amount is calculated by the feature amount calculation sections;
a feature amount selection section for selecting one of calculation results output from the feature amount calculation sections in accordance with a sensing result output from the background sensing section; and
a character determination section for determining whether the pixel of interest is a character or a line drawing on the basis of a feature amount selected by the feature amount selection section.

### Claim 11 (depends on 10)

An image processing apparatus according to claim 10, wherein said feature amount calculation section calculates a feature amount of the pixel of interest by using a first region defined surrounding the pixel of interest, and said background sensing section senses a background density or a background color regarding a region surrounding the pixel of interest by using a second region which is similar in size to the first region or greater than the first region.

### Claim 12 (depends on 10)

An image processing apparatus according to claim 10, wherein said background sensing section senses the background density or background color by using only those pixels which the determination result selected by the character determination selector section regards as an object other than the character or line drawing.

### Claim 13 (depends on 10)

An image processing apparatus according to claim 10, wherein said plurality of feature amount calculation sections include at least one feature amount calculation section that calculates the feature amount on the basis of density gradients or distances in a color space between pixels detected in different directions with respect to a predetermined region surrounding the pixel of interest.

### Claim 14 (depends on 10)

An image processing apparatus according to claim 10, wherein said background sensing section prepares a histogram regarding a density detected in a predetermined region surrounding the pixel of interest, and determines that a sensed density is a background density when the sensed density is within a range that is lower than a predetermined value, and when the sensed density repeatedly appears more than a predetermined number of times and the number of times the sensed density appears is largest.

### Claim 15 (depends on 10)

An image processing apparatus according to claim 10, wherein:
when the background sensing section fails to detect the background density or background color of a character, the background sensing section outputs a sensing result signal indicating that a background sensing operation results in failure;
said plurality of feature amount calculation sections includes at least one feature amount calculation section that calculates the feature amount of the pixel of interest by using a calculation method suited to a case where the background density or the background color cannot be detected; and
said feature amount selection section selects a calculation result output from the feature amount calculation section that is included among said plurality of feature amount calculation sections and that calculates the feature amount of the pixel of interest by using the calculation method suited to the case where the background density or the background color cannot be detected.

### Claim 16 (depends on 10)

An image processing apparatus according to claim 10, wherein:
said background sensing section senses whether the background of a character is white or a color other than white;
said plurality of feature amount calculation sections include a feature amount calculation section for calculating the feature amount of the pixel of interest by using a calculation method suited to a case where the background is white, and a feature amount calculation section for calculating the feature amount of the pixel of interest by using a calculation method suited to a case where the background is other than white; and
said feature amount selection section selects a calculation result output from the feature amount calculation section for calculating the feature amount of the pixel of interest by using the calculation method suited to the case where the background is white, when the background of the character is sensed as being white by the background sensing section, and selects a calculation result output from the feature amount calculation section for calculating the feature amount of the pixel of interest by using the calculation method suited to the case where the background is other than white, when the background of the character is sensed as being other than white by the background sensing section.

### Claim 17 (depends on 10)

An image processing apparatus according to claim 10, wherein said background sensing section is a low-pass filter, and said feature amount calculation section is a high-pass filter.

### Claim 18

An image processing apparatus for processing color images, comprising:
a feature amount calculation section for calculating a feature amount with respect to a pixel of interest;
a background sensing section for sensing a background density or a background color with respect to a region surrounding the pixel of interest;
a plurality of color determination sections for determining colors with respect to the pixel of interest on the basis of a chroma and/or a hue thereof, said color determination sections using mutually different determination methods; and
a color determination selector section for selecting one of determination results output from the color determination sections in accordance with the feature amount the feature amount calculation section determines with respect to the pixel of interest or the background density or color the background sensing section senses.

### Claim 19 (depends on 18)

An image processing apparatus according to claim 18, wherein different reference values are set to said color determination sections, and each of said color determination sections compares a reference value assigned thereto with the chroma and hue of the pixel of interest, thereby determining the color of the pixel of interest.

### Claim 20 (depends on 18)

An image processing apparatus according to claim 18, wherein said plurality of color determination sections includes at least one color determination section that compares a chroma and/or a hue of a highest-density pixel of a predetermined region surrounding the pixel of interest with reference values, thereby determining the color of the pixel of interest.

### Claim 21 (depends on 18)

An image processing apparatus according to claim 18, wherein said feature amount calculation section calculates the feature amount on the basis of density gradients or distances in a color space between pixels detected in different directions with respect to a predetermined region surrounding the pixel of interest.

### Claim 22 (depends on 18)

An image processing apparatus according to claim 18, wherein said background sensing section prepares a histogram regarding a density detected in a predetermined region surrounding the pixel of interest, and determines that a sensed density is a background density when the sensed density is within a range that is lower than a predetermined value, and when the sensed density repeatedly appears more than a predetermined number of times and the number of times the sensed density appears is largest.

### Claim 23 (depends on 18)

An image processing apparatus according to claim 18, wherein:
when the background sensing section fails to detect the background density or background color of a character, the background sensing section outputs a sensing result signal indicating that a background sensing operation results in failure;
said plurality of color determination sections includes at least one color determination section that determines the color of the pixel of interest by using a determination method suited to a case where the background density or the background color cannot be detected; and
said color determination selector selects a determination result output from the color determination section that is included among said plurality of color determination sections and that determines the color of the pixel of interest by using the determination method suited to the case where the background density or the background color cannot be detected, when said color determination selector section receives from the background sensing section the signal indicating that the background sensing operation results in failure.

### Claim 24 (depends on 18)

An image processing apparatus according to claim 18, wherein:
said background sensing section senses whether the background of a character is white or a color other than white;
said plurality of color determination sections include a color determination section for determining the color of the pixel of interest by using a determination method suited to a case where the background is white, and a color determination section for determining the color of the pixel of interest by using a determination method suited to a case where the background is other than white; and
said character determination selector section selects a determination result output from the color determination section for determining the color of the pixel of interest by using the determination method suited to the case where the background is white, when the background of the character is sensed as being white by the background sensing section, and selects a determination result output from the color determination section for determining the color of the pixel of interest by using the determination method suited to the case where the background is other than white, when the background of the character is sensed as being other than white by the background sensing section.

### Claim 25 (depends on 18)

An image processing apparatus according to claim 18, wherein said background sensing section is a low-pass filter, and said feature amount calculation section is a high-pass filter.

### Claim 26

An image processing apparatus for processing color images, comprising:
a feature amount calculation section for calculating a feature amount with respect to a pixel of interest;
a character determination section for determining whether the pixel of interest is a character or a line drawing on the basis of a feature amount calculated by the feature amount selection section; and
a color determination section for determining the color of the pixel of interest by comparing a chroma and/or a hue of a highest-density pixel of a predetermined region surrounding the pixel of interest with reference values.
