# US 7,609,881 B2 · Device and method for image processing as well as image processing computer program > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 7,609,881 B2 - Document ID: US7609881B2 - Status: Granted - Kind: B2 - Application number: 10/689,669 - Filed: 2003-10-22 - Published: 2004-07-15 - Granted: 2009-10-27 - Earliest claimed: 2002-10-23 - Assignees: Konica Minolta Business Technologies, Inc. - Inventors: Yukihiko Ichikawa; Yoshinori Tanaka - Web page: https://patentgrep.com/patent/US7609881B2 ## CPC - H04N 1/644: {using a reduced set of representative colours, e.g. each representing a particular range in a colour space} - G06T 7/11: Region-based segmentation - H04N 1/41: Bandwidth or redundancy reduction (by scanning H04N1/17 {; methods or arrangements for coding, decoding, compressing or decompressing digital video signals H04N19/00}) - G06T 2207/10008: from scanner, fax or copier - G06T 2207/20132: Image cropping - G06T 2207/30176: Document - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL ## Abstract The image processing device is equipped with an image area extracting part for extracting a plurality of image areas from image data, an image positional information recognizing part for recognizing positional information of each extracted image area, an attribute recognizing part for recognizing at least attributes concerning whether each extracted image area is a filled closed area or unfilled closed area, a file producing part for producing a file synthesizing a plurality of image areas based on the positional information recognized by the image positional information recognizing part, and a sequence setting part for setting overlying sequence for each image area in accordance with the recognition result of the attribute recognizing part. The file producing part produces the file by overlaying a multiple of image areas in accordance with the overlaying sequence set up by the sequence setting part. ## Claims ### Claim 1 An image processing device comprising: an image area extracting part for extracting a plurality of image areas from image data; a positional information recognizing part for recognizing positional information of each extracted image area; an attribute recognizing part for recognizing at least attributes concerning whether each extracted image area is a filled closed area, wherein the closed area has an inside of which a color has different value from an outside of the closed area, common stays or an unfilled closed area, wherein the closed area has an inside of which a color has same value from an outside of the closed area; a file producing part for producing a file by synthesizing said image areas based on the positional information recognized by said positional information recognizing part; and a sequence setting part for setting up an overlaying sequence for each image area in accordance with the recognition result of said attribute recognizing part, wherein said file producing part produces the file by overlaying said image areas in accordance with the overlaying sequence set up by said sequence setting part. ### Claim 2 (depends on 1) An image processing device according to the claim 1, wherein said sequence setting part sets up the overlaying sequence to overlay unfilled closed areas in front of filled closed areas. ### Claim 3 (depends on 2) An image processing device according to the claim 2, wherein said attribute recognizing part further recognizes whether each extracted image area is a line area that does not form any closed area, and said sequence setting part sets up the overlaying sequence to overlay line areas in front of filled closed areas in accordance with the recognition result of said attribute recognizing part. ### Claim 4 (depends on 1) An image processing device according to the claim 1, wherein said image area extracting part comprises a first extracting part for extracting text image areas, graphic image areas, and photographic image areas from image data, and a second extracting part for extracting filled closed areas, unfilled closed areas, and line areas that do not form any closed areas from the extracted graphic image areas; wherein said attribute recognizing part recognizes attributes concerning whether each extracted image area is a text image area, a photographic image area, a filled closed area, an unfilled closed area or a line area; and said sequence setting part sets up the overlaying sequence for each image area of text image areas, photographic image areas, filled closed areas, unfilled closed areas, and line areas in accordance with the recognition result of said attribute recognizing part. ### Claim 5 (depends on 4) An image processing device according to the claim 4, wherein said sequence setting part sets up the overlaying sequence to overlay text image areas in front, filled closed areas and photographic image areas in back, and unfilled closed areas and line areas in between the front and back. ### Claim 6 (depends on 5) An image processing device according to the claim 5, further comprising an image area overlapping discriminating part for discriminating whether at least a part of either filled closed areas or photographic image areas are overlapping each other; wherein said sequence setting part further sets up an overlaying sequence for filled closed areas and photographic image areas, depending on the result of a comparison of the sizes of filled closed areas and photographic image areas, or the number of overlapping areas, when at least some of the filled closed areas and photographic image areas are overlapping. ### Claim 7 (depends on 4) An image processing device according to the claim 4, wherein said second extracting part comprises, a vector transforming part for transforming image data in graphic image areas into vector data; a closed area extracting part for extracting closed areas based on the connection relation of a plurality of vector data; a color information judging part for judging whether the color information of internal points and external points of the extracted closed areas are the same; and a filled closed area detecting part for detecting filled closed areas based on the judgment results of the color information judging part. ### Claim 8 (depends on 1) An image processing device according to the claim 1, further comprising a document scanning unit for scanning documents to obtain input image data, wherein said image area extracting part extracts a plurality of image areas from the input image data obtained by scanning the documents. ### Claim 9 An image processing method comprising: using a processor to perform steps of: extracting a plurality of image areas from image data; recognizing positional information of each extracted image area; recognizing at least attributes concerning whether each extracted image area is a filled closed area, wherein the closed area has an inside of which a color has different value from an outside of the closed area, or an unfilled closed area, wherein the closed area has an inside of which a color has same value from an outside of the closed area; producing a file by synthesizing said image areas based on positional information recognized; and setting up an overlaying sequence for each image area in accordance with the recognition result of the attributes, wherein said producing step includes producing file by overlaying said image areas in accordance with the overlaying sequence, which has been set up. ### Claim 10 (depends on 9) An image processing method according to the claim 9, wherein said setting up step includes setting up an overlaying sequence to overlay unfilled closed areas in front of filled closed area. ### Claim 11 (depends on 10) An image processing method according to the claim 10, wherein said step of recognizing attributes includes recognizing whether each extracted image areas is a line area that does not form any closed areas, and wherein said setting step includes setting overlaying sequence to overlay line areas in front of filled closed areas. ### Claim 12 (depends on 9) An image processing method according to the claim 9, wherein said extracting step includes a first extracting step of extracting text image areas, graphic image areas, and photographic image areas from image data, and a second extracting step of extracting filled closed areas, unfilled closed areas, and line areas that do not form any closed areas from the extracted graphic image areas; wherein said step of recognizing attributes includes recognizing attributes concerning whether each extracted image area is a text image area, a photographic image area, a filled closed area, an unfilled closed area or a line area; and said setting up step includes setting up the overlaying sequence for each image area of text image areas, photographic image areas, filled closed areas, unfilled closed areas, and line areas in accordance with the recognition results of the attributes. ### Claim 13 (depends on 12) An image processing method according to the claim 12 wherein said setting up step includes setting up the overlaying sequence to overlay text image areas in front, filled closed areas and photographic image areas in back, and unfilled closed areas and line areas are in between them. ### Claim 14 (depends on 13) An image processing method according to the claim 13, further comprising a step of discriminating whether at least a port of either filled closed areas or photographic image areas are overlapping each other; wherein said setting up step includes setting overlaying sequence for filled closed areas and photographic image areas, depending on the result of a comparison of the sizes of filled closed areas and photographic image areas, or the number of overlapping areas, when at least some of the filled closed areas and photographic image areas are overlapping. ### Claim 15 (depends on 12) An image processing method according to the claim 12, wherein said second extracting step comprises, a step of transforming image data in graphic image areas into vector data; a step of extracting closed areas based on the connection relation of a plurality of vector data; a step of judging whether the color information of internal points and external points of the extracted closed areas are the same; and a step of detecting filled closed areas based on the judgment result of whether the compared color information is the same. ### Claim 16 (depends on 9) An image processing device according to the claim 9, further comprising a step for scanning documents to obtain input image data, wherein said extracting step includes extracting a plurality of image areas from the input image data obtained from documents. ### Claim 17 A computer executable program stored on a computer readable medium used for image processing, executing the procedures of: extracting a plurality of image areas from image data; recognizing positional information of each extracted image area; recognizing at least attributes concerning whether each extracted image area is a filled closed area, wherein the closed area has an inside of which a color has different value from an outside of the closed area, or an unfilled closed area wherein the closed area has an inside of which a color has same value from an outside of the closed; producing a file by synthesizing said image areas based on positional information recognized; and setting up an overlaying sequence for each image area in accordance with the recognition result of the attributes, wherein said producing procedure includes producing file by overlaying said image areas in accordance with the overlaying sequence, which has been set up. ### Claim 18 (depends on 17) A computer executable program stored on a computer readable medium according to the claim 17, wherein said setting up procedure includes setting up an overlaying sequence to overlay unfilled closed areas in front of filled closed areas. ### Claim 19 (depends on 18) A computer program executable stored on a computer readable medium according to the claim 18, wherein said procedure of recognizing attributes includes recognizing whether each extracted image area is a line area that does not form any closed area, and wherein said setting procedure includes setting overlaying to overlay line areas in front of filled closed areas. ### Claim 20 (depends on 17) A computer program executable stored on a computer readable medium according to the claim 17, wherein said extracting procedure includes a first extracting procedure of extracting text image areas, graphic image areas, and photographic image areas from image data, and a second extracting procedure of extracting filled closed areas, unfilled closed areas, and line areas that do not form any closed areas from the extracted graphic image areas; wherein said procedure of recognizing attributes includes recognizing attributes concerning whether each extracted image area is a text image area, a photographic image area, a filled closed area, an unfilled closed area or a line area; and said setting up procedure includes setting up the overlaying sequence for each image area of text image areas, photographic image areas, filled closed areas, unfilled closed areas and line areas in accordance with the recognition results of the attributes. ### Claim 21 (depends on 20) A computer executable program stored on a computer readable medium according to the claim 20, wherein said setting up procedure includes setting up the overlaying sequence to overlay text image areas in front, filled closed areas and photographic image areas in back, and unfilled closed areas and line areas are in between them. ### Claim 22 (depends on 21) A computer executable program stored on a computer readable medium according to the claim 21, further comprising a procedure of discriminating whether at least a port of either filled closed areas or photographic image areas are overlapping each other; wherein said setting up procedure includes setting overlaying sequence for filled closed areas and photographic image areas, depending on the result of a comparison of the sizes of filled closed areas and photographic image areas, or the number of overlapping areas, when at least some of the filled closed areas and photographic image areas are overlapping. ### Claim 23 (depends on 20) A computer executable program stored on a computer readable medium according to the claim 20, wherein said second extracting procedure comprises, a procedure of transforming image data in graphic image areas into vector data; a procedure of extracting closed areas based on the connection relation of a plurality of vector data; a procedure of judging whether the color information of internal points and external points of the extracted closed areas are the same; and a procedure of detecting filled closed areas based on the judgment result of whether the compared color information is the same. ### Claim 24 (depends on 20) A computer executable program stored on a computer readable medium according to the claim 20, further comprising a procedure for scanning documents to obtain input image data, wherein said extracting procedure includes extracting a plurality of image areas from the input image data obtained from documents.