# US 2008/0279474 A1 · Punched hole detection and removal

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2008/0279474 A1
- Document ID: US20080279474A1
- Status: Published application
- Kind: A1
- Application number: 11/801,958
- Filed: 2007-05-11
- Published: 2008-11-13
- Earliest claimed: 2007-05-11
- Assignees: Xerox Corporation
- Inventors: Dennis L. Venable; Zhigang Fan; Lee C. Moore
- Web page: https://patentgrep.com/patent/US20080279474A1

## CPC

- G06T 7/0004: {Industrial image inspection}
- G06T 5/77: Retouching; Inpainting; Scratch removal
- H04N 1/38: Circuits or arrangements for blanking or otherwise eliminating unwanted parts of pictures (H04N1/387 takes precedence)
- G06T 2207/10008: from scanner, fax or copier
- G06T 2207/30144: Printing quality
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A method for removal of punched hole artifacts in digital images includes, for a scanned document page, deriving an original digital image that defines the page in terms of a plurality of input pixels. A reduced resolution bitonal image is generated from the original image. The method further includes providing for identifying of candidate punched hole artifacts in the reduced resolution bitonal image and providing for testing the candidate punched hole artifacts for at least one of shape, size, and location. Where a candidate punched hole artifact meets the at least one test, the method includes generating a modified image. This includes erasing the candidate punched hole artifact from the original digital image.

## Claims

### Claim 1

A method for removal of punched hole artifacts in digital images, comprising:
for a scanned document page, deriving an original digital image that defines the page in terms of a plurality of input pixels;
generating a reduced resolution bitonal image from the original image;
providing for identifying of candidate punched hole artifacts in the reduced resolution bitonal image;
providing for testing the candidate punched hole artifacts for at least one of shape, size, and location; and
where a candidate punched hole artifact meets the at least one test, generating a modified image, including erasing the candidate punched hole artifact from the original digital image.

### Claim 2 (depends on 1)

The method of claim 1, wherein where the original digital image is not bitonal, the method further comprises generating a bitonal image from the original image.

### Claim 3 (depends on 1)

The method of claim 1, further comprising:
performing a morphological opening on the reduced resolution image.

### Claim 4 (depends on 3)

The method of claim 3, wherein the identification of candidate punched holes in the reduced resolution bitonal image includes identifying objects remaining after the morphological opening has been performed.

### Claim 5 (depends on 1)

The method of claim 1, wherein the at least one test includes determining whether the candidate punched hole artifact is within a predetermined distance from an edge of the image.

### Claim 6 (depends on 1)

The method of claim 1, wherein the at least one test includes determining whether the candidate punched hole artifact meets a test for circularity.

### Claim 7 (depends on 1)

The method of claim 1, wherein the at least one test includes determining whether the candidate punched hole artifact falls predominantly within an area of a template for a punched hole artifact.

### Claim 8 (depends on 1)

The method of claim 1, wherein the at least one test includes determining whether at least two candidate punched hole artifacts are spaced by a distance which falls within a predetermined range.

### Claim 9 (depends on 1)

The method of claim 1, wherein the at least one test includes determining whether the candidate punched hole artifact has a size within a predetermined range.

### Claim 10 (depends on 1)

The method of claim 1, wherein the generating of the reduced resolution image includes reducing the resolution such that a punched hole artifact has a diameter of less than about thirty pixels.

### Claim 11 (depends on 10)

The method of claim 10, wherein the generating of the reduced resolution image includes reducing the resolution such that a punched hole artifact has a diameter of at least ten pixels.

### Claim 12 (depends on 10)

The method of claim 10, wherein the at least one test includes a test for circularity, and wherein the circularity test is performed on the bitonal reduced resolution image.

### Claim 13 (depends on 10)

The method of claim 10, wherein the generating of the reduced resolution image includes reducing the resolution such that a punched hole artifact has a diameter of no more than two pixels.

### Claim 14 (depends on 13)

The method of claim 13, wherein the identifying of candidate punched hole artifacts comprises determining for a current pixel which is black, whether at least a predetermined proportion of a selected group of neighboring pixels are white.

### Claim 15 (depends on 1)

The method of claim 1, further comprising scanning a document comprising a printed page.

### Claim 16 (depends on 1)

The method of claim 1, further comprising outputting the modified digital image.

### Claim 17 (depends on 16)

The method of claim 16, wherein the modified image is output to a printer and the method further comprises rendering the modified image on print media.

### Claim 18 (depends on 1)

An image processing unit which executes instructions for performing the method of claim 1.

### Claim 19 (depends on 18)

An image processing system comprising the image processing unit of claim 18 and a printer for printing the modified image.

### Claim 20 (depends on 19)

The image processing system of claim 19, further comprising a scanner which captures the original digital image.

### Claim 21 (depends on 1)

A computer program product encoding instructions, which when executed on a computer causes the computer to perform the method of claim 1.

### Claim 22

An image processing unit which receives an input digital image and generates a bitonal reduced resolution image therefrom, the image processing unit being configured for identifying candidate punched hole artifacts in the bitonal reduced resolution image and for verifying whether an identified candidate punched hole artifact meets at least one test for a punched hole artifact, and where the candidate punched hole artifact meets the at least one test, automatically erasing the candidate punched hole artifact from the input digital image.

### Claim 23 (depends on 22)

An image processing system comprising the image processing unit of claim 22 and a printer.

### Claim 24

An automated method of removing punched hole artifacts from scanned digital images comprising:
scanning a document page to generate image data;
deriving an original digital image from the image data that defines the page in terms of a plurality of input pixels;
filtering the image to remove objects smaller than punched hole artifacts, including generating a reduced resolution image from the original image and optionally performing a morphological opening;
for objects remaining after the filtering, performing tests on the objects for identifying candidate punched hole artifacts; and
automatically erasing objects determined to be candidate punched hole artifacts from the original digital image.
