# US 5,710,830 A · Method of and apparatus for segmenting foreground and background information for optical character recognition of labels employing single layer recurrent neural network

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 5,710,830 A
- Document ID: US5710830A
- Status: Granted
- Kind: A
- Application number: 08/574,254
- Filed: 1995-11-30
- Granted: 1998-01-20
- Earliest claimed: 1994-10-05
- Assignees: United Parcel Service
- Inventors: Lee F. Holeva
- Web page: https://patentgrep.com/patent/US5710830A

## CPC

- H05B 3/0076: {for cooking, e.g. in ovens (lamps specially adapted for non-metallic cooking plates H05B3/742, H05B3/744)}
- F24C 7/06: Arrangement or mounting of electric heating elements
- F24C 7/087: {of electric circuits regulating heat}
- G01L 1/144: {with associated circuitry (G01L1/146 and G01L1/148 take precedence)}
- G05D 1/0816: {to ensure stability}
- G06V 30/162: Quantising the image signal
- G06V 30/10: Character recognition
- H05B: ELECTRIC HEATING; ELECTRIC LIGHT SOURCES NOT OTHERWISE PROVIDED FOR; CIRCUIT ARRANGEMENTS FOR ELECTRIC LIGHT SOURCES, IN GENERAL
- F24C: DOMESTIC STOVES OR RANGES (exclusively for solid fuels F24B); DETAILS OF DOMESTIC STOVES OR RANGES, OF GENERAL APPLICATION
- G01L: MEASURING FORCE, STRESS, TORQUE, WORK, MECHANICAL POWER, MECHANICAL EFFICIENCY, OR FLUID PRESSURE (weighing G01G)
- G05D: SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

A method and apparatus for processing a greyscale input of an image, particularly of a shipping label, into a binary output image in which foreground information is segmented from the background information and contrasts between adjacent regions having different background densities are obliterated is described. A neuron employing a 5.times.5 input neighborhood having a unique neuron activation function is shown. No explicit line process is employed. Output is biased toward a particular one of the output values by employing non-linear feedback as a function of both the grey scale value for the pixel corresponding to the label site being updated and the most recent value of the label site. The otherwise strong contribution from a gradient term in the energy function is suppressed by a shunting inhibition when the shunting inhibition function detects that the pixel lies on or near a boundary between adjacent regions of differing background intensities.

## Claims

### Claim 1

A method of segmenting foreground areas from background areas of an input image including input pixels having grey scale input pixel values, comprising the steps of:
defining an output image comprising output pixels having binary output pixel values;
assigning each input pixel and each output pixel a position in a coordinate system so that the input image and the output image correspond to the physical configuration of the substrate;
assigning a scaling factor to each input pixel so that a scaling factor assigned to an input pixel represents an estimate of the background input pixel values in a neighborhood about the input pixel;
defining an energy function that varies as a function of the input pixels values, the output pixels values, and the scaling factors comprising
a first component expressing a cost associated with an output pixel value not being in agreement with the value of a corresponding input pixel taking into account the value of the scaling factor assigned to the corresponding input pixel,
a second component expressing a cost associated with the value of an output pixel not being in agreement with the values of pixels in a neighborhood around the output pixel, and
a third component expressing a cost associated with the gradient of the input pixel values so as to define boundaries between regions of the input image having contrasting input pixel values; and
segmenting foreground areas of the output image from background areas of the output image by iteratively varying the output pixel values so that the energy function converges toward a minimum value.

### Claim 2 (depends on 1)

The method of claim 1, wherein the step of segmenting foreground areas of the output image from background areas of the output image comprises the step of growing foreground areas of the output image.

### Claim 3 (depends on 2)

The method of claim 2, wherein the step of growing foreground areas of the output image comprises the steps of:
growing the foreground areas of the output image until the foreground areas intersect the boundaries; and
shunting boundaries associated with changes in the scaling factors so that changes in the scaling factors do not prevent the growth of the foreground areas.

### Claim 4 (depends on 3)

The method of claim 3, wherein the step of growing the foreground areas of the output image until the foreground areas intersect the boundaries comprises the step of assigning the energy function an energy penalty for foreground areas crossing boundaries.

### Claim 5 (depends on 4)

The method of claim 4, wherein the step of assigning the energy function an energy penalty for foreground areas crossing boundaries comprises the step of assigning the energy function an energy penalty based on directional derivatives taken from the input image.

### Claim 6 (depends on 5)

The method of claim 5, wherein the energy function further comprises:
a shunt inhibitor that counteracts the energy penalty for foreground areas of the output image crossing boundaries associated with changes in the scaling factors so that changes in the scaling factors do not prevent the growth of the foreground areas.

### Claim 7 (depends on 1)

The method of claim 1, wherein the third component includes directional derivatives taken in directions relative to the coordinate system comprising:
a vertical direction;
a horizontal direction;
a plus forty-five degrees direction; and
a minus forty-five degrees direction.

### Claim 8 (depends on 1)

The method of claim 1, wherein the input pixels are in a one-to-one correspondence with the output pixels so that each output pixel has an associated input pixel.

### Claim 9

An apparatus for segmenting foreground areas from background areas of an input image including input pixels having grey scale input pixel values, comprising:
a computer storage medium for defining an output image comprising output pixels having binary output pixel values;
means for assigning each input pixel and each output pixel a position in a coordinate system so that the input image and the output image correspond to the physical configuration of the substrate;
means for assigning a scaling factor to each input pixel so that a scaling factor assigned to an input pixel represents an estimate of the background input pixel values in a neighborhood about the input pixel;
means for defining an energy function that varies as a function of the input pixels values, the output pixels values, and the scaling factors comprising,
a first component expressing a cost associated with an output pixel value not being in agreement the value of a corresponding input pixel taking into account the value of the scaling factor assigned to the corresponding input pixel,
a second component expressing a cost associated with the value of an output pixel not being in agreement with the values of its neighboring output pixels, and
a third component expressing a cost associated with the gradient of the input pixel values so as to define boundaries between regions of the input image having contrasting input pixel values; and
means for segmenting foreground areas of the output image from background areas of the output image by iteratively varying the output pixel values so that the energy function converges toward a minimum value.

### Claim 10 (depends on 9)

The apparatus of claim 9, wherein:
the means for assigning a scaling factor to each input pixel comprises a competitive learning network for assigning a scaling factor to each input pixel so that a scaling factor assigned to an input pixel represents an estimate of the background input pixel values in a neighborhood about the input pixel.

### Claim 11 (depends on 9)

The apparatus of claim 9, wherein the means for segmenting foreground areas of the output image from background areas of the output image comprises:
means for growing foreground areas of the output image until the foreground areas intersect the boundaries; and
means for shunting boundaries associated with changes in the scaling factors so that changes in the scaling factors do not prevent the growth of the foreground areas.

### Claim 12 (depends on 11)

The apparatus of claim 11, wherein:
the means for segmenting foreground areas of the output image from background areas of the output image comprises a recurrent neural network for segmenting foreground areas of the output image from background areas of the output image by iteratively varying the output pixel values so that the energy function converges toward a minimum value.