# US 2023/0051051 A1 · Method, apparatus, and computer-readable storage medium for recognizing characters in a digital document

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0051051 A1
- Document ID: US20230051051A1
- Status: Published application
- Kind: A1
- Application number: 17/975,963
- Filed: 2022-10-28
- Published: 2023-02-16
- Earliest claimed: 2021-06-01
- Assignees: Lead Technologies, Inc.
- Applicants: Lead Technologies, Inc.
- Inventors: Moe DAHER; Waseem SHADID
- Web page: https://patentgrep.com/patent/US20230051051A1

## CPC

- G06V 30/413: Classification of content, e.g. text, photographs or tables
- G06V 10/82: using neural networks
- G06V 30/1801: {Detecting partial patterns, e.g. edges or contours, or configurations, e.g. loops, corners, strokes or intersections (extracting features by contour coding G06V30/182)}
- G06V 30/18105: {related to colour}
- G06V 30/19173: {Classification techniques}
- G06V 30/226: of cursive writing
- G06V 30/36: {Matching; Classification}
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

Method, computer readable medium, and apparatus of recognizing character zone in a digital document. In an embodiment, the method includes classifying a segment of the digital document as including text, calculating at least one parameter value associated with the classified segment of the digital document, determining, based on the calculated at least one parameter value, a zonal parameter value, classifying the segment of the digital document as a handwritten text zone or as a printed text zone based on the determined zonal parameter value and a threshold value, the threshold value being based on a selection of an intersection of a handwritten text distribution profile and a printed text distribution profile, each of the handwritten text distribution profile and the printed text distribution profile being associated with a zonal parameter corresponding to the determined zonal parameter value, and generating, based on the classifying, a modified version of the digital document.

## Claims

### Claim 1

A method comprising:
determining, by processing circuitry and based on at least one parameter value associated with a segment of a digital document, a zonal parameter value;
classifying, by the processing circuitry, the segment of the digital document as a handwritten text zone or as a printed text zone based on the determined zonal parameter value and a threshold value, the threshold value being based on a selection of an intersection of a handwritten text distribution profile and a printed text distribution profile, each of the handwritten text distribution profile and the printed text distribution profile being associated with a zonal parameter corresponding to the determined zonal parameter value; and
generating, by the processing circuitry and based on the classifying, a modified version of the digital document.

### Claim 2 (depends on 1)

The method of claim 1, further comprising
performing, by the processing circuitry and when the segment is classified as a handwritten text zone, handwritten character recognition on the segment to recognize the handwritten text, and
performing, by the processing circuitry and when the segment is classified as a printed text zone, printed character recognition on the segment to recognize the printed text.

### Claim 3 (depends on 1)

The method of claim 1, wherein the determined zonal parameter value is an object density value calculated by
multiplying, by the processing circuitry, a segment ratio by a segment height, the segment ratio being a ratio of a number of objects in the segment to a segment width.

### Claim 4 (depends on 1)

The method of claim 1, wherein the generating the modified version of the digital document includes
assigning, by the processing circuitry and when the segment is classified as a handwritten text zone, a handwritten text identifier to the segment, and
assigning, by the processing circuitry and when the segment is classified as a printed text zone, a printed text identifier to the segment.

### Claim 5 (depends on 2)

The method of claim 2, further comprising
generating, by the processing circuitry and as the modified version of the digital document, a first selectable version of the digital document, wherein the first selectable version of the digital document includes the recognized handwritten text within the segment.

### Claim 6 (depends on 2)

The method of claim 2, further comprising
generating, by the processing circuitry and as the modified version of the digital document, a second selectable version of the digital document, wherein the second selectable version of the digital document includes the recognized printed text within the segment.

### Claim 7 (depends on 1)

The method of claim 1, further comprising
obtaining, by the processing circuitry, the threshold value from a reference table comprising threshold values based on a type of the zonal parameter value, each of the threshold values being based on a corresponding handwritten text distribution profile and corresponding printed text distribution profile from a database,
the corresponding handwritten text distribution profile being based on a histogram associated with text zones labeled as handwritten text, and
the corresponding printed text distribution profile being based on a histogram associated with text zones labeled as printed text.

### Claim 8 (depends on 7)

The method of claim 7, wherein each of the histograms are based on a comparison of a parameter value for an object within a labeled text zone and a corresponding ranking for the object, the corresponding ranking being based on the parameter value for the object and parameter values for each other object within the labeled text zone.

### Claim 9 (depends on 1)

The method of claim 1, wherein the selection of the intersection of the handwritten text distribution profile and the printed text distribution profile includes
maximizing, by the processing circuitry, an area under a curve for each of the handwritten text distribution profile and the printed text distribution profile, the threshold value being a value above which the segment is likely to be handwritten text.

### Claim 10 (depends on 1)

The method of claim 1, wherein the classifying includes
calculating, by the processing circuitry, a zonal ranking value based on the determined zonal parameter value and ranking values associated with each of the at least one parameter value, and
comparing, by the processing circuitry, the zonal ranking value to the threshold value, the segment of the digital document being classified as a handwritten text zone when the zonal ranking value satisfies the threshold value.

### Claim 11

A non-transitory computer-readable medium storing instructions which when executed by a computer, cause the computer to perform a method, the method comprising:
determining, based on at least one parameter value associated with a segment of a digital document, a zonal parameter value;
classifying the segment of the digital document as a handwritten text zone or as a printed text zone based on the determined zonal parameter value and a threshold value, the threshold value being based on a selection of an intersection of a handwritten text distribution profile and a printed text distribution profile, each of the handwritten text distribution profile and the printed text distribution profile being associated with a zonal parameter corresponding to the determined zonal parameter value; and
generating, based on the classifying, a modified version of the digital document.

### Claim 12 (depends on 11)

The non-transitory computer-readable medium of claim 11, further comprising
performing, when the segment is classified as a handwritten text zone, handwritten character recognition on the segment to recognize the handwritten text, and
performing, when the segment is classified as a printed text zone, printed character recognition on the segment to recognize the printed text.

### Claim 13 (depends on 11)

The non-transitory computer-readable medium of claim 11, wherein the determined zonal parameter value is an object density value calculated by
multiplying a segment ratio by a segment height, the segment ratio being a ratio of a number of objects in the segment to a segment width.

### Claim 14 (depends on 11)

The non-transitory computer-readable medium of claim 11, wherein the generating the modified version of the digital document includes
assigning, when the segment is classified as a handwritten text zone, a handwritten text identifier to the segment, and
assigning, when the segment is classified as a printed text zone, a printed text identifier to the segment.

### Claim 15 (depends on 12)

The non-transitory computer-readable medium of claim 12, further comprising
generating, as the modified version of the digital document, a first selectable version of the digital document, wherein the first selectable version of the digital document includes the recognized handwritten text within the segment and the recognized printed text within the segment.

### Claim 16 (depends on 11)

The non-transitory computer-readable medium of claim 11, further comprising
obtaining the threshold value from a reference table comprising threshold values based on a type of the zonal parameter value, each of the threshold values being based on a corresponding handwritten text distribution profile and corresponding printed text distribution profile from a database,
the corresponding handwritten text distribution profile being based on a histogram associated with text zones labeled as handwritten text, and
the corresponding printed text distribution profile being based on a histogram associated with text zones labeled as printed text.

### Claim 17 (depends on 16)

The non-transitory computer-readable medium of claim 16, wherein each of the histograms are based on a comparison of a parameter value for an object within a labeled text zone and a corresponding ranking for the object, the corresponding ranking being based on the parameter value for the object and parameter values for each other object within the labeled text zone.

### Claim 18 (depends on 11)

The non-transitory computer-readable medium of claim 11, wherein the selection of the intersection of the handwritten text distribution profile and the printed text distribution profile includes maximizing an area under a curve for each of the handwritten text distribution profile and the printed text distribution profile, the threshold value being a value above which the segment is likely to be handwritten text.

### Claim 19 (depends on 11)

The non-transitory computer-readable medium of claim 11, wherein the classifying includes
calculating a zonal ranking value based on the determined zonal parameter value and ranking values associated with each of the at least one parameter value, and
comparing the zonal ranking value to the threshold value, the segment of the digital document being classified as a handwritten text zone when the zonal ranking value satisfies the threshold value.

### Claim 20

An apparatus, comprising:
processing circuitry configured to
determine, based on at least one parameter value associated with a segment of a digital document, a zonal parameter value,
classify the segment of the digital document as a handwritten text zone or as a printed text zone based on the determined zonal parameter value and a threshold value, the threshold value being based on a selection of an intersection of a handwritten text distribution profile and a printed text distribution profile, each of the handwritten text distribution profile and the printed text distribution profile being associated with a zonal parameter corresponding to the determined zonal parameter value, and
generate, based on the classifying, a modified version of the digital document.
