# US 2025/0095397 A1 · Extracting structured information from document images

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0095397 A1
- Document ID: US20250095397A1
- Status: Published application
- Kind: A1
- Application number: 18/966,909
- Filed: 2024-12-03
- Published: 2025-03-20
- Earliest claimed: 2021-12-23
- Assignees: ABBYY Development LLC
- Applicants: ABBYY Development Inc.
- Inventors: Mikhail Lanin; Stanislav Semenov
- Web page: https://patentgrep.com/patent/US20250095397A1

## CPC

- G06V 30/412: Layout analysis of documents structured with printed lines or input boxes, e.g. business forms or tables
- G06V 30/19107: {Clustering techniques}
- G06V 30/19173: {Classification techniques}
- G06V 30/413: Classification of content, e.g. text, photographs or tables
- G06V 30/414: Extracting the geometrical structure, e.g. layout tree; Block segmentation, e.g. bounding boxes for graphics or text
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

An example method of extracting structured information from document images comprises: receiving a document image; detecting a tabular structure within the document image; identifying a plurality of rows of the tabular structure, wherein each row of the plurality of rows comprises plurality of lines; for each row of the plurality of rows, identifying a respective plurality of lines comprised by the row; detecting, in the plurality of lines, a set of fields; detecting a multi-line field by grouping two or more fields of the set of fields; and extracting information from the multi-line field.

## Claims

### Claim 1

A method, comprising:
receiving, by a processing device, a document image;
detecting a tabular structure within the document image;
identifying a plurality of rows of the tabular structure, wherein each row of the plurality of rows comprises plurality of lines;
for each row of the plurality of rows, identifying a respective plurality of lines comprised by the row;
detecting, in the plurality of lines, a set of fields;
detecting a multi-line field by grouping two or more fields of the set of fields; and
extracting information from the multi-line field.

### Claim 2 (depends on 1)

The method of claim 1, further comprising: identifying
vertical boundaries of the tabular structure.

### Claim 3 (depends on 1)

The method of claim 1, wherein identifying the plurality of rows further comprises:
identifying a plurality of lines of the tabular structure; and classifying each line of the plurality of lines.

### Claim 4 (depends on 1)

The method of claim 1, wherein identifying the plurality of rows further comprises:
identifying a plurality of lines of the tabular structure; and clustering the plurality of lines into a plurality of clusters.

### Claim 5 (depends on 1)

The method of claim 1, wherein identifying the set of field types further comprises:
determining, for each line of the one or more lines, a corresponding line type derived from a corresponding set of field types of one or more fields comprised by the line.

### Claim 6 (depends on 1)

The method of claim 1, further comprising:
training a table detection classifier for detecting one or more tabular structures within a document.

### Claim 7 (depends on 1)

The method of claim 1, further comprising:
training a vertical boundary detection classifier for identifying vertical boundaries of the one or more tabular structures.

### Claim 8 (depends on 1)

The method of claim 1, further comprising:
training a row detection classifier for determining a row layout of the one or more tabular structures.

### Claim 9 (depends on 1)

The method of claim 1, further comprising:
training a field detection module for detecting fields of the one or more tabular structures.

### Claim 10

A system comprising:
a memory; and
a processing device operatively coupled to the memory, the processing device configured to:
receive a document image;
detect a tabular structure within the document image;
identify a plurality of rows of the tabular structure, wherein each row of the plurality of rows comprises plurality of lines;
for each row of the plurality of rows, identify a respective plurality of lines comprised by the row;
detect, in the plurality of lines, a set of fields;
detect a multi-line field by grouping two or more fields of the set of fields; and
extract information from the multi-line field.

### Claim 11 (depends on 10)

The system of claim 10, wherein the processing device is further configured to:
identify vertical boundaries of the tabular structure.

### Claim 12 (depends on 10)

The system of claim 10, wherein identifying the set of field types further comprises:
determining, for each line of the one or more lines, a corresponding line type derived from a corresponding set of field types of one or more fields comprised by the line.

### Claim 13 (depends on 10)

The system of claim 10, wherein the processing device is further configured to perform at least one of:
training a table detection classifier for detecting one or more tabular structures within a document;
training a vertical boundary detection classifier for identifying vertical boundaries of the one or more tabular structures;
training a row detection classifier for determining a row layout of the one or more tabular structures; or
training a field detection module for detecting fields of the one or more tabular structures.

### Claim 14

A non-transitory computer-readable storage medium including executable instructions that, when executed by a computing system, cause the computing system to:
receive a document image;
detect a tabular structure within the document image;
identify a plurality of rows of the tabular structure, wherein each row of the plurality of rows comprises plurality of lines;
for each row of the plurality of rows, identify a respective plurality of lines comprised by the row;
detect, in the plurality of lines, a set of fields;
detect a multi-line field by grouping two or more fields of the set of fields; and
extract information from the multi-line field.

### Claim 15 (depends on 14)

The non-transitory computer-readable storage medium of claim 14, wherein the tabular structure is provided by a table.

### Claim 16 (depends on 14)

The non-transitory computer-readable storage medium of claim 14, further comprising executable instructions that, when executed by the computing system, cause the computing system to:
identifying vertical boundaries of the tabular structure.

### Claim 17 (depends on 14)

The non-transitory computer-readable storage medium of claim 14, wherein identifying the plurality of rows further comprises:
identifying a plurality of lines of the tabular structure; and classifying each line of the plurality of lines.

### Claim 18 (depends on 14)

The non-transitory computer-readable storage medium of claim 14, wherein identifying the plurality of rows further comprises:
identifying a plurality of lines of the tabular structure; and clustering the plurality of lines into a plurality of clusters.

### Claim 19 (depends on 14)

The non-transitory computer-readable storage medium of claim 14, wherein identifying the set of field types further comprises:
determining, for each line of the one or more lines, a corresponding line type derived from a corresponding set of field types of one or more fields comprised by the line.

### Claim 20 (depends on 14)

The non-transitory computer-readable storage medium of claim 14, further comprising executable instructions that, when executed by the computing system, cause the computing system to perform at least one of:
training a table detection classifier for detecting one or more tabular structures within a document;
training a vertical boundary detection classifier for identifying vertical boundaries of the one or more tabular structures;
training a row detection classifier for determining a row layout of the one or more tabular structures; or
training a field detection module for detecting fields of the one or more tabular structures.
