# US 2021/0279460 A1 · Information processing system, information processing method, and non-transitory recording medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0279460 A1
- Document ID: US20210279460A1
- Status: Published application
- Kind: A1
- Application number: 17/146,686
- Filed: 2021-01-12
- Published: 2021-09-09
- Earliest claimed: 2020-03-06
- Assignees: Ricoh Company, Ltd.
- Inventors: HIROSHI KOBAYASHI; YOSHIHARU TOJO; FUMIHIRO TESHIMA
- Web page: https://patentgrep.com/patent/US20210279460A1

## CPC

- G06V 30/412: Layout analysis of documents structured with printed lines or input boxes, e.g. business forms or tables
- G06V 30/414: Extracting the geometrical structure, e.g. layout tree; Block segmentation, e.g. bounding boxes for graphics or text
- G06V 30/416: Extracting the logical structure, e.g. chapters, sections or page numbers; Identifying elements of the document, e.g. authors
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

An information processing system includes circuitry. The circuitry causes a terminal apparatus to display a setting screen for setting an extraction area for extracting, from a tabular image, an item value for each of one or more extraction target items. The setting screen displays, on the tabular image, an extraction guide representing the extraction area according to each of the one or more extraction target items. The circuitry further receives an operation of setting a position of the extraction guide on the setting screen.

## Claims

### Claim 1

An information processing system comprising circuitry configured to
cause a terminal apparatus to display a setting screen for setting an extraction area for extracting, from a tabular image, an item value for each of one or more extraction target items, the setting screen displaying, on the tabular image, an extraction guide representing the extraction area according to each of the one or more extraction target items, and
receive an operation of setting a position of the extraction guide on the setting screen.

### Claim 2 (depends on 1)

The information processing system of claim 1, wherein the circuitry
receives an operation of specifying an extraction target item out of the one or more extraction target items on the setting screen, and
causes the terminal apparatus to display the extraction guide representing the extraction area according to the specified extraction target item.

### Claim 3 (depends on 1)

The information processing system of claim 1, wherein the circuitry causes the terminal apparatus to display the extraction guide representing the extraction area to extract an item name and the item value for each of the one or more extraction target items, the extraction area including an area of the item name and an area of the item value associated with each other for each of the one or more extraction target items.

### Claim 4 (depends on 3)

The information processing system of claim 3, wherein the tabular image is an image of a description section of a ledger sheet image, and
wherein the item name corresponds to a description item name included in the description section, and the item value corresponds to a value of a description item represented by the description item name.

### Claim 5 (depends on 4)

The information processing system of claim 4, wherein in response to receipt of an instruction to extract the description item name and the value of the description item from the description section, the circuitry
extracts, from the image of the description section, a first keyword in an area of the description item name in the extraction area and a second keyword in an area of the value of the description item in the extraction area, and
associates the first keyword and the second keyword with each other.

### Claim 6 (depends on 4)

The information processing system of claim 4, wherein the circuitry
generates description definition information in which information representing a position of an area of the description item name in the image of the description section is associated with a keyword in the area of the description item name, and
stores the generated description definition information in a memory.

### Claim 7 (depends on 3)

The information processing system of claim 3, wherein the circuitry receives an operation of moving, on the tabular image, a position of a column included in the extraction guide and associating the item name and the item value with each other.

### Claim 8 (depends on 3)

The information processing system of claim 3, wherein the extraction guide includes a plurality of columns each associating the item name and the item value with each other, and
wherein the circuitry causes the terminal apparatus to display the extraction guide with each of the plurality of columns in the extraction guide matching in width a corresponding one of a plurality of columns in a table represented by the tabular image.

### Claim 9 (depends on 8)

The information processing system of claim 8, wherein the circuitry causes the terminal apparatus to further display a display component and a list of item names, the display component being used to perform an operation of changing number of rows included in the extraction guide.

### Claim 10 (depends on 1)

The information processing system of claim 1 comprising:
a server including the circuitry; and
the terminal apparatus including a display,
wherein the circuitry of the server
transmits, to the terminal apparatus, an instruction to display the setting screen, and
receives, from the terminal apparatus, information representing an operation performed on the setting screen, and
wherein the terminal apparatus displays the setting screen on the display in accordance with the instruction received from the server.

### Claim 11

An information processing method comprising:
displaying, on a display, a setting screen for setting an extraction area for extracting, from a tabular image, an item value for each of one or more extraction target items, the setting screen displaying, on the tabular image, an extraction guide representing the extraction area according to each of the one or more extraction target items; and
receiving an operation of setting a position of the extraction guide on the setting screen.

### Claim 12 (depends on 11)

The information processing method of claim 11, further comprising:
receiving an operation of specifying an extraction target item out of the one or more extraction target items on the setting screen,
wherein the displaying includes
displaying the extraction guide representing the extraction area according to the specified extraction target item.

### Claim 13 (depends on 11)

The information processing method of claim 11, wherein the displaying includes
displaying the extraction guide representing the extraction area to extract an item name and the item value for each of the one or more extraction target items, the extraction area including an area of the item name and an area of the item value associated with each other for each of the one or more extraction target items.

### Claim 14 (depends on 13)

The information processing method of claim 13, wherein the tabular image is an image of a description section of a ledger sheet image, and
wherein the item name corresponds to a description item name included in the description section, and the item value corresponds to a value of a description item represented by the description item name.

### Claim 15 (depends on 14)

The information processing method of claim 14, further comprising:
in response to receipt of an instruction to extract the description item name and the value of the description item from the description section, extracting, from the image of the description section, a first keyword in an area of the description item name in the extraction area and a second keyword in an area of the value of the description item in the extraction area; and
associating the first keyword and the second keyword with each other.

### Claim 16 (depends on 14)

The information processing method of claim 14, further comprising:
generating description definition information in which information representing a position of an area of the description item name in the image of the description section is associated with a keyword in the area of the description item name; and
storing the generated description definition information in a memory.

### Claim 17 (depends on 13)

The information processing method of claim 13, further comprising:
receiving an operation of moving, on the tabular image, a position of a column included in the extraction guide and associating the item name and the item value with each other.

### Claim 18 (depends on 13)

The information processing method of claim 13, wherein the extraction guide includes a plurality of columns each associating the item name and the item value with each other, and
wherein the displaying includes
displaying the extraction guide with each of the plurality of columns in the extraction guide matching in width a corresponding one of a plurality of columns in a table represented by the tabular image.

### Claim 19 (depends on 18)

The information processing method of claim 18, wherein the displaying includes
displaying a display component and a list of item names, the display component being used to perform an operation of changing number of rows included in the extraction guide.

### Claim 20

A non-transitory recording medium storing a plurality of instructions which, when executed by one or more processors, cause the processors to perform an image processing method comprising:
displaying, on a display, a setting screen for setting an extraction area for extracting, from a tabular image, an item value for each of one or more extraction target items, the setting screen displaying, on the tabular image, an extraction guide representing the extraction area according to each of the one or more extraction target items; and
receiving an operation of setting a position of the extraction guide on the setting screen.
