# US 2022/0019835 A1 · Image processing system, apparatus, method, and storage medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0019835 A1
- Document ID: US20220019835A1
- Status: Published application
- Kind: A1
- Application number: 17/372,277
- Filed: 2021-07-09
- Published: 2022-01-20
- Earliest claimed: 2020-07-17
- Applicants: Canon Kabushiki Kaisha
- Inventors: Yoshihito Nanaumi
- Web page: https://patentgrep.com/patent/US20220019835A1

## CPC

- G06V 30/153: {using recognition of characters or words}
- G06T 7/10: Segmentation; Edge detection (motion-based segmentation G06T7/215)
- G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80)
- G06V 10/40: Extraction of image or video features
- G06V 30/1456: {based on user interactions}
- G06T 2207/30176: Document
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

Character recognition processing is executed on a document image, and a candidate segmentation point is specified in a character string of a recognition result of the character recognition processing. In response to a user specifying a desired position on the document image displayed, a character string corresponding to the specified position is set as an output target and the candidate segmentation point is displayed. In a case where the candidate segmentation point is operated by the user, the character string set as the output target is changed to a character string obtained by segmentation based on the operated candidate segmentation point.

## Claims

### Claim 1

A system comprising:
a recognition unit configured to execute character recognition processing on a document image;
a candidate segmentation unit configured to specify a candidate segmentation point in a character string of a recognition result of the character recognition processing;
a display unit configured to display the document image, set a character string corresponding to a position specified by a user on the displayed document image as an output target, and display the candidate segmentation point; and
a change unit configured to change, in a case where the displayed candidate segmentation point is operated by the user, the character string set as the output target to a character string based on the candidate segmentation point.

### Claim 2 (depends on 1)

The system according to claim 1, further comprising:
a text segmentation unit configured to segment the character string of the recognition result, using a regular expression definition which associates a regular expression with a parameter relating to a whitespace character,
wherein the candidate segmentation unit specifies the candidate segmentation point in the character string of the recognition result and in a character string obtained by segmentation performed by the text segmentation unit.

### Claim 3 (depends on 1)

The system according to claim 1, wherein the display unit sets the character string corresponding to the specified position, identifiably displays an area corresponding to the character string on the document image, and displays the candidate segmentation point.

### Claim 4 (depends on 1)

The system according to claim 1, wherein the candidate segmentation unit specifies the candidate segmentation point, based on a position of a predetermined character in a character string.

### Claim 5 (depends on 4)

The system according to claim 4, wherein the candidate segmentation unit searches for the position of the predetermined character in the character string, using a regular expression definition which associates a regular expression for searching for the predetermined character with a parameter relating to a whitespace character, and specifies the candidate segmentation point, based on the searched position.

### Claim 6 (depends on 4)

The system according to claim 4, wherein the predetermined character is a whitespace character, and the candidate segmentation unit specifies the candidate segmentation point, based on a position of the whitespace character in a character string.

### Claim 7 (depends on 4)

The system according to claim 4, wherein the candidate segmentation unit specifies the candidate segmentation point, based on a position of a colon in a character string.

### Claim 8 (depends on 4)

The system according to claim 4, wherein the predetermined character is a semicolon, and the candidate segmentation unit specifies the candidate segmentation point, based on a position of the semicolon in a character string.

### Claim 9 (depends on 1)

The system according to claim 1, wherein the change unit changes the character string set as the output target to a character string segmented based on the candidate segmentation point, in response to a predetermined operation performed by the user on the displayed candidate segmentation point.

### Claim 10 (depends on 1)

The system according to claim 1, wherein, in response to specifying of the position on the displayed document image by the user, the display unit highlights an area of a character string corresponding to the specified position and displays the candidate segmentation point in a manner to be specified.

### Claim 11 (depends on 1)

The system according to claim 1, further comprising a server and a terminal,
wherein the server includes the recognition unit and the candidate segmentation unit, and
wherein the terminal includes the display unit and the change unit.

### Claim 12

An apparatus comprising:
a recognition unit configured to execute character recognition processing on a document image;
a candidate segmentation unit configured to specify a candidate segmentation point in a character string of a recognition result of the character recognition processing; and
a transmission unit configured to transmit information about the document image, the character string of the recognition result, and the candidate segmentation point to a terminal,
wherein the terminal which receives the information displays the document image, sets a character string corresponding to a position specified by a user on the displayed document image as an output target, displays the candidate segmentation point, and, in a case where the displayed candidate segmentation point is operated by the user, changes the character string set as the output target to a character string based on the candidate segmentation point.

### Claim 13

A method comprising:
executing character recognition processing on a document image;
specifying a candidate segmentation point in a character string of a recognition result of the character recognition processing;
displaying the document image, in the displaying, a character string corresponding to a position specified by a user on the displayed document image being set as an output target and the candidate segmentation point being displayed; and
changing, in a case where the displayed candidate segmentation point is operated by the user, the character string set as the output target to a character string based on the candidate segmentation point.

### Claim 14 (depends on 13)

The method according to claim 13, further comprising:
segmenting the character string of the recognition result, using a regular expression definition which associates a regular expression with a parameter relating to a whitespace character,
wherein the segmenting specifies the candidate segmentation point in the character string of the recognition result and in a character string obtained by segmentation performed by segmenting.

### Claim 15 (depends on 13)

The method according to claim 13, wherein the displaying sets the character string corresponding to the specified position, identifiably displays an area corresponding to the character string on the document image, and displays the candidate segmentation point.

### Claim 16 (depends on 13)

The method according to claim 13, wherein the segmenting specifies the candidate segmentation point, based on a position of a predetermined character in a character string.

### Claim 17

A non-transitory computer readable storage medium storing a program for causing a processor to perform:
executing character recognition processing on a document image;
specifying a candidate segmentation point in a character string of a recognition result of the character recognition processing;
displaying the document image, in the displaying, a character string corresponding to a position specified by a user on the displayed document image being set as an output target and the candidate segmentation point being displayed; and
changing, in a case where the displayed candidate segmentation point is operated by the user, the character string set as the output target to a character string based on the candidate segmentation point.

### Claim 18 (depends on 17)

The non-transitory computer readable storage medium according to claim 17, wherein the processor further performs:
segmenting the character string of the recognition result, using a regular expression definition which associates a regular expression with a parameter relating to a whitespace character,
wherein the segmenting specifies the candidate segmentation point in the character string of the recognition result and in a character string obtained by segmentation performed by segmenting.

### Claim 19 (depends on 17)

The non-transitory computer readable storage medium according to claim 17, wherein the displaying sets the character string corresponding to the specified position, identifiably displays an area corresponding to the character string on the document image, and displays the candidate segmentation point.

### Claim 20 (depends on 17)

The non-transitory computer readable storage medium according to claim 17, wherein the segmenting specifies the candidate segmentation point, based on a position of a predetermined character in a character string.
