# US 2024/0202465 A1 · Information processing apparatus, controlling method of information processing apparatus, and storage medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0202465 A1
- Document ID: US20240202465A1
- Status: Published application
- Kind: A1
- Application number: 18/540,694
- Filed: 2023-12-14
- Published: 2024-06-20
- Earliest claimed: 2022-12-20
- Assignees: Canon Kabushiki Kaisha
- Applicants: Canon Kabushiki Kaisha
- Inventors: YOSUKE IGARASHI
- Web page: https://patentgrep.com/patent/US20240202465A1

## CPC

- G06T 11/60: Creating or editing images; Combining images with text
- G06F 40/169: Annotation, e.g. comment data or footnotes
- G06F 40/47: Machine-assisted translation, e.g. using translation memory
- G06F 40/58: Use of machine translation, e.g. for multi-lingual retrieval, for server-side translation for client devices or for real-time translation
- G06T 11/20: Drawing from basic elements
- G06V 10/945: {User interactive design; Environments; Toolboxes}
- G06V 20/70: Labelling scene content, e.g. deriving syntactic or semantic representations
- G06V 30/191: {Design or setup of recognition systems or techniques; Extraction of features in feature space; Clustering techniques; Blind source separation}
- G06V 30/30: based on the type of data
- G06F 40/51: Translation evaluation
- G06T 2200/24: involving graphical user interfaces [GUIs]
- G06V 30/10: Character recognition
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

An information processing apparatus according to the present disclosure acquires a translation text by executing a translation process on an input text; selects one or more consecutive characters in the translation text as a selection text, based on a user operation; assigns a label selected based on a user operation, to a character string corresponding to the selection text in the input text; and stores the input text to which the label has been assigned, in a storage unit.

## Claims

### Claim 1

An information processing apparatus comprising:
at least one memory that stores instructions; and
at least one processor that executes the instructions to:
acquire a translation text by executing a translation process on an input text;
select one or more consecutive characters in the translation text as a selection text, based on a user operation;
assign a label selected based on a user operation, to a character string corresponding to the selection text in the input text; and
store the input text to which the label has been assigned, in a storage unit.

### Claim 2 (depends on 1)

The information processing apparatus according to claim 1,
wherein the at least one processor executes the instructions further to:
acquire an input image;
acquire the input text and an input text area representing a coordinate range of the input text, by executing a character recognition process on the input image; and
display, based on the translation text and the input text area, a translation image generated by drawing the translation text to a layout similar to that of the input image, on a display,
wherein the selection text is selected by the user operation on the translation image displayed on the display.

### Claim 3 (depends on 2)

The information processing apparatus according to claim 2,
wherein the at least one processor executes the instructions further to:
acquire, in the translation process, a translation text area by executing translation for each input text area; and
assign, in a case where the selection text matches an entire text of the translation text area to which the selection text belongs, the selected label to an entire text of the input text area corresponding to the translation text area selected based on the user operation.

### Claim 4 (depends on 2)

The information processing apparatus according to claim 2,
wherein the at least one processor executes the instructions further to:
acquire, in the translation process, a translation text area by executing translation for each input text area;
search for the character string corresponding to the selection text from a text of the input text area corresponding to the translation text area to which the selection text belongs; and
assign, in a case where the character string corresponding to the selection text is found, the selected label to the found character string.

### Claim 5 (depends on 2)

The information processing apparatus according to claim 2,
wherein the at least one processor executes the instructions further to:
acquire, in the translation process, a translation text area by executing translation for each input text area;
search for the character string corresponding to the selection text from a text of the input text area corresponding to the translation text area to which the selection text belongs; and
assign, in a case where the character string corresponding to the selection text is not found, the label to an entire text of the input text area corresponding to the translation text area to which the selection text belongs, and further assign a flag.

### Claim 6 (depends on 2)

The information processing apparatus according to claim 2,
wherein the at least one processor executes the instructions further to:
display an image acquired by trimming from the input image the input text area corresponding to a translation text area to which the selection text belongs, at a position near the translation text area to which the selection text belongs.

### Claim 7 (depends on 2)

The information processing apparatus according to claim 2,
wherein the at least one processor executes the instructions further to:
display, on the display, the input image and the translation image side by side in their entirety on a same screen.

### Claim 8

A controlling method of an information processing apparatus, the controlling method comprising:
acquiring a translation text by executing a translation process on an input text;
selecting one or more consecutive characters in the translation text as a selection text, based on a user operation;
assigning a label selected based on a user operation, to a character string corresponding to the selection text in the input text; and
storing the input text to which the label has been assigned, in a storage unit.

### Claim 9

A non-transitory computer-readable storage medium that stores a program of instructions wherein the instructions cause at least one processor to:
acquire a translation text by executing a translation process on an input text;
select one or more consecutive characters in the translation text as a selection text, based on a user operation;
assign a label selected based on a user operation, to a character string corresponding to the selection text in the input text; and
store the input text to which the label has been assigned, in a storage unit.
