US 11,907,651 B2Granted

Information processing apparatus, information processing method, and storage medium

AssigneeCanon Kabushiki Kaisha

InventorTakayuki Kawashima

Life of this patent

Estimating the term…

Loading patent…

Abstract

The information processing apparatus analyzes the results of modification performed by user for a recommended character string and determines whether there is an excess or a lack in units of predetermined character string areas in a recommended area corresponding to the recommended character string. In a case where it is determined that there is an excess or a lack as a result of the determination, a recommended character string that eliminates the excess or the lack is specified. Then, area information for specifying the recommended area, which is registered in a database, is updated so that the character string corresponding to the specified recommended area becomes the recommended character string.

Claims5

Dependent claims

An information processing apparatus for recommending, based on results of character recognition for a character area within a business form image, a specific character string to be used for setting a property of the business form image, the apparatus comprising:

one or more memories storing instructions;
and
one or more processors executing the instructions to:
specify a business form similar to an inputted business form image based on feature information indicating a feature of a specified business form registered in a database, wherein the database registers the feature information about the specified similar business form and area information about the specified similar business form in association with each other, the area information indicating a position of a character string area including a character string to be used for setting a property;
determine a recommended area in the inputted business form image based on the area information about the specified similar business form associated with the feature information about the specified similar business form;
output a character string included in the determined recommended area for setting a property of the input business form image;
analyze a modified character string into which the outputted character string is modified by a user;
and
update the database, which registers the area information about the specified similar business form, based on results of the analysis,
wherein in the analyzing,
a difference character string between the output character string and the modified character string is obtained, and
in a case where the modified character string includes both of the output character string and the difference character string, an area on a periphery of the recommended area in the input business form image is searched to specify a character string area corresponding to the difference character string,
wherein in the updating,
in a case where the character string area corresponding to the difference character string is specified on the periphery of the recommended area, the area information about the specified similar business form being registered in the database is updated so that the updated area information indicates a position of an area obtained by connecting the specified character string area with the recommended area,
wherein the updated area information is used to determine a recommended area in a newly inputted business form image in a case where a feature of the newly inputted business form image to be input next time or later is similar to a feature of the specified similar business form.

12 more elements

An information processing method for recommending, based on results of character recognition for a character area within a business form image, a specific character string to be used for setting a property of the business form, the method comprising the steps of:

specifying a business form similar to an inputted business form image based on feature information indicating a feature of a specified business form registered in a database, wherein the database registers the feature information about the specified similar business form and area information about the specified similar business form in association with each other, the area information indicating a position of a character string area including a character string to be used for setting a property;
determining a recommended area in the inputted business form image based on the area information about the specified similar business form associated with the feature information about the specified similar business form;
outputting a character string included in the determined recommended area for setting a property of the input business form image;
analyzing a modified character string into which the outputted character string is modified by a user;
and
updating the database, which registers the area information about the specified similar business form, based on results of the analysis,
wherein in the analyzing,
a difference character string between the output character string and the modified character string is obtained, and
in a case where the modified character string includes both of the output character string and the difference character string, an area on a periphery of the recommended area in the input business form image is searched to specify a character string area corresponding to the difference character string,
wherein in the updating,
in a case where the character string area corresponding to the difference character string is specified on the periphery of the recommended area, the area information about the specified similar business form being registered in the database is updated so that the updated area information indicates a position of an area obtained by connecting the specified character string area with the recommended area,
wherein the updated area information is used to determine a recommended area in a newly inputted business form image in a case where a feature of the newly inputted business form image to be input next time or later is similar to a feature of the specified similar business form.

9 more elements

A non-transitory computer readable storage medium storing a program for causing a computer to perform an information processing method for recommending, based on results of character recognition for a character area within a business form image, a specific character string to be used for setting a property of the business form, the method comprising the steps of:

specifying a business form similar to an inputted business form image based on feature information indicating a feature of a specified business form registered in a database, wherein the database registers the feature information about the specified similar business form and area information about the specified similar business form in association with each other, the area information indicating a position of a character string area including a character string to be used for setting a property;
determining a recommended area in the inputted business form image based on the area information about the specified similar business form associated with the feature information about the specified similar business form;
outputting a character string included in the determined recommended area for setting a property of the input business form image;
analyzing a modified character string into which the outputted character string is modified by a user;
and
updating the database, which registers the area information about the specified similar business form, based on results of the analysis,
wherein in the analyzing,
a difference character string between the output character string and the modified character string is obtained, and
in a case where the modified character string includes both of the output character string and the difference character string, an area on a periphery of the recommended area in the input business form image is searched to specify a character string area corresponding to the difference character string,
wherein in the updating,
in a case where the character string area corresponding to the difference character string is specified on the periphery of the recommended area, the area information about the specified similar business form being registered in the database is updated so that the updated area information indicates a position of an area obtained by connecting the specified character string area with the recommended area,
wherein the updated area information is used to determine a recommended area in a newly inputted business form image in a case where a feature of the newly inputted business form image to be input next time or later is similar to a feature of the specified similar business form.

9 more elements

Dependencies are inferred from the claim text.

Facts

Application: 17/722,177Filed 15 Apr 2022
Priority: JP 2021-07611028 Apr 2021
Published: US 2022/0350956 A13 Nov 2022
Granted: 20 Feb 2024
Term ends: Not estimatedThe source records don’t support an estimate.

Classification7 codes

G06F 40/174
Editing, e.g. inserting or deleting: form filling; Merging
G06V 30/1444
Image acquisition: selective acquisition, locating or processing of specific regions, e.g. highlighted text, fiducial marks or predetermined fields
G06V 30/412
Analysis of document content: layout analysis of documents structured with printed lines or input boxes, e.g. business forms or tables
G06V 30/418
Analysis of document content: document matching, e.g. of document images

Family

US 2022/0350956 A1Pre-grant publication · published 3 Nov 2022
US 11,907,651 B2This patent

From the US filing history. Foreign family members aren’t listed.

Timeline

Citations

Open elsewhere

Building an agent or pulling many patents? Use the API or MCP server instead of scraping pages. Get an API key