Information processing device, information processing method, and recording medium that has recorded information processing program

An information processing device comprising:

• an image database for storing an image as a search target;
• character string region extraction means for extracting a character string region including a character string in the image stored in the image database;
• character candidate recognition means for specifying a plurality of character candidates through execution of character recognition from the image, for each of characters forming the character string in the character string region extracted by the character string region extraction means, wherein the plurality of character candidates are obtained for each character of the character string;
• character candidate storage means for storing a character string consisting of a combination of some of the plurality of character candidates specified by the character candidate recognition means, in correspondence with the image as the specifying origin of the character candidates;
• search keyword input means for inputting a search keyword;
• search means for performing a search to determine whether each of characters forming the keyword input by the keyword input means matches any of character strings stored by the character candidate storage means, in a sequence of the keyword;
• and
• output means for outputting a result of the search by the search means, based on the correspondence between the character string and the image stored by the character candidate storage means,
• wherein the character candidate recognition means evaluates correctness of the character recognition on each of the character candidates specified in the character recognition and ranks each of the character candidates obtained for the same character based on the evaluated correctness,
• wherein the character candidate storage means stores the character string, based on information indicative of the correctness evaluated by the character candidate recognition means,
• wherein the search means is configured so that when each of the characters forming the keyword matches any of the character strings stored by the character candidate storage means, the search means evaluates reliability on the match based on a ranking of the matched character candidate, and determines a number of character candidates to be compared with each character of the keyword according to a number of the characters of the keyword, and determines character string to be judged on the match with the keyword having the determined number of character candidates, from the information indicative of the correctness on the character candidates, and
• wherein the output means outputs the result of the search, also based on the reliability.

An information processing method by an information processing device comprising an image database for storing an image as a search target, the method comprising:

• a character string region extraction step of extracting a character string region including a character string in the image stored in the image database;
• a character candidate recognition step of specifying a plurality of character candidates through execution of character recognition from the image, for each of characters forming the character string in the character string region extracted in the character string region extraction step, wherein the plurality of character candidates are obtained for each character of the character string;
• a character candidate storage step of storing the plurality of character candidates specified by the character candidate recognition step, in correspondence with the image as the specifying origin of the character candidates;
• a search keyword input step of inputting a search keyword;
• a search step of performing a search to determine whether each of characters forming the keyword input in the keyword input step matches any of the plurality of character candidates obtained for the each character of the character string stored in the character candidate storage step, in a sequence of the keyword;
• and
• an output step of outputting a result of the search in the search step, based on the correspondence between the character candidates and the image stored in the character candidate storage step,
• wherein in the character candidate recognition step, correctness of the character recognition on each of the character candidates specified in the character recognition is evaluated and each of the character candidates obtained for the same character is ranked based on the evaluated correctness,
• wherein in the character candidate storage step, the character candidates, based on information indicative of the correctness evaluated in the character candidate recognition step is stored,
• wherein in the search step, when each of the characters forming the keyword matches any of the plurality of character candidates stored in the character candidate storage step, reliability on the match is evaluated based on a ranking of the matched character candidate, and a number of character candidates to be compared with each character of the keyword is determined according to a number of the characters of the keyword, and character candidates to be judged on the match with the keyword having the determined number of character candidates are determined, from the information indicative of the correctness on the character candidates, and
• wherein in the output step, the result of the search is output, also based on the reliability.

An information processing method by an information processing device comprising an image database for storing an image as a search target, the method comprising:

• a character string region extraction step of extracting a character string region including a character string in the image stored in the image database;
• a character candidate recognition step of specifying a plurality of character candidates through execution of character recognition from the image, for each of characters forming the character string in the character string region extracted in the character string region extraction step, wherein the plurality of character candidates are obtained for each character of the character string;
• a character candidate storage step of storing a character string consisting of a combination of some of the plurality of character candidates specified by the character candidate recognition step, in correspondence with the image as the specifying origin of the character candidates;
• a search keyword input step of inputting a search keyword;
• a search step of performing a search to determine whether each of characters forming the keyword input in the keyword input step matches any of character strings stored in the character candidate storage step, in a sequence of the keyword;
• and
• an output step of outputting a result of the search in the search step, based on the correspondence between the character string and the image stored in the character candidate storage step,
• wherein in the character candidate recognition step, correctness of the character recognition on each of the character candidates specified in the character recognition is evaluated and each of the character candidates obtained for the same character is ranked based on the evaluated correctness,
• wherein in the character candidate storage step, the character string, based on information indicative of the correctness evaluated in the character candidate recognition step is stored,
• wherein in the search step, when each of the characters forming the keyword matches any of the character strings stored in the character candidate storage step, reliability on the match is evaluated based on a ranking of the matched character candidate, and a number of character candidates to be compared with each character of the keyword is determined according to a number of the characters of the keyword, and character string to be judged on the match with the keyword having the determined number of character candidates is determined, from the information indicative of the correctness on the character candidates, and
• wherein in output step, the result of the search is output, also based on the reliability.

A non-transitory computer-readable recording medium that has recorded an information processing program to make at least one computer function as:

• an image database for storing an image as a search target;
• character string region extraction means for extracting a character string region including a character string in the image stored in the image database;
• character candidate recognition means for specifying a plurality of character candidates through execution of character recognition from the image, for each of characters forming the character string in the character string region extracted by the character string region extraction means, wherein the plurality of character candidates are obtained for each character of the character string;
• character candidate storage means for storing the plurality of character candidates specified by the character candidate recognition means, in correspondence with the image as the specifying origin of the character candidates;
• search keyword input means for inputting a search keyword;
• search means for performing a search to determine whether each of characters forming the keyword input by the keyword input means matches any of the plurality of character candidates obtained for the each character of the character string stored by the character candidate storage means, in a sequence of the keyword;
• and
• output means for outputting a result of the search by the search means, based on the correspondence between the character candidates and the image stored by the character candidate storage means,
• wherein the character candidate recognition means evaluates correctness of the character recognition on each of the character candidates specified in the character recognition and ranks each of the character candidates obtained for the same character based on the evaluated correctness,
• wherein the character candidate storage means stores the character candidates, based on information indicative of the correctness evaluated by the character candidate recognition means,
• wherein the search means is configured so that when each of the characters forming the keyword matches any of the plurality of character candidates stored by the character candidate storage means, the search means evaluates reliability on the match based on a ranking of the matched character candidate, and determines a number of character candidates to be compared with each character of the keyword according to a number of the characters of the keyword, and determines character candidates to be judged on the match with the keyword having the determined number of character candidates, from the information indicative of the correctness on the character candidates, and
• wherein the output means outputs the result of the search, also based on the reliability.

A non-transitory computer-readable recording medium that has recorded an information processing program to make at least one computer function as:

• an image database for storing an image as a search target;
• character string region extraction means for extracting a character string region including a character string in the image stored in the image database;
• character candidate recognition means for specifying a plurality of character candidates through execution of character recognition from the image, for each of characters forming the character string in the character string region extracted by the character string region extraction means, wherein the plurality of character candidates are obtained for each character of the character string;
• character candidate storage means for storing a character string consisting of a combination of some of the plurality of character candidates specified by the character candidate recognition means, in correspondence with the image as the specifying origin of the character candidates;
• search keyword input means for inputting a search keyword;
• search means for performing a search to determine whether each of characters forming the keyword input by the keyword input means matches any of character strings stored by the character candidate storage means, in a sequence of the keyword;
• and
• output means for outputting a result of the search by the search means, based on the correspondence between the character string and the image stored by the character candidate storage means,
• wherein the character candidate recognition means evaluates correctness of the character recognition on each of the character candidates specified in the character recognition and ranks each of the character candidates obtained for the same character based on the evaluated correctness,
• wherein the character candidate storage means stores the character string, based on information indicative of the correctness evaluated by the character candidate recognition means,
• wherein the search means is configured so that when each of the characters forming the keyword matches any of the character strings stored by the character candidate storage means, the search means evaluates reliability on the match based on a ranking of the matched character candidate, and determines a number of character candidates to be compared with each character of the keyword according to a number of the characters of the keyword, and determines character string to be judged on the match with the keyword having the determined number of character candidates, from the information indicative of the correctness on the character candidates, and
• wherein the output means outputs the result of the search, also based on the reliability.

An information processing device comprising:

• an image database for storing an image as a search target;
• at least one memory operable to store program code;
• at least one processor operable to read said program code and operate as instructed by said program code, said program code including:
• character string region extraction code that causes the at least one processor to extract a character string region including a character string in the image stored in the image database;
• character candidate recognition code that causes the at least one processor to specify a plurality of character candidates through execution of character recognition from the image, for each of characters forming the character string in the character string region extracted by the character string region extraction code, wherein the plurality of character candidates are obtained for each character of the character string;
• character candidate storage code that causes the at least one processor to extract for storing the plurality of character candidates specified by the character candidate recognition code, for each of the characters, in correspondence with the image as the specifying origin of the character candidates;
• search keyword input code for inputting a search keyword;
• search code that causes the at least one processor to perform a search to determine whether each of characters forming the keyword input by the keyword input code matches any of the plurality of character candidates obtained for the each character of the character string stored by the character candidate storage code, in a sequence of the keyword;
• and
• output code that causes the at least one processor to output a result of the search by the search code, based on the correspondence between the character candidates and the image stored by the character candidate storage code,
• wherein the character candidate recognition code that causes the at least one processor to output evaluate correctness of the character recognition on each of the character candidates specified in the character recognition and ranks each of the character candidates obtained for the same character based on the evaluated correctness,
• wherein the character candidate storage code that causes the at least one processor to store the character candidates, based on information indicative of the correctness evaluated by the character candidate recognition code,
• wherein the search code is configured so that when each of the characters forming the keyword matches any of the plurality of character candidates stored by the character candidate storage code, the search code that causes the at least one processor to evaluate reliability on the match based on a ranking of the matched character candidate, and determines a number of character candidates to be compared with each character of the keyword according to a number of the characters of the keyword, and determines character candidates to be judged on the match with the keyword having the determined number of character candidates, from the information indicative of the correctness on the character candidates, and
• wherein the output code that causes the at least one processor to output the result of the search, also based on the reliability.

An information processing device comprising:

• an image database for storing an image as a search target;
• at least one memory operable to store program code;
• at least one processor operable to read said program code and operate as instructed by said program code, said program code including:
• character string region extraction code that causes the at least one processor to extract a character string region including a character string in the image stored in the image database;
• character candidate recognition code that causes the at least one processor to specify a plurality of character candidates through execution of character recognition from the image, for each of characters forming the character string in the character string region extracted by the character string region extraction code, wherein the plurality of character candidates are obtained for each character of the character string;
• character candidate storage code that causes the at least one processor to store a character string consisting of a combination of some of the plurality of character candidates specified by the character candidate recognition code, in correspondence with the image as the specifying origin of the character candidates;
• search keyword input code that causes the at least one processor to input a search keyword;
• search code that causes the at least one processor to perform a search to determine whether each of characters forming the keyword input by the keyword input code matches any of character strings stored by the character candidate storage code, in a sequence of the keyword;
• and
• output code that causes the at least one processor to output a result of the search by the search code, based on the correspondence between the character string and the image stored by the character candidate storage code,
• wherein the character candidate recognition code that causes the at least one processor to evaluate correctness of the character recognition on each of the character candidates specified in the character recognition and ranks each of the character candidates obtained for the same character based on the evaluated correctness,
• wherein the character candidate storage code that causes the at least one processor to store the character string, based on information indicative of the correctness evaluated by the character candidate recognition code,
• wherein the search code is configured so that when each of the characters forming the keyword matches any of the character strings stored by the character candidate storage code, the search code that causes the at least one processor to evaluate reliability on the match based on a ranking of the matched character candidate, and determines a number of character candidates to be compared with each character of the keyword according to a number of the characters of the keyword, and determines character string to be judged on the match with the keyword having the determined number of character candidates, from the information indicative of the correctness on the character candidates, and
• wherein the output code that causes the at least one processor to output the result of the search, also based on the reliability.

A non-transitory computer-readable recording medium that has recorded an information processing program to make at least one computer function as:

• an image database for storing an image as a search target;
• at least one memory operable to store program code;
• at least one processor operable to read said program code and operate as instructed by said program code, said program code including:
• character string region extraction code that causes the at least one processor to extract a character string region including a character string in the image stored in the image database;
• character candidate recognition code that causes the at least one processor to specify a plurality of character candidates through execution of character recognition from the image, for each of characters forming the character string in the character string region extracted by the character string region extraction code, wherein the plurality of character candidates are obtained for each character of the character string;
• character candidate storage code that causes the at least one processor to store the plurality of character candidates specified by the character candidate recognition code, in correspondence with the image as the specifying origin of the character candidates;
• search keyword input code that causes the at least one processor to input a search keyword;
• search code that causes the at least one processor to perform a search to determine whether each of characters forming the keyword input by the keyword input code matches any of the plurality of character candidates obtained for the each character of the character string stored by the character candidate storage code, in a sequence of the keyword;
• and
• output code that causes the at least one processor to output a result of the search by the search code, based on the correspondence between the character candidates and the image stored by the character candidate storage code,
• wherein the character candidate recognition code that causes the at least one processor to evaluate correctness of the character recognition on each of the character candidates specified in the character recognition and ranks each of the character candidates obtained for the same character based on the evaluated correctness,
• wherein the character candidate storage code that causes the at least one processor to store the character candidates, based on information indicative of the correctness evaluated by the character candidate recognition code,
• wherein the search code is configured so that when each of the characters forming the keyword matches any of the plurality of character candidates stored by the character candidate storage code, the search code that causes the at least one processor to evaluate reliability on the match based on a ranking of the matched character candidate, and determines a number of character candidates to be compared with each character of the keyword according to a number of the characters of the keyword, and determines character candidates to be judged on the match with the keyword having the determined number of character candidates, from the information indicative of the correctness on the character candidates, and
• wherein the output code that causes the at least one processor to output the result of the search, also based on the reliability.

A non-transitory computer-readable recording medium that has recorded an information processing program to make at least one computer function as:

• an image database for storing an image as a search target;
• at least one memory operable to store program code;
• at least one processor operable to read said program code and operate as instructed by said program code, said program code including:
• character string region extraction code that causes the at least one processor to extract a character string region including a character string in the image stored in the image database;
• character candidate recognition code that causes the at least one processor to specify a plurality of character candidates through execution of character recognition from the image, for each of characters forming the character string in the character string region extracted by the character string region extraction code, wherein the plurality of character candidates are obtained for each character of the character string;
• character candidate storage code that causes the at least one processor to store a character string consisting of a combination of some of the plurality of character candidates specified by the character candidate recognition code, in correspondence with the image as the specifying origin of the character candidates;
• search keyword input code that causes the at least one processor to input a search keyword;
• search code that causes the at least one processor to perform a search to determine whether each of characters forming the keyword input by the keyword input code matches any of character strings stored by the character candidate storage code, in a sequence of the keyword;
• and
• output code that causes the at least one processor to output a result of the search by the search code, based on the correspondence between the character string and the image stored by the character candidate storage code,
• wherein the character candidate recognition code that causes the at least one processor to evaluate correctness of the character recognition on each of the character candidates specified in the character recognition and ranks each of the character candidates obtained for the same character based on the evaluated correctness,
• wherein the character candidate storage code that causes the at least one processor to store the character string, based on information indicative of the correctness evaluated by the character candidate recognition code,
• wherein the search code is configured so that when each of the characters forming the keyword matches any of the character strings stored by the character candidate storage code, the search code that causes the at least one processor to evaluate reliability on the match based on a ranking of the matched character candidate, and determines a number of character candidates to be compared with each character of the keyword according to a number of the characters of the keyword, and determines character string to be judged on the match with the keyword having the determined number of character candidates, from the information indicative of the correctness on the character candidates, and
• wherein the output code that causes the at least one processor to output the result of the search, also based on the reliability.