# US 10,311,318 B2 · Reference line setting device, reference line setting method and reference line setting program > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,311,318 B2 - Document ID: US10311318B2 - Status: Granted - Kind: B2 - Application number: 15/554,031 - Filed: 2015-07-17 - Published: 2018-02-15 - Granted: 2019-06-04 - Earliest claimed: 2015-07-17 - Assignees: Rakuten, Inc. - Applicants: Rakuten, Inc. - Inventors: Ryota Hinami; Naoki Chiba - Web page: https://patentgrep.com/patent/US10311318B2 ## CPC - G06V 20/62: Text, e.g. of license plates, overlay texts or captions on TV images - G06V 30/18086: {by performing operations within image blocks or by using histograms} - G06T 1/0007: {Image acquisition} - G06V 30/10: Character recognition - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL ## Abstract A reference line setting device includes an image acquisition means to acquire an image containing a character region, a recognition means to recognize characters from the character region of the image by a specified recognition method, a line position information acquisition means to acquire line position information of a plurality of characters out of the characters recognized by the recognition means with reference to a storage means storing, for each character, line position information concerning a position which at least two reference lines pass through in a vertical direction of characters, the reference lines being lines drawn in an alignment direction of characters, along which a certain part of each character is to be placed, and a setting means to set each of the reference lines to the image based on a plurality of line position information for each reference line acquired by the line position information acquisition means. ## Claims ### Claim 1 A reference line setting device comprising: at least one memory configured to store computer program code; at least one processor configured to access said computer program code and operate as instructed by said computer program code, said computer program code including: image acquisition code configured to cause at least one of said at least one processor to acquire an image containing a character region; line position information acquisition code configured to cause at least one of said at least one processor to acquire line position information of a plurality of characters out of characters recognized from the character region of the image by a specified recognition method with reference to a storage means storing, for each character, line position information concerning coordinate positions in a vertical direction of characters where at least two reference lines extend in an alignment direction of characters, along which a certain part of each character is to be placed; and setting code configured to cause at least one of said at least one processor to set each of the reference lines to the image based on a plurality of line position information for each reference line acquired. ### Claim 2 (depends on 1) The reference line setting device according to claim 1, wherein the line position information acquisition code is configured to cause at least one of said at least one processor to acquire line position information indicating a position in which a first reference line passes through, and the setting code is configured to cause at least one of said at least one processor to set the first reference line by a method of least squares based on the line position information of the first reference line of a plurality of characters. ### Claim 3 (depends on 2) The reference line setting device according to claim 2, wherein the line position information is composed of a mean and a variance of a distribution of the coordinate positions in the vertical direction of characters where reference lines extend in the alignment direction of characters, and the setting code is configured to cause at least one of said at least one processor to summarize a distribution of the line position information of one reference line out of the reference lines other than the first reference line of a plurality of characters recognized from the character region of the image, and set, as the one reference line, a line passing through a position with highest probability obtained by summation of the distribution of the line position information and having the same slope as the first reference line. ### Claim 4 (depends on 2) The reference line setting device according to claim 2, wherein the line position information is composed of a mean and a variance of a distribution of the coordinate positions in the vertical direction of characters where reference lines extend in the alignment direction of characters, and the setting code is configured to cause at least one of said at least one processor to summarize a distribution of the line position information of two or more reference lines out of the reference lines other than the first reference line of a plurality of characters recognized from the character region of the image, and set the two or more reference lines passing through a position with highest probability obtained by summation of the distribution of the line position information and intersecting with the first reference line at one point. ### Claim 5 (depends on 1) The reference line setting device according to claim 1, wherein the character is an alphabetic character, the reference lines include an ascender line, a mean line, a base line and a descender line, the line position information acquisition code is configured to cause at least one of said at least one processor to acquire the line position information of the ascender line, the mean line, the base line and the descender line for each character, and the setting code is configured to cause at least one of said at least one processor to set each of the reference lines based on the line position information of the ascender line, the mean line, the base line and the descender line of a plurality of characters. ### Claim 6 (depends on 1) The reference line setting device according to claim 1, further comprising: learning code configured to cause at least one of said at least one processor to calculate the line position information of each character based on a plurality of images showing a plurality of characters to which the reference lines are set, and store the calculated line position information for each character into the storage means. ### Claim 7 (depends on 6) The reference line setting device according to claim 6, wherein the learning code is configured to cause at least one of said at least one processor to calculate, as the line position information, a mean and a variance of the coordinate positions in the vertical direction of characters where each reference line extend in the alignment direction of characters based on the plurality of characters shown in the plurality of images. ### Claim 8 (depends on 1) The reference line setting device according to claim 1, wherein the character is an alphabetic character, and the line position information acquisition code is configured to cause at least one of said at least one processor to acquire the line position information of a character whose uppercase and lowercase versions are not similar in shape. ### Claim 9 (depends on 1) The reference line setting device according to claim 1, wherein the line position information acquisition code is configured to cause at least one of said at least one processor to acquire the line position information of a character where a reliability score indicating a probability of results of character recognition from the image is equal to or more than a specified value. ### Claim 10 (depends on 1) The reference line setting device according to claim 1, wherein the alignment direction of characters include a horizontal direction. ### Claim 11 A reference line setting method in a reference line setting device, the method comprising: acquiring an image containing a character region; acquiring line position information of a plurality of characters out of characters recognized from the character region of the image by a specified recognition method with reference to a storage means storing, for each character, line position information concerning coordinate positions in a vertical direction of characters where at least two reference lines extend in an alignment direction of characters, along which a certain part of each character is to be placed; and setting each of the reference lines to the image based on a plurality of line position information for each reference line acquired.