Method and apparatus for detecting text

An apparatus for detecting text, comprising:

• at least one processor;
• and
• a memory storing instructions, wherein the instructions, when executed by the at least one processor, cause the at least one processor to perform operations, the operations comprising:
• extracting features of a to-be-detected image in a plurality of abstract levels using a feature extraction network of a text detection model;
• predicting, using a character detection network of the text detection mode based on the extracted features of the to-be-detected image, a probability of each pixel point in the to-be-detected image being a character pixel point, and position information of the each pixel point relative to a bounding box of a character including the pixel point when the each pixel point is the character pixel point;
• determining position information of bounding boxes of candidate characters, based on the probability of the each pixel point being the character pixel point and the position information of the each pixel point relative to the bounding box of character including the each pixel point when the each pixel point is the character pixel point;
• inputting the extracted features of the to-be-detected image into a character mapping network of the text detection model, converting a feature map outputted by the character map network based on the position information of the bounding boxes of the candidate characters, and generating character vectors characterizing features of the candidate characters;
• determining a neighboring candidate character of each candidate character in the to-be-detected image based on the position information of the bounding boxes of the candidate characters, and connecting the each candidate character with an associated neighboring candidate character to form a character set based on a degree of difference between the each candidate character and the neighboring candidate character, the degree of different being calculated using the character vector;
• and
• determining a character area of the to-be-detected image based on the position information of the bounding boxes of the candidate characters in the character set.

A non-transitory computer storage medium, storing a computer program therein, the program, when executed by a processor, causes the processor to perform operations, the operations comprising

• extracting features of a to-be-detected image in a plurality of abstract levels using a feature extraction network of a text detection model;
• predicting, using a character detection network of the text detection mode based on the extracted features of the to-be-detected image, a probability of each pixel point in the to-be-detected image being a character pixel point, and position information of the each pixel point relative to a bounding box of a character including the each pixel point when the each pixel point is the character pixel point;
• determining position information of bounding boxes of candidate characters, based on the probability of the each pixel point being the character pixel point and the position information of the each pixel point relative to the bounding box of the character including the each pixel point when the each pixel point is the character pixel point;
• inputting the extracted features of the to-be-detected image into a character mapping network of the text detection model, converting a feature map outputted by the character mapping network based on the position information of the bounding boxes of the candidate characters, and generating character vectors characterizing features of the candidate characters;
• determining a neighboring candidate character of each candidate character in the to-be-detected image based on the position information of the bounding boxes of the candidate characters, and connecting the each candidate character with an associated neighboring candidate character to form a character set based on a degree of difference between the each candidate character and the neighboring candidate character, the degree of difference being calculated using the character vectors;
• and
• determining a character area of the to-be-detected image based on the position information of the bounding boxes of the candidate characters in the character set.