Methods and apparatuses for recognizing text, recognition devices and storage media
AssigneeShanghai Goldway Intelligent Transportation System Co., Ltd.
InventorLiang Qiao
Life of this patent
Estimating the term…
Abstract
Methods and an apparatuses for recognizing a text, recognition devices and storage media are provided, which belong to the field of text detections. A method includes: extracting, by the recognition device, a feature map of a to-be-recognized image, then determining segmentation information of a text region of the to-be-recognized image based on a preset segmentation network and the feature map, and then determining boundary key points in the text region based on the segmentation information, and then converting a text in the text region into a text with a target arrangement sequence based on the boundary key points and then inputting the text obtained by conversion into a preset recognition model for recognition processing.
Claims18
A method of recognizing a text, comprising:
- according to a preset feature extraction network and a to-be-recognized image, extracting a feature map of the to-be-recognized image;
- providing the feature map to a preset segmentation network, determining segmentation information of a text region of the to-be-recognized image;
- according to the segmentation information, determining boundary key points in the text region;
- according to the boundary key points, converting a text in the text region into a text with a target arrangement sequence;
- and
- inputting the text obtained by conversion into a preset recognition model for recognition processing;
- wherein according to the segmentation information, determining the boundary key points in the text region comprising:
- according to offsets between each pixel point in a first boundary region and two boundary key points in the first boundary region in the segmentation information, determining position information of the two boundary key points in the first boundary region;
- and according to offsets between each pixel point in a second boundary region and two boundary key points in the second boundary region in the segmentation information, determining position information of the two boundary key points in the second boundary region, wherein the first boundary region is located at a head portion of the text region, and the second boundary region is located at a tail portion of the text region;
- and
- according to the position information of the two boundary key points in the first boundary region and the position information of the two boundary key points in the second boundary region, determining other boundary key points other than boundary key points in the first boundary region and boundary key points in the second boundary region in the text region.
A recognition device, wherein the recognition device comprises a processor and a memory, the memory stores at least one computer instruction and the at least one computer instruction is loaded and run by the processor to implement operations comprising:
- according to a preset feature extraction network and a to-be-recognized image, extracting a feature map of the to-be-recognized image;
- providing the feature map to a preset segmentation network , determining segmentation information of a text region of the to-be-recognized image;
- according to the segmentation information, determining boundary key points in the text region;
- according to the boundary key points, converting a text in the text region into a text with a target arrangement sequence;
- and
- inputting the text obtained by conversion into a preset recognition model for recognition processing,
- wherein according to the segmentation information, determining the boundary key points in the text region comprising:
- according to offsets between each pixel point in a first boundary region and two boundary key points in the first boundary region in the segmentation information, determining position information of the two boundary key points in the first boundary region;
- and according to offsets between each pixel point in a second boundary region and two boundary key points in the second boundary region in the segmentation information, determining position information of the two boundary key points in the second boundary region, wherein the first boundary region is located at a head portion of the text region, and the second boundary region is located at a tail portion of the text region;
- and
- according to the position information of the two boundary key points in the first boundary region and the position information of the two boundary key points in the second boundary region, determining other boundary key points other than boundary key points in the first boundary region and boundary key points in the second boundary region in the text region.
A non-transitory computer readable storage medium, wherein the computer readable storage medium stores at least one computer instruction which is loaded and run by a processor to implement operations comprising:
- according to a preset feature extraction network and a to-be-recognized image, extracting a feature map of the to-be-recognized image;
- providing the feature map to a preset segmentation network, determining segmentation information of a text region of the to-be-recognized image;
- according to the segmentation information, determining boundary key points in the text region;
- according to the boundary key points, converting a text in the text region into a text with a target arrangement sequence;
- and
- inputting the text obtained by conversion into a preset recognition model for recognition processing;
- wherein according to the segmentation information, determining the boundary key points in the text region comprising:
- according to offsets between each pixel point in a first boundary region and two boundary key points in the first boundary region in the segmentation information, determining position information of the two boundary key points in the first boundary region;
- and according to offsets between each pixel point in a second boundary region and two boundary key points in the second boundary region in the segmentation information, determining position information of the two boundary key points in the second boundary region, wherein the first boundary region is located at a head portion of the text region, and the second boundary region is located at a tail portion of the text region;
- and
- according to the position information of the two boundary key points in the first boundary region and the position information of the two boundary key points in the second boundary region, determining other boundary key points other than boundary key points in the first boundary region and boundary key points in the second boundary region in the text region.
Dependencies are inferred from the claim text.