Text refinement network
AssigneeAdobe Inc.
InventorsZhifei Zhang, Xingqian Xu, Zhaowen Wang, Brian Price
Life of this patent
Estimating the term…
Abstract
Systems and methods for text segmentation are described. Embodiments of the inventive concept are configured to receive an image including a foreground text portion and a background portion, classify each pixel of the image as foreground text or background using a neural network that refines a segmentation prediction using a key vector representing features of the foreground text portion, wherein the key vector is based on the segmentation prediction, and identify the foreground text portion based on the classification.
Claims19
A method for text segmentation, comprising:
- receiving an image including a foreground text portion and a background portion;
- encoding the image to produce a feature map;
- generating a segmentation map of the image based on the feature map, wherein the segmentation map partially identifies the foreground text portion and the background portion;
- generating a key vector representing features of the foreground text portion based on the segmentation map and the feature map;
- combining the key vector and the feature map to produce an attention map;
- and
- generating, using a neural network, a refined segmentation map by classifying each pixel of the image as foreground text or background based on the attention map and the feature map.
A method for text segmentation, comprising:
- receiving an image including a foreground text portion and a background portion;
- encoding the image to produce a feature map;
- decoding the feature map to produce a segmentation prediction;
- identifying a key vector based on the segmentation prediction, wherein the key vector represents features of the foreground text portion;
- combining the key vector and the feature map to produce an attention map;
- combining the attention map and the feature map to produce a combined feature map;
- decoding the combined feature map to produce a refined segmentation prediction;
- and
- identifying the foreground text portion based on the refined segmentation prediction.
An apparatus for text segmentation, comprising:
- one or more processors;
- and
- one or more memories including instructions executable by the one or more processors to:
- receive an image including a foreground text portion and a background portion;
- encode the image to produce a feature map;
- generate a segmentation map of the image based on the feature map, wherein the segmentation map partially identifies the foreground text portion and the background portion;
- generate a key vector representing features of the foreground text portion based on the segmentation map and the feature map;
- combine the key vector and the feature map to produce an attention map;
- and
- generate a refined segmentation map by classifying each pixel of the image as foreground text or background based on the attention map and the feature map.
Dependencies are inferred from the claim text.