Processing of images with text
AssigneeCanva Pty Ltd
InventorsSanchit Sanchit, Alexander Tack
Life of this patent
Estimating the term…
Abstract
Image processing techniques are described, including techniques in which text data associated with an image is used to determine a font of text in an image. The image is split into a plurality of crops based on the text data. A trained machine learning model is used to determine feature vectors of the image. The feature vectors are combined into a combined feature vector. A second trained machine learning model is used to determine a font using the combined feature vector. The second trained machine learning model may be a multi-layer perceptron network. The second trained machined learning model may be trained on a plurality of images with text of known fonts and properties. The described image processing techniques also include text removal.
Claims20
A method for determining a font for text in an image, the method comprising:
- extracting a plurality of crops of an image, the plurality of crops including at least one non-square crop of the image, wherein each non-square crop of the image is located within a group text area, the group text area encompassing a group of the text in the image and determined based on text data associated with the image, the text data comprising location information for text in the image;
- determining, by a first trained machine leaning model, a feature vector for each of the crops of the image;
- combining the feature vectors to form a combined feature vector;
- determining, by a second trained machine learning model provided with the combined feature vector as an input, a class probability value for each of a plurality of classes, the plurality of classes corresponding to fonts;
- and
- determining a font for the group of text in the image as the font having the highest determined class probability value.
Dependencies are inferred from the claim text.