Maintaining item identity in translated images
AssigneeAmazon Technologies, Inc.
InventorsMichael Opitz, Sujith Gunjur Umapathy, Nikhil Garg, Angel Noe Martinez Gonzalez, Nadine Behrmann, Epameinondas Antonakos
Life of this patent
Estimating the term…
Abstract
Systems and methods are provided for selectively translating text present in an infographic image describing an item. Text is identified within an image and classified as to-be-translated or not-to-be-translated text. The to-be-translated text is removed from the image to create and empty image. The to-be translated text is translated from a first language to a second language. The layout of the empty image is modified based on the translated text. The translated text is superimposed on the modified empty image.
Claims20
A system comprising:
- at least one processor, and
- at least one non-transitory storage media storing instructions that, when executed by the at least one processor, cause the at least one processor to:
- detect text within an image, wherein the text comprises one or more lines of text, and wherein the text is in a first language;
- identify one or more bounding boxes associated with the one or more lines of text within the image;
- classify a first portion of the text as text to be translated and a second portion of the text as text not to be translated;
- group the one or more lines of the text associated with the first portion of the text into one or more semantic groups;
- translate, each of the one or more semantic groups of the first portion of the text, from the first language to a second language;
- generate an empty image by removing the first portion of text from the image, wherein the empty image comprises the second portion of the text;
- modify a text layout of at least one text box associated with the empty image based on the translated first portion of the text;
- and
- render a localized image comprising the empty image superimposed with the translated first portion of the text.
A computer-implemented method, comprising:
- identifying one or more bounding boxes associated with one or more lines of text within an image;
- classifying a first portion of the text as text to be translated and a second portion of the text as text not to be translated;
- grouping one or more lines of the text associated with the first portion into one or more semantic groups;
- generating an empty image by removing the first portion of text from the image;
- translating the first portion of the text from a first language to a second language, based on the one or more semantic groups;
- modifying a text layout within the empty image based on the translated first portion of the text;
- and
- rendering a localized image comprising the empty image superimposed with the translated first portion of the text.
A non-transitory storage media storing instructions that, when executed by at least one processor, cause the at least one processor to:
- detect text within an image;
- classify a first portion of the text as text to be translated and a second portion of the text as text not to be translated;
- translate the first portion of the text;
- and
- render the image with the second portion of the text and the translated first portion of the text.
Dependencies are inferred from the claim text.