Language-agnostic OCR extraction

A system comprising:

• at least one memory;
• and
• at least one processor coupled to the at least one memory;
• wherein the at least one memory comprises instructions that, when executed by the at least one processor cause the at least one processor to perform operations comprising:
• identifying a word region of an image using optical character recognition;
• the word region comprises a set of bounding box coordinates;
• applying a language agnostic machine learning model to the word region;
• the language agnostic machine learning model is trained on training data comprising a set of image-text pairs and a set of multilingual text translation pairs;
• receiving, from the language agnostic machine learning model, a word region embedding that is associated with the word region;
• searching a multilingual index for a text embedding that matches the word region embedding;
• receiving, from the multilingual index, text associated with the text embedding;
• and
• using at least one of the text or the text embedding to determine whether or how to display the image via a user interface at a device.