Translating images based on semantic information

A system comprising:

• a memory component;
• and
• a processing device coupled to the memory component, the processing device to perform operations comprising:
• receiving an embedding vector at a connection between an encoding path and a decoding path of a machine learning model, the embedding vector including encoded semantic information describing features of a domain of a digital image;
• and
• training the machine learning model on the domain of the digital image while decoding the encoded semantic information of the embedding vector using the decoding path of the machine learning model.

A non-transitory computer-readable storage medium storing executable instructions, which when executed by a processing device, cause the processing device to perform operations comprising:

• receiving an input image in a first format, encoded semantic information describing a domain of the input image, and a selection of a second format;
• decoding the encoded semantic information using a machine learning model;
• generating an output image in the second format by translating the input image from the first format to the second format using the machine learning model, the machine learning model guided by the decoded semantic information;
• and
• displaying the output image in the second format in a user interface.