Training models for sign language translation

A system comprising:

• one or more computer readable mediums including instructions;
• one or more computing systems coupled to the one or more computer readable mediums and configured to execute the instructions to cause or direct the system to perform operations, the operations comprising:
• providing first training data to a translation system configured to translate between sign language and language data, the translation system includes a plurality of stages and each of the plurality of stages including one or more machine learning models;
• obtaining a first hypothesis output from the translation system based on the first training data;
• modifying one or more of the machine learning models based on the first hypothesis output;
• providing second training data to a first set of the plurality of stages without providing the second training data to other of the plurality of stages not included in the first set of the plurality of stages;
• obtaining a second hypothesis output from the first set of the plurality of stages based on the second training data;
• and
• modifying one or more of the machine learning models of the first set of the plurality of stages based on the second hypothesis output.