Self evolution decoding

A system comprising one or more computers and one or more storage devices storing instructions that are operable, when executed by the one or more computers, to cause the one or more computers to perform operations comprising:

• processing, by a Large Language Model (LLM) of N layers, an input by an inference operation of the LLM;
• obtaining, from the LLM, logits of an evolution layer of the LLM, the evolution layer being subsequent to a first layer of the LLM;
• for a plurality of layers that occur before the evolution layer, processing the logits of the layer with the logits of the evolution layer to generate an approximated gradient;
• based on the approximated gradient and the logits of the evolution layer, generating adjusted logits for the evolution layer;
• and
• processing the adjusted logits for the evolution layer to generate an output for the LLM.

A computer storage medium encoded with instructions that, when executed by one or more computers, cause the one or more computers to perform operations comprising:

• processing, by a Large Language Model (LLM) of N layers, an input by an inference operation of the LLM;
• obtaining, from the LLM, logits of an evolution layer of the LLM, the evolution layer being subsequent to a first layer of the LLM;
• for each of a plurality of layers that occur before the evolution layer, processing the logits of the layer with the logits of the evolution layer to generate an approximated gradient;
• based on the approximated gradient and the logits of the evolution layer, generating adjusted logits for the evolution layer;
• and
• processing the adjusted logits for the evolution layer to generate an output for the LLM.