Self-speculative decoding using forecasted embeddings in autoregressive generative artificial intelligence models

A processor-implemented method for machine learning, comprising:

• receiving an input prompt for processing;
• generating a set of forecasted parameters for the input prompt using a parameter prediction model;
• generating, using a generative artificial intelligence model, a response to the input prompt based on the input prompt and the set of forecasted parameters;
• and
• outputting the generated response.

A processing system comprising:

• means for receiving an input prompt for processing;
• means for generating a set of forecasted parameters for the input prompt using a parameter prediction model;
• means for generating, using a generative artificial intelligence model, a response to the input prompt based on the input prompt and the set of forecasted parameters;
• and
• means for outputting the generated response.