Method for performing acceleration procedure to accelerate inference procedure of large language model

A non-transitory machine-readable medium for storing a program code, wherein when loaded and executed by a processor, the program code instructs the processor to perform a method for performing an acceleration procedure to accelerate an inference procedure of a large language model (LLM);

• and the method comprises:
• performing a first drafting procedure to generate multiple first draft tokens;
• according to first draft information related to the multiple first draft tokens, determining whether a first rule is met in order to generate a first determination result, wherein the first rule corresponds to the first acceleration procedure;
• in response to the first determination result indicating that the first rule is not met, performing a second drafting procedure to generate multiple second draft tokens;
• obtaining multiple formal draft tokens at least based on the multiple second draft tokens;
• inputting the multiple formal draft tokens to the LLM in order to generate multiple target tokens;
• and
• performing a matching operation upon the multiple formal draft tokens and the multiple target tokens to generate at least one output token of the LLM.