US 2025/0363301 A1 · SYSTEM AND METHOD FOR TRAINING AND OPERATING LARGE LANGUAGE MODELS USING CODEWORDS

Abstract

This invention presents an optimized approach for training and operating Large Language Models (LLMs) using codewords. By converting traditional token-based LLMs to codeword-based systems, the method achieves significant efficiency gains. The process involves tokenizing training data and assigning codewords to tokens. LLMs are then trained and operated using these compact codewords instead of conventional tokens. During operation, prompts are converted to codewords, processed by the LLM, and the outputs are converted back to text. This approach reduces the overall cost of training and operating LLMs by approximately, offering a more efficient solution for large-scale language processing tasks.

Claims15

Dependent claims

A computer system comprising:

a hardware memory, wherein the computer system is configured to execute software instructions stored on nontransitory machine-readable storage media that:
tokenize a set of training data into a plurality of training tokens;
create a codeword dictionary by assigning unique codewords to each of the plurality of training tokens;
convert all training tokens into a plurality of training codewords using the codeword dictionary;
train a large language model using the plurality of training codewords;
receive a text prompt from a user;
tokenize the prompt into a plurality of prompt tokens;
convert the plurality of prompt tokens into a plurality of prompt codewords using the codeword dictionary;
process the sequence of prompt codewords through the large language model to generate a codeword response;
and
convert the codeword response into a text response.

8 more elements

Dependencies are inferred from the claim text.

System and method for training and operating large language models using codewords

Life of this patent

System and method for training and operating large language models using codewords

Life of this patent

Abstract

Claims15