Number encoding for enhanced large language model (llm) numerical reasoning
AssigneeInternational Business Machines Corporation
InventorsELIYAHU SCHWARTZ, Assaf Arbelle, LESHEM CHOSHEN
Life of this patent
Estimating the term…
Abstract
A numerical value is obtained and the numerical value is preprocessed by adding a digit count before the numerical value to generate a modified numerical value, the digit count indicating a count of digits in the numerical value. The modified numerical value is provided to a machine learning model pretrained to understand the modified numerical value that comprises the digit count and the modified numerical value is processed using the pre-trained machine learning model.
Claims20
A computer-implemented method comprising:
- obtaining a numerical value;
- preprocessing the numerical value by adding a digit count before the numerical value to generate a modified numerical value, the digit count indicating a count of digits in the numerical value;
- providing the modified numerical value to a machine learning model pretrained to understand the modified numerical value that comprises the digit count;
- and
- processing the modified numerical value using the pretrained machine learning model.
A computer program product, comprising:
- one or more tangible computer-readable storage media and program instructions stored on at least one of the one or more tangible computer-readable storage media, the program instructions executable by a processor, the program instructions comprising:
- obtaining a numerical value;
- preprocessing the numerical value by adding a digit count before the numerical value to generate a modified numerical value, the digit count indicating a count of digits in the numerical value;
- providing the modified numerical value to a machine learning model pretrained to understand the modified numerical value that comprises the digit count;
- and
- processing the modified numerical value using the pre-trained machine learning model.
A system comprising:
- a memory;
- and
- at least one processor, coupled to said memory, and operative to perform operations comprising:
- obtaining a numerical value;
- preprocessing the numerical value by adding a digit count before the numerical value to generate a modified numerical value, the digit count indicating a count of digits in the numerical value;
- providing the modified numerical value to a machine learning model pretrained to understand the modified numerical value that comprises the digit count;
- and
- processing the modified numerical value using the pre-trained machine learning model.
Dependencies are inferred from the claim text.