US 12,755,110 B1Granted

Taint-aware, entropy-based set block decoding for language model-based token prediction

AssigneeIntuit Inc.

InventorsSagiv Antebi, Shirli Di Castro Shashua, Ofir Ben Shoham, Shai Ardazi

Life of this patent

Estimating the term…

Loading patent…

Abstract

Certain aspects of the disclosure provide techniques for language model token prediction. A method generally includes processing an input token sequence to generate, for each respective token position of a plurality of token positions in an output token sequence: an entropy score based on a probability distribution for a set of candidate output tokens associated with the respective token position; and a taint score indicative of an extent to which the probability distribution is influenced by a untrusted subset of tokens of the input token sequence; for each respective token position, determining whether the entropy score satisfies an adjusted entropy threshold that is based on at least the taint score associated with the respective token position; based on the determination for each respective token position: performing a set block decoding operation; performing a single-token decoding operation; or generating a message in accordance with a refusal policy.

Claims20

Dependent claims

A method of token prediction, comprising:

processing an input token sequence to generate, for each respective token position of a plurality of token positions in an output token sequence:
an entropy score based on a probability distribution for a set of candidate output tokens associated with the respective token position, wherein the probability distribution comprises a probability score for each respective candidate output token in the set of candidate output tokens;
and
a taint score indicative of an extent to which the probability distribution is influenced by a first subset of tokens, of the input token sequence, marked as untrusted input;
for each respective token position, determining whether the entropy score associated with the respective token position satisfies an adjusted entropy threshold associated with the respective token position, wherein the adjusted entropy threshold is based on at least the taint score associated with the respective token position;
based on the determination for each respective token position:
performing a set block decoding operation to generate a first version of the output token sequence that includes at least two output tokens that correspond to at least two token positions of the plurality of token positions in the output token sequence;
performing a single-token decoding operation to generate a second version of the output token sequence that includes a single output token that corresponds to a single token position of the plurality of token positions in the output token sequence;
or
generating a message in accordance with a refusal policy;
and
outputting the first version of the output token sequence, the second version of the output token sequence, or the message.

9 more elements

A processing system comprising one or more processors and one or more memories coupled with the one or more processors and configured to cause the processing system to:

process an input token sequence to generate, for each respective token position of a plurality of token positions in an output token sequence:
an entropy score based on a probability distribution for a set of candidate output tokens associated with the respective token position, wherein the probability distribution comprises a probability score for each respective candidate output token in the set of candidate output tokens;
and
a taint score indicative of an extent to which the probability distribution is influenced by a first subset of tokens, of the input token sequence, marked as untrusted input;
for each respective token position, determine whether the entropy score associated with the respective token position satisfies an adjusted entropy threshold associated with the respective token position, wherein the adjusted entropy threshold is based on at least the taint score associated with the respective token position;
based on the determination for each respective token position:
perform a set block decoding operation to generate a first version of the output token sequence that includes at least two output tokens that correspond to at least two token positions of the plurality of token positions in the output token sequence;
perform a single-token decoding operation to generate a second version of the output token sequence that includes a single output token that corresponds to a single token position of the plurality of token positions in the output token sequence;
or
generate a message in accordance with a refusal policy;
and
output the first version of the output token sequence, the second version of the output token sequence, or the message.

9 more elements

Dependencies are inferred from the claim text.