Capability aware language model with improved computational efficiency
AssigneeIntuit Inc.
InventorsShai Ardazi, Ofir Ben Shoham, Matan Vetzler, Sagiv Antebi
Life of this patent
Estimating the term…
Loading patent…
AssigneeIntuit Inc.
InventorsShai Ardazi, Ofir Ben Shoham, Matan Vetzler, Sagiv Antebi
Estimating the term…
A method including receiving an input to a language model having an initial computational efficiency. During processing the language model outputs a first boundary token during a selected execution phase of the language model. Prior to the selected execution phase, the language model is modified with a designated pruning weight mask. The language model also outputs, during processing, a second boundary token during a subsequent execution phase. Prior to the subsequent execution phase, the language model is modified with a successive pruning weight mask. At least one of the designated pruning weight mask and the successive pruning weight mask modifies the language model to have final computational efficiency greater than the initial computational efficiency. The language model generates a number of tokens during the execution phases, and the tokens are returned.
A method comprising:
A system comprising:
Dependencies are inferred from the claim text.