Methods, apparatuses and computer program products to facilitate streaming processing of large language model inputs
OwnerFrank Torsten Bernd Seide, Yangyang Shiinventors
Life of this patent
Estimating the term…
Loading patent…
OwnerFrank Torsten Bernd Seide, Yangyang Shiinventors
Estimating the term…
A system and method to train a large language model are provided. The system may access training data including one or more events and including one or more frames of a fixed duration. The system may further generate a label sequence based on the training data, and the system may determine an interleaved embedding sequence from the label sequence. The system may further determine a probability distribution over one or more predicted tokens based at least in part on an embedding of the interleaved embedding sequence. The system may further determine a difference between the probability distribution over the one or more predicted tokens and the label sequence. The system may further modify one or more parameters of the large language model based on the determined difference.
A method, comprising:
An apparatus comprising:
A non-transitory computer-readable medium storing instructions that, when executed, cause:
Dependencies are inferred from the claim text.