Multimodal Large Language Model That Learns to Correct Itself, Focusing on Automated Speech Recognition
AssigneeGoogle Inc.
InventorsQuan Wang, Fadi Biadsy, Yonghui Xiao, Youzheng Chen
Life of this patent
Estimating the term…
Loading patent…
AssigneeGoogle Inc.
InventorsQuan Wang, Fadi Biadsy, Yonghui Xiao, Youzheng Chen
Estimating the term…
A method includes receiving a prompt directed towards an assistant large language model (LLM) and generating, using the assistant LLM, a sequence of output tokens based on the prompt. The sequence of output tokens includes a sequence of textual tokens including one or more correct textual tokens and one or more incorrect textual tokens, and one or more revision tokens each indicating a corresponding N number of incorrect textual tokens generated prior to the respective revision token and corresponding replacement textual tokens generated after the respective revision token for replacement of the corresponding N number of incorrect textual tokens. The method also includes generating a revised sequence of output tokens for the prompt based on the sequence of output tokens.
A computer-implemented method executed on data processing hardware that causes the data processing hardware to perform operations comprising:
A system comprising:
Dependencies are inferred from the claim text.