Fast Speculative Decoding Using Multiple Parallel Drafts
AssigneeGoogle Inc.
InventorsZiteng Sun, Ananda Theertha Suresh, Jae Hun Ro, Ahmad Beirami, Himanshu Jain, Xinnan Yu, Michael Dennis Riley, Sanjiv Kumar
Life of this patent
Estimating the term…