Importance signaling tokens in generative neural network context blocks
AssigneeGDM Holding LLC
InventorsDanny Karmon, Ilia Labzovsky
Life of this patent
Estimating the term…
Loading patent…
AssigneeGDM Holding LLC
InventorsDanny Karmon, Ilia Labzovsky
Estimating the term…
Methods, systems and apparatus for incorporating importance signaling tokens in generative neural network context blocks. In one aspect a user query is received and multiple data chunks for the user query are retrieved. Values of one or more significance metrics for each of one or more data chunks of the multiple data chunks are obtained. A context block for the user query is generated. The context block comprises the one or more data chunks and respective tokens that indicate the values of the one or more significance metrics for the one or more data chunks. An input that includes the user query and the context block is processed using a generative neural network to generate a response to the user query. The response to the user query is output.
A computer implemented method comprising:
A system comprising one or more computers and one or more storage devices storing instructions that are operable, when executed by the one or more computers, to cause the one or more computers to perform operations comprising:
A non-transitory computer storage medium encoded with instructions that, when executed by one or more computers, cause the one or more computers to perform operations comprising:
Dependencies are inferred from the claim text.