Event-triggered question generation for multi-modal content retrieval
AssigneeAmazon Technologies, Inc.
InventorsPratyay Banerjee, Ankit Chadha
Life of this patent
Estimating the term…
Abstract
Devices and techniques are generally described for event-triggered multimodal enrichment and question generation in search. First event data may be received from an event stream. A first prompt for a first language model may be generated. The first prompt may include the first event data and a first request to generate at least a first question associated with the first event data. The first language model may generate the first question and a first answer to the first question based at least in part on the first prompt. A first entry for a search index may be generated. The first entry may include the first question as a key value and the first entry may associate the first question with the first answer.
Claims20
A computer-implemented method comprising:
- receiving, using an asynchronous event driven architecture, a first event stream comprising a plurality of event messages;
- determining first event message data of the plurality of event messages, the first event message data describing a first event of the first event stream;
- retrieving past event data by performing a first semantic search using the first event message data as a first query to query a first data structure;
- determining past question data and past answer data associated with the past event data in the first data structure;
- inputting first prompt data into a language model, the first prompt data comprising the first event message data, the past event data, the past question data, the past answer data, and an instruction to generate a new question that is answerable using the first event message data;
- generating, by the language model in response to the first prompt data, the new question and a new answer for the new question using the new question and the first event message data;
- and
- generating an entry in a first search index comprising the new question, the new answer, and a first timestamp, wherein the new question is a key value in the first search index, and wherein the first timestamp identifies a time associated with the first event message data.
A computer-implemented method comprising:
- receiving, by a first computing device from an asynchronous interface, first event data from an event stream;
- generating a first prompt for a first language model, the first prompt comprising the first event data and a first request to generate at least a first question associated with the first event data;
- generating, by the first language model based at least in part on the first prompt, the first question and a first answer to the first question;
- and
- generating a first entry for a search index, the first entry comprising the first question as a key value, wherein the first entry associates the first question with the first answer.
A system comprising:
- at least one processor;
- and
- non-transitory computer-readable memory storing instructions that, when executed by the at least one processor, are effective to:
- receive, by a first computing device from an asynchronous interface, first event data from an event stream;
- generate a first prompt for a first language model, the first prompt comprising the first event data and a first request to generate at least a first question associated with the first event data;
- generate, by the first language model based at least in part on the first prompt, the first question and a first answer to the first question;
- and
- generate a first entry for a search index, the first entry comprising the first question as a key value, wherein the first entry associates the first question with the first answer.
Dependencies are inferred from the claim text.