Generative response engine using chain-of-thought reasoning
AssigneeOpenAI OpCo, LLC
InventorsPeter Vidani, Valerie Qi
Life of this patent
Estimating the term…
Loading patent…
AssigneeOpenAI OpCo, LLC
InventorsPeter Vidani, Valerie Qi
Estimating the term…
The present technology pertains to a generative response system (system) that includes a chain-of-thought (CoT) reasoning model. The system receives a prompt for a response, wherein the response benefits from multi-step, CoT reasoning. The prompt is tokenized to generate input tokens, which can also include tokens representing a contextual conversation history. A first machine learning (ML) model having a CoT functionality processes the input tokens, generating reasoning tokens, which explore one or more reasoning frameworks for responding to the prompt. The combination of the first and second tokens is processed to generate output tokens representing the response sent to the requester. The second tokens are not provided to the requester and are omitted from the chat history. However, a summary of the multi-step reasoning framework used to generate the response can be generated based on the second tokens and presented to the requester.
A method of performing chain-of-thought (CoT) reasoning using one or more machine learning (ML) models, the method comprising:
A computing apparatus comprising:
A non-transitory computer-readable storage medium, the computer-readable storage medium including instructions that when executed by a computer, cause the computer to:
Dependencies are inferred from the claim text.