US 2025/0095641 A1Published application

Large language model (llm)-based correction based on a multi-tool prompt

AssigneeAmazon Technologies, Inc.

InventorDeepak Babu Rajaram Piskala

Life of this patent

Estimating the term…

Loading patent…

Abstract

Techniques for large language model (LLM)-based correction based on a multi-tool prompt are described. In an example, a computer system receives, via a user interface, user input including user-provided information and indicating a request for a task to be performed on the user-provided information. The computer system generates, by using an LLM associated with a prompt, a first input to a first tool based on the user input. The prompt indicating a sequence of steps to perform for the task and tools available to the LLM. The first tool corresponds to a first step of the sequence of steps. The computer system determines, by using the LLM, a first output of the first tool in response to the first input and an update to the user-provided information based on the first output and a completion of the task. The computer system causes the user interface to present the update.

Claims20

Dependent claims

A computer-implemented method comprising:

receiving, via a user interface, user input including user-provided information and indicating a request for a task to be performed on the user-provided information, the task comprising text correction, the user-provided information comprising text that is output by an automatic speech recognition (ASR) process and that includes a first entity identifier;
generating, by using a large language model associated with a prompt, a first input to a first tool based at least in part on the user input, the prompt indicating a sequence of steps to perform for the task, a plurality of tools available to the large language model, and an execution format for each step, the first tool corresponding to a first step of the sequence of steps, the first input being based at least in part on a first execution format for the first step;
determining, by using the large language model, a first output of the first tool in response to the first input;
determining, by using the large language model, that a second step of the sequence is to be performed based at least in part on the first output;
generating, by using the large language model, a second input to a second tool based at least in part on the first output, the second tool corresponding to the second step, the second input being based at least in part on a second execution format for the second step;
determining, by using the large language model, a second output of the second tool in response to the second input;
determining, by using the large language model, an update to the user-provided information based at least in part on the second output and a completion of the task, the update comprising a correction to the first entity identifier;
and
causing the user interface to present the update.

6 more elements

One or more computer-readable storage media storing instructions that, upon execution on a system, cause the system to perform operations comprising:

receiving, via a user interface, user input including user-provided information and indicating a request for a task to be performed on the user-provided information;
generating, by using a large language model associated with a prompt, a first input to a first tool based at least in part on the user input, the prompt indicating a sequence of steps to perform for the task and a plurality of tools available to the large language model, the first tool corresponding to a first step of the sequence of steps;
determining, by using the large language model, a first output of the first tool in response to the first input;
determining, by using the large language model, an update to the user-provided information based at least in part on the first output and a completion of the task;
and
causing the user interface to present the update.

3 more elements

Dependencies are inferred from the claim text.

Facts

Application: 18/369,049Filed 15 Sep 2023
Published: 20 Mar 2025
Term ends: Not estimatedThe source records don’t support an estimate.

Classification6 codes

G06F 16/3329
Query formulation: natural language query formulation
G10L 15/183
Using natural language modelling: using context dependencies, e.g. language models
G06F 16/3344
Query execution: using natural language analysis
G06F 16/338
Querying: presentation of query results

Family

US 12,444,412 B2Related patent
US 2025/0095641 A1This patent

From the US filing history. Foreign family members aren’t listed.

Timeline

Citations

Open elsewhere

Building an agent or pulling many patents? Use the API or MCP server instead of scraping pages. Get an API key