US 11,907,676 B1Granted

Processing orchestration for systems including distributed components

AssigneeAmazon Technologies, Inc.

InventorJoe Pemberton

Life of this patent

Estimating the term…

Loading patent…

Abstract

Techniques for implementing a streaming remote procedure call (RPC) mechanism using distributed processing components of a system are described. A first processing component sends a connect message to a second processing component. Thereafter, the first processing component sends different instances of data to the second processing component as the different instances of data are determined by the first processing component. The second processing component performs at least some processes as the second processing component receives the different instances of data. After the first processing component sends all relevant data to the second processing component, the first processing component sends a commit message to the second processing component. Based at least in part on receiving the commit message, the second processing component determines finishes its processing, and sends result data to the first processing component.

Claims20

Dependent claims

A computer-implemented method comprising:

receiving, from a first device, first audio data representing a spoken natural language input;
determining a user identifier associated with the first audio data;
sending, by an orchestrator component and to a first processing component, first data representing the orchestrator component will be sending a first plurality of data types to the first processing component to enable the first processing component to select, from among a plurality of processing components, a processing component configured to determine a response to the spoken natural language input;
after sending the first data, sending, by the orchestrator component, the user identifier to the first processing component;
performing automatic speech recognition (ASR) processing on the first audio data to determine ASR output data;
performing natural language understanding (NLU) processing on the ASR output data to determine NLU output data;
after sending the first data and the user identifier, sending, by the orchestrator component, the NLU output data to the first processing component;
after sending the NLU output data and the user identifier, sending, by the orchestrator component and to the first processing component, second data representing the first processing component has received all of the first plurality of data types to be sent to the first processing component by the orchestrator component;
after sending the second data, receiving, from the first processing component, third data representing a second processing component is to determine the response to the spoken natural language input;
and
causing the second processing component to determine the response to the spoken natural language input.

8 more elements

A computer-implemented method comprising:

receiving first data representing a user command;
determining a first processing component is to send a plurality of data types to a second processing component;
sending, by the first processing component and to the second processing component, second data representing the first processing component will be sending the plurality of data types to the second processing component to enable the second processing component to perform processing with respect to the user command;
determining third data corresponding to the user command, the third data corresponding to a first data type of the plurality of data types;
after sending the second data, sending, by the first processing component, the third data to the second processing component;
after sending the third data, determining fourth data corresponding to the user command, the fourth data corresponding to a second data type of the plurality of data types;
after sending the second data and the third data, sending, by the first processing component, the fourth data to the second processing component, wherein sending the fourth data after sending the third data enables the second processing component to process with respect to the third data at least partially in parallel to the fourth data being determined;
after sending the third data and the fourth data, sending, by the first processing component and to the second processing component, fifth data representing the second processing component has received all of the plurality of data types to be sent to the second processing component by the first processing component;
after sending the fifth data, receiving, from the second processing component, sixth data determined from processing of at least the third data and the fourth data by the second processing component;
and
based at least in part on the sixth data, determining output data responsive to the user command.

8 more elements

A computing system, comprising:

at least one processor;
and
at least one memory comprising instructions that, when executed by the at least one processor, cause the computing system to:
receive first data representing a user command;
determine a first processing component is to send a plurality of data types to a second processing component;
send, by the first processing component and to the second processing component, second data representing the first processing component will be sending the plurality of data types to the second processing component to enable the second processing component to perform processing with respect to the user command;
determine third data corresponding to the user command, the third data corresponding to a first data type of the plurality of data types;
after sending the second data, send, by the first processing component, the third data to the second processing component;
after sending the third data, determine fourth data corresponding to the user command, the fourth data corresponding to a second data type of the plurality of data types;
after sending the second data and the third data, send, by the first processing component, the fourth data to the second processing component, wherein sending the fourth data after sending the third data enables the second processing component to process with respect to the third data at least partially in parallel to the fourth data being determined;
after sending the third data and the fourth data, send, by the first processing component and to the second processing component, fifth data representing the second processing component has received all of the plurality of data types to be sent to the second processing component by the first processing component;
after sending the fifth data, receive, from the second processing component, sixth data determined from processing of at least the third data and the fourth data by the second processing component;
and
based at least in part on the sixth data, determine output data responsive to the user command.

11 more elements

Dependencies are inferred from the claim text.