Back to results
US 12,456,455 B2Granted
Natural-language based order processing
AssigneeNCR Voyix Corporation
InventorsEmma Marie Chadwick, Trisha Bhandary, Vishal Bilagi, T'Avvion Jones, Harnoor Singh
Life of this patent
Estimating the term…
Abstract
A customer is detected at a drive-thru and a natural language voice dialogue session is established with the customer. The customer provides voice inquiries and order details via speech during the session, the speech is translated to text sentences, and commands are issued to a transaction system through an Application Programming Interface (API) based on the text of the sentences. The transaction system updates a display associated with the drive-thru based on the commands processed for the session and places an order for the customer with a Point-Of-Sale (POS) terminal associated with the drive-thru based on the order details.
Claims19
A method, comprising:
- detecting a presence of a customer at a device equipped with a plurality of peripheral devices including at least a microphone and a speaker, and optionally a camera or a motion sensor;
- initiating a natural-language voice dialogue with the customer during a session based on the detected presence, wherein the natural-language voice dialogue is facilitated by a session manager configured to establish the session via speech captured by the microphone;
- translating voice statements of the customer during the session to order details of an order using a dialogue application programming interface (API) translator that converts audio speech of the customer into text structured sentences or text commands;
- placing the order with a transaction system associated with the device based on the order details, wherein the transaction system interacts with fulfillment terminals at a store to communicate the order and the order details for fulfillment and delivery to the customer;
- and
- providing a location identifier associated with a geographical location of the device to the dialogue API translator, wherein the location identifier configures the dialogue API translator for a dialect or accent used in the geographical location when translating the voice statements;
- wherein the transaction system is configured to update a display associated with the device with results based on sending commands to the transaction system using the dialogue API translator;
- wherein the display is updated in real-time as the customer provides voice statements during the session to show a visual representation of ordered items;
- wherein the session manager uses the dialogue API translator to instruct the transaction system to begin an order for the customer at the store associated with the device, which causes a menu of items associated with the store to be rendered and presented on the display associated with the device for customer viewing.
6 more elements
A method, comprising:
- receiving voice statements audibly communicated by a customer through a microphone of a device associated with a store to take an order of the customer with the store during a session;
- translating the voice statements into text during the session using a dialogue application programming interface (API) translator that is configured to convert audio speech of the customer into text structure sentences or text commands;
- wherein translating comprises:
- providing a location identifier associated with a geographical location of the device and the voice statements to a voice-to-text service and receiving the text as output from the voice-to-text service, wherein the location identifier configures the voice-to-text service for a dialect, or an accent used in the geographical location when translating the voice statements into the text;
- mapping select text to commands associated with a transaction system of the store using a session manager that establishes a natural language voice session or dialogue with the customer;
- sending the commands through an API for processing by the transaction system;
- assembling order details from the session;
- placing the order with the transaction system using the API, wherein the transaction system is configured to interact with fulfillment terminals at the store to communicate the order and the order details for fulfillment and delivery to the customer;
- and
- establishing the natural language voice session through a cloud processing environment comprising a plurality of servers logically cooperating and accessible as a single server;
- wherein the transaction system is configured to update a display associated with the device with results based on sending the commands to the transaction system using the API;
- wherein the display is updated in real-time as the customer provides voice statements during the session to show a visual representation of ordered items;
- wherein the session manager plays a natural language greeting to the customer over a speaker that welcomes the customer and asks what the customer would like to order today.
10 more elements
A system, comprising:
- a cloud processing environment comprising at least one server;
- the at least one server comprising a processor and a non-transitory computer-readable storage medium;
- the non-transitory computer-readable storage medium comprises executable instructions;
- and
- the executable instructions when executed on the processor from the non-transitory computer-readable storage medium cause the processor to perform operations comprising:
- engaging a customer in a natural-language dialogue at a drive-thru device of a store to take an order of the customer with the store;
- translating voice statements of the customer into one or more of an inquiry, an ordered item, and a customization of a given ordered item using a dialogue application programming interface (API) translator that converts audio speech of the customer into text structured sentences or text commands;
- providing commands to a transaction system associated with one or more of the inquiry, the ordered item, and the customization of the given ordered item using an API;
- translating feedback from the transaction system into automated speech played to the customer over a speaker of the drive-thru device during a session;
- confirming order details for the order during the session;
- placing the order with the transaction system with the order details using the API, wherein the transaction system is configured to interact with fulfillment terminals at the store to communicate the order and the order details for fulfillment and delivery to the customer, and wherein the transaction system is configured to update a display associated with the drive-thru device with results based on sending the commands to the transaction system using the API;
- and
- wherein the cloud processing environment comprises a plurality of servers logically cooperating and accessible as a single server, and wherein a session manager provides a location identifier to the dialogue API translator that configures the dialogue API translator for a dialect or accent used in a geographic location of the store;
- wherein the transaction system sends a confirmation back to the session manager and the session manager plays speech over the speaker of the drive-thru device that instructs the customer to pull forward or to pull into a designated parking spot to await delivery of the order.
11 more elements
Dependencies are inferred from the claim text.