US 9,431,008 B2 · Multiple parallel dialogs in smart phone applications

Abstract

An arrangement is described for conducting natural language dialogs with a user on a mobile device using automatic speech recognition (ASR) and multiple different dialog applications. A user interface provides for user interaction with the dialogue applications in natural language dialogs. An ASR engine processes unknown speech inputs from the user to produce corresponding speech recognition results. A dialog concept module develops dialog concept items from the speech recognition results and stores the dialog concept items and additional dialog information in a dialog concept database. A dialog processor accesses dialog concept database information and coordinates operation of the ASR engine and the dialog applications to conduct with the user a plurality of separate parallel natural language dialogs in the dialog applications.

Claims17

Dependent claims

A method comprising:

receiving first recognized text corresponding to first speech input from a user;
displaying a first tab of a user interface, the first tab corresponding to a first application, wherein the first tab comprises the first recognized text with an icon associated with the first application;
receiving second recognized text corresponding to second speech input from the user;
displaying, responsive to the first speech input and the second speech input, a second tab of the user interface, the second tab corresponding to a second application, wherein the second application is selected based on the second speech input;
receiving third recognized text corresponding to third speech input from the user;
and
displaying the first tab of the user interface, wherein the first tab further comprises the second recognized text with an icon associated with the second application and the third recognized text with the icon associated with the first application.

4 more elements

A method comprising:

receiving first speech input from a user;
determining a first recognized text corresponding to the first speech input;
storing, in a dialog concept database and based on the first speech input, a first dialog concept item and an associated first indicator of a first application;
displaying a user interface for the first application, the user interface for the first application comprising the first recognized text with the first indicator;
receiving second speech input from the user;
determining a second recognized text corresponding to the second speech input;
storing, in the dialog concept database and based on the second speech input, a second dialog concept item and a second indicator of a second application corresponding to the second dialog concept item;
receiving third speech input from the user;
determining a third recognized text corresponding to the third speech input;
storing, in the dialog concept database and based on the third speech input, a third dialog concept item and a third indicator of a third application corresponding to the third dialog concept item;
and
modifying the user interface for the first application to further comprise the second recognized text with the second indicator and the third recognized text with the third indicator.

9 more elements

Dependencies are inferred from the claim text.

Multiple parallel dialogs in smart phone applications

Life of this patent

Multiple parallel dialogs in smart phone applications

Life of this patent

Abstract

Claims17