Integrating multi-channel inputs to determine user preferences
AssigneeIntuit Inc.
InventorsBenjamin Indyk, Igor A. Podgorny, Raymond Chan
Life of this patent
Estimating the term…
Abstract
Systems of the present disclosure adjust an interface mode of an application based on paralinguistic features of audio input. The audio input is via a microphone associated with a computing device. A predictive model uses paralinguistic features of the audio input and additional features received from sensors or a user profile to predict an interface mode that a user would currently prefer to use. The interface mode specifies how output is provided and how input is received. The interface mode may also specify which elements of a graphical user interface are displayed, where the elements are placed, and how the elements are sized.
Claims20
A method for adjusting a user interface of an application, the method comprising:
- receiving audio input from a user interacting with an application on a mobile device;
- extracting application instructions from the audio input based on verbal content of the audio input;
- extracting paralinguistic features from the audio input, based on non-verbal content of the audio input;
- providing the paralinguistic features as inputs to a predictive model configured to predict a preferred user interface mode for the application;
- receiving, from the predictive model, a predicted preferred user interface mode for the application;
- activating the predicted preferred user interface mode of the application;
- activating a predictive input mode associated with the predicted preferred user interface mode;
- receiving a partial application input from the user while in the predicted preferred user interface mode;
- providing a predicted complete application input to the user;
- and
- providing application output based on the predicted complete application input via the predicted preferred user interface mode.
A method for adjusting a user interface of an application, the method comprising:
- receiving audio input from a user interacting with an application on a mobile device;
- extracting application instructions from the audio input based on verbal content of the audio input;
- extracting paralinguistic features from the audio input based on non-verbal content of the audio input, wherein the paralinguistic features indicate that the user is moving;
- receiving sensor data from a sensor of the mobile device;
- providing the paralinguistic features and the sensor data as inputs to a predictive model configured to predict a preferred user interface mode for the application;
- receiving, from the predictive model, a predicted preferred user interface mode for the application;
- activating the predicted preferred user interface mode of the application by:
- changing a mode of providing application output;
- and
- changing a screen sensitivity of a touch-screen display of the mobile device;
- and
- providing application output via the predicted preferred user interface mode based on the application instructions.
A method for adjusting a user interface of an application, the method comprising:
- receiving audio input from a user interacting with an application on a mobile device;
- extracting application instructions from the audio input based on verbal content of the audio input;
- extracting paralinguistic features from the audio input, based on non-verbal content of the audio input, wherein the paralinguistic features indicate the user is in a noisy environment;
- providing the paralinguistic features as inputs to a predictive model configured to predict a preferred user interface mode for the application;
- receiving, from the predictive model, a predicted preferred user interface mode of the application;
- activating the predicted preferred user interface mode of the application by:
- changing a mode of providing application output;
- and
- hiding one or more user interface elements of the application;
- and
- providing application output via the predicted preferred user interface mode based on the application instructions.
Dependencies are inferred from the claim text.