# US 12,182,595 B2 · Virtual assistant focused user interfaces > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,182,595 B2 - Document ID: US12182595B2 - Status: Granted - Kind: B2 - Application number: 17/404,189 - Filed: 2021-08-17 - Published: 2021-12-02 - Granted: 2024-12-31 - Earliest claimed: 2013-04-18 - Assignees: Verint Americas Inc. - Applicants: Verint Americas Inc. - Inventors: Fred A. Brown; Tanya M. Miller; Richard Morris - Web page: https://patentgrep.com/patent/US12182595B2 ## CPC - G06F 9/453: {Help systems} - A61K 39/12: Viral antigens - C07K 16/1145: {Env proteins, e.g. gp41, gp110/120, gp160, V3, principal neutralising domain [PND] or CD4-binding site} - C07K 16/2812: {against CD4} - G06F 3/0488: using a touch-screen or digitiser, e.g. input of commands through traced gestures - G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback} - G06Q 10/02: Reservations, e.g. for tickets, services or events - G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue - A61K 2039/5254: {avirulent or attenuated} - A61K 2039/575: {humoral response} - C12N 2740/16122: New viral proteins or individual genes, new structural or functional aspects of known viral proteins or genes - C12N 2740/16134: Use of virus or viral component as vaccine, e.g. live-attenuated or inactivated virus, VLP, viral protein - G06F 3/0482: Interaction with lists of selectable items, e.g. menus - G06F 3/0486: Drag-and-drop - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - A61K: PREPARATIONS FOR MEDICAL, DENTAL OR TOILETRY PURPOSES (devices or methods specially adapted for bringing pharmaceutical products into particular physical or administering forms A61J3/00; chemical aspects of, or use of materials for deodorisation of air, for disinfection or sterilisation, or for bandages, dressings, absorbent pads or surgical articles A61L; soap compositions C11D) - C07K: PEPTIDES (peptides in foodstuffs A23; obtaining protein compositions for foodstuffs, working-up proteins for foodstuffs A23J; preparations for medicinal purposes A61K; peptides containing beta-lactam rings C07D; cyclic dipeptides not having in their molecule any other peptide link than those which form their ring, e.g. piperazine-2,5-diones, C07D; ergot alkaloids of the cyclic peptide type C07D519/02; macromolecular compounds having statistically distributed amino acid units in their molecules, i.e. when the preparation does not provide for a specific; but for a random sequence of the amino acid units, homopolyamides and block copolyamides derived from amino acids C08G69/00; macromolecular products derived from proteins C08H1/00; preparation of glue or gelatine C09H; single cell proteins, enzymes C12N; genetic engineering processes for obtaining peptides C12N15/00; compositions for measuring or testing processes involving enzymes C12Q; investigation or analysis of biological material G01N33/00) - G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR - G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING - C12N: MICROORGANISMS OR ENZYMES; COMPOSITIONS THEREOF; PROPAGATING, PRESERVING, OR MAINTAINING MICROORGANISMS; MUTATION OR GENETIC ENGINEERING; CULTURE MEDIA (microbiological testing media C12Q1/00) ## Abstract Conversation user interfaces that are configured for virtual assistant interaction may include contextual interface items that are based on contextual information. The contextual information may relate to a current or previous conversation between a user and a virtual assistant and/or may relate to other types of information, such as a location of a user, an orientation of a device, missing information, and so on. The conversation user interfaces may additionally, or alternatively, control an input mode based on contextual information, such as an inferred input mode of a user or a location of a user. Further, the conversation user interfaces may tag conversation items by saving the conversation items to a tray and/or associating the conversation items with indicators. ## Claims ### Claim 1 One or more non-transitory computer-readable storage media storing computer-readable instructions that, when executed, instruct one or more processors to perform operations comprising: causing a conversation user interface to be presented by a smart device to enable a conversation between a user of the smart device and a virtual assistant implemented at least in part by the smart device; receiving an input request through the conversation user interface from the user that is received during the current conversation between the user and the virtual assistant [wherein the input from the user is open to multiple interpretations]; identifying, by natural language processing, multiple interpretations of the input request; identifying contextual information that is related to the conversation between the user and the virtual assistant; and causing one or more contextual conversation items to be presented within the conversation user interface based at least in part on the contextual information, wherein the one or more contextual conversation items comprise a mixed response information indication item that includes a first subitem that identifies a task associated with [satisfies] one of the multiple interpretations of the input request of the user and a second subitem that identifies a second task associated with [satisfies] another of the multiple interpretations of the input request of the user, and wherein the first and second subitems are each presented partly behind the mixed response information indication item so that a portion of each subitem is hidden behind the mixed response information indication item and a second portion of each subitem is displayed; and receiving a selection of the first or second subitem to present information in the first or second subitem in the conversation user interface and to execute the task associated therewith. ### Claim 2 (depends on 1) The one or more non-transitory computer-readable storage media of claim 1, wherein the contextual information comprises at least one of a location of a user, an event associated with a user, environmental data obtained by a sensor of the smart device, a preference of the user, conversation history of the user with the virtual assistant in the current conversation, or conversation history of the user with virtual assistant in a previous conversation. ### Claim 3 (depends on 1) The one or more non-transitory computer-readable storage media of claim 1, wherein: the contextual information comprises event information related to a future event associated with the user; and the one or more contextual conversation items comprise information that is relevant to the future event associated with the user, the information being personalized for the user based on previous interactions of the user with the virtual assistant. ### Claim 4 (depends on 1) The one or more non-transitory computer-readable storage media of claim 1, wherein: the contextual information comprises a portion of information that is needed for the virtual assistant to perform a task; and the one or more contextual conversation items comprise a missing information item that indicates that the portion of the information has been obtained and indicates that another portion of the information is needed for the virtual assistant to perform the task. ### Claim 5 (depends on 1) The one or more non-transitory computer-readable storage media of claim 1, wherein: the contextual information comprises an input mode that is currently used by the user to interact with the virtual assistant; and the one or more contextual conversation items comprise a suggestion item that suggests an alternative input mode to the input mode that is currently used by the user. ### Claim 6 (depends on 1) The one or more non-transitory computer-readable storage media of claim 1, wherein: the contextual information comprises collected information that has been collected during a current conversation between the user and the virtual assistant; and the one or more contextual conversation items comprise an information item that represents the collected information in a condensed format. ### Claim 7 (depends on 1) The one or more non-transitory computer-readable storage media of claim 1, wherein the information item further represents information for a task that has been performed by the virtual assistant based on the collected information. ### Claim 8 (depends on 1) The one or more non-transitory computer-readable storage media of claim 1, wherein: the contextual information identifies an orientation of the smart device; and the one or more contextual conversation items are presented based at least in part on the orientation of the smart device. ### Claim 9 (depends on 8) The one or more non-transitory computer-readable storage media of claim 8, wherein the one or more contextual conversation items are scrollable in a horizontal direction within the conversation user interface when the identified orientation of the smart device is a portrait orientation. ### Claim 10 (depends on 9) The one or more non-transitory computer-readable storage media of claim 9, wherein the one or more contextual conversation items are presented on a timeline when the identified orientation of the smart device is a landscape orientation. ### Claim 11 (depends on 1) The one or more non-transitory computer-readable storage media of claim 1, wherein the one or more contextual conversation items comprise one or more option items representing options for the user. ### Claim 12 (depends on 1) The one or more non-transitory computer-readable storage media of claim 1, wherein the one or more contextual conversation items comprise one or more option items representing options for the user. ### Claim 13 (depends on 1) The one or more non-transitory computer-readable storage media of claim 1, further comprising controlling an input mode of the conversation user interface according to the contextual information. ### Claim 14 (depends on 13) The one or more non-transitory computer-readable storage media of claim 13, wherein the controlling comprises causing the conversation user interface to be presented with an input mode that is selected based at least in part on a location of the smart device, the conversation user interface being configured with the input mode as a primary mode of input. ### Claim 15 (depends on 13) The one or more non-transitory computer-readable storage media of claim 13, wherein: the contextual information comprises location information indicating a location of the smart device; and the controlling comprises causing the conversation user interface to be presented with an input mode that is selected based at least in part on the location of the smart device, the conversation user interface being configured with the input mode as a primary mode of input. ### Claim 16 (depends on 13) The one or more non-transitory computer-readable storage media of claim 13, wherein: the contextual information comprises input history indicating one or more input modes that the user has previously used to interact with the conversation user interface or another user interface; and the controlling comprises causing the conversation user interface to be presented with an input mode from among the one or more input modes that have been previously used by the user, the conversation user interface being configured with the input mode as a primary mode of input. ### Claim 17 (depends on 14) The one or more non-transitory computer-readable storage media of claim 14, wherein: the contextual information indicates an inferred type of input mode of the user; and the controlling comprises causing the conversation user interface to interact with the user through the inferred type of input mode of the user, the conversation user interface being configured with the input mode as a primary mode of input. ### Claim 18 (depends on 17) The one or more non-transitory computer-readable storage media of claim 17, wherein: the inferred type of input mode of the user comprises text input; and the controlling comprises displaying a keyboard within or proximate to the conversation user interface. ### Claim 19 (depends on 17) The one or more non-transitory computer-readable storage media of claim 17, wherein: the inferred type of input mode of the user comprises touch input; and the controlling comprises displaying a selectable icon to receive touch input.