Database systems and interactive user interfaces for dynamic conversational interactions
AssigneeMerative US L.P.
InventorsMurray A. Reicher, Stewart Nickolas, David Boloker
Life of this patent
Estimating the term…
Abstract
A conversation management system provides a conversational computing interface that manages verbal exchanges between a computer (e.g., artificial intelligence) and a human operator. In a medical embodiment, conversational input from the computing system is generated based on medical knowledge, uses deep learning algorithms, and/or intelligently tracks the state of a conversation so as to the most relevant data to the user.
Claims17
A computing system configured to conduct conversations with a user regarding review and analysis of medical data, the computing system comprising:
- a computer processor configured to execute software instructions;
- an audio input device configured to provide an audio input to the computer processor;
- and
- one or more tangible non-transitory computer readable medium storing:
- a medical knowledge database storing medical information regarding a plurality of clinical data elements, including correlations between respective medical symptoms and medical diagnoses;
- a messaging backbone configured to receive messages from message producers and provide messages to message consumers;
- and
- a plurality of compute engines including at least software code configured for execution by the computer processor, the compute engines including at least:
- an utterance ingestion engine configured to convert portions of the audio input to corresponding textual input;
- a conversation manager configured to dynamically update a state of a conversation between the user and the computing system;
- a conversation engine configured to determine an intent of action of the user;
- and
- a dispatcher configured to determine a first action based on the textual input, the intent of action, context of viewing activity by the user including medical images and data previously provided to the user as a result of a conversation action, information in the medical knowledge database, and the state of the conversation,
- wherein the textual input includes a request for prior images of a patient represented within a currently-displayed image,
- wherein the first action includes providing first speech output to the user, automatically accessing the medical knowledge base to determine images of interest to the user, automatically selecting, from image storage, a plurality of prior images of the patient, and displaying the plurality of prior images of the patient for comparison by the user,
- wherein the computer processor is further configured to maintain a prioritized list of possible conversation actions, display portions of the prioritized listing in response to user input, and display at least a portion of the prioritized listing in response to a risk level to the patient exceeding a predetermined threshold, and
- wherein the dispatcher is further configured to, in response to second input from the user including a workflow command determine a second action based on the second input, the second action including providing second speech output to the user prompting the user to slow down, and provide the second speech output to the user.
A computing system comprising:
- a picture archiving and communication system (PACS) configured to view medical images;
- a medical knowledge database providing information regarding a patient, an exam, and general medical information;
- an utterance ingestion engine configured to convert portions of audio input to corresponding textual input;
- a conversation manager configured to dynamically update a state of a conversation between the user and the computing system;
- a conversation engine configured to determine an intent of action of the user;
- and
- a dispatcher configured to determine a first action based on the textual input, the intent of action, context of viewing activity by the user including medical images and data previously provided to the user as a result of an image management action, information in the medical knowledge database, and the state of the conversation, and initiate the first action at a time determined by user mouse and speech actions, past user behavior and the medical knowledge,
- wherein the textual input includes a request for prior images of a patient represented within a currently-displayed image,
- wherein the first action include providing first speech output to the user, automatically accessing the medical knowledge base to determine images of interest to the user, automatically selecting, from image storage, a plurality of prior images of the patient, and automatically displaying the plurality of prior images of the patient for comparison by the user,
- wherein the dispatcher is further configured to, in response to second input from the user including a workflow command, determine a second action based on the second input, the second action including providing second speech output to the user prompting the user to slow down, and provide the second speech output to the user.
A computing system configured to conduct conversations with a user regarding review and analysis of medical data, the computing system comprising:
- a computer processor configured to execute software instructions;
- and
- one or more tangible non-transitory computer readable medium storing the software instructions, the software instructions including:
- a messaging backbone configured to receive messages from message producers and provide messages to message consumers;
- and
- a plurality of compute engines, the compute engines including at least:
- an utterance ingestion engine configured to convert portions of audio input to corresponding textual input;
- a conversation manager configured to dynamically update a state of a conversation between the user and the computing system;
- a conversation engine configured to determine an intent of action of the user;
- and
- a dispatcher configured to automatically select and display two or more medical images of a patient represented in a currently-displayed image for comparison by the user based on the textual input, the intent of action, context of viewing activity by the user including medical images and data previously provided to the user as a result of a conversation action, information in a medical knowledge database storing correlations between respective medical symptoms and medical diagnoses, and the state of the conversation,
- wherein the dispatcher is configured to display the two or more medical images based on criteria for matching at least one selected from a group consisting of related images and related image studies, the criteria based on archive status, and
- wherein the dispatcher is further configured to, in response to input received from the user including a workflow command, determine an action based on the input, the action including providing speech output to the user prompting the user to slow down, and provide the speech output to the user.
Dependencies are inferred from the claim text.