# US 2024/0203430 A1 · Responding to requests for information and other verbal utterances in a healthcare facility

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0203430 A1
- Document ID: US20240203430A1
- Status: Published application
- Kind: A1
- Application number: 18/591,516
- Filed: 2024-02-29
- Published: 2024-06-20
- Earliest claimed: 2018-12-31
- Assignees: Cerner Innovation, Inc.
- Applicants: Cerner Innovation, Inc.
- Inventors: Todd Bechtel; Chad Hays; Amanda Sleightholm
- Web page: https://patentgrep.com/patent/US20240203430A1

## CPC

- G10L 17/24: the user being prompted to utter a password or a predefined phrase
- G16H 40/67: for remote operation
- G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback}
- G06F 21/32: using biometric data, e.g. fingerprints, iris scans or voiceprints
- G06F 21/6245: {Protecting personal data, e.g. for financial or medical purposes}
- G10L 15/07: to the speaker
- G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue
- G16H 10/60: for patient-specific data, e.g. for electronic patient records
- G10L 17/00: Speaker identification or verification techniques
- G10L 2015/223: {Execution procedure of a spoken command}
- G10L 2015/225: {Feedback of the input speech}
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Systems, methods, and devices are provided for responding to requests received from users in a healthcare facility, and for generating alerts based upon criticality detected in received verbal utterances. A personal assistant device (PAD) may receive a verbal request for information. The identity of the requestor may be verified and a response to the request may be received by the PAD. In some cases, prior to audibly outputting the response, it may be determined whether the response contains protected health information (PHI). Upon determining that the response contains PHI, the presence of persons other than the patient in proximity to the PAD and/or security of the location of the PAD may be evaluated prior to audibly outputting the response. Additionally, alerts having a heightened criticality may be generated when a received verbal utterance is determined to have a heightened criticality.

## Claims

### Claim 1

A system comprising:
a personal assistant device associated with a patient in a healthcare facility and having a listening component and a speaker, the personal assistant device being configured to receive verbal requests for information from a user and to audibly provide responses to received verbal requests;
one or more processors in communication with the personal assistant device and an electronic healthcare information system; and
one or more computer-readable media storing computer-readable instructions that, when executed by the one or more processors, cause the one or more processors to:
receive a verbal utterance from the user via the listening component of the personal assistant device associated with the patient;
determine the verbal utterance satisfies a threshold level of criticality based at least in part on a word, phrase, or intonation detected in the verbal utterance;
verify, from the verbal utterance, an identity of the user as the patient or an authorized proxy of the patient;
determine, based on the identity and the determination that the verbal utterance satisfies a predetermined threshold level of criticality, that a predetermined criterion is satisfied; and
based at least in part on determining that the predetermined criterion is satisfied, initiate an action generating a digital alert to at least one member of a healthcare team associated with the patient, the digital alert having the level of criticality of the verbal utterance.

### Claim 2 (depends on 1)

The system of claim 1, wherein the computer-readable instructions, when executed by the one or more processors, further cause the one or more processors to verify an identify of the patient or an authorized proxy of the patient at least in part by comparing a voice signature from the verbal utterance to one or more voice signatures associated with the patient or the authorized proxy of the patient.

### Claim 3 (depends on 1)

The system of claim 1, wherein the computer-readable instructions, when executed by the one or more processors, further cause the one or more processors to audibly output information on the personal assistant device after determining that the information does not contain protected health information.

### Claim 4 (depends on 1)

The system of claim 1, wherein the computer-readable instructions, when executed by the one or more processors, further cause the one or more processors to audibly output information on the personal assistant device after:
determining that the information contains protected health information, and
determining whether persons other than the patient are in proximity to the personal assistant device.

### Claim 5 (depends on 1)

The system of claim 1, wherein the computer-readable instructions, when executed by the one or more processors, further cause the one or more processors to output textual information on a device, other than the personal assistant device, associated with the patient after determining that the information contains protected health information.

### Claim 6 (depends on 1)

The system of claim 1, wherein the computer-readable instructions, when executed by the one or more processors, further cause the one or more processors to detect and remove protected health information from information to be output on the personal assistant device, and audibly output the information after detecting and removing the protected health information.

### Claim 7 (depends on 1)

The system of claim 1, wherein the computer-readable instructions, when executed by the one or more processors, further cause the one or more processors to receive a response from at least one member of the healthcare team associated with the patient, and audibly output the response from the personal assistant device.

### Claim 8 (depends on 1)

The system of claim 1, wherein the computer-readable instructions, when executed by the one or more processors, further cause the one or more processors to verify an identify of the patient or an authorized proxy of the patient based at least in part on one or more of:
a location of the personal assistant device,
a personal identification number provided by the user,
a password provided by the user,
biometric recognition information provided by the user, or
a location of a device other than the personal assistant device that is also associated with the user.

### Claim 9 (depends on 1)

The system of claim 1, wherein the computer-readable instructions, when executed by the one or more processors, further cause the one or more processors to determine, from the verbal utterance, which intent of a plurality of intents, are being used, wherein the action is specific to the intent of the plurality of intents.

### Claim 10

A method, comprising:
receiving verbal requests for information from a user to a personal assistant device associated with a patient in a healthcare facility, and audibly providing responses to the received verbal requests;
communicating information about the requests and responses between the personal assistant device and an electronic healthcare information system;
receiving a verbal utterance from the user via the personal assistant device associated with the patient;
determining the verbal utterance satisfies a threshold level of criticality based at least in part on a word, phrase, or intonation detected in the verbal utterance;
verifying, from the verbal utterance, an identity of the user as the patient or an authorized proxy of the patient;
determining, based on the verified identity and the determination that the verbal utterance satisfies a predetermined threshold level of criticality, that a predetermined criterion is satisfied; and
based at least in part on determining that the predetermined criterion is satisfied, initiating an action generating a digital alert to at least one member of a healthcare team associated with the patient, the digital alert having the level of criticality of the verbal utterance.

### Claim 11 (depends on 10)

The method of claim 10, further comprising verifying an identify of the patient or an authorized proxy of the patient at least in part by comparing a voice signature from the verbal utterance to one or more voice signatures associated with the patient or the authorized proxy of the patient.

### Claim 12 (depends on 10)

The method of claim 10, further comprising outputting textual information on a device, other than the personal assistant device, associated with the patient after determining that the information contains protected health information.

### Claim 13 (depends on 10)

The method of claim 10, further comprising detecting and removing protected health information from information to be output on the personal assistant device, and audibly outputting the information after detecting and removing the protected health information.

### Claim 14 (depends on 10)

The method of claim 10, further comprising receiving a response from at least one member of the healthcare team associated with the patient, and audibly output the response from the personal assistant device after determining that the response does not contain protected health information.

### Claim 15

One or more non-transitory computer-readable media storing computer-readable instructions that, when executed by one or more processors, cause the one or more processors to:
receive verbal requests for information from a user to a personal assistant device associated with a patient in a healthcare facility, and audibly providing responses to the received verbal requests;
communicate information about the requests and responses between the personal assistant device and an electronic healthcare information system;
receive a verbal utterance from the user via the personal assistant device associated with the patient;
determine the verbal utterance satisfies a threshold level of criticality based at least in part on a word, phrase, or intonation detected in the verbal utterance;
verify, from the verbal utterance, an identity of the user as the patient or an authorized proxy of the patient;
determine, based on the verified identity and the determination that the verbal utterance satisfies a predetermined threshold level of criticality, that a predetermined criterion is satisfied; and
based at least in part on determining that the predetermined criterion is satisfied, initiate an action generating a digital alert to at least one member of a healthcare team associated with the patient, the digital alert having the level of criticality of the verbal utterance.

### Claim 16 (depends on 15)

The one or more non-transitory computer-readable media of claim 15, wherein the computer-readable instructions, when executed by the one or more processors, further cause the one or more processors to verify an identify of the patient or an authorized proxy of the patient at least in part by comparing a voice signature from the verbal utterance to one or more voice signatures associated with the patient or the authorized proxy of the patient.

### Claim 17 (depends on 15)

The one or more non-transitory computer-readable media of claim 15, wherein the computer-readable instructions, when executed by the one or more processors, further cause the one or more processors to output textual information on a device, other than the personal assistant device, associated with the patient after determining that the information contains protected health information.

### Claim 18 (depends on 15)

The one or more non-transitory computer-readable media of claim 15, wherein the computer-readable instructions, when executed by the one or more processors, further cause the one or more processors to detect and remove protected health information from information to be output on the personal assistant device, and audibly output the information after detecting and removing the protected health information.

### Claim 19 (depends on 15)

The one or more non-transitory computer-readable media of claim 15, wherein the computer-readable instructions, when executed by the one or more processors, further cause the one or more processors to receive a response from at least one member of the healthcare team associated with the patient, and audibly output the response from the personal assistant device after determining that the response does not contain protected health information.

### Claim 20 (depends on 15)

The one or more non-transitory computer-readable media of claim 15, wherein the computer-readable instructions, when executed by the one or more processors, further cause the one or more processors to verify an identify of the patient or an authorized proxy of the patient based at least in part on one or more of:
a location of the personal assistant device,
a personal identification number provided by the user,
a password provided by the user,
biometric recognition information provided by the user, or
a location of a device other than the personal assistant device that is also associated with the user.
