# US 2024/0257807 A1 · Systems and methods for voice assistant for electronic health records

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0257807 A1
- Document ID: US20240257807A1
- Status: Published application
- Kind: A1
- Application number: 18/422,491
- Filed: 2024-01-25
- Published: 2024-08-01
- Earliest claimed: 2023-01-26
- Assignees: Bola Technologies, Inc.
- Applicants: Bola Technologies, Inc.
- Inventors: Rushi M. Ganmukhi; Paritosh Katyal; Augusto Monteiro Nobre Amanco; Christine Long; Firshta Shefa; Muthouazhagi Dhanapal; Tarangini Sarathy
- Web page: https://patentgrep.com/patent/US20240257807A1

## CPC

- G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L 15/16: using artificial neural networks
- G10L 15/26: Speech to text systems (G10L15/08 takes precedence)
- G16H 10/60: for patient-specific data, e.g. for electronic patient records
- G16H 50/20: for computer-aided diagnosis, e.g. based on medical expert systems
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA

## Abstract

An electronic record voice assistant system can include one or more processors that receive audio data, apply a machine learning model to the audio data to generate speech data including at least one value, determine a state of an electronic record, and update one or more fields of the electronic record using the state and the at least one value.

## Claims

### Claim at position 1

1-64. (canceled)

### Claim 65

A method of operating a voice assistant, comprising:
detecting, by one or more processors, a domain of a procedure being performed on a subject;
receiving, by the one or more processors, audio data during the procedure;
detecting, by the one or more processors, a state of an electronic record associated with the subject;
applying, by the one or more processors, the domain and the audio data as input to at least one machine learning model to cause the at least one machine learning model to generate speech data representative of the audio data that comprises (1) a command for navigation of the electronic record and (2) a value for entry in the electronic record;
selecting, by the one or more processors, a field of the electronic record based at least on the state and the command; and
assigning, by the one or more processors, the value to the field.

### Claim 66 (depends on 65)

The method of claim 65, wherein detecting the domain comprises:
identifying, by the one or more processors, an identifier of at least one of the electronic record or the subject; and
selecting, by the one or more processors, the domain based at least on the identifier.

### Claim 67 (depends on 65)

The method of claim 65, wherein the state comprises a location in the electronic record, the method further comprising applying the state as input to the at least one speech model to cause the at least one speech model to generate the speech data.

### Claim 68 (depends on 65)

The method of claim 65, wherein the at least one speech model comprises one or more neural networks.

### Claim 69 (depends on 65)

The method of claim 65, wherein the audio data comprises a duration of audio of at least five seconds.

### Claim 70 (depends on 65)

The method of claim 65, wherein the at least one speech model is configured using training data that includes at least one of noise or a speed change.

### Claim 71 (depends on 65)

The method of claim 65, wherein the at least one speech model is configured training data that includes a first subset of training data having context information corresponding to the domain and a second subset of training data not having context information.

### Claim 72 (depends on 65)

The method of claim 65, wherein the domain comprises at least one of a dental, restorative, surgical, medical, cardiological, or gastrointestinal domain.

### Claim 73 (depends on 65)

The method of claim 65, wherein selecting the field of the electronic record comprising generating one or more HTML commands corresponding to the command to navigate to the field, the one or more HTML commands representative of at least one of a keystroke or a mouse click to apply to an interface of a client device on which the electronic record is accessible.

### Claim 74 (depends on 65)

The method of claim 65, wherein assigning the value to the field comprises generating one or more HTML commands corresponding to the value and representative of at least one of a keystroke or a mouse click to apply to an interface of a client device on which the electronic record is accessible.

### Claim 75

A system, comprising:
one or more processors to:
detect a domain of a procedure being performed on a subject;
receive audio data during the procedure;
detect a state of an electronic record associated with the subject;
apply the domain and the audio data as input to at least one machine learning model to cause the at least one machine learning model to generate speech data representative of the audio data that comprises (1) a command for navigation of the electronic record and (2) a value for entry in the electronic record;
select a field of the electronic record based at least on the state and the command; and
assign the value to the field.

### Claim 76 (depends on 75)

The system of claim 75, wherein the one or more processors are to detect the domain by:
identifying an identifier of at least one of the electronic record or the subject; and
selecting the domain based at least on the identifier.

### Claim 77 (depends on 75)

The system of claim 75, wherein the state comprises a location in the electronic record, and the one or more processors are to apply the state as input to the at least one speech model to cause the at least one speech model to generate the speech data.

### Claim 78 (depends on 75)

The system of claim 75, wherein the at least one speech model comprises one or more neural networks.

### Claim 79 (depends on 75)

The system of claim 75, wherein the audio data comprises a duration of audio of at least five seconds.

### Claim 80 (depends on 75)

The system of claim 75, wherein the at least one speech model is configured using training data that includes at least one of noise or a speed change.

### Claim 81 (depends on 75)

The system of claim 75, wherein the at least one speech model is configured training data that includes a first subset of training data having context information corresponding to the domain and a second subset of training data not having context information.

### Claim 82 (depends on 75)

The system of claim 75, wherein the domain comprises at least one of a dental, restorative, surgical, medical, cardiological, or gastrointestinal domain.

### Claim 83 (depends on 75)

The system of claim 75, wherein the one or more processors are to select selecting the field of the electronic record by generating one or more HTML commands corresponding to the command to navigate to the field, the one or more HTML commands representative of at least one of a keystroke or a mouse click to apply to an interface of a client device on which the electronic record is accessible.

### Claim 84 (depends on 75)

The system of claim 75, wherein the one or more processors are to assign the value to the field by generating one or more HTML commands corresponding to the value and representative of at least one of a keystroke or a mouse click to apply to an interface of a client device on which the electronic record is accessible.
