# US 12,118,272 B2 · Systems and methods to accept speech input and edit a note upon receipt of an indication to edit

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,118,272 B2
- Document ID: US12118272B2
- Status: Granted
- Kind: B2
- Application number: 17/990,235
- Filed: 2022-11-18
- Published: 2023-03-16
- Granted: 2024-10-15
- Earliest claimed: 2020-09-23
- Assignees: Suki AI, Inc.
- Applicants: Suki AI, Inc.
- Inventors: Matt Pallakoff
- Web page: https://patentgrep.com/patent/US12118272B2

## CPC

- G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback}
- G06F 3/0481: based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F 3/0486: Drag-and-drop
- G06F 3/0488: using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F 3/04883: for inputting data by handwriting, e.g. gesture or text
- G06F 40/166: Editing, e.g. inserting or deleting
- G06F 40/174: Form filling; Merging
- G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue
- G16H 10/60: for patient-specific data, e.g. for electronic patient records
- G16H 15/00: ICT specially adapted for medical reports, e.g. generation or transmission thereof
- G16H 80/00: ICT specially adapted for facilitating communication between medical practitioners or patients, e.g. for collaborative diagnosis, therapy or health monitoring
- G06F 3/04842: Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence)
- G10L 2015/221: {Announcement of recognition results}
- G10L 2015/223: {Execution procedure of a spoken command}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA

## Abstract

Systems and methods to accept speech input and edit a note upon receipt of an indication to edit are disclosed. Exemplary implementations may: effectuate presentation of a graphical user interface that includes a note, the note including note sections, the note sections including a first note section, the individual note sections including body fields; obtain user input from the client computing platform, the user input representing an indication to edit a first body field of the first note section; obtain audio information representing sound captured by an audio section of the client computing platform, the audio information including value definition information specifying one or more values to be included in the individual body fields; perform speech recognition on the audio information to obtain a first value; and populate the first body field with the first value so that the first value is included in the first body field.

## Claims

### Claim 1

A system configured to accept speech input and edit a note upon receipt of an indication to edit, the system comprising:
one or more processors configured by machine-readable instructions to:
effectuate presentation, via a client computing platform associated with a user, of a graphical user interface that includes a note, wherein the note includes note sections, the individual note sections including body fields that correspond to title fields;
obtain audio information conveying speech from the user associated with the client computing platform, wherein the audio information includes first audio information, wherein the first audio information represents the user speaking a name that corresponds to first value definition information and a first title field that refers to a first note section, the first value definition information specifying a set of parameters that are related and corresponding values to be inserted in the individual body fields;
determine, based on the first audio information, the set of the parameters that are related and the corresponding values for inclusion in a first body field of the first note section of the note based on the name, the first value definition information, and the first title field, wherein the set of parameters include at least a first parameter and a first value for the first parameter;
populate the first body field with the set of the parameters and the corresponding values determined;
obtain secondary input via the graphical user interface that indicates the first parameter and the first value corresponding to the first parameter, wherein the secondary input includes a screen tap of the first parameter and/or a press-and-drag over the first value;
obtain second audio information, wherein the second audio information represents the user speaking a second value for the first parameter to be included in the first body field;
determine, based on the second audio information, the second value;
populate the first body field with the second value in correspondence with the first parameter, wherein the population of the first body field with the second value includes replacing the first value with the second value; and
simultaneous to the populations, effectuate presentation of the populations to the note via the graphical user interface.

### Claim 2 (depends on 1)

The system of claim 1, wherein the first body field includes a second parameter, wherein the second audio information includes the second parameter and second value definition information such that determinations based on the second audio information includes determining a third value for the second parameter from the second value definition information, wherein the one or more processors are further configured by machine-readable instructions to:
obtain a user input indicating to edit a value corresponding to the second parameter, wherein the user input is provided via the client computing platform; and
populate the first body field with the third value adjacent to and corresponding to the second parameter.

### Claim 3 (depends on 1)

The system of claim 1, wherein the one or more processors are further configured by machine-readable instructions to:
receive a command input by the user via the user interface of the client computing platform to import the one or more values included in the individual body fields, as presented in the individual body fields, to an electronic medical record associated with a patient; and
responsive to reception of the command, import the one or more values included in the individual body fields, as presented in the individual body fields, to the electronic medical record associated with the patient.

### Claim 4

A method to accept speech input and edit a note upon receipt of an indication to edit, the method comprising:
effectuating presentation, via a client computing platform associated with a user, of a graphical user interface that includes a note, wherein the note includes note sections, the individual note sections including body fields that correspond to title fields;
obtaining audio information conveying speech from the user associated with the client computing platform, wherein the audio information includes first audio information, wherein first the audio information represents the user speaking a name that corresponds to first value definition information and a first title field that refers to a first note section, the first value definition information specifying a set of parameters that are related and corresponding values to be inserted in the individual body fields;
determining, based on the first audio information, the set of the parameters that are related and the corresponding values for inclusion in a first body field of the first note section of the node based on the name, the first value definition information, and the first title field, wherein the set of parameters include at least a first parameter and a first value for the first parameter;
populating the first body field with the set of the parameters and the corresponding values determined;
obtaining secondary input via the graphical user interface that indicates the first parameter and the first value corresponding to the first parameter, wherein the secondary input includes a screen tap of the first parameter and/or a press-and-drag over the first value;
obtaining second audio information, wherein the second audio information that represents the user speaking a second value for the first parameter to be included in the first body field;
determining, based on the second audio information, the second value;
populating the first body field with the second value in correspondence with the first parameter, wherein the population of the first body field with the second includes replacing the first value with the second value; and
simultaneous to the populations, effectuating presentation of the populations to the note via the graphical user interface.

### Claim 5 (depends on 4)

The method of claim 4, wherein the first body field includes a second parameter, wherein the second audio information includes the second parameter and second value definition information such that determinations based on the second audio information includes determining a third value for the second parameter from the second value definition information, further comprising:
obtain a user input indicating to edit a value corresponding to the second parameter, wherein the user input is provided via the client computing platform; and
populating the first body field with the third value adjacent to and corresponding to the second parameter.

### Claim 6 (depends on 4)

The method of claim 4, further comprising:
receiving a command input by the user via the user interface of the client computing platform to import the one or more values included in the individual body fields, as presented in the individual body fields, to an electronic medical record associated with a patient; and
responsive to reception of the command, importing the one or more values included in the individual body fields, as presented in the individual body fields, to the electronic medical record associated with the patient.