# US 2025/0095798 A1 · Automated soap note evaluation using machine learning models

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0095798 A1
- Document ID: US20250095798A1
- Status: Published application
- Kind: A1
- Application number: 18/830,972
- Filed: 2024-09-11
- Published: 2025-03-20
- Earliest claimed: 2023-09-15
- Assignees: Oracle International Corporation
- Applicants: Oracle International Corporation
- Inventors: Arash Shamaei; Sagar Kalyan Gollamudi; Poorya Zaremoodi; Nitika Mathur; Shubham Pawankumar Shah; Syed Najam Abbas Zaidi; Shiquan Yang
- Web page: https://patentgrep.com/patent/US20250095798A1

## CPC

- G06F 40/30: Semantic analysis
- G16H 10/60: for patient-specific data, e.g. for electronic patient records
- G06F 40/205: Parsing
- G06F 40/295: Named entity recognition
- G06F 40/56: Natural language generation
- G06N 3/045: Combinations of networks
- G06N 3/0475: Generative networks
- G06N 20/00: Machine learning
- G06N 20/20: Ensemble learning
- G10L 15/26: Speech to text systems (G10L15/08 takes precedence)
- G16H 10/00: ICT specially adapted for the handling or processing of patient-related medical or healthcare data (for medical reports G16H15/00; for therapies or health-improving plans G16H20/00; for the handling or processing of medical images G16H30/00)
- G16H 15/00: ICT specially adapted for medical reports, e.g. generation or transmission thereof
- G16H 50/20: for computer-aided diagnosis, e.g. based on medical expert systems
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

Techniques are disclosed for automatically evaluating SOAP notes. A method comprises accessing a Subjective, Objective, Assessment and Plan (SOAP) note and a checklist that includes checklist facts; using a first machine-learning model prompt to extract SOAP note facts from the SOAP note; using one or more second machine-learning model prompts to generate feedback for the SOAP note, the feedback indicating whether individual checklist facts are supported by at least one of the SOAP note facts, and whether individual SOAP note facts are supported by at least one of the checklist facts; and generating a score for the SOAP note based on the feedback.

## Claims

### Claim 1

A computer-implemented method comprising:
accessing a Subjective, Objective, Assessment and Plan (SOAP) note and a checklist that includes checklist facts;
using a first machine-learning model prompt to extract SOAP note facts from the SOAP note;
using one or more second machine-learning model prompts to generate feedback for the SOAP note, the feedback indicating whether individual checklist facts are supported by at least one of the SOAP note facts, and whether individual SOAP note facts are supported by at least one of the checklist facts; and
generating a score for the SOAP note based on the feedback.

### Claim 2 (depends on 1)

The computer-implemented method of claim 1, wherein using the one or more second machine-learning model prompts to generate the feedback for the SOAP note comprises using a first prompt of the one or more second machine-learning model prompts to determine whether each checklist fact is included the SOAP note facts.

### Claim 3 (depends on 2)

The computer-implemented method of claim 2, wherein using the one or more second machine-learning model prompts to generate the feedback for the SOAP note comprises using the first prompt to determine an importance level of each of the checklist facts.

### Claim 4 (depends on 2)

The computer-implemented method of claim 2, wherein using the one or more second machine-learning model prompts to generate the feedback for the SOAP note comprises using a second prompt to determine whether each SOAP note fact corresponds to at least one checklist fact in the checklist facts.

### Claim 5 (depends on 1)

The computer-implemented method of claim 1, wherein the SOAP note is generated using one or more machine learning models based at least in-part on a text transcript corresponding to an interaction between a healthcare provider and a patient of the healthcare provider.

### Claim 6 (depends on 5)

The computer-implemented method of claim 5, wherein the checklist facts are extracted from the text transcript, and wherein each of the checklist facts is expressed as a sentence.

### Claim 7 (depends on 1)

The computer-implemented method of claim 1, wherein each SOAP note fact in the SOAP note facts is an atomic sentence, and wherein using the first machine-learning model prompt to extract the SOAP note facts comprises using the first machine-learning model prompt to generate atomic sentences from the SOAP note.

### Claim 8 (depends on 1)

The computer-implemented method of claim 1, wherein the feedback provides an indication of which checklist facts are not included in the SOAP note facts and which SOAP note facts are not included in the checklist facts.

### Claim 9 (depends on 8)

The computer-implemented method of claim 8, wherein generating the score for the SOAP note based on the feedback comprises calculating a SOAP note score based on the feedback.

### Claim 10 (depends on 1)

The computer-implemented method of claim 1, wherein using the one or more second machine-learning model prompts to generate the feedback for the SOAP note comprises using a prompt of the one or more second machine-learning model prompts to determine that a SOAP note fact, indicated to support a checklist fact, contradicts the checklist fact.

### Claim 11

A system comprising:
one or more processing systems; and
one or more computer-readable media storing instructions which, when executed by the one or more processing systems, cause the system to perform operations comprising:
accessing a Subjective, Objective, Assessment and Plan (SOAP) note and a checklist that includes checklist facts;
using a first machine-learning model prompt to extract SOAP note facts from the SOAP note;
using one or more second machine-learning model prompts to generate feedback for the SOAP note, the feedback indicating whether individual checklist facts are supported by at least one SOAP note fact, and whether individual SOAP note facts are supported by at least one fact in the checklist facts; and
generating a score for the SOAP note based on the feedback.

### Claim 12 (depends on 11)

The system of claim 11, wherein using the one or more second machine-learning model prompts to generate the feedback for the SOAP note comprises using a first prompt of the one or more second machine-learning model prompts to determine whether each checklist fact is included the SOAP note facts.

### Claim 13 (depends on 12)

The system of claim 12, wherein using the one or more second machine-learning model prompts to generate the feedback for the SOAP note comprises using the first prompt to determine an importance level of each of the checklist facts.

### Claim 14 (depends on 12)

The system of claim 12, wherein using the one or more second machine-learning model prompts to generate the feedback for the SOAP note comprises using a second prompt to determine whether each of the SOAP note facts corresponds to at least one of the checklist facts.

### Claim 15 (depends on 11)

The system of claim 11, wherein the SOAP note is generated using one or more machine learning models based at least in-part on a text transcript corresponding to an interaction between a healthcare provider and a patient of the healthcare provider.

### Claim 16 (depends on 15)

The system of claim 15, wherein the checklist facts are extracted from the text transcript and wherein each of the checklist facts is expressed as a sentence.

### Claim 17 (depends on 11)

The system of claim 11, wherein each fact in the SOAP note facts is an atomic sentence, and wherein using the first machine-learning model prompt to extract the SOAP note facts from the SOAP note comprises using the first machine-learning model prompt to generate atomic sentences from the SOAP note.

### Claim 18 (depends on 11)

The system of claim 11, wherein the feedback provides an indication of which checklist facts are not included in the SOAP note facts and which SOAP note facts are not included in the checklist facts.

### Claim 19 (depends on 18)

The system of claim 18, wherein generating the score for the SOAP note based on the feedback comprises calculating a SOAP note score based on the feedback.

### Claim 20 (depends on 11)

The system of claim 11, wherein using the one or more second machine-learning model prompts to generate the feedback for the SOAP note comprises using a prompt of the one or more second machine-learning model prompts to determine that a SOAP note fact, indicated to support a checklist fact, contradicts the checklist fact.

### Claim 21

One or more non-transitory computer-readable media storing instructions which, when executed by one or more processors, cause a system to perform operations comprising:
accessing a Subjective, Objective, Assessment and Plan (SOAP) note and a checklist that includes checklist facts;
using a first machine-learning model prompt to extract SOAP note facts from the SOAP note;
using a one or more second machine-learning model prompts to generate feedback for the SOAP note, the feedback indicating whether individual checklist facts are supported by at least one SOAP note fact, and whether individual SOAP note facts are supported by at least one checklist fact; and
generating a score for the SOAP note based on the feedback.

### Claim 22 (depends on 21)

The one or more non-transitory computer-readable media of claim 21, wherein using the one or more second machine-learning model prompts to generate the feedback for the SOAP note comprises using a first prompt of the one or more second machine-learning model prompts to determine whether each of the checklist facts is included the SOAP note facts.

### Claim 23 (depends on 22)

The one or more non-transitory computer-readable media of claim 22, wherein using the one or more second machine-learning model prompts to generate the feedback for the SOAP note comprises using the first prompt to determine an importance level of each of the checklist facts.

### Claim 24 (depends on 22)

The one or more non-transitory computer-readable media of claim 22, wherein using the one or more second machine-learning model prompts to generate the feedback for the SOAP note comprises using a second prompt to determine whether each of the SOAP note facts corresponds to at least one of the checklist facts.

### Claim 25 (depends on 21)

The one or more non-transitory computer-readable media of claim 21, wherein the SOAP note is generated using one or more machine learning models based at least in-part on a text transcript corresponding to an interaction between a healthcare provider and a patient of the healthcare provider.

### Claim 26 (depends on 25)

The one or more non-transitory computer-readable media of claim 25, wherein the checklist facts are extracted from the text transcript, and wherein each of the checklist facts is expressed as a sentence.

### Claim 27 (depends on 21)

The one or more non-transitory computer-readable media of claim 21, wherein each SOAP note fact is an atomic sentence, and wherein using the first machine-learning model prompt to extract the SOAP note facts comprises using the first machine-learning model prompt to generate atomic sentences from the SOAP note.

### Claim 28 (depends on 21)

The one or more non-transitory computer-readable media of claim 21, wherein the feedback provides an indication of which of the checklist facts are not included in the SOAP note facts and which of the SOAP note facts are not included in the checklist facts.

### Claim 29 (depends on 28)

The one or more non-transitory computer-readable media of claim 28, wherein generating the score for the SOAP note based on the feedback comprises calculating a SOAP note score based on the feedback.

### Claim 30 (depends on 21)

The one or more non-transitory computer-readable media of claim 21, wherein using the one or more second machine-learning model prompts to generate the feedback for the SOAP note comprises using a prompt of the one or more second machine-learning model prompts to determine that a SOAP note fact, indicated to support a checklist fact, contradicts the checklist fact.
