# US 2026/0087238 A1 · Method and system for ai-based real-time transcription of audio data

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0087238 A1
- Document ID: US20260087238A1
- Status: Published application
- Kind: A1
- Application number: 19/314,748
- Filed: 2025-08-29
- Published: 2026-03-26
- Earliest claimed: 2024-09-24
- Inventors: Christopher Tisa; Brandon Diaz; Mario Barredo
- Web page: https://patentgrep.com/patent/US20260087238A1

## CPC

- G06F 40/166: Editing, e.g. inserting or deleting
- G06N 20/00: Machine learning
- G10L 15/26: Speech to text systems (G10L15/08 takes precedence)
- G10L 17/00: Speaker identification or verification techniques
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

A system for automated real-time transcription and editing of audio data using interim text. The system includes a processor of an audio transcription server (ATS) node configured to host a machine learning (ML) module, coupled to at least one audio source and one user-entity node over a network. The processor executes instructions to: acquire audio data; derive features for beam forming and speaker diarization; generate classifiers and provide them to the ML module; identify speakers based on generated parameters; transcribe the audio into interim text associated with the speaker; derive labels to generate a feature vector; and use the ML module to predict interim text editing parameters. These parameters are provided to the user-entity node to enable real-time editing of the interim text. The system supports enhanced speaker identification and editing workflows, particularly suited for legal transcription, including mono-channel input and secure, profile-based speaker recognition.

## Claims

### Claim 1

A system for automated real-time transcription and editing of audio data using interim text, comprising:
a processor of an audio transcription server (ATS) node configured to host a machine learning (ML) module coupled to at least one audio source entity and connected to at least one user-entity node over a network; and
a memory on which are stored machine-readable instructions that, when executed by the processor, cause the processor to:
acquire audio data from the at least one audio source entity;
parse the audio data to derive features for speaker diarization;
generate a set of classifiers based on the derived features;
provide the classifiers to the ML module configured to generate a predictive model for producing at least one speaker identification parameter;
identify a speaker based on the speaker identification parameter;
continuously transcribe the audio data to generate interim text associated with the identified speaker;
derive a plurality of features from the audio data to generate a feature vector;
input the feature vector into the ML module configured to generate a predictive model for producing at least one interim text editing parameter; and
provide the interim text editing parameter to the user-entity node for editing the interim text.

### Claim 2 (depends on 1)

The system of claim 1, wherein the processor is further configured to query a local database to retrieve historical interim text editing-related data based on the plurality of features and the identified speaker, and generate the feature vector based on the retrieved historical data.

### Claim 3 (depends on 2)

The system of claim 2, wherein voiceprint profiles are shared across multiple proceedings via a distributed or federated database, the database incorporating security and privacy controls.

### Claim 4 (depends on 1)

The system of claim 1, wherein the processor is further configured to retrieve remote historical interim text editing-related data from at least one of a cloud-based, distributed, federated, or hybrid storage database, and generate the feature vector based on both local and remote data.

### Claim 5 (depends on 1)

The system of claim 1, wherein the processor is further configured to generate time-stamped hotkey commands synchronized with the interim text editing parameter for real-time interaction.

### Claim 6 (depends on 1)

The system of claim 1, wherein the processor is further configured to acquire video data associated with a speaker and derive visual features to assist in speaker identification.

### Claim 7 (depends on 6)

The system of claim 6, wherein the video data is analyzed to derive at least one of lip movement, gaze direction, or facial orientation features, and the system integrates the derived features with at least one of beamformed or source-separated audio data to improve speaker identification accuracy.

### Claim 8 (depends on 1)

The system of claim 1, wherein the processor is further configured to extract a language identifier from the audio data and generate the feature vector based on the language identifier.

### Claim 9 (depends on 1)

The system of claim 1, wherein the processor is further configured to continuously monitor audio data parameters for deviations beyond a predefined threshold and regenerate updated interim text editing parameters in real time.

### Claim 10 (depends on 1)

The system of claim 1, wherein an audio source separation module comprises at least one of beamforming, neural source separation, or blind source separation.

### Claim 11 (depends on 1)

The system of claim 1, wherein the system is agnostic to an underlying speech-to-text engine and operates with cloud-based or locally hosted engines that produce time-synchronized transcriptions.

### Claim 12

A method for real-time transcription and editing of audio data using interim text, comprising:
acquiring audio data from at least one audio source entity;
parsing the audio data to derive audio source separation and/or speaker diarization features, the features optionally including beamforming features;
generating classifiers and providing them to a machine learning module to produce speaker identification parameters;
identifying a speaker based on the speaker identification parameters;
continuously transcribing the audio data into formatted transcript output associated with the identified speaker;
generating a feature vector from audio features;
inputting the feature vector into the machine learning module to generate at least one formatted transcript output editing parameter; and
providing the editing parameter to a user-entity node for formatted transcript output editing.

### Claim 13 (depends on 12)

The method of claim 12, further comprising analyzing video data to derive at least one of lip movement, gaze direction, or facial orientation features, and integrating the derived features with beamformed audio data to improve speaker identification accuracy.

### Claim 14 (depends on 12)

The method of claim 12, further comprising receiving human-annotated speaker tags from a transcriptionist during the live transcription process.

### Claim 15 (depends on 12)

The method of claim 12, wherein the system extracts voice snippets corresponding to the annotated segments and stores them in association with the identified speaker.

### Claim 16 (depends on 15)

The method of claim 15, further comprising incrementally building a speaker profile data for each speaker based on the collected labeled voice snippets.

### Claim 17 (depends on 16)

The method of claim 16, wherein the speaker profile data are stored in a secure database for reuse in future proceedings.

### Claim 18 (depends on 17)

The method of claim 17, wherein the system uses the stored speaker profiles to perform automatic speaker identification in real-time or near-real-time in subsequent legal proceedings.

### Claim 19 (depends on 18)

The method of claim 18, further comprising presenting the automatically identified speaker names to a human operator for confirmation or correction.

### Claim 20 (depends on 19)

The method of claim 19, wherein any confirmed or corrected speaker labels are used to update and refine the respective speaker's profile data.

### Claim 21 (depends on 20)

The method of claim 20, wherein the audio input comprises a mono-channel feed containing multiple speakers, and speaker identification is performed through speaker profile data recognition rather than separate audio channels.

### Claim 22 (depends on 21)

The method of claim 21, wherein the set of potential speakers is limited to a predefined list specific to the legal proceeding.

### Claim 23 (depends on 22)

The method of claim 22, wherein the speaker profiles are linked to metadata such as the speaker's role, law firm affiliation, or bar registration number.

### Claim 24 (depends on 12)

The method of claim 12, wherein the speaker profile data comprise one or more of a voiceprint, a speaker embedding vector, prosodic features, or other learned speaker representations.

### Claim 25 (depends on 12)

The method of claim 12, further comprising synchronizing speaker profiles via a distributed or federated database with security and privacy controls.

### Claim 26 (depends on 12)

The method of claim 12, wherein the visual features comprise at least one of facial recognition, lip movement, gaze direction, head pose, skeletal or gesture cues, or optical flow features.
