# US 2026/0087235 A1 · Custom display post processing in speech recognition

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0087235 A1
- Document ID: US20260087235A1
- Status: Published application
- Kind: A1
- Application number: 19/355,771
- Filed: 2025-10-10
- Published: 2026-03-26
- Earliest claimed: 2022-04-29
- Assignees: Microsoft Technology Licensing, LLC
- Applicants: Microsoft Technology Licensing, LLC
- Inventors: Wei LIU; Padma VARADHARAJAN; Piyush BEHRE; Nicholas KIBRE; Edward C. LIN; Shuangyu CHANG; Che ZHAO; Khuram SHAHID; Heiko Willy RAHMEL
- Web page: https://patentgrep.com/patent/US20260087235A1

## CPC

- G06F 40/151: Transformation
- G06F 40/117: Tagging; Marking up (details of markup languages G06F40/143); Designating a block; Setting of attributes (style sheets, e.g. eXtensible Stylesheet Language Transformation [XSLT], G06F40/154)
- G06F 40/166: Editing, e.g. inserting or deleting
- G06F 40/284: Lexical analysis, e.g. tokenisation or collocates
- G10L 15/26: Speech to text systems (G10L15/08 takes precedence)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

Solutions for custom display post processing (DPP) in speech recognition (SR) use a customized multi-stage DPP pipeline that transforms a stream of SR tokens from lexical form to display form. A first transformation stage of the DPP pipeline receives the stream of tokens, in turn, by an upstream filter, a base model stage, and a downstream filter, and transforms a first aspect of the stream of tokens (e.g., disfluency, inverse text normalization (ITN), capitalization, etc.) from lexical form into display form. The upstream filter and/or the downstream filter alter the stream of tokens to change the default behavior of the DPP pipeline into custom behavior. Additional transformation stages of the DPP pipeline perform further transforms, allowing for outputting final text in a display format that is customized for a specific user. This permits each user to efficiently leverage a common baseline DPP pipeline to produce a custom output.

## Claims

### Claim at position 1

-20. (canceled)

### Claim 21

A system comprising:
a processor; and
a computer-readable medium storing instructions that are operative upon execution by the processor to:
receive a target format document;
transform text of the target format document into a stream of tokens each representing an element of human speech in lexical form;
receive, by a multi-stage display post processing (DPP) pipeline, the stream of tokens, wherein the DPP pipeline comprises at least an upstream filter, a first base model, a second base model, and a downstream filter;
transform, by the first base model, a first aspect of the stream of tokens from the lexical form to a display form;
transform, by the second base model, a second aspect of the stream of tokens from the lexical form to a display form;
output, by the multi-stage display post processing (DPP) pipeline, a baseline text representing the stream of tokens with the transformed first aspect and the transformed second aspect;
determine a difference between baseline text and text of the target format document;
based on the determined difference, generate a set of rules for the upstream filter and the downstream filter;
provide a user interface (UI) for a user to accept or edit the set of generated rules;
freeze a current version of the DPP pipeline;
transform, utilizing the current version of the DDP pipeline, an input stream of human speech from a lexical form to a display form; and
provide the transformed input stream to the user.

### Claim 22 (depends on 21)

The system of claim 21, wherein the instructions that are further operative upon execution by the processor to:
perform an explicit punctuation operation on the baseline text before determining the difference between the baseline text and the text of the target format document.

### Claim 23 (depends on 21)

The system of claim 21, wherein the instructions are further operative upon execution by the processor to:
perform a grammar capitalization operation on the baseline text before determining the difference between the baseline text and the text of the target format document.

### Claim 24 (depends on 21)

The system of claim 21, wherein the user enables or disables the upstream filter or the downstream filter or both.

### Claim 25 (depends on 21)

The system of claim 21, wherein the instructions are further operative upon execution by the processor to:
perform a keyword spotted text removal operation on the baseline text before determining the difference between the baseline text and the text of the target format document.

### Claim 26 (depends on 21)

The system of claim 21, wherein the transformed input stream includes a textual transcript of the display form being shown on the UI.

### Claim 27 (depends on 21)

The system of claim 21, wherein the instructions are further operative upon execution by the processor to:
receive an indication of an error in the transformed input stream; and
based on receiving the indication of an error, training the upstream filter or the downstream filter or both, using a trainer.

### Claim 28 (depends on 21)

The system of claim 21, wherein the instructions are further operative upon execution by the processor to:
alter, by the upstream filter or the downstream filter or both, the stream of tokens before determining the difference between the baseline text and the text of the target format document.

### Claim 29

A computerized method comprising:
receiving a target format document;
transforming text of the target format document into a stream of tokens each representing an element of human speech in lexical form;
receiving, by a multi-stage display post processing (DPP) pipeline, the stream of tokens, wherein the DPP pipeline comprises at least an upstream filter, a first base model, a second base model, and a downstream filter;
transforming, by the first base model, a first aspect of the stream of tokens from the lexical form to a display form;
transforming, by the second base model, a second aspect of the stream of tokens from the lexical form to a display form;
outputting, by the multi-stage display post processing (DPP) pipeline, a baseline text representing the stream of tokens with the transformed first aspect and the transformed second aspect;
determining a difference between baseline text and text of the target format document;
based on the determined difference, generating a set of rules for the upstream filter and the downstream filter;
providing a user interface (UI) for a user to accept or edit the set of generated rules;
freezing a current version of the DPP pipeline;
transforming, utilizing the current version of the DPP pipeline, an input stream of human speech from a lexical form to a display form; and
providing the transformed input stream to the user.

### Claim 30 (depends on 29)

The computerized method of claim 29, further comprising:
performing an explicit punctuation operation on the baseline text before determining the difference between the baseline text and the text of the target format document.

### Claim 31 (depends on 29)

The computerized method of claim 29, further comprising:
performing a grammar capitalization operation on the baseline text before determining the difference between the baseline text and the text of the target format document.

### Claim 32 (depends on 29)

The computerized method of claim 29, wherein the user enables or disables the upstream filter or the downstream filter or both.

### Claim 33 (depends on 29)

The computerized method of claim 29, further comprising:
performing a keyword spotted text removal operation on the baseline text before determining the difference between the baseline text and the text of target format document.

### Claim 34 (depends on 29)

The computerized method of claim 29, wherein the transformed input stream includes a textual transcript of the display form being shown on the UI.

### Claim 35 (depends on 29)

The computerized method of claim 29, further comprising:
receiving indication of an error in the transformed input stream; and
based on receiving the indication of an error, training the upstream filter or the downstream filter or both, using a trainer.

### Claim 36 (depends on 29)

The computerized method of claim 29, further comprising:
altering, by the upstream filter or the downstream filter or both, the stream of tokens before determining a first difference between the baseline text and the text of the target format document.

### Claim 37

One or more computer storage media having computer-executable instructions stored thereon, which, on execution by a computer, cause the computer to perform operations comprising:
receiving a target format document;
transforming text of the target format document into a stream of tokens each representing an element of human speech in lexical form;
receiving, by a multi-stage display post processing (DPP) pipeline, the stream of tokens, wherein the DPP pipeline comprises at least an upstream filter, a first base model, a second base model, and a downstream filter;
transforming, by the first base model, a first aspect of the stream of tokens from the lexical form to a display form;
transforming, by the second base model, a second aspect of the stream of tokens from the lexical form to a display form;
outputting, by the multi-stage display post processing (DPP) pipeline, a baseline text representing the stream of tokens with the transformed first aspect and the transformed second aspect;
determining a difference between baseline text and text of the target format document;
based on the determined difference, generating a set of rules for the upstream filter and the downstream filter;
providing a user interface (UI) for a user to accept or edit the set of generated rules;
freezing a current version of the DPP pipeline;
transforming, utilizing the current version of the DPP pipeline, an input stream of human speech from a lexical form to a display form; and
providing the transformed input stream to the user.

### Claim 38 (depends on 37)

The one or more computer storage media of claim 37, wherein the transformed input stream includes a textual transcript of the display form being shown on the UI.

### Claim 39 (depends on 37)

The one or more computer storage media of claim 37, wherein the user enables or disables the upstream filter or the downstream filter or both.

### Claim 40 (depends on 37)

The one or more computer storage media of claim 37, wherein the operations further comprise:
altering, by the upstream filter or the downstream filter or both, the stream of tokens before determining the difference between the baseline text and the text of the target format document.
