# US 2014/0278410 A1 · Text processing using natural language understanding

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2014/0278410 A1
- Document ID: US20140278410A1
- Status: Published application
- Kind: A1
- Application number: 14/289,434
- Filed: 2014-05-28
- Published: 2014-09-18
- Earliest claimed: 2011-05-13
- Assignees: Nuance Communications, Inc.
- Applicants: Nuance Communications, Inc.
- Inventors: Sara H. Basson; Rick Hamilton; Dan Ning Jiang; Dimitri Kanevsky; David Nahamoo; Michael Picheny; Bhuvana Ramabhadran; Tara N. Sainath
- Web page: https://patentgrep.com/patent/US20140278410A1

## CPC

- G06F 40/40: Processing or translation of natural language (natural language analysis G06F40/20; semantic analysis G06F40/30)
- G06F 40/30: Semantic analysis
- G06F 40/58: Use of machine translation, e.g. for multi-lingual retrieval, for server-side translation for client devices or for real-time translation
- G10L 15/063: {Training}
- G10L 15/26: Speech to text systems (G10L15/08 takes precedence)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

Techniques for converting spoken speech into written speech are provided. The techniques include transcribing input speech via speech recognition, mapping each spoken utterance from input speech into a corresponding formal utterance, and mapping each formal utterance into a stylistically formatted written utterance.

## Claims

### Claim 1

A method for rephrasing one or more portions of text in a first text to obtain a second text, wherein the method comprises acts of:
using at least one processor to perform natural language understanding (NLU) processing on the first text to obtain at least one semantic representation of the first text;
using the at least one semantic representation of the first text to generate at least one formal representation of the first text;
analyzing the at least one formal representation of the first text to identify at least one language characteristic that is present in the first text;
identifying a transformation rule associated with the at least one language characteristic; and
obtaining the second text at least in part by applying the transformation rule associated with the at least one language characteristic to rephrase one or more portions of text in the first text.

### Claim 2 (depends on 1)

The method of claim 1, wherein using the at least one semantic representation of the first text to generate at least one formal representation of the first text comprises generating a set of alternative and equivalent formal representations of the first text.

### Claim 3 (depends on 1)

The method of claim 1, further comprising:
obtaining the first text at least in part by transcribing input speech via speech recognition; and
editing at least one speech recognition error to create a modified transcript of speech input.

### Claim 4 (depends on 3)

The method of claim 3, wherein creating a modified transcript comprises modifying the transcript to more closely align the transcript with written grammar.

### Claim 5 (depends on 3)

The method of claim 3, wherein the at least one language characteristic is a characteristic of a first language style, and wherein the transformation rule associated with the at least one language characteristic is applied to rephrase the one or more portions of text in the first text to more closely align with a second language style that is different from the first language style.

### Claim 6 (depends on 1)

The method of claim 1, further comprising using a statistical equation to train a spoken to written speech translator.

### Claim 7 (depends on 6)

The method of claim 6, wherein a statistical equation comprises Prob_theta(F|A)=Prob_theta(F|T)Prob(T|A)/Prob(A, F|T), where F is written speech, T is spoken speech, A is speech spoken by an individual.

### Claim 8 (depends on 1)

The method of claim 1, further comprising representing one or more metrics of proximity from one language style to another, using an entropy-based measure that incorporates understandability over a specified number of words.

### Claim 9 (depends on 1)

The method of claim 1, further comprising estimating one or more parameters with an expectation maximization algorithm that optimizes one or more functions via association with an auxiliary function.

### Claim 10 (depends on 9)

The method of claim 9, wherein a function for estimation of one or more parameters comprises Prob_theta(F|A)=f(theta)=Prob_theta(F|T) Prob_theta(T|A)/Prob(A, F|T), where F is written speech, T is spoken speech, A is speech spoken by an individual.

### Claim 11 (depends on 10)

The method of claim 10, further comprising associating the function Prob_theta(F|T) with a summation of all possible choices of associating a written utterance with one or more spoken word utterances.

### Claim 12 (depends on 11)

The method of claim 11, wherein each alignment of a spoken word utterance with one or more possible formal written utterances has a likelihood measure, and wherein total probability Prob_theta(F|T) is a summation of all likelihoods of alignments.

### Claim 13 (depends on 1)

The method of claim 1, further comprising providing a system, wherein the system comprises one or more distinct software modules, each of the one or more distinct software modules being embodied on a tangible computer-readable recordable storage medium, and wherein the one or more distinct software modules comprise a speech recognition module, a formal mapping module and a stylistic formatting module executing on a hardware processor.

### Claim at position 14

14-19. (canceled)

### Claim 20

A computer program product comprising a tangible computer readable recordable storage medium including computer usable program code for rephrasing one or more portions of text in a first text to obtain a second text, the computer program product including:
computer usable program code for performing natural language understanding (NLU) processing on the first text to obtain at least one semantic representation of the first text;
computer usable program code for using the at least one semantic representation of the first text to generate at least one formal representation of the first text; and
computer usable program code for analyzing the at least one formal representation of the first text to identify at least one language characteristic that is present in the first text, identifying a transformation rule associated with the at least one language characteristic, and obtaining the second text at least in part by applying the transformation rule associated with the at least one language characteristic to rephrase one or more portions of text in the first text.

### Claim 21 (depends on 20)

The computer program product of claim 20, wherein the computer usable program code for using the at least one semantic representation of the first text to generate at least one formal representation of the first text comprises computer usable program code for generating a set of alternative and equivalent formal representations of the first text.

### Claim 22 (depends on 20)

The computer program product of claim 20, further comprising computer usable program code for representing one or more metrics of proximity from one language style to another, using an entropy-based measure that incorporates understandability over a specified number of words.

### Claim 23

A system for rephrasing one or more portions of text in a first text to obtain a second text, comprising:
a memory; and
at least one processor coupled to the memory and operative to:
perform natural language understanding (NLU) processing on the first text to obtain at least one semantic representation of the first text;
use the at least one semantic representation of the first text to generate at least one formal representation of the first text;
analyze the at least one formal representation of the first text to identify at least one language characteristic that is present in the first text;
identify a transformation rule associated with the at least one language characteristic; and
obtain the second text at least in part by applying the transformation rule associated with the at least one language characteristic to rephrase one or more portions of text in the first text.

### Claim 24 (depends on 23)

The system of claim 23, wherein the at least one processor coupled to the memory operative to use the at least one semantic representation of the first text to generate at least one formal representation of the first text is operative to generate a set of alternative and equivalent formal representations of the first text.

### Claim 25 (depends on 23)

The system of claim 23, wherein the at least one processor coupled to the memory is further operative to represent one or more metrics of proximity from one language style to another, using an entropy-based measure that incorporates understandability over a specified number of words.
