# US 2021/0056951 A1 · Development of Voice and Other Interaction Applications

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0056951 A1
- Document ID: US20210056951A1
- Status: Published application
- Kind: A1
- Application number: 16/989,807
- Filed: 2020-08-10
- Published: 2021-02-25
- Earliest claimed: 2019-08-19
- Assignees: Voicify, LLC
- Applicants: Voicify, LLC
- Inventors: Jeffrey K. McMahon; Robert T. Naughton; Nicholas G. Laidlaw; Alexander M. Dunn; Jason Green
- Web page: https://patentgrep.com/patent/US20210056951A1

## CPC

- G10L 13/08: Text analysis or generation of parameters for speech synthesis out of text, e.g. grapheme to phoneme translation, prosody generation or stress or intonation determination
- G06F 3/04817: using icons (graphical or visual programming using iconic symbols G06F8/34)
- G10L 13/0335: {Pitch control}
- G10L 13/047: Architecture of speech synthesisers
- G10L 13/033: Voice editing, e.g. manipulating the voice of the synthesiser
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Among other things, a developer of an interaction application for an enterprise can create items of content to be provided to an assistant platform for use in responses to requests of end-users. The developer can deploy the interaction application using defined items of content and an available general interaction model including intents and sample utterances having slots. The developer can deploy the interaction application without requiring the developer to formulate any of the intents, sample utterances, or slots of the general interaction model.

## Claims

### Claim 1

A machine-based method comprising
presenting a user interface enabling a developer to create speech markup language strings conforming to a speech markup language definition applied by a corresponding interaction assistant platform,
the user interface enabling the user to create markup language strings using plain text and graphical elements and without requiring the user to select or enter any formal expressions of markup elements of the speech markup language definition.

### Claim 2 (depends on 1)

The method of claim 1 in which the user interface presents controls for entering text to be spoken to an end user by an interaction assistant.

### Claim 3 (depends on 1)

The method of claim 1 in which the user interface presents controls corresponding to elements of the speech markup language strings associated with effects to be applied or added to one or more words of text to be spoken to an end user by an interaction assistant.

### Claim 4 (depends on 1)

The method of claim 1 in which the user interface presents controls corresponding to properties of elements of the speech markup language strings.

### Claim 5 (depends on 1)

The method of claim 1 in which the user interface presents controls corresponding to selectable values of properties of elements of the speech markup language strings.

### Claim 6 (depends on 1)

The method of claim 1 in which the user interface presents controls comprising icons graphically representative of effects to be applied to one or more words of text to be spoken to an end user by an interaction assistant, properties of the effects, or values of properties of the effects.

### Claim 7 (depends on 1)

The method of claim 1 in which the user interface displays graphical indicators in line with text words, the graphical indicators representing effects to be applied to one or more of the text words when the words are spoken to an end user by an interaction assistant.

### Claim 8 (depends on 7)

The method of claim 7 in which the graphical indicators comprise backgrounds displayed with the words to which the corresponding effects are to be applied.

### Claim 9 (depends on 8)

The method of claim 8 in which the backgrounds are color-coded according to the effects to which they correspond.

### Claim 10 (depends on 8)

The method of claim 8 in which effects to be applied to one or more words can be nested and the backgrounds are nested in accordance with the nesting of the effects.

### Claim 11

A machine-based method comprising
displaying to a user of a user interface a representation of the speech markup language string including plain text and graphical indicators of markup language elements,
each of the graphical indicators being displayed in graphical association with a portion of the speech markup language string to which the corresponding one of the markup language elements applies.

### Claim 12 (depends on 11)

The method of claim 11 in which the graphical indicators are displayed in line with the plain text.

### Claim 13 (depends on 11)

The method of claim 11 in which the graphical indicators represent audio effects to be applied to one or more words of the plain text.

### Claim 14 (depends on 11)

The method of claim 11 in which the graphical indicators represent properties of audio effects to be applied to one or more words of the plain text.

### Claim 15 (depends on 11)

The method of claim 11 in which the graphical indicators comprise backgrounds displayed with words of the plain text to which the corresponding effects are to be applied.

### Claim 16 (depends on 15)

The method of claim 15 in which the backgrounds are color-coded according to the effects to which they correspond.

### Claim 17 (depends on 15)

The method of claim 15 in which effects to be applied to one or more words of the plain text can be nested and the backgrounds are nested in accordance with the nesting of the effects.

### Claim 18 (depends on 11)

The method of claim 11 in which the user interface displays controls enabling a developer to display of the raw speech markup language strings and to display the plain text and graphical indicators representative of the effects to be applied to the text in line.
