# US 2021/0082433 A1 · Display apparatus and method for registration of user command

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0082433 A1
- Document ID: US20210082433A1
- Status: Published application
- Kind: A1
- Application number: 17/106,568
- Filed: 2020-11-30
- Published: 2021-03-18
- Earliest claimed: 2014-11-20
- Assignees: Samsung Electronics Co., Ltd.
- Applicants: Samsung Electronics Co., Ltd.
- Inventors: Nam-yeong KWON; Kyung-mi PARK
- Web page: https://patentgrep.com/patent/US20210082433A1

## CPC

- G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue
- G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback}
- G10L 15/02: Feature extraction for speech recognition; Selection of recognition unit
- G10L 15/06: Creation of reference templates; Training of speech recognition systems, e.g. adaptation to the characteristics of the speaker's voice (G10L15/14 takes precedence)
- G10L 15/10: using distance or distortion measures between unknown speech and reference templates
- H04N 21/42203: {sound input device, e.g. microphone}
- H04N 21/4394: {involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams (arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58)}
- H04N 21/482: End-user interface for programme selection
- G10L 15/187: Phonemic context, e.g. pronunciation rules, phonotactical constraints or phoneme n-grams
- G10L 2015/0638: {Interactive procedures}
- G10L 2015/088: {Word spotting}
- G10L 2015/221: {Announcement of recognition results}
- G10L 2015/223: {Execution procedure of a spoken command}
- G10L 2015/225: {Feedback of the input speech}
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A display apparatus includes an input unit configured to receive a user command; an output unit configured to output a registration suitability determination result for the user command; and a processor configured to generate phonetic symbols for the user command, analyze the generated phonetic symbols to determine registration suitability for the user command, and control the output unit to output the registration suitability determination result for the user command. Therefore, the display apparatus may register a user command which is resistant to misrecognition and guarantees high recognition rate among user commands defined by a user.

## Claims

### Claim 1

A non-transitory computer-readable medium recording instructions for execution by a processor of an apparatus to cause the apparatus to perform operations comprising:
based on a user input being received, performing a function corresponding to a voice input state for receiving a user voice input;
receiving the user voice input;
identifying whether or not a text corresponding to the user voice input is related to a pre-registered voice command or a prohibited expression; and
based on the text being related to at least one of the pre-registered voice command or the prohibited expression, displaying an indicator that the text is related to the at least one of the pre-registered voice command or the prohibited expression.

### Claim 2 (depends on 1)

The non-transitory computer-readable medium of claim 1, wherein the operations further comprise:
outputting an audio indication that the text is related to the at least one of the pre-registered voice command or the prohibited expression.

### Claim 3 (depends on 1)

The non-transitory computer-readable medium of claim 1, wherein the operations further comprise:
based on the indicator being displayed, receiving re-input of other user voice input through the user voice input receiver; and
based on a text of the re-input not being related to the pre-registered voice command and the prohibited expression, registering the text of the re-input as a voice command.

### Claim 4 (depends on 1)

The non-transitory computer-readable medium of claim 1, wherein the operations further comprise:
based on the text being related to at least one of the pre-registered voice command or the prohibited expression, displaying a user interface guiding a plurality of registrable user commands.

### Claim 5 (depends on 1)

The non-transitory computer-readable medium of claim 1, wherein the operations further comprise:
based on the text being related to the pre-registered voice command, displaying an indicator that the text is unable to be registered as a voice command.

### Claim 6 (depends on 5)

The non-transitory computer-readable medium of claim 5, wherein the operations further comprise:
based on the text being related to the pre-registered voice command, displaying an indicator guiding re-input of other user voice for registering the voice command.

### Claim 7 (depends on 1)

The non-transitory computer-readable medium of claim 1, wherein the operations further comprise:
based on the text being related to the prohibited expression, displaying an indicator that the text is related to the prohibited expression.

### Claim 8 (depends on 1)

The non-transitory computer-readable medium of claim 1, wherein the operations further comprise:
based on the text not being related to the pre-registered voice command and the prohibited expression, displaying the text and an indicator that the text is able to be registered as a voice command.

### Claim 9 (depends on 1)

The non-transitory computer-readable medium of claim 1, wherein the operations further comprise:
based on a plurality of texts corresponding to the user voice input being obtained, displaying a list comprising the plurality of texts; and
identifying whether or not a text selected by a user input from among the plurality of texts is related to a pre-registered voice command or a prohibited expression.

### Claim 10

An apparatus comprising:
a user input receiver;
a user voice input receiver;
a display; and
a processor configured to:
based on a user input being received through the user input receiver, perform a function corresponding to voice input state for receiving a user voice input;
receive a user voice input through the user voice input receiver;
identify whether or not a text corresponding to the user voice input is related to a pre-registered voice command or a prohibited expression; and
based on the text being related to at least one of the pre-registered voice command or the prohibited expression, control the display to display an indicator that the text is related to the at least one of the pre-registered voice command or the prohibited expression.

### Claim 11 (depends on 10)

The apparatus of claim 10, wherein
the apparatus further comprises an audio output unit, and
the processor is further configured to control the audio output unit to output an audio indication that the text is related to the at least one of the pre-registered voice command or the prohibited expression.

### Claim 12 (depends on 10)

The apparatus of claim 10, wherein the processor is further configured to:
based on the indicator not being displayed, receive re-input of other user voice input through the user voice input receiver, and
based on a text of the re-input not being related to the pre-registered voice command and the prohibited expression, register the text of the re-input as a voice command.

### Claim 13 (depends on 10)

The apparatus of claim 10, wherein the processor is further configured to:
based on the text being related to at least one of the pre-registered voice command or the prohibited expression, control the display to display a user interface guiding a plurality of registrable user commands.

### Claim 14 (depends on 10)

The apparatus of claim 10, wherein the processor is further configured to:
based on the text being related to the pre-registered voice command, control the display to display an indicator that the text is unable to be registered as a voice command.

### Claim 15 (depends on 14)

The apparatus of claim 14, wherein the processor is further configured to:
based on the text being related to the pre-registered voice command, control the display to display an indicator guiding re-input of other user voice for registering the voice command.

### Claim 16 (depends on 10)

The apparatus of claim 10, wherein the processor is further configured to:
based on the text being related to the prohibited expression, control the display to display an indicator that the text is related to the prohibited expression.

### Claim 17 (depends on 10)

The apparatus of claim 10, wherein the processor is further configured to:
based on the text not being related to the pre-registered voice command and the prohibited expression, control the display to display the text and an indicator that the text is able to be registered as a voice command.

### Claim 18 (depends on 10)

The apparatus of claim 10, wherein the processor is further configured to:
based on a plurality of texts corresponding to the user voice input being obtained, control the display to display a list comprising the plurality of texts, and
identify whether or not a text selected by a user input from among the plurality of texts is related to a pre-registered voice command or a prohibited expression.

### Claim 19

A control method of an apparatus, the method comprising:
based on a user input being received, performing a function corresponding to voice input state for receiving a user voice input;
receiving a user voice input;
identifying whether or not a text corresponding to the user voice input is related to a pre-registered voice command or a prohibited expression; and
based on the text being related to at least one of the pre-registered voice command or the prohibited expression, displaying an indicator that the text is related to the at least one of the pre-registered voice command or the prohibited expression.

### Claim 20 (depends on 18)

The control method of claim 18, wherein the method further comprises:
outputting an audio indication that the text is related to the at least one of the pre-registered voice command or the prohibited expression.
