# US 2021/0065572 A1 · Display apparatus and method for question and answer

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0065572 A1
- Document ID: US20210065572A1
- Status: Published application
- Kind: A1
- Application number: 17/097,142
- Filed: 2020-11-13
- Published: 2021-03-04
- Earliest claimed: 2014-11-12
- Assignees: Samsung Electronics Co., Ltd.
- Applicants: Samsung Electronics Co., Ltd.
- Inventors: Eun-sang BAK
- Web page: https://patentgrep.com/patent/US20210065572A1

## CPC

- G09B 7/00: Electrically-operated teaching apparatus or devices working with questions and answers (mechanically operated G09B3/00; computing arrangements G06F)
- G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback}
- G06F 16/243: {Natural language query formulation}
- G06F 16/3322: {using system suggestions (G06F16/3325 takes precedence)}
- G06F 16/3329: Natural language query formulation
- G06F 16/433: {using audio data}
- G06F 40/295: Named entity recognition
- G10L 15/1822: {Parsing for meaning understanding}
- G10L 15/30: Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
- G09B: EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS (devices for psychotechnics or for testing reaction times A61B5/16; games, sports, amusements A63; projectors, projector screens G03B)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

A display apparatus and a method for questions and answers includes a display unit includes an input unit configured to receive user's speech voice; a communication unit configured to perform data communication with an answer server; and a processor configured to create and display one or more question sentences using the speech voice in response to the speech voice being a word speech, create a question language corresponding to the question sentence selected from among the displayed one or more question sentences, transmit the created question language to the answer server via the communication unit, and, in response to one or more answer results related to the question language being received from the answer server, display the received one or more answer results. Accordingly, the display apparatus may provide an answer result appropriate to a user's question intention although a non-sentence speech is input.

## Claims

### Claim 1

A display apparatus comprising:
an input receiver;
a voice receiver;
a display;
a communicator; and
a processor configured to:
receive a user voice through the voice receiver,
based on a voice text corresponding to the user voice including a plurality of words, receive a related word corresponding to the voice text through the communicator from an external server and generate a plurality of texts including the related word,
control the display to display the plurality of texts,
based on a user input for selecting a text from among the plurality of texts being received through the input receiver, receive information corresponding to the selected text through the communicator from the external server, and
control the display to display the received information corresponding to the selected text.

### Claim 2 (depends on 1)

The display apparatus as claimed in claim 1, wherein the processor is configured to control the display to display the plurality of texts in order of a number of times in which each of the plurality of texts has been previously selected based on selection history information.

### Claim 3 (depends on 1)

The display apparatus as claimed in claim 1, wherein the processor is configured to select and display a predetermined number of texts from among the plurality of texts based on a number of times in which each of the plurality of texts has been previously selected based on selection history information.

### Claim 4 (depends on 1)

The display apparatus as claimed in claim 1, further comprising:
a storage storing a plurality of sentences, and keywords corresponding to characteristic vectors for the plurality of respective sentences,
wherein the processor is configured to compare a similarity in a pronunciation column between the stored keywords corresponding to the characteristic vectors for the plurality of respective sentences and the user voice, identify a sentence including a keyword having a highest similarity with the user voice as one of the plurality of texts.

### Claim 5 (depends on 1)

The display apparatus as claimed in claim 1, wherein the external server is a triple structure knowledge base server and extracts the related word using attribute information related to the voice texts.

### Claim 6 (depends on 1)

The display apparatus as claimed in claim 1, further comprising a storage storing a plurality of sentences,
wherein the processor is configured to, when there is no sentence including a related word having a predetermined similarity with the user voice among the plurality of sentences, receive at least one related word corresponding to the voice text from the external server and generate the plurality of texts based on the at least one related word.

### Claim 7 (depends on 1)

The display apparatus as claimed in claim 1, wherein the processor is configured to, based on the voice text being a sentence, extract an object name from the voice text using a natural language processing based algorithm and generate a question language based on the extracted object name.

### Claim 8

A controlling method of a display apparatus, the method comprising:
receiving a user voice through a voice receiver;
based on a voice text corresponding to the user voice including a plurality of words, receive a related word corresponding to the voice text from an external server and generating a plurality of texts based on the related word;
displaying the plurality of texts;
based on a user input for selecting a text from among the plurality of texts being received, receiving information corresponding to the selected text from the external server; and
displaying the received information corresponding to the selected text.

### Claim 9 (depends on 8)

The controlling method as claimed in claim 8, wherein the displaying the plurality of texts comprises displaying the plurality of texts in order of a number of times in which each of the plurality of texts has been previously selected based on selection history information.

### Claim 10 (depends on 8)

The controlling method as claimed in claim 8, wherein the displaying the plurality of texts comprises displaying a predetermined number of texts from among the plurality of texts based on a number of times in which each of the plurality of texts has been previously selected based on selection history information.

### Claim 11 (depends on 8)

The controlling method as claimed in claim 8, further comprising:
comparing a similarity in a pronunciation column between pre-stored keywords corresponding to characteristic vectors for each of plurality of pre-stored sentences and the user voice; and
identifying a sentence including a keyword having a highest similarity with the user voice as one of the plurality of texts.

### Claim 12 (depends on 8)

The controlling method as claimed in claim 8, wherein the generating the plurality of texts comprises:
when there is no sentence including a related word having a predetermined similarity with the user voice among a plurality of pre-stored sentences, receiving at least one related word corresponding to the voice text from the external server; and
generating the plurality of texts based on the at least one related word.

### Claim 13 (depends on 8)

The controlling method as claimed in claim 8, wherein the generating the plurality of texts comprises:
based on the voice text being a sentence, extracting an object name from the voice text using a natural language processing based algorithm; and
generating a question language based on the extracted object name.

### Claim 14

A non-transitory computer-readable storage medium coupled to a display apparatus and storing a computer program for executing the following operations of:
receiving a user voice through a voice receiver;
based on a voice text corresponding to the user voice including a plurality of words, generating a plurality of texts including a related word corresponding to the voice text;
displaying the plurality of texts;
based on a user input for selecting a text from among the plurality of texts being received, receiving information corresponding to the selected text from an external server; and
displaying the received information corresponding to the selected text.
