# US 2022/0286726 A1 · Display device and control method therefor

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0286726 A1
- Document ID: US20220286726A1
- Status: Published application
- Kind: A1
- Application number: 17/637,742
- Filed: 2019-09-03
- Published: 2022-09-08
- Earliest claimed: 2019-09-03
- Assignees: LG Electronics Inc.
- Applicants: LG Electronics Inc.
- Inventors: Seunghyun HEO; Jaekyung LEE
- Web page: https://patentgrep.com/patent/US20220286726A1

## CPC

- H04N 21/42203: {sound input device, e.g. microphone}
- G06F 3/16: Sound input; Sound output (speech processing G10L)
- G10L 15/1815: {Semantic context, e.g. disambiguation of the recognition hypotheses based on word meaning}
- G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L 15/30: Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
- H04N 21/437: Interfacing the upstream path of the transmission network, e.g. for transmitting client requests to a VOD server {(flow control in data networks H04L47/10; streaming protocols, e.g. RTP or RTCP, H04L65/65; scheduling or organising the servicing of application requests in data packet switching networks H04L67/60)}
- H04N 21/472: End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content {(end-user interfaces for retrieving video data from a database G06F16/739; network services for supporting unicast streaming H04L65/612)}
- H04N 21/4828: {for searching programme descriptors (retrieval of video data G06F16/739)}
- G10L 15/1822: {Parsing for meaning understanding}
- G10L 2015/088: {Word spotting}
- G10L 2015/223: {Execution procedure of a spoken command}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

A display device comprises a network interface, a memory, a display unit, and a control unit. When speech is received while a content image is displayed through a content provider application, the control unit controls the network interface so as to transmit, to a content provider that provided the content provider application, request information corresponding to the speech.

## Claims

### Claim 1

A display device comprising:
a network interface configured to communicate with at least one content provider (CP);
a memory configured to store a CP application of each of the at least one CP;
a display configured to display a content image through a first CP application of the at least one CP application; and
a controller,
wherein, when receiving an utterance during display of the content image through the first CP application, the controller controls the network interface to transfer request information corresponding to the utterance to a first CP that provides the first CP application.

### Claim 2 (depends on 1)

The display device of claim 1, wherein the first CP application is operated in a foreground on the display.

### Claim 3 (depends on 1)

The display device of claim 1, wherein the request information is Speech-To-Text (STT)-based character data about the utterance.

### Claim 4 (depends on 1)

The display device of claim 1, wherein the request information includes keyword information and intent information about the utterance.

### Claim 5 (depends on 1)

The display device of claim 1, wherein the controller receives execution information in response to the request information from the first CP and performs control to operate according to the execution information.

### Claim 6 (depends on 5)

The display device of claim 5, wherein, when the request information is a content search request, the execution information is a content search result.

### Claim 7 (depends on 5)

The display device of claim 5, wherein, when the request information is a content play request, the execution information is content play.

### Claim 8 (depends on 5)

The display device of claim 5, wherein, when the request information is a control command related to the displayed content image, the execution information is an execution result of the control command.

### Claim 9 (depends on 8)

The display device of claim 8, wherein the controller controls the display to re-display the displayed content image according to information on execution of the control command.

### Claim 10 (depends on 5)

The display device of claim 5, wherein the controller transfers request information corresponding to the utterance to the first CP through the first CP application and receives the execution information from the first CP through the first CP application.

### Claim 11 (depends on 5)

The display device of claim 5, wherein the controller transfers the request information corresponding to the utterance to the first CP through a natural language processing server and receives the execution information from the first CP through the first CP application.

### Claim 12 (depends on 5)

The display device of claim 5, wherein the controller transfers the request information corresponding to the utterance to the first CP application and receives the execution information from the first CP application.

### Claim 13 (depends on 1)

The display device of claim 1, wherein, when the utterance includes voice about a second CP application of the at least one CP application, the controller controls the network interface to transfer the request information corresponding to the utterance to a second CP that provides the second CP application.

### Claim 14 (depends on 13)

The display device of claim 13, wherein the second CP application is in one state of being operated in a foreground on the display, being operated in a background, and not being executed on the display.

### Claim 15 (depends on 1)

The display device of claim 1, wherein, when a content image is not displayed through the first CP application and the utterance does not include voice about the first CP application, the controller controls the network interface to transfer the request information corresponding to the utterance to each of the at least one CP.

### Claim 16 (depends on 1)

The display device of claim 1, wherein:
the display displays an image that is not content provided by each of the at least one CP, and
when receiving utterance during display of the image that is not content provided by each of the at least one CP, the controller performs control to autonomously operate according to the request information corresponding to the utterance.

### Claim 17 (depends on 16)

The display device of claim 16, wherein:
the request information is a content search request,
the controller searches for content according to the request information, and
when the number of the search content result is one, the controller controls the display to reproduce an image of the searched content.

### Claim 18

A method of controlling a display device, the method comprising:
displaying a content image through a first content provider (CP) application of at least one CP application; and
when receiving an utterance during display of the content image through the first CP application, transferring request information corresponding to the utterance to a first CP that provides the first CP application.

### Claim 19 (depends on 18)

The method of claim 18, further comprising:
when the utterance includes voice about a second CP application of the at least one CP application, transferring the request information corresponding to the utterance to a second CP that provides the second CP application.
