# US 12,225,256 B2 · Display device > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,225,256 B2 - Document ID: US12225256B2 - Status: Granted - Kind: B2 - Application number: 17/757,767 - Filed: 2019-12-19 - Published: 2023-01-19 - Granted: 2025-02-11 - Earliest claimed: 2019-12-19 - Assignees: LG Electronics Inc. - Applicants: LG Electronics Inc. - Inventors: Miyeon Kwon; Seongwoon Seol; Kyungryun Lee; Eunyoung Cho - Web page: https://patentgrep.com/patent/US12225256B2 ## CPC - G09G 5/12: Synchronisation between the display unit and other units, e.g. other display units, video-disc players - H04N 21/42203: {sound input device, e.g. microphone} - G06F 3/14: Digital output to display device {; Cooperation and interconnection of the display device with other functional units} - G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback} - G08C 17/02: using a radio link - G08C 23/04: using light waves, e.g. infrared - H04N 21/42204: {User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor (constructive details of casings for the remote control device H01H9/0235; user interfaces for controlling a tuning device of a television receiver through a remote control H03J9/00; remote control of peripheral devices connected to a television receiver through the remote control device of the television receiver H04B1/205)} - H04N 21/42226: {Reprogrammable remote control devices} - H04N 21/43615: {Interfacing a Home Network, e.g. for connecting the client to a plurality of peripherals (home Audio Video Interoperability [HAVI] data switching networks H04L12/2805)} - H04N 21/43635: {HDMI} - H04N 21/485: End-user interface for client configuration - G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00) - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G08C: TRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS (fluid pressure transmitting systems F15B; mechanical means for transferring the output of a sensing member into a different variable G01D5/00; mechanical control systems G05G) ## Abstract A display device according to an embodiment of the present disclosure comprises: a display unit; a user input interface unit which receives a signal from a remote control device; and a control unit which receives a voice signal, and on the basis of data extracted from the voice signal, sets an external device connected to the display device as an object to be controlled by the remote control device. ## Claims ### Claim 1 A display device comprising: a display configured to display content of an external device; a user input interface configured to receive a signal from a remote control device; and a controller configured to: receive a voice signal expressing an intention of setting the external device as a control target of the remote control device; extract, from the voice signal, data comprising at least one of a type of the external device, a service provider of the external device, a manufacturer of the external device, or an external input terminal to which the external device is connected; determine whether the extracted data comprises all data required for setting the remote control device; receive an additional input signal through the user input interface or an additional voice signal to acquire all of the required data among the type of the external device, the service provider of the external device, the manufacturer of the external device and the external input terminal, based on determining that the extracted data does not comprise all of the required data; set the external device to be controlled by the remote control device based on the extracted data and the additional input signal; and control the external device using the remote control device. ### Claim 2 (depends on 1) The display device according to claim 1, wherein, when receiving a control command of the external device in a state in which the content of the external device that is not set as the control target of the remote control device is being displayed, the controller is further configured to perform an operation for setting the external device as the control target of the remote control device. ### Claim 3 (depends on 2) The display device according to claim 2, wherein, when receiving the control command of the external device in the state in which the content of the external device that is not set as the control target of the remote control device is being displayed, the display is further configured to display a screen that guides the setting of the external device as the control target of the remote control device. ### Claim 4 (depends on 1) The display device according to claim 1, wherein, when receiving the voice signal for setting the external device as the control target of the remote control device, the controller is further configured to: acquire a number of external input terminals connected to the external device; and receive a selection command of the external input terminal, to which the external device set as the control target of the remote control device is connected, when the external input terminal connected to the external device is provided in plurality. ### Claim 5 (depends on 1) The display device according to claim 1, wherein, when receiving the voice signal for setting the external device as the control target of the remote control device, the controller is further configured to: acquire a number of external input terminals connected to the external device; recognize the external input terminal, to which the external device is connected, when there is one external input terminal to which the external device is connected; and set the external device connected to the recognized external input terminal as the control target of the remote control device. ### Claim 6 (depends on 1) The display device according to claim 1, wherein, when receiving a command for setting the external device connected to the display device as the control target of the remote control device through the voice signal, the controller is further configured to: acquire a number of external input terminals connected to the external device; and receive a selection command of the external device to be set as the control target of the remote control device when the external device connected to the display device is provided in plurality. ### Claim 7 (depends on 1) The display device according to claim 1, wherein, when the data extracted from the voice signal comprises all data for setting the external device as the control target of the remote control device, the controller is further configured to set the external device connected to the display device as the control target of the remote control device based on the data extracted from the voice signal. ### Claim 8 (depends on 1) The display device according to claim 1, wherein the display is further configured to display types of data required for setting the external device as the control target of the remote control device. ### Claim 9 (depends on 8) The display device according to claim 8, wherein the display is further configured to display data, which is not extracted from the voice signal among the data for setting the external device as the control target of the remote control device, as a type of required data. ### Claim 10 (depends on 9) The display device according to claim 9, wherein the controller is further configured to receive the additional input signal after displaying the type of required data through the display. ### Claim 11 (depends on 10) The display device according to claim 10, wherein the controller is further configured to set the external device as the control target of the remote control device by using the data extracted from the voice signal and data depending on the additional input signal. ### Claim 12 (depends on 1) The display device according to claim 1, wherein the controller is further configured to: determine whether the external device requires a key test based on the data extracted from the voice signal; when it is determined that the external device connected to the display device requires the key test, output a key test screen through the display; execute the key test to install corresponding control information in the remote control device; acquire the control information necessary for controlling the external device through the remote control device; and allow the user to control the external device using the remote control device based on the control information. ### Claim 13 (depends on 1) The display device according to claim 1, wherein the controller is further configured to: acquire audio uttered by the user through a voice acquisition module; convert the acquired audio through a STT (speech-to-text) module into text data; and analyze the intention to start setting of the remote controller based on the text data through an NLP (natural language processing) module.