# US 2014/0195248 A1 · Interactive server, display apparatus, and control method thereof > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2014/0195248 A1 - Document ID: US20140195248A1 - Status: Published application - Kind: A1 - Application number: 14/149,186 - Filed: 2014-01-07 - Published: 2014-07-10 - Earliest claimed: 2013-01-07 - Assignees: Samsung Electronics Co., Ltd. - Applicants: Samsung Electronics Co., Ltd. - Inventors: Ji-hye CHUNG; Myung-jae KIM; Yong-wook SHIN; Bo-ra LEE; Jin-sik LEE; Cheong-jae LEE - Web page: https://patentgrep.com/patent/US20140195248A1 ## CPC - H04N 21/237: Communication with additional data server - G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue - H04N 21/42203: {sound input device, e.g. microphone} - H04N 21/4415: using biometric characteristics of the user, e.g. by voice recognition or fingerprint scanning {(cryptography using biological data H04L9/3231; authentication in networks using biometric H04L63/0861)} - H04N 21/47202: {for requesting content on demand, e.g. video on demand} - H04N 21/4753: {for user identification, e.g. by entering a PIN or password (cryptographic authentication protocols H04L9/32; networks authentication protocols H04L63/08)} - G10L 15/1822: {Parsing for meaning understanding} - G10L 2015/223: {Execution procedure of a spoken command} - G10L 2015/228: {of application context} - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING ## Abstract An interactive server, a display apparatus, and a control method thereof are disclosed. An interactive server includes a communication unit configured to perform communication with a display apparatus and receive a voice command signal including a first command element representing a target and a second command element representing an execution command; a storage unit configured to store indicators and command words; an extraction unit configured to extract an indicator corresponding to the first command element and a command word corresponding to the second command element from the storage unit; and a controller configured to generate response information corresponding to the voice command signal by combining the extracted indicator and command word, and send the response information to the display apparatus, wherein the first command element is an command element that is determined based on a displaying status of objects displayed on a screen of the display apparatus. ## Claims ### Claim 1 An interactive server comprising: a communication unit configured to perform communication with a display apparatus and receive a voice command signal including a first command element representing a target and a second command element representing an execution command; a storage unit configured to store a plurality of indicators and a plurality of command words; an extraction unit configured to extract an indicator corresponding to the first command element and a command word corresponding to the second command element from the storage unit; and a controller configured to generate response information corresponding to the voice command signal by combining the extracted indicator and command word, and send the response information to the display apparatus, wherein the first command element is an command element that is determined based on a displaying status of objects displayed on a screen of the display apparatus. ### Claim 2 (depends on 1) The interactive server of claim 1, wherein the first command element comprises at least one of a pronoun, an ordinal number, and a direction. ### Claim 3 (depends on 2) The interactive server of claim 2, wherein the extraction unit is further configured to determine whether the first command element includes request information, and, if the first command element includes the request information, to extract a command word corresponding to the request information from the storage unit, and wherein the controller is further configured to add content information corresponding to the request information to the response information based on the extracted command word corresponding to the request information. ### Claim 4 (depends on 1) The interactive server of claim 1, wherein the indicator comprises an execution word that refers to the target among the objects displayed on the screen of the display apparatus. ### Claim 5 (depends on 1) The interactive server of claim 1, wherein the indicator comprises unique identifying information of the objects displayed on the screen of the display apparatus; and the extraction unit is further configured to determine the target referred to by the first command element based on a conversation history of the display apparatus, and extract the unique identifying information corresponding to the determined target as the indicator. ### Claim 6 (depends on 1) The interactive server of claim 1, further comprising: a voice processing unit configured to convert the received voice command signal into text information. ### Claim 7 A display apparatus, comprising: an input unit configured to receive a voice command; a communication unit configured to send a voice command signal corresponding to the voice command to a server apparatus; a display unit configured to display a screen; and a controller configured to select a target referred to by an indicator based on a display status of objects displayed on the screen of the display unit in response to response information including the indicator and a command word being received from the server apparatus, and perform an operation corresponding to the command word with respect to the selected target. ### Claim 8 (depends on 7) The display apparatus of claim 7, wherein the voice command signal comprises a first command element representing the target and a second command element representing an execution command, and the first command element is an command element that is determined based on a screen displaying status of the display apparatus, and comprises at least one of a pronoun, an ordinal number, and a direction. ### Claim 9 A control method of an interactive server, the control method comprising: receiving a voice command signal including a first command element representing a target and a second command element representing an execution command from a display apparatus; extracting, using a processor, an indicator corresponding to the first command element and a command word corresponding to the second command element; and generating response information corresponding to the voice command signal by combining the extracted indicator and command word, and sending the response information to the display apparatus, wherein the first command element is an command element determined based on a displaying status of objects displayed on a screen of the display apparatus. ### Claim 10 (depends on 9) The control method of claim 9, wherein the first command element comprises at least one of a pronoun, an ordinal number, and a direction. ### Claim 11 (depends on 10) The control method of claim 10, wherein the extracting an indicator corresponding to the first command element and a command word corresponding to the second command element comprises: determining whether the first command element includes request information; and extracting the command word corresponding to the request information from a storage unit if the first command element includes the request information, and the sending the response information to the display apparatus comprises adding content information corresponding to the request information to the response information based on the extracted command word. ### Claim 12 (depends on 9) The control method of claim 9, wherein the indicator comprises an execution word that refers to the target among the objects displayed on the screen of the display apparatus. ### Claim 13 (depends on 9) The control method of claim 9, wherein the indicator comprises unique identifying information of the objects displayed on the screen of the display apparatus; and the extracting an indicator corresponding to the first command element and a command word corresponding to the second command element comprises: determining the target referred to by the first command element based on a conversation history of the display apparatus; and extracting the unique identifying information corresponding to the determined target as the indicator. ### Claim 14 (depends on 10) The control method of claim 10, further comprising: converting the received voice command signal into text information. ### Claim 15 A control method of a display apparatus, the control method comprising: receiving a voice command; sending an voice command signal corresponding to the voice command to a server apparatus; receiving response information including an indicator and a command word from the server apparatus; and selecting a target referred to by the indicator based on a displaying status of objects displayed on a screen, and performing, using a processor, an operation corresponding to the command word with respect to the selected target. ### Claim 16 (depends on 15) The control method of claim 15, wherein the voice command signal comprises a first command element representing the target and a second command element representing an execution command, and the first command element is an command element determined based on a screen displaying status of the display apparatus, and comprises at least one of a pronoun, an ordinal number, and a direction. ### Claim 17 A display apparatus comprising: a display unit configured to display a screen including a plurality of selectable objects; an input unit configured to receive a voice command; a communication unit configured to receive response information from an external device in response to receiving the voice command, the response information including a command word that is selected according to the voice command; and a controller configured to select a target object from among the plurality of selectable objects using the response information received from the external device, and to perform an operation corresponding to the command word with respect to the selected target object.