# US 12,223,956 B2 · Display device and method for controlling same > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,223,956 B2 - Document ID: US12223956B2 - Status: Granted - Kind: B2 - Application number: 17/740,616 - Filed: 2022-05-10 - Published: 2022-08-25 - Granted: 2025-02-11 - Earliest claimed: 2020-01-21 - Assignees: Samsung Electronics Co., Ltd. - Applicants: Samsung Electronics Co., Ltd. - Inventors: Donghoon Kang; Soohyang Kim - Web page: https://patentgrep.com/patent/US12223956B2 ## CPC - G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue - G06F 3/14: Digital output to display device {; Cooperation and interconnection of the display device with other functional units} - G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback} - G10L 15/08: Speech classification or search - G10L 15/28: Constructional details of speech recognition systems - G09G 2354/00: Aspects of interface with display user - G09G 2370/022: Centralised management of display operation, e.g. in a server instead of locally - G09G 2370/04: Exchange of auxiliary data, i.e. other than image data, between monitor and graphics controller - G09G 2370/16: Use of wireless transmission of display information - G10L 21/0208: Noise filtering - G10L 2015/088: {Word spotting} - G10L 2015/223: {Execution procedure of a spoken command} - G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00) ## Abstract A display device including a user input receiver configured to receive a user input; a voice receiver configured to receive a user voice input; a memory configured to store a plurality of Voice Assistance (VA) applications associated with a plurality of VA servers that provide a conversation service; and a processor configured to based on a user input for performing a function corresponding to at least one VA application being received through the user input receiver, perform a function corresponding to a first VA application among the plurality of VA applications stored in the memory according to setting information designating the function corresponding to the first VA to be automatically performed according to the user input, and based on a wake up word for performing a function corresponding to a second VA application among the plurality of VA applications being included in the user voice input received through the voice receiver, change the setting information stored in the memory such that the function corresponding to the second VA application is automatically performed according to the user input. ## Claims ### Claim 1 A display device comprising: a user input receiver configured to receive a user input corresponding to a Push to Talk (PTT) function from a user; a voice receiver configured to receive an utterance voice from the user; a memory storing a plurality of Voice Assistance (VA) applications associated with a plurality of VA servers that provide a conversation service based on the utterance voice from the user; and a processor configured to: based on the user input corresponding to the PTT function for performing a function corresponding to at least one VA application being received through the user input receiver, perform a function corresponding to a first VA application among the plurality of VA applications according to setting information of the function corresponding to the first VA application to be automatically performed by the user input corresponding to the PTT function, and based on the utterance voice including a wake up word for performing a function corresponding to a second VA application among the plurality of VA applications being received through the voice receiver, change the setting information stored in the memory such that the function corresponding to the second VA application is automatically performed by the user input corresponding to the PTT function, wherein the processor is further configured to: based on the user input corresponding to the PTT function for performing the function corresponding to the at least one VA application through the user input receiver being received after changing the setting information, perform the function corresponding to the second VA application among the plurality of VA applications according to the changed setting information of the second VA application to be automatically performed by the user input corresponding to the PTT function, wherein the first VA application is associated with a first VA server among the plurality of VA servers, and the second VA application is associated with a second VA server different from the first VA server among the plurality of VA servers. ### Claim 2 (depends on 1) The display device of claim 1, wherein the processor is configured to perform preprocessing on the utterance voice from the user, received from the voice receiver, and transfer the preprocessed utterance voice from the user to the second VA application. ### Claim 3 (depends on 1) The display device of claim 1, wherein the plurality of VA applications are configured to store conversation policies in the memory that define processing of the utterance obtained from the user through the voice receiver, and the processor is configured to provide voice messages based on the utterance voice from the user and the conversation policies, and update the conversation policies through the plurality of VA servers associated with the plurality of VA applications. ### Claim 4 (depends on 3) The display device of claim 3, further comprising a sound outputter configured to output the voice messages, wherein the processor is configured to control the sound outputter based on a voice message provided by the second VA application. ### Claim 5 (depends on 1) The display device of claim 1, further comprising an image outputter configured to display a user interface, wherein the processor is configured to display a user interface related to activation/deactivation of the setting information through the image outputter. ### Claim 6 (depends on 1) The display device of claim 1, wherein the processor is configured to perform preprocessing on the utterance voice from the user, received through the voice receiver, and recognize the wake up word for performing the function corresponding to the second VA application from the preprocessed utterance voice from the user based on a preset time period. ### Claim 7 (depends on 1) The display device of claim 1, wherein the processor is configured to perform preprocessing on the utterance voice from the user, received through the voice receiver, and determine whether the wake up word for performing the function corresponding to the second VA application is included in the preprocessed utterance voice from the user. ### Claim 8 (depends on 1) The display device of claim 1, wherein the processor is configured to determine to change the setting information based on a repetition number of the wake up word for performing the function corresponding to the second VA application. ### Claim 9 (depends on 1) The display device of claim 1, wherein the processor is configured to perform preprocessing on the utterance voice from the user based on at least one of noise removal, echo canceling, or beamforming. ### Claim 10 A method for controlling a display device including a memory storing a plurality of Voice Assistance (VA) applications associated with a plurality of VA servers that provide a conversation service based on an utterance voice from a user, comprising: receiving a user input corresponding to a Push to Talk, PTT, function for performing a function corresponding to at least one VA application among the plurality of VA applications through a user input receiver; based on the user input corresponding to the PTT function for performing a function corresponding to at least one VA application being received through the user input receiver, performing a function corresponding to a first VA application among the plurality of VA applications according to setting information of the function corresponding to the first VA application to be automatically performed by the user input corresponding to the PTT function; based on the utterance voice including a wake up word for performing a function corresponding to a second VA application among the plurality of VA applications being received through the voice receiver, changing the setting information such that the function corresponding to the second VA application is automatically performed by the user input corresponding to the PTT function; and based on the user input corresponding to the PTT function for performing the function corresponding to the at least one VA application through the user input receiver being received after changing the setting information, performing the function corresponding to the second VA application among the plurality of VA applications according to the changed setting information of the second VA application to be automatically performed by the user input corresponding to the PTT function; wherein the first VA application is associated with a first VA server among the plurality of VA servers, and the second VA application is associated with a second VA server different from the first VA server among the plurality of VA servers. ### Claim 11 (depends on 10) The method of claim 10, further comprising performing preprocessing on the utterance voice from the user, wherein the changing comprises recognizing the wake up word for performing the function corresponding to the second VA application from the preprocessed utterance voice from the user based on a preset time period. ### Claim 12 (depends on 11) The method of claim 11, wherein the recognizing comprises determining whether the wake up word for performing the function corresponding to the second VA application is included in the preprocessed utterance voice from the user. ### Claim 13 (depends on 11) The method of claim 11, wherein the changing comprises changing the setting information based on a repetition number of the wake up word for performing the function corresponding to the second VA application.