# US 2020/0401426 A1 · Display apparatus and controlling method thereof > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2020/0401426 A1 - Document ID: US20200401426A1 - Status: Published application - Kind: A1 - Application number: 17/010,614 - Filed: 2020-09-02 - Published: 2020-12-24 - Earliest claimed: 2017-05-12 - Assignees: Samsung Electronics Co., Ltd. - Applicants: Samsung Electronics Co., Ltd. - Inventors: Yang-soo KIM; Suraj Singh TANWAR - Web page: https://patentgrep.com/patent/US20200401426A1 ## CPC - G06F 9/454: {Multi-language systems; Localisation; Internationalisation} - G06F 3/0481: based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance - G06F 3/0484: for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range - G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback} - G06F 40/263: Language identification - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract A display apparatus is provided. The display apparatus according to an embodiment includes a display, and a processor configured to control the display to display a UI screen including a plurality of text objects, control the display to display a text object in a different language from a preset language among the plurality of text objects, along with a preset number, and in response to a recognition result of a voice uttered by a user including the displayed number, perform an operation relating to a text object corresponding to the displayed number. ## Claims ### Claim 1 A display apparatus, comprising: a display; and a processor configured to: receive a user voice input; process the user voice input to obtain text information corresponding to the user voice input; based on the user voice input being received while a web browsing application is executed in a foreground state, control the web browsing application to identify a content, corresponding the text information, that is included in a first web page provided by the web browsing application; based on the content corresponding to the text information being identified in the first web page, control the web browsing application to provide a second web page corresponding to the text information, based on the content corresponding to the text information not being identified in the first web page, receive via the web browsing application, information associated with non-use of the text information by the web browsing application, and based on the information associated with non-use of the text information, execute a search application for performing a search operation associated with the text information through an external server. ### Claim 2 (depends on 1) The display apparatus as claimed in claim 1, wherein the search application includes a video search application for performing a search for video contents associated with the text information through the external server. ### Claim 3 (depends on 1) The display apparatus as claimed in claim 1, wherein the processor is configured to: based on a specific button related to voice recognition of an external device being pressed while the web browsing application is displaying the first web page in the foreground state, control the web browsing application to analyze a plurality of contents included in the first web page, and display a symbol to guide a user's speech near the plurality of contents. ### Claim 4 (depends on 3) The display apparatus as claimed in claim 3, wherein the specific button related to voice recognition of the external device is a button that activates a microphone of the external device. ### Claim 5 (depends on 3) The display apparatus as claimed in claim 3, wherein the symbol to guide the user's speech includes a number, and wherein the processor is configured to, when the text information includes a second number, identify the content corresponding to the user's speech among the plurality of contents included in the first web page based on the second number included in the text information and the symbol including the number. ### Claim 6 (depends on 3) The display apparatus as claimed in claim 3, wherein the symbol to guide the user's speech includes an icon, and wherein the processor is configured to, when the text information includes a text, identify the content corresponding to the user's speech among the plurality of contents included in the first web page based on the text included in the text information and the symbol including the icon. ### Claim 7 (depends on 6) The display apparatus as claimed in claim 6, wherein the symbol including the icon is displayed near a content including text capable of voice recognition. ### Claim 8 (depends on 1) The display apparatus as claimed in claim 1, wherein the processor is configured to: if the content corresponding to the text information is not identified in the first web page, control the display to display a UI asking whether to execute the search application, and based on the user voice input to the UI, execute the search application. ### Claim 9 (depends on 1) The display apparatus as claimed in claim 1, wherein the processor is further configured to control the search application to provide a search result using the text information. ### Claim 10 (depends on 3) The display apparatus as claimed in claim 3, wherein the processor is configured to control the display to display the symbol including a number near a content including text that is not capable of voice recognition. ### Claim 11 A display method of a display apparatus, the display method comprising: receiving a user voice input; processing the user voice input to obtain text information corresponding to the user voice input; based on the user voice input being received while a web browsing application is executed in a foreground state, controlling the web browsing application to identify a content, corresponding the text information, that is included in a first web page provided by the web browsing application; based on the content corresponding to the text information being identified in the first web page, controlling the web browsing application to provide a second web page corresponding to the text information, based on the content corresponding to the text information not being identified in the first web page, receiving via the web browsing application, information associated with non-use of the text information by the web browsing application, and based on the information associated with non-use of the text information, executing a search application for performing a search operation associated with the text information through an external server. ### Claim 12 (depends on 11) The display method as claimed in claim 11, wherein the search application includes a video search application for performing a search for video contents associated with the text information through the external server. ### Claim 13 (depends on 11) The display method as claimed in claim 11, further comprising: based on a specific button related to voice recognition of an external device being pressed while the web browsing application is displaying the first web page in the foreground state, controlling the web browsing application to analyze a plurality of contents included in the first web page, and displaying a symbol to guide a user's speech near the plurality of contents. ### Claim 14 (depends on 13) The display method as claimed in claim 13, wherein the specific button related to voice recognition of the external device is a button that activates a microphone of the external device. ### Claim 15 (depends on 13) The display method as claimed in claim 13, wherein the symbol to guide the user's speech includes a number, and wherein the display method further comprises, when the text information includes a second number, identifying the content corresponding to the user's speech among the plurality of contents included in the first web page based on the second number included in the text information and the symbol including the number. ### Claim 16 (depends on 13) The display method as claimed in claim 13, wherein the symbol to guide the user's speech includes an icon, and wherein the display method further comprises, when the text information includes a text, identifying the content corresponding to the user's speech among the plurality of contents included in the first web page based on the text included in the text information and the symbol including the icon. ### Claim 17 (depends on 16) The display method as claimed in claim 16, wherein the symbol including the icon is displayed near the content including text capable of voice recognition. ### Claim 18 (depends on 11) The display method as claimed in claim 11, wherein the executing the search application comprises: if the content corresponding to the text information is not identified in the first web page, displaying a UI asking whether to executing the search application, and based on the user voice input to the UI, executing the search application. ### Claim 19 (depends on 11) The display method as claimed in claim 11, wherein the executing the search application comprises: controlling the search application to provide a search result using text information. ### Claim 20 (depends on 13) The display method as claimed in claim 13, further comprising: displaying a symbol including a number near the content including text that is not capable of voice recognition.