# US 10,871,944 B2 · Implicit narration for aural user interface > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,871,944 B2 - Document ID: US10871944B2 - Status: Granted - Kind: B2 - Application number: 16/664,268 - Filed: 2019-10-25 - Published: 2020-02-20 - Granted: 2020-12-22 - Earliest claimed: 2016-11-22 - Assignees: Microsoft Technology Licensing, LLC - Applicants: Microsoft Technology Licensing, LLC - Inventors: Brian S. Stucker; David Lu; Allen L. Ussher; Jennifer L. Bost - Web page: https://patentgrep.com/patent/US10871944B2 ## CPC - G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback} - G06F 3/0481: based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance - G06F 16/345: {Summarisation for human users} - G06Q 10/107: Computer-aided management of electronic mailing [e-mailing] - G10L 13/08: Text analysis or generation of parameters for speech synthesis out of text, e.g. grapheme to phoneme translation, prosody generation or stress or intonation determination - G06Q 10/40: Business processes related to social networking or social networking services - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR - G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING ## Abstract A computing device and a method for controlling narration. The computing device comprises a display device displaying a visual user interface including textual information and an electronic processor configured to map the textual information to an implicit audio narration, wherein mapping textual information to the implicit audio narration has a scalable level of precision to the textual information depending on the visual user interface, and the electronic processor further configured to output the implicit audio narration. ## Claims ### Claim 1 A computing device comprising: a visual user interface including textual information and graphical information; and an electronic processor configured to: map each field of the textual information of the visual user interface to an implicit audio narration, wherein mapping a field of the textual information to the implicit audio narration has a scalable level of precision based on a context of content in the visual user interface, map the graphical information to the implicit audio narration, wherein mapping the graphical information to the implicit audio narration includes mapping a graphical icon to an application name, and output the implicit audio narration. ### Claim 2 (depends on 1) The computing device of claim 1, wherein the electronic processor is further configured to analyze the visual user interface, and determine, for each field of the textual information, the scalable level of precision for mapping the field of the textual information to the implicit audio narration. ### Claim 3 (depends on 1) The computing device of claim 1, wherein the electronic processor is further configured to map a first field of the textual information including a time-stamp to a first segment of the implicit audio narration, the first segment of the implicit audio narration including a relative indication of a duration associated with the time-stamp with respect to a reference time. ### Claim 4 (depends on 1) The computing device of claim 1, wherein the textual information is selected from a group consisting of an email, a text message, and a notification from a software application. ### Claim 5 (depends on 1) The computing device of claim 1, wherein the electronic processor is further configured to map a first field of the textual information to a first segment of the implicit audio narration, the first segment of the implicit audio narration including a variation of at least one of a vocabulary and grammar associated with the first field of the textual information. ### Claim 6 (depends on 1) The computing device of claim 1, wherein the electronic processor is further configured to determine a fuzzy time grouping for a plurality of time-stamps associated with the textual information; and output the implicit audio narration including the fuzzy time grouping. ### Claim 7 A method for controlling narration, the method comprising: receiving a textual information from a visual user interface; mapping, with an electronic processor, each field of the textual information from the visual user interface to an implicit audio narration, wherein mapping a field of the textual information to the implicit audio narration has a scalable level of precision based on a context of content in the visual user interface, receiving graphical information from a visual user interface, mapping the graphical information to the implicit audio narration, wherein mapping the graphical information to the implicit audio narration includes mapping a graphical icon to an application name, and outputting the implicit audio narration. ### Claim 8 (depends on 7) The method of claim 7, further comprising analyzing, with the electronic processor, the textual information received from the visual user interface, and determining for each field of the textual information, the scalable level of precision for mapping the field of the textual information to the implicit audio narration. ### Claim 9 (depends on 7) The method of claim 7, further comprising: mapping, with the electronic processor, a first field of the textual information including a time-stamp to a first segment of the implicit audio narration, the first segment of the implicit audio narration including a relative indication of a time associated with the time-stamp with respect to a reference time. ### Claim 10 (depends on 7) The method of claim 7, further comprising: mapping, with the electronic processor, a first field of the textual information to a first segment of the implicit audio narration, the first segment of the implicit audio narration including a variation of at least one of a vocabulary and a grammar associated with the first field of the textual information. ### Claim 11 (depends on 7) The method of claim 7, wherein the textual information is selected from a group consisting of an email, a text message, and a notification from a software application. ### Claim 12 (depends on 7) The method of claim 7, further comprising: determining a fuzzy time grouping for a plurality of time-stamps associated with the textual information; and outputting the implicit audio narration including the fuzzy time grouping. ### Claim 13 A non-transitory machine-readable medium containing computer-executable instructions that when executed by one or more processors cause the one or more processors to perform a method for controlling narration, the method comprising: receiving textual information from a visual user interface, mapping each field of the textual information from the visual user interface to an implicit audio narration, wherein mapping a field of the textual information to the implicit audio narration has a scalable level of the precision based on a context of content in the visual user interface, receiving graphical information from a visual user interface, mapping the graphical information to the implicit audio narration, wherein mapping the graphical information to the implicit audio narration includes mapping a graphical icon to an application name, and outputting the implicit audio narration. ### Claim 14 (depends on 13) The non-transitory machine-readable medium of claim 13, wherein the method further comprises: analyzing the visual user interface; and determining, for each field of the textual information, the scalable level of precision for mapping the field of the textual information to the implicit audio narration. ### Claim 15 (depends on 13) The non-transitory machine-readable medium of claim 13, wherein the method further comprises: mapping a first field of the textual information, including a time-stamp to a first segment of the implicit audio narration, the first segment of the implicit audio narration including a relative indication of a time associated with the time-stamp. ### Claim 16 (depends on 13) The non-transitory machine-readable medium of claim 13, wherein the method further comprises: mapping a first field of the textual information to a first segment of the implicit audio narration, the first segment of the implicit audio narration including a variation of at least one of a vocabulary and grammar associated with the first field of the textual information. ### Claim 17 (depends on 13) The non-transitory machine-readable medium of claim 13, wherein the textual information is selected from a group consisting of an email, a text message, and a notification from a software application.