# US 11,029,815 B1 · Modular systems and methods for selectively enabling cloud-based assistive technologies > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,029,815 B1 - Document ID: US11029815B1 - Status: Granted - Kind: B1 - Application number: 17/169,265 - Filed: 2021-02-05 - Published: 2021-05-27 - Granted: 2021-06-08 - Earliest claimed: 2016-03-18 - Assignees: AudioEye, Inc. - Applicants: AudioEye, Inc. - Inventors: Sean D. Bradley; Mark D. Baker; Jeffrey O. Jones; Kenny P. Hefner; Adam Finkelstein; Douglas J. Gilormo; Taylor R. Bodnar; David C. Pinckney; Charlie E. Blevins; Trevor C. Jones; Helena Laymon - Web page: https://patentgrep.com/patent/US11029815B1 ## CPC - G06F 40/143: Markup, e.g. Standard Generalized Markup Language [SGML] or Document Type Definition [DTD] - G06F 3/04817: using icons (graphical or visual programming using iconic symbols G06F8/34) - G06F 3/0482: Interaction with lists of selectable items, e.g. menus - G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback} - G06F 40/117: Tagging; Marking up (details of markup languages G06F40/143); Designating a block; Setting of attributes (style sheets, e.g. eXtensible Stylesheet Language Transformation [XSLT], G06F40/154) - G06F 40/14: Tree-structured documents (parsing G06F40/205; validation G06F40/226) - G10L 13/027: Concept to speech synthesisers; Generation of natural phrases from machine-based concepts (generation of parameters for speech synthesis out of text G10L13/08) - G10L 15/02: Feature extraction for speech recognition; Selection of recognition unit - G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue - G10L 15/26: Speech to text systems (G10L15/08 takes precedence) - H04L 67/535: {Tracking the activity of the user (network monitoring arrangements H04L43/00; recording of computer activity G06F11/34)} - G10L 13/02: Methods for producing synthetic speech; Speech synthesisers - G10L 2015/221: {Announcement of recognition results} - H04L 67/02: based on web technology, e.g. hypertext transfer protocol [HTTP] - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING - H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M) ## Abstract Methods and systems for manual and programmatic remediation of websites. JavaScript code is accessed by a user device and optionally calls TTS, ASR, and RADAE modules from a remote server to thereby facilitate website navigation by people with diverse abilities. ## Claims ### Claim 1 A web page remediation computer-implemented method of programmatically assigning a descriptive HTML attribute to an untagged element on a web page to enable an audible description of the untagged element, the web page having an associated document object model (DOM), the computer-implemented method comprising: dynamically analyzing, by a computer system, code associated with the web page, the code comprising at least the DOM or HTML code; detecting one or more compliance issues relating to web accessibility standards in the code, wherein at least one of the one or more compliance issues comprises the untagged element lacking an adequate descriptive HTML attribute; applying one or more pre-existing remediations to the one or more compliance issues, wherein the one or more pre-existing remediations is generated by a remote server system performing at least: analyzing, by the remote server system, the untagged element to determine a subject matter associated with the untagged element; generating, by the remote server system, a descriptive HTML attribute to be associated with the untagged element based on the determined subject matter of the untagged element; and periodically analyzing, by the remote server system, the code associated with the web page to assess validity of the assigned descriptive HTML attribute; assigning, by the computer system, the generated descriptive HTML attribute to the untagged element in the code of the web page, the descriptive HTML attribute assigned to the untagged element adapted to enable an assistive technology to speak the descriptive attribute to a user; receiving, by the computer system, a first user input; and displaying, by the computer system, based on the first user input a dynamic user interface concurrently with the web page to the user, wherein the dynamic user interface enables the user to manage remediations on the web page, wherein receiving a second user input by the computer system causes the dynamic user interface to disappear. ### Claim 2 (depends on 1) The computer-implemented method of claim 1, wherein the first user input comprises a predetermined key combination. ### Claim 3 (depends on 1) The computer-implemented method of claim 1, wherein the first user input comprises a mouse click on an icon displayed in the web page. ### Claim 4 (depends on 1) The computer-implemented method of claim 1, wherein the one or more pre-existing remediations are javascript. ### Claim 5 (depends on 1) The computer-implemented method of claim 1, wherein the untagged element is an input field. ### Claim 6 (depends on 1) The computer-implemented method of claim 1, wherein the untagged element is an image, and the analyzing the untagged element further comprises: accessing, by the remote server system, the image to determine the subject matter of the image; generating the subject matter of the image by inputting the accessed image into an artificial intelligence algorithm. ### Claim 7 (depends on 6) The computer-implemented method of claim 6, wherein the image lacks the adequate descriptive HTML attribute when one or more descriptive HTML attributes of the image are erroneous. ### Claim 8 (depends on 1) The computer-implemented method of claim 1, wherein the assigning comprises changing the DOM or HTML code associated with the web page. ### Claim 9 (depends on 1) The computer-implemented method of claim 1, wherein the dynamic user interface is configured to enable the user to change a font size of the web page. ### Claim 10 (depends on 1) The computer-implemented method of claim 1, wherein the dynamic user interface enable the user to manually remediate online content of the web page by targeting at least one element of the web page. ### Claim 11 A non-transitory electronic storage medium with computer code stored thereon, the computer code configured to programmatically assign a descriptive HTML attribute to an element on a web page to enable an audible description of the element, the web page having an associated document object model (DOM), and the computer code configured to perform, when executed by a computer processor, the steps of: dynamically analyzing, by a computer system, code associated with the web page, the code comprising at least the DOM or HTML code; detecting one or more compliance issues relating to web accessibility standards in the code, wherein at least one of the one or more compliance issues comprises the element lacking an adequate descriptive HTML attribute; applying one or more pre-existing remediations to the one or more compliance issues, wherein the one or more pre-existing remediations is generated by a remote server system performing at least: analyzing, by the remote server system, the element to determine a subject matter associated with the element; generating, by the remote server system, a descriptive HTML attribute to be associated with the element based on the determined subject matter of the element; and periodically analyzing, by the remote server system, the code associated with the web page to assess validity of the assigned descriptive HTML attribute; assigning, by the computer system, the generated descriptive HTML attribute to the element in the code of the web page, the descriptive HTML attribute assigned to the element adapted to enable an assistive technology to speak the descriptive attribute to a user; receiving, by the computer system, a first user input; and displaying, by the computer system, based on the first user input a dynamic user interface concurrently with the web page to the user, wherein the dynamic user interface enables the user to manage remediations on the web page, wherein receiving a second user input by the computer system causes the dynamic user interface to disappear. ### Claim 12 (depends on 11) The non-transitory electronic storage medium with computer code stored thereon of claim 11, wherein the first user input comprises a predetermined key combination. ### Claim 13 (depends on 11) The non-transitory electronic storage medium with computer code stored thereon of claim 11, wherein the first user input comprises a mouse click on an icon displayed in the web page. ### Claim 14 (depends on 11) The non-transitory electronic storage medium with computer code stored thereon of claim 11, wherein the one or more pre-existing remediations are javascript. ### Claim 15 (depends on 11) The non-transitory electronic storage medium with computer code stored thereon of claim 11, wherein the element is an input field. ### Claim 16 (depends on 11) The non-transitory electronic storage medium with computer code stored thereon of claim 11, wherein the element is an image, and the analyzing the element further comprises: accessing, by the remote server system, the image to determine the subject matter of the image; generating the subject matter of the image by inputting the accessed image into an artificial intelligence algorithm. ### Claim 17 (depends on 16) The non-transitory electronic storage medium with computer code stored thereon of claim 16, wherein the image lacks the adequate descriptive HTML attribute when one or more descriptive HTML attributes of the image are erroneous. ### Claim 18 (depends on 11) The non-transitory electronic storage medium with computer code stored thereon of claim 11, wherein the assigning comprises changing the DOM or HTML code associated with the web page. ### Claim 19 (depends on 11) The non-transitory electronic storage medium with computer code stored thereon of claim 11, wherein the dynamic user interface is configured to enable the user to change a font size of the web page. ### Claim 20 (depends on 11) The non-transitory electronic storage medium with computer code stored thereon of claim 11, wherein the dynamic user interface enable the user to manually remediate online content of the web page by targeting at least one element of the web page.