US 10,871,975 B2Granted

Modifying readable and focusable elements on a page during execution of automated scripts

AssigneeCapital One Services, LLC

InventorsVu Nguyen, Jonatan Yucra Rodriguez, Adam Vukich, Joshua Edwards, David Gabriele, Abdelkadar M'Hamed Benkreira

Life of this patent

Estimating the term…

Loading patent…

Abstract

A device may initiate an automated script to perform one or more interactions with a browser application and identify a first element in a page rendered by the browser application that satisfies one or more accessibility criteria, wherein the first element may include text that is readable by a screen reader application and/or an attribute that causes the first element to be navigable using a keyboard. The device may modify the first element to be inaccessible to the screen reader application and the keyboard and insert, into the page, a second element including text that is readable by the screen reader application to describe the one or more interactions that the automated script is performing. The client device may restore the page to an original state based on determining that the automated script has finished executing.

Claims20

Dependent claims

A method, comprising:

initiating, by a device, an automated script to perform one or more interactions with a browser application executing on the device;
identifying, by the device, a set of elements in a page rendered by the browser application that satisfy one or more accessibility criteria,
wherein the set of elements include at least one content element that includes text readable by a screen reader application executing on the device and at least one focusable element that is navigable using a keyboard associated with the device;
modifying, by the device, content on the page to make the text associated with the at least one content element inaccessible to the screen reader application and to make the at least one focusable element inaccessible using the keyboard associated with the device;
and
inserting, by the device, at least one explanatory element into the page based on the one or more interactions that the automated script is performing,
wherein the at least one explanatory element includes text that is readable by the screen reader application to describe the one or more interactions that the automated script is performing, and
wherein the at least one explanatory element is navigable using the keyboard associated with the device.

5 more elements

A device, comprising:

one or more memories;
and
one or more processors, communicatively coupled to the one or more memories, configured to:
initiate an automated script to perform one or more interactions with a browser application executing on the device;
identify a set of elements in a page rendered by the browser application that satisfy one or more accessibility criteria,
wherein the set of elements include at least one content element that includes text readable by a screen reader application executing on the device and at least one focusable element that is navigable using a keyboard associated with the device;
modify content on the page to make the text associated with the at least one content element inaccessible to the screen reader application and to make the at least one focusable element inaccessible using the keyboard associated with the device;
and
insert at least one explanatory element into the page based on the one or more interactions that the automated script is performing,
wherein the at least one explanatory element is navigable using the keyboard associated with the device.

7 more elements

A non-transitory computer-readable medium storing instructions, the instructions comprising:

one or more instructions that, when executed by one or more processors on a device, cause the one or more processors to:
initiate an automated script to perform one or more interactions with a browser application executing on the device;
identify a set of elements in a page rendered by the browser application that satisfy one or more accessibility criteria,
wherein the set of elements include at least one content element that includes text readable by a screen reader application executing on the device and at least one focusable element that is navigable using a keyboard associated with the device;
modify content on the page to make the text associated with the at least one content element inaccessible to the screen reader application and to make the at least one focusable element inaccessible using the keyboard associated with the device;
and
insert at least one explanatory element into the page based on the one or more interactions that the automated script is performing.

4 more elements

Dependencies are inferred from the claim text.

Facts

Application: 16/850,042Filed 16 Apr 2020 · division
Priority: 15 May 2019
Published: US 2020/0364064 A119 Nov 2020
Granted: 22 Dec 2020
Term ends: Not estimatedThe source records don’t support an estimate.

Classification15 codes

G06F 9/451
Arrangements for executing specific programs: execution arrangements for user interfaces
G06F 3/04842
For the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a…:…
G06F 3/0489
Using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of…:…
G06F 3/04895
Using dedicated keyboard keys or combinations thereof: guidance during keyboard input operation, e.g. prompting

Family

Application16/413,169Parent of this division · filed 15 May 2019
US 2020/0364064 A1Pre-grant publication · published 19 Nov 2020
US 10,656,955 B1Parent of this division
US 10,871,975 B2This patent

From the US filing history. Foreign family members aren’t listed.

Timeline

Citations

Open elsewhere

Building an agent or pulling many patents? Use the API or MCP server instead of scraping pages. Get an API key