US 11,531,557 B2Granted

Determining user interface elements required for task completion using machine learning

AssigneeSalesforce, Inc.

InventorsDavid James Woodward, Brian J. Lonsdorf, Owen Winne Schoppe, Alan Martin Ross, Jessica Lundin, Sönke Rohde

Life of this patent

Estimating the term…

Loading patent…

Abstract

Disclosed herein are system, method, and computer program product embodiments for determining the minimum set of user interface (UI) elements for a task. One embodiment operates by transmitting UI elements associated with an application to a first computing device operated by a first user and a second computing device operated by a second user. Further, the embodiment includes obtaining data structures corresponding to a first task and a second task and then grouping, using a machine learning model, the data structures into a first cluster corresponding to the first task and a second cluster corresponding to the second task. Further still, the embodiment also includes determining a minimum set of UI elements required for the first task based on the first cluster.

Claims20

Dependent claims

A method, comprising:

transmitting, by one or more computing devices, a plurality of user interface (UI) elements associated with an application to a first computing device operated by a first user and a second computing device operated by a second user;
obtaining, by the one or more computing devices, a plurality of data structures comprising:
a first data structure identifying a first subset of the plurality of UI elements manipulated by the first user while the first user was completing a first task in the application using the first computing device;
and
a second data structure identifying a second subset of the plurality of UI elements manipulated by the second user while the second user was completing a second task in the application using the second computing device;
grouping, using a machine learning model executing on the one or more computing devices, the plurality of data structures into a plurality of clusters comprising:
a first cluster corresponding to the first task and comprising the first data structure;
and
determining, using the one or more computing devices, a minimum set of UI elements required for the first task based on the first cluster.

6 more elements

A system, comprising:

one or more computer processors;
and
a memory storing instructions that, when executed by the one or more computer processors, cause the one or more computer processors to:
transmit a plurality of user interface (UI) elements associated with an application to a first computing device operated by a first user and a second computing device operated by a second user;
obtain a plurality of data structures comprising:
a first data structure identifying a first subset of the plurality of UI elements manipulated by the first user while the first user was completing a first task in the application using the first computing device;
and
a second data structure identifying a second subset of the plurality of UI elements manipulated by the second user while the second user was completing a second task in the application using the second computing device;
group, using a machine learning model, the plurality of data structures into a plurality of clusters comprising:
a first cluster corresponding to the first task and comprising the first data structure;
and
determine a minimum set of UI elements required for the first task based on the first cluster.

9 more elements

A non-transitory computer readable medium (CRM) storing instructions, the instructions, when executed by one or more computer processors, cause the one or more computer processors to:

transmit a plurality of user interface (UI) elements associated with an application to a first computing device operated by a first user and a second computing device operated by a second user;
obtain a plurality of data structures comprising:
a first data structure identifying a first subset of the plurality of UI elements manipulated by the first user while the first user was completing a first task in the application using the first computing device;
and
a second data structure identifying a second subset of the plurality of UI elements manipulated by the second user while the second user was completing a second task in the application using the second computing device;
group, using a machine learning model, the plurality of data structures into a plurality of clusters comprising:
a first cluster corresponding to the first task and comprising the first data structure;
and
determine a minimum set of UI elements required for the first task based on the first cluster.

6 more elements

Dependencies are inferred from the claim text.