US 11,687,208 B2Granted

Evaluation of interactions with a user interface

AssigneeFullStory, Inc.

InventorsJoel Grayson Webber, Stephanie Jill Brubaker, Hollis Bruce Johnson, Jr., Ian Thomas Rose, Scott Mitchell Voigt, Jaime Michael Yap, Joshua Calvin Teague

Life of this patent

Estimating the term…

patentgrep

Loading patent…

Abstract

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for evaluating interactions with a user interface are disclosed. In one aspect, a method includes identifying a set of mutation events specifying changes to the structure of a user interface that occurred during the user session, and generating user interface states specifying different structures of the user interface throughout the given user session. Based at least in part on the user interface states, playback data that present visual changes of the user interface corresponding to the set of mutation events that occurred during the user session are generated. Session activity data describing user interactions that occurred during the user session are also generated. At least a portion of the playback data and the session activity data are output to a requesting device.

Claims17

Dependent claims

A method, comprising:

configuring a script to exclude a specified set of information from event data collected from client devices that execute the script during user sessions that occur at the client devices;
obtaining and storing, by one or more servers and based on execution of the script at the client devices, the event data representing (i) changes to user interface structures presented at the client devices during the user sessions that occur at the client devices, and (ii) user interactions performed during the user sessions that occur at the client devices;
receiving, from a publisher device, a query specifying (i) a given user interaction and (ii) a given user interface state;
reconstituting, by the one or more servers and using the stored event data for a given user session among the user sessions, playback of at least a portion of the given user session based on the given user session including the given user interaction and the given user interface state specified in the query, wherein the reconstituted playback includes visual presentation of (i) a first user interface structure presented at a first point within the given user session based on the event data corresponding to the first point within the given user session and (ii) a second user interface structure that presented the specified set of information at a second point within the given user session, wherein the presentation of the reconstituted second user interface structure excludes the specified set of information;
providing, to the publisher device, the reconstituted playback of the given user session, wherein the publisher device differs from (i) a given client device at which the given user session occurred and (ii) the one or more servers;
creating, in a data storage device, an index entry that indexes a session identifier for the given user session to stored data specifying (i) user interactions that occurred during the given user session and (ii) states of the user interface structure that were presented during the given user session;
and
searching the data storage device using the (i) given user interaction and (ii) the given user interface state from the query;
identifying, based on the searching, a set of sessions responsive to the query, wherein the set of sessions includes the given user session;
and
presenting, at the publisher device, a list specifying the set of sessions.

8 more elements

A non-transitory computer readable medium storing instructions that when executed by one or more data processing apparatus cause the one or more data processing apparatus to perform operations comprising:

configuring a script to exclude a specified set of information from event data collected from client devices that execute the script during user sessions that occur at the client devices;
obtaining and storing, based on execution of the script at the client devices, the event data representing (i) changes to user interface structures presented at the client devices during the user sessions that occur at the client devices, and (ii) user interactions performed during the user sessions that occur at the client devices;
receiving, from a publisher device, a query specifying (i) a given user interaction and (ii) a given user interface state;
reconstituting, using the stored event data for a given user session among the user sessions, playback of at least a portion of the given user session based on the given user session including the given user interaction and the given user interface state specified in the query, wherein the reconstituted playback includes visual presentation of (i) a first user interface structure presented at a first point within the given user session based on the event data corresponding to the first point within the given user session and (ii) a second user interface structure that presented the specified set of information at a second point within the given user session, wherein the presentation of the reconstituted second user interface structure excludes the specified set of information;
providing, to the publisher device, the reconstituted playback of the given user session, wherein the publisher device differs from (i) a given client device at which the given user session occurred and (ii) the one or more data processing apparatus;
creating, in a data storage device, an index entry that indexes a session identifier for the given user session to stored data specifying (i) user interactions that occurred during the given user session and (ii) states of the user interface structure that were presented during the given user session;
and
searching the data storage device using the (i) given user interaction and (ii) the given user interface state from the query;
identifying, based on the searching, a set of sessions responsive to the query, wherein the set of sessions includes the given user session;
and
presenting, at the publisher device, a list specifying the set of sessions.

8 more elements

A system, comprising:

a data storage device;
and
one or more processors that interact with the data storage device and execute instructions that cause the one or more processors to perform operations comprising:
configuring a script to exclude a specified set of information from event data collected from client devices that execute the script during user sessions that occur at the client devices;
obtaining and storing, based on execution of the script at the client devices, the event data representing (i) changes to user interface structures presented at the client devices during the user sessions that occur at the client devices, and (ii) user interactions performed during the user sessions that occur at the client devices;
receiving, from a publisher device, a query specifying (i) a given user interaction and (ii) a given user interface state;
reconstituting, using the stored event data for a given user session among the user sessions, playback of at least a portion of the given user session based on the given user session including the given user interaction and the given user interface state specified in the query, wherein the reconstituted playback includes visual presentation of (i) a first user interface structure presented at a first point within the given user session based on the event data corresponding to the first point within the given user session and (ii) a second user interface structure that presented the specified set of information at a second point within the given user session, wherein the presentation of the reconstituted second user interface structure excludes the specified set of information;
providing, to the publisher device, the reconstituted playback of the given user session, wherein the publisher device differs from (i) a given client device at which the given user session occurred and (ii) the one or more data processing apparatus;
creating, in a data storage device, an index entry that indexes a session identifier for the given user session to stored data specifying (i) user interactions that occurred during the given user session and (ii) states of the user interface structure that were presented during the given user session;
and
searching the data storage device using the (i) given user interaction and (ii) the given user interface state from the query;
identifying, based on the searching, a set of sessions responsive to the query, wherein the set of sessions includes the given user session;
and
presenting, at the publisher device, a list specifying the set of sessions.

11 more elements

Dependencies are inferred from the claim text.

Facts

Application: 17/548,856Filed 13 Dec 2021 · continuation
Priority: 31 Dec 2014
Published: US 2022/0214772 A17 Jul 2022
Granted: 27 Jun 2023
Term ends: Not estimatedThe source records don’t support an estimate.

Classification7 codes

G06F 3/0481
Interaction techniques based on graphical user interfaces [GUI]: based on specific properties of the displayed interaction object or a…
G06F 9/451
Arrangements for executing specific programs: execution arrangements for user interfaces
G06F 11/302
Monitoring arrangements specially adapted to the computing system or computing system component being monitored: where the computing system…
G06F 11/3438
Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of…:…

Family

Application14/587,481Parent of this continuation · filed 31 Dec 2014
Application15/695,951Parent of this continuation · filed 5 Sep 2017
US 9,766,769 B1Parent of this continuation · filed 19 Sep 2017
Application15/896,887Parent of this continuation · filed 14 Feb 2018
US 9,927,947 B1Parent of this continuation · filed 27 Mar 2018
Application16/535,799Parent of this continuation · filed 8 Aug 2019
US 10,402,041 B2Parent of this continuation · filed 3 Sep 2019
Application17/094,390Parent of this continuation · filed 10 Nov 2020
US 10,838,571 B2Parent of this continuation · filed 17 Nov 2020
US 2022/0214772 A1Pre-grant publication · published 7 Jul 2022
US 11,199,939 B2Parent of this continuation
US 2018/0173375 A1Published application
US 2019/0361572 A1Published application
US 2021/0055836 A1Published application
US 11,687,208 B2This patent

From the US filing history. Foreign family members aren’t listed.