# US 2018/0024723 A1 · Synchronizing user input with a user interface

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2018/0024723 A1
- Document ID: US20180024723A1
- Status: Published application
- Kind: A1
- Application number: 15/213,705
- Filed: 2016-07-19
- Published: 2018-01-25
- Earliest claimed: 2016-07-19
- Assignees: Red Hat, Inc.
- Applicants: Red Hat, Inc.
- Inventors: Martin Vecera; Jiri Pechanec
- Web page: https://patentgrep.com/patent/US20180024723A1

## CPC

- G06F 3/0488: using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F 3/0484: for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F 9/451: Execution arrangements for user interfaces
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Synchronizing user input with a user interface is disclosed. User input that identifies a selected location on a display device that is presenting a first user interface (UI) is received at the first time. A user input record that includes a location identifier that identifies the selected location, and a user input timestamp that identifies the first time, is stored in a memory. At a second time, a second UI is presented on the display device that is different from the first UI. The second UI includes a user-activatable UI portion having an activatable extent that includes the selected location. After the second time, processing of the user input record is initiated. It is determined that the user input timestamp identifies a time earlier than the second time, and activation of the user-activatable UI portion is inhibited.

## Claims

### Claim 1

A method comprising:
receiving, at a first time by a computing device comprising a processor device, user input that identifies a selected location on a display device that is presenting a first user interface (UI) at the first time;
storing, in a memory, a user input record that includes a location identifier (ID) that identifies the selected location and a user input timestamp that identifies the first time;
presenting, at a second time, on the display device a second UI that is different from the first UI, the second UI including a user-activatable UI portion having an activatable extent that includes the selected location;
initiating, after the second time, processing of the user input record;
determining that the user input timestamp identifies a time earlier than the second time; and
inhibiting activation of the user-activatable UI portion.

### Claim 2 (depends on 1)

The method of claim 1 further comprising storing, in the memory:
a location ID that identifies a location of the user-activatable UI portion;
extent information that identifies the activatable extent of the user-activatable UI portion with respect to the location; and
a presentation timestamp identifying the second time.

### Claim 3 (depends on 2)

The method of claim 2 wherein initiating, after the second time, processing of the user input record further comprises determining that the selected location is within the activatable extent of the user-activatable UI portion; and
wherein determining that the user input timestamp identifies the time earlier than the second time comprises determining that the user input timestamp is earlier than the presentation timestamp.

### Claim 4 (depends on 1)

The method of claim 1 wherein initiating, after the second time, processing of the user input record further comprises:
determining that at the first time a different user-activatable UI portion having an activatable extent included the selected location;
determining an application module that generated the different user-activatable UI portion; and
sending a message identifying the user input to the application module for processing the user input with respect to the different user-activatable UI portion.

### Claim 5 (depends on 4)

The method of claim 4 wherein determining that at the first time the different user-activatable UI portion having the activatable extent included the selected location comprises:
accessing a structure that identifies a plurality of user-activatable UI portions, and for each respective user-activatable UI portion identifies:
a location identifier (ID) that identifies a location on the display device at which the respective user-activatable UI portion was presented;
extent information that identifies an activatable extent of the respective user-activatable UI portion;
a presentation timestamp that identifies a time at which the respective user-activatable UI portion was presented on the display device;
a removal timestamp that identifies a time at which the respective user-activatable UI portion was removed from the display device; and
an application module identifier that identifies an application module that generated the respective user-activatable UI portion.

### Claim 6 (depends on 5)

The method of claim 5 wherein accessing the structure that identifies the plurality of user-activatable UI portions further comprises:
identifying the different user-activatable UI portion by determining that:
the activatable extent of the different user-activatable UI portion includes the selected location;
the presentation timestamp of the different user-activatable UI portion identifies a time earlier than the user input timestamp; and
the removal timestamp of the different user-activatable UI portion identifies a time later than the user input timestamp.

### Claim 7 (depends on 1)

The method of claim 1 further comprising:
presenting, prior to the first time, the first UI on the display device, the first UI comprising a first user-activatable UI portion having an activatable extent that includes the selected location; and
storing, in the memory:
a location identifier (ID) that identifies a location on the display device at which the first user-activatable UI portion was presented;
extent information that identifies the activatable extent of the first user-activatable UI portion; and
a presentation timestamp that identifies a time at which the first user-activatable UI portion was presented on the display device.

### Claim 8 (depends on 7)

The method of claim 7 further comprising:
storing, at the second time, a removal timestamp that identifies a time at which the first user-activatable UI portion was removed from the display device.

### Claim 9 (depends on 1)

The method of claim 1 further comprising presenting a message on the display device that indicates that activation of the user-activatable UI portion is inhibited.

### Claim 10 (depends on 1)

The method of claim 1 wherein the user input comprises a click event associated with a mouse pointer that is located at the selected location.

### Claim 11 (depends on 1)

The method of claim 1 wherein the user input comprises a touch event associated with a user contacting the display device at the selected location.

### Claim 12

A computing device comprising:
a memory; and
a processor device coupled to the memory to:
receive, at a first time, user input that identifies a selected location on a display device that is presenting a first user interface (UI) at the first time;
store, in the memory, a user input record that includes a location identifier (ID) that identifies the selected location and a user input timestamp that identifies the first time;
present, at a second time, on the display device a second UI that is different from the first UI, the second UI including a user-activatable UI portion having an activatable extent that includes the selected location;
initiate, after the second time, processing of the user input record;
determine that the user input timestamp identifies a time earlier than the second time; and
inhibit activation of the user-activatable UI portion.

### Claim 13 (depends on 12)

The computing device of claim 12 wherein the processor device is further to store, in the memory:
a location ID that identifies a location of the user-activatable UI portion;
extent information that identifies the activatable extent of the user-activatable UI portion with respect to the location; and
a presentation timestamp identifying the second time.

### Claim 14 (depends on 13)

The computing device of claim 13 wherein to initiate, after the second time, processing of the user input record, the processor device is further to:
determine that at the first time a different user-activatable UI portion having an activatable extent included the selected location;
determine an application module that generated the different user-activatable UI portion; and
send a message identifying the user input to the application module for processing the user input with respect to the different user-activatable UI portion.

### Claim 15 (depends on 12)

The computing device of claim 12 wherein the processor device is further to:
present, prior to the first time, the first UI on the display device, the first UI comprising a first user-activatable UI portion having an activatable extent that includes the selected location; and
store, in the memory:
a location ID that identifies a location on the display device at which the first user-activatable UI portion was presented;
extent information that identifies the activatable extent of the first user-activatable UI portion; and
a presentation timestamp that identifies a time at which the first user-activatable UI portion was presented on the display device.

### Claim 16 (depends on 15)

The computing device of claim 15 wherein the processor device is further to store, at the second time, a removal timestamp that identifies a time at which the first user-activatable UI portion was removed from the display device.

### Claim 17

A computer program product stored on a non-transitory computer-readable storage medium and including instructions configured to cause a processor device to:
receive, at a first time, user input that identifies a selected location on a display device that is presenting a first user interface (UI) at the first time;
store, in a memory, a user input record that includes a location identifier (ID) that identifies the selected location and a user input timestamp that identifies the first time;
present, at a second time, on the display device a second UI that is different from the first UI, the second UI including a user-activatable UI portion having an activatable extent that includes the selected location;
initiate, after the second time, processing of the user input record;
determine that the user input timestamp identifies a time earlier than the second time; and
inhibit activation of the user-activatable UI portion.

### Claim 18 (depends on 17)

The computer program product of claim 17 wherein the instructions are further configured to cause the processor device to store, in the memory:
a location ID that identifies a location of the user-activatable UI portion;
extent information that identifies the activatable extent of the user-activatable UI portion with respect to the location; and
a presentation timestamp identifying the second time.

### Claim 19 (depends on 18)

The computer program product of claim 18 wherein the instructions that configured to cause the processor device to initiate, after the second time processing of the user input record, are further configured to cause the processor device to:
determine that at the first time a different user-activatable UI portion having an activatable extent included the selected location;
determine an application module that generated the different user-activatable UI portion; and
send a message identifying the user input to the application module for processing the user input with respect to the different user-activatable UI portion.

### Claim 20 (depends on 17)

The computer program product of claim 17 wherein the instructions are further configured to cause the processor device to:
present, prior to the first time, the first UI on the display device, the first UI comprising a first user-activatable UI portion having an activatable extent that includes the selected location; and
store, in the memory:
a location identifier (ID) that identifies a location on the display device at which the first user-activatable UI portion was presented;
extent information that identifies the activatable extent of the first user-activatable UI portion; and
a presentation timestamp that identifies a time at which the first user-activatable UI portion was presented on the display device.
