# US 2019/0317655 A1 · Systems and methods for assisting user interactions with displays

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0317655 A1
- Document ID: US20190317655A1
- Status: Published application
- Kind: A1
- Application number: 16/144,029
- Filed: 2018-09-27
- Published: 2019-10-17
- Earliest claimed: 2018-04-12
- Assignees: Capital One Services, LLC
- Applicants: Capital One Services, LLC
- Inventors: Adam Koeppel; Tyler Locke; James Zarakas; David Kelly Wurmfeld
- Web page: https://patentgrep.com/patent/US20190317655A1

## CPC

- G06F 3/04883: for inputting data by handwriting, e.g. gesture or text
- G06F 3/0489: using dedicated keyboard keys or combinations thereof
- G06F 3/016: {Input arrangements with force or tactile feedback as computer generated output to the user}
- G06F 3/04886: by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
- G06F 3/041: Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F 2203/014: Force feedback applied to GUI
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

User interface systems and methods for assisting user interactions with displays are disclosed. A user interface system may include a display and a sensor configured to detect an interaction, by a user, with the display. The user interface system may also include one or more memory devices storing instructions and one or more processors configured to execute the instructions. The instructions may instruct the user interface system to generate a pattern on the display, determine that the interaction is a command to initiate a process to assist the user in interacting with the display, generate a display element on the pattern at a location specified by the command, and provide a feedback signal to the user indicating the display element location.

## Claims

### Claim at position 1

1-20. (canceled)

### Claim 21

A user interface system, comprising:
a display;
a sensor configured to detect an interaction, by a user, with the display;
one or more memory devices storing instructions; and
one or more processors configured to execute the instructions to perform operations comprising:
determining that the interaction is a command to initiate a process to provide a user-specified location for a display element;
generating the display element and positioning the display element at the user-specified location on the display; and
providing a feedback signal to the user indicating the display element location.

### Claim 22 (depends on 21)

The system of claim 21, wherein:
the interaction comprises a touch of the display; and
the operations comprise initiating the process to provide the user-specified location when the touch persists for longer than a threshold period of time.

### Claim 23 (depends on 21)

The system of claim 21, wherein the display element is a home key of a virtual keyboard pattern.

### Claim 24 (depends on 23)

The system of claim 23, wherein:
the virtual keyboard pattern comprises a numeric keypad; and
the display element is a “5” key of the numeric keypad.

### Claim 25 (depends on 21)

The system of claim 21, wherein the feedback signal comprises a haptic feedback.

### Claim 26 (depends on 21)

The system of claim 21, wherein the feedback signal comprises an audible feedback.

### Claim 27 (depends on 21)

The system of claim 21, wherein the feedback signal comprises a visual feedback.

### Claim 28 (depends on 21)

The system of claim 21, wherein the operations comprise commanding a device external to the display to generate the feedback signal.

### Claim 29 (depends on 21)

The system of claim 21, wherein:
the display element comprises a home key of a virtual keyboard pattern;
providing the feedback signal comprises providing a first feedback signal indicating a user interaction with the home key; and
the operations further comprise providing a second feedback signal indicating a user interaction with a key of the virtual keyboard pattern other than the home key.

### Claim 30 (depends on 29)

The system of claim 29, wherein the first and second feedback signals are haptic feedbacks having different haptic characteristics.

### Claim 31 (depends on 29)

The system of claim 29, wherein the first and second feedback signals are audible feedbacks having different audible characteristics.

### Claim 32

An apparatus, comprising:
a display;
a sensor configured to detect an interaction, by a user, with the display;
one or more memory devices storing instructions; and
one or more processors configured to execute the instructions to perform operations comprising:
determining that the interaction is a command to initiate a process to provide a user-specified location for a display element;
generating the display element and positioning the display element at the user-specified location on the display; and
a feedback provider configured to provide a feedback signal to the user indicating the display element location.

### Claim 33 (depends on 32)

The apparatus of claim 32, wherein:
the interaction comprises a touch of the display; and
the operations comprise initiating the process to provide the user-specified location for the display element when the touch persists for longer than a threshold period of time.

### Claim 34 (depends on 32)

The apparatus of claim 32, wherein the display element is a home key of the virtual keyboard pattern.

### Claim 35 (depends on 32)

The apparatus of claim 32, wherein feedback provider is configured to provide at least one of a haptic feedback, an audible feedback, or a visual feedback.

### Claim 36 (depends on 32)

The apparatus of claim 32, wherein the operations comprise commanding a device external to the display to generate the feedback signal.

### Claim 37 (depends on 32)

The apparatus of claim 32, wherein:
the display element comprises a home key of a virtual keyboard pattern;
the feedback provider is configured to provide a first feedback signal indicating a user interaction with the home key; and
the feedback provider is further configured to provide a second feedback signal indicating a user interaction with a key of the virtual keyboard pattern other than the home key.

### Claim 38 (depends on 37)

The apparatus of claim 37, wherein the first and second feedback signals are haptic feedbacks having different haptic characteristics.

### Claim 39 (depends on 37)

The apparatus of claim 37, wherein the first and second feedback signals are audible feedbacks having different audible characteristics.

### Claim 40

A method for providing user interface, comprising:
detecting an interaction, by a user, with a display;
determining that the interaction is a command to initiate a process to provide a user-specified location for a display element;
generating the display element and positioning the display element at the user-specified location on the display; and
providing a feedback signal to the user indicating the display element location.
