# US 11,112,881 B2 · Systems and methods for identifying user-operated features of input interfaces obfuscating user navigation

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,112,881 B2
- Document ID: US11112881B2
- Status: Granted
- Kind: B2
- Application number: 16/409,763
- Filed: 2019-05-10
- Published: 2020-11-12
- Granted: 2021-09-07
- Earliest claimed: 2019-05-10
- Assignees: Microsoft Technology Licensing, LLC
- Applicants: Microsoft Technology Licensing, LLC
- Inventors: Ross Garrett Cutler
- Web page: https://patentgrep.com/patent/US11112881B2

## CPC

- G06F 3/0236: {using selection techniques to select from displayed items}
- G06F 21/31: User authentication
- G06F 3/016: {Input arrangements with force or tactile feedback as computer generated output to the user}
- G06F 3/0234: {using switches operable in different directions}
- G06F 3/0482: Interaction with lists of selectable items, e.g. menus
- G06F 3/04886: by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
- G06F 21/36: by graphic or iconic representation
- G06F 21/83: input devices, e.g. keyboards, mice or controllers thereof
- G06F 21/84: output devices, e.g. displays or monitors
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Techniques for obfuscating user selections during user-input sessions in which potentially sensitive information is being identified, involving displaying several targets, such as keys of a virtual keyboard, on a display device, where each target corresponds to one of multiple options. While a current user target is associated with a visual indicator at a first time, a discriminatory signal indicating the visual indication displayed at the first time is for the current user target is provided, where the discriminatory signal includes one of a haptic signal generated by a device in physical contact with the user, an audio signal, and a modified image. Concurrently, the obfuscation system is configured to present another visual indication corresponding to a current distractor target. The current user target is thus obfuscated as two different visual indicators are presented and move through the group of options.

## Claims

### Claim 1

A system comprising a processor and machine-readable media including instructions which, when executed by the processor, cause the processor to:
concurrently display a first plurality of targets including a first target, a second target, a third target, a fourth target, and a fifth target;
present, at a first time during a first period of time that a current user target remains the first target, a discriminatory signal to a user indicating a first visual indication displayed at the first time is for the current user target, wherein the discriminatory signal includes one of a haptic signal generated by a device in physical contact with the user, an audio signal, and a modified image, and wherein the audio signal and the modified image are discernable within a predetermined range of the system to prevent an observer outside of the predetermined range of the system from discerning the audio signal and the modified image;
display, at the first time, the first visual indication in association with the current user target;
display a second visual indication of a first current distractor target at the second target during the first period of time;
move a third visual indication of the current user target to the third target at a second time after the first period of time to reflect a change of the current user target to the third target in response to a first user input event for navigation of a current user target;
actuate the current user target at a third time after the second time in response to a second user input for actuation of the current user target;
move the second visual indication to the fourth target at a fourth time at or after the second time; and
move the second visual indication to the fifth target at a fifth time after the third time and before the second time.

### Claim 2 (depends on 1)

The system of claim 1, wherein the instructions further cause the processor to present the first plurality of targets as virtual keys for entering corresponding characters.

### Claim 3 (depends on 1)

The system of claim 1, wherein the instructions further cause the processor to:
generate the modified image by making a patterned change in pixel colors for pixels associated with the current target; and
present the discriminatory signal at least in part by displaying the modified image.

### Claim 4 (depends on 3)

The system of claim 3, wherein the instructions further cause the processor to:
select a first plurality of pixels associated with the current target;
perform a first modification to pixel colors of the first plurality of pixels;
select a second plurality of pixels associated with the current target; and
perform a second modification to pixel colors of the second plurality of pixels, wherein the second modification offsets the first modification.

### Claim 5 (depends on 1)

The system of claim 1, wherein the instructions further cause the processor to present the discriminatory signal at least in part by presenting the audio signal.

### Claim 6 (depends on 1)

The system of claim 1, wherein the instructions further cause the processor to present the discriminatory signal at least in part by causing the device to generate the haptic signal.

### Claim 7 (depends on 1)

The system of claim 1, wherein the instructions further cause the processor to:
display a first visual element associated with the current user target at a position away from the current user target;
display a second visual element associated with the first current distractor target at a position away from the first current distractor target; and
alternate between or rotating among a first plurality of visual elements for applying a visual indication of whether the discriminatory signal is or is not being presented for a visual element to which the visual indication is being applied, wherein the first plurality of visual elements includes the first visual element and the second visual element.

### Claim 8 (depends on 1)

The system of claim 1, wherein the instructions further cause the processor to alternate between or rotate among a first plurality of current targets for applying a visual indication of whether the discriminatory signal is or is not being presented for a current target to which the visual indication is being applied, wherein the first plurality of current targets includes the current user target and the first current distractor target.

### Claim 9

A method performed by a data processing system of obfuscating a user target actuation, the method comprising:
concurrently displaying a first plurality of targets including a first target, a second target, a third target, a fourth target, and a fifth target;
presenting, at a first time during a first period of time that a current user target remains the first target, a discriminatory signal to a user indicating a first visual indication displayed at the first time is for the current user target, wherein the discriminatory signal includes one of a haptic signal generated by a device in physical contact with the user, an audio signal, and a modified image, and wherein the audio signal and the modified image are discernable within a predetermined range of the system to prevent an observer outside of the predetermined range of the system from discerning the audio signal and the modified image;
displaying, at the first time, the first visual indication in association with the current user target;
displaying a second visual indication of a first current distractor target at the second target during the first period of time;
moving a third visual indication of the current user target to the third target at a second time after the first period of time to reflect a change of the current user target to the third target in response to a first user input event for navigation of a current user target;
actuating the current user target at a third time after the second time in response to a second user input for actuation of the current user target;
moving the second visual indication to the fourth target at a fourth time at or after the second time; and
moving the second visual indication to the fifth target at a fifth time after the third time and before the second time.

### Claim 10 (depends on 9)

The method of claim 9, further comprising generating the modified image by making a patterned change in pixel colors for pixels associated with the current target, wherein the presenting the discriminatory signal includes displaying the modified image.

### Claim 11 (depends on 10)

The method of claim 10, wherein the making a patterned change in pixel colors includes:
selecting a first plurality of pixels associated with the current target;
performing a first modification to pixel colors of the first plurality of pixels;
selecting a second plurality of pixels associated with the current target; and
performing a second modification to pixel colors of the second plurality of pixels, wherein the second modification offsets the first modification.

### Claim 12 (depends on 9)

The method of claim 9, wherein the presenting the discriminatory signal includes presenting the audio signal.

### Claim 13 (depends on 12)

The method of claim 12, further comprising:
recording an ambient audio signal;
generating a first channel portion of the audio signal based on the recorded ambient audio signal, in which a first phase change is applied; and
generating a second channel portion of the audio signal based on the recorded ambient audio signal, in which a different second phase change is applied,
wherein the presenting the audio signal includes presenting the first channel portion of the audio signal and the second channel portion of the audio signal.

### Claim 14 (depends on 9)

The method of claim 9, wherein the presenting the discriminatory signal includes causing the device to generate the haptic signal.

### Claim 15 (depends on 14)

The method of claim 14, further comprising presenting a discriminatory signal via a companion device identified for the user.

### Claim 16 (depends on 9)

The method of claim 9, further comprising:
determining, as a first determination, that user input is in an idle state based on less than a first threshold amount of movement being performed for the current user target during a period of time,
wherein the presentation of the discriminatory signal is performed while the user input is in an idle state based on the user input being in an idle state.

### Claim 17 (depends on 9)

The method of claim 9, further comprising:
displaying a first visual element associated with the current user target at a position away from the current user target;
displaying a second visual element associated with the first current distractor target at a position away from the first current distractor target; and
alternating between or rotating among a first plurality of visual elements for applying a visual indication of whether the discriminatory signal is or is not being presented for a visual element to which the visual indication is being applied, wherein the first plurality of visual elements includes the first visual element and the second visual element.

### Claim 18 (depends on 9)

The method of claim 9, further comprising alternating between or rotating among a first plurality of current targets for applying a visual indication of whether the discriminatory signal is or is not being presented for a current target to which the visual indication is being applied, wherein the first plurality of current targets includes the current user target and the first current distractor target.

### Claim 19

A computer-readable storage medium on which are stored instructions that, when executed, cause a processor of a programmable device to perform functions of:
concurrently displaying a first plurality of targets including a first target, a second target, a third target, a fourth target, and a fifth target;
presenting, at a first time during a first period of time that a current user target remains the first target, a discriminatory signal to a user indicating a first visual indication displayed at the first time is for the current user target, wherein the discriminatory signal includes one of a haptic signal generated by a device in physical contact with the user, an audio signal, and a modified image, and wherein the audio signal and the modified image are discernable within a predetermined range of the system to prevent an observer outside of the predetermined range of the system from discerning the audio signal and the modified image;
displaying, at the first time, the first visual indication in association with the current user target;
displaying a second visual indication of a first current distractor target at the second target during the first period of time;
moving a third visual indication of the current user target to the third target at a second time after the first period of time to reflect a change of the current user target to the third target in response to a first user input event for navigation of a current user target;
actuating the current user target at a third time after the second time in response to a second user input for actuation of the current user target;
moving the second visual indication to the fourth target at a fourth time at or after the second time; and
moving the second visual indication to the fifth target at a fifth time after the third time and before the second time.