# US 2021/0240264 A1 · Periodic motion-based visual stimulus

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0240264 A1
- Document ID: US20210240264A1
- Status: Published application
- Kind: A1
- Application number: 16/780,173
- Filed: 2020-02-03
- Published: 2021-08-05
- Earliest claimed: 2020-02-03
- Assignees: Microsoft Technology Licensing, LLC
- Applicants: Microsoft Technology Licensing, LLC
- Inventors: Andrew D. WILSON; Hakim SI MOHAMMED; Christian HOLZ; Adrian Kuo Ching LEE; Ivan Jelev TASHEV; Hannes GAMPER; Edward Bryan CUTRELL; David Emerson JOHNSTON; Dimitra EMMANOUILIDOU; Mihai R. JALOBEANU
- Web page: https://patentgrep.com/patent/US20210240264A1

## CPC

- G06F 3/015: {Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection}
- A61B 5/378: Visual stimuli
- G01R 19/0084: {Measuring voltage only}
- G02B 27/0176: {characterised by mechanical features}
- G06F 1/163: {Wearable computers, e.g. on a belt}
- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- G06F 3/0304: {Detection arrangements using opto-electronic means (constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042)}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G01R: MEASURING ELECTRIC VARIABLES; MEASURING MAGNETIC VARIABLES (indicating correct tuning of resonant circuits H03J3/12)
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS

## Abstract

A computer device is provided is includes a display device, and a sensor system configured to be mounted adjacent to a user's head and to measure an electrical potential near one or more electrodes of the sensor system. The computer device further includes a processor configured to present a periodic motion-based visual stimulus having a changing motion that is frequency-modulated for a target frequency or code-modulated for a target code, detect changes in the electrical potential via the one or more electrodes, identify a corresponding visual evoked potential feature in the detected changes in electrical potential that corresponds to the periodic motion-based visual stimulus, and recognize a user input to the computing device based on identifying the corresponding visual evoked potential feature.

## Claims

### Claim 1

A computer device comprising:
a display device;
a sensor system configured to be mounted adjacent to a user's head and to measure an electrical potential near one or more electrodes of the sensor system; and
a processor configured to:
present a periodic motion-based visual stimulus having a changing motion that is frequency-modulated for a target frequency or code-modulated for a target code;
detect changes in the electrical potential via the one or more electrodes;
identify a corresponding visual evoked potential feature in the detected changes in the electrical potential that corresponds to the periodic motion-based visual stimulus; and
recognize a user input to the computing device based on identifying the corresponding visual evoked potential feature.

### Claim 2 (depends on 1)

The computer device of claim 1, wherein the periodic motion-based visual stimulus is code-modulated for a target code; and
wherein to identify the corresponding visual evoked potential feature, the processor is configured to identify a corresponding code in the detected changes in electrical potential that corresponds to the target code of the periodic motion-based visual stimulus.

### Claim 3 (depends on 1)

The computer device of claim 1, wherein the periodic motion-based visual stimulus is frequency-modulated to change at the target frequency; and
wherein to identify the corresponding visual evoked potential feature, the processor is configured to identify a peak in a frequency domain of the detected changes in electrical potential at a corresponding frequency that corresponds to the target frequency of the periodic motion-based visual stimulus.

### Claim 4 (depends on 3)

The computer device of claim 3, wherein the target frequency of the periodic motion-based visual stimulus includes a fundamental frequency and one or more upper harmonic frequencies.

### Claim 5 (depends on 4)

The computer device of claim 4, wherein the processor is configured to recognize the user input based on identifying peaks at corresponding frequencies that correspond to the fundamental frequency and the one or more upper harmonic frequencies of the periodic motion-based visual stimulus.

### Claim 6 (depends on 1)

The computer device of claim 1, wherein the periodic motion-based visual stimulus includes a periodic motion selected from the group consisting of a rotational motion, an oscillating motion, and a changing grating pattern.

### Claim 7 (depends on 1)

The computer device of claim 1, wherein the periodic motion-based visual stimulus is a rapid serial visual presentation of images.

### Claim 8 (depends on 1)

The computer device of claim 1, wherein the display device is a near-eye display device, and wherein the periodic motion-based visual stimulus is an animated three-dimensional virtual object presented by the near-eye display device.

### Claim 9 (depends on 1)

The computer device of claim 1, wherein to recognize the user input, the processor is further configured to:
determine that the user is attending to the periodic motion-based visual stimulus based on a magnitude of the corresponding visual evoked potential feature; and
recognize the user input based on determining that the user is attending to the periodic motion-based visual stimulus.

### Claim 10 (depends on 9)

The computer device of claim 9, wherein the processor is further configured to present a plurality of periodic motion-based visual stimuli having different target frequencies or target codes, each periodic motion-based visual stimulus being associated with respective interface elements of a plurality of interface elements.

### Claim 11 (depends on 10)

The computer device of claim 10, wherein the processor is further configured to:
determine a user attended periodic motion-based visual stimulus from among the plurality of periodic motion-based visual stimuli; and
recognize the user input to be directed to an interface element associated with the user attended periodic motion-based visual stimulus.

### Claim 12 (depends on 1)

The computer device of claim 1, wherein the processor is further configured to:
store a library of different types of periodic motion-based visual stimuli;
receive an input of one or more parameters for a user interface;
determine a type of periodic motion-based visual stimulus and one or more characteristics based on the received one or more parameters for the user interface; and
generate a set of periodic motion-based visual stimuli based on the determined type and one or more characteristics.

### Claim 13 (depends on 12)

The computer device of claim 12, wherein the one or more characteristics are selected from the group consisting of a differentiated frequency characteristic, a size characteristic, a visual contrast characteristic, and a positional separation characteristic.

### Claim 14

A method comprising:
at a computer device having a processor and a sensor system configured to be mounted adjacent to a user's head and to measure an electrical potential near one or more electrodes of the sensor system:
presenting a periodic motion-based visual stimulus having a changing motion that is frequency-modulated for a target frequency or code-modulated for a target code via a display device of the computer device;
detecting changes in the electrical potential via the one or more electrodes;
identifying a corresponding visual evoked potential feature in the detected changes in the electrical potential that corresponds to the periodic motion-based visual stimulus; and
recognizing a user input to the computing device based on identifying the corresponding visual evoked potential feature.

### Claim 15 (depends on 14)

The method of claim 14, wherein the periodic motion-based visual stimulus is code-modulated for a target code; and
wherein identifying the corresponding visual evoked potential feature further comprises identifying a corresponding code in the detected changes in electrical potential that corresponds to the target code of the periodic motion-based visual stimulus.

### Claim 16 (depends on 14)

The method of claim 14, wherein the periodic motion-based visual stimulus is frequency-modulated to change at the target frequency; and
wherein identifying the corresponding visual evoked potential feature further comprises identifying a peak in a frequency domain of the detected changes in electrical potential at a corresponding frequency that corresponds to the target frequency of the periodic motion-based visual stimulus.

### Claim 17 (depends on 14)

The method of claim 14, wherein recognizing the user input further comprises:
determining that the user is attending to the periodic motion-based visual stimulus based on a magnitude of the corresponding visual evoked potential feature; and
recognizing the user input based on determining that the user is attending to the periodic motion-based visual stimulus.

### Claim 18 (depends on 17)

The method of claim 17, further comprising presenting a plurality of periodic motion-based visual stimuli having different target frequencies or target codes, each periodic motion-based visual stimulus being associated with respective interface elements of a plurality of interface elements.

### Claim 19 (depends on 18)

The method of claim 18, further comprising:
determining a user attended periodic motion-based visual stimulus from among the plurality of periodic motion-based visual stimuli; and
recognizing the user input to be directed to an interface element associated with the user attended periodic motion-based visual stimulus.

### Claim 20

A computer device comprising:
a display device;
a sensor system configured to be mounted adjacent a user's head and to measure an electrical potential near one or more electrodes of the sensor system; and
a processor configured to:
present a plurality of interface elements via the display device;
present a plurality of periodic motion-based visual stimuli, each periodic motion-based visual stimulus being associated with respective interface elements of the plurality of interface elements;
detect changes in the electrical potential via the one or more electrodes;
determine that the user is attending to a user attended periodic motion-based visual stimulus from among the plurality of periodic motion-based visual stimuli based on identifying a corresponding visual evoked potential feature in the detected changes in the electrical potential that corresponds to the user attended periodic motion-based visual stimulus; and
recognize a user input directed at an interface element that is associated with the user attended periodic motion-based visual stimulus.
