# US 2020/0401218 A1 · Combined gaze and touch input for device operation

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0401218 A1
- Document ID: US20200401218A1
- Status: Published application
- Kind: A1
- Application number: 16/445,092
- Filed: 2019-06-18
- Published: 2020-12-24
- Earliest claimed: 2019-06-18
- Assignees: Synaptics Incorporated
- Applicants: Synaptics Incorporated
- Inventors: Matthew Joseph CAMILLERI; Tyson Ryo MIKUNI; Mohamed Ashraf SHEIK-NAINAR; Do Hee KIM; Andrew Chen Chou HSU
- Web page: https://patentgrep.com/patent/US20200401218A1

## CPC

- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06F 3/03547: {Touch pads, in which fingers can move on a surface}
- G06F 3/038: Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
- G06F 3/0418: {for error correction or compensation, e.g. based on parallax, calibration or alignment}
- G06F 3/04883: for inputting data by handwriting, e.g. gesture or text
- G06F 2203/0381: Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Systems and methods for performing a device operation in response to a touch input and based on a user's gaze are described. An example device includes a touch sensor configured to sense a touch input from a user, a gaze sensor configured to capture gaze information regarding a user's gaze, one or more processors, and a memory coupled to the one or more processors. The memory stores instructions that, when executed by the one or more processors, cause the device to determine a feature of the user's gaze based on the captured gaze information, and disregard the touch input based on the feature of the user's gaze.

## Claims

### Claim 1

A device, comprising:
a touch sensor configured to sense a touch input from a user;
a gaze sensor configured to capture gaze information regarding a user's gaze;
one or more processors; and
a memory coupled to the one or more processors, the memory storing instructions that, when executed by the one or more processors, cause the device to:
determine a gaze duration of the user's gaze based on the captured gaze information; and
disregard the touch input based on the gaze duration of the user's gaze.

### Claim 2 (depends on 1)

The device of claim 1, wherein execution of the instructions further causes the device to:
determine a gaze location of the user's gaze based on the captured gaze information, wherein disregarding the touch input is also based on the gaze location.

### Claim 3

(canceled)

### Claim 4 (depends on 2)

The device of claim 2, wherein execution of the instructions further causes the device to:
determine a type of the touch input, wherein disregarding the touch input is further based on the type of the touch input.

### Claim 5 (depends on 2)

The device of claim 2, wherein execution of the instructions further causes the device to:
determine a force of the touch input, wherein performing the device operation is further based on the force of the touch input.

### Claim 6 (depends on 5)

The device of claim 5, wherein the touch sensor includes a force touchpad and the gaze sensor includes a camera.

### Claim 7 (depends on 2)

The device of claim 2, wherein performing the device operation is further based on an operating state of the device.

### Claim 8 (depends on 1)

The device of claim 1, wherein execution of the instructions further causes the device to:
determine whether the user's gaze is detected, wherein disregarding the touch input is based on whether the user's gaze is detected.

### Claim 9

A non-transitory, computer readable medium storing instructions that, when executed by one or more processors of a device, cause the device to:
sense, by a touch sensor, a touch from a user;
capture, by a gaze sensor, gaze information regarding a user's gaze;
determine, by one or more processors, a gaze duration of the user's gaze based on the captured gaze information; and
disregard the touch input based on the gaze duration of the user's gaze.

### Claim 10 (depends on 9)

The computer readable medium of claim 9, wherein the instructions further cause the device to:
determine a gaze location of the user's gaze based on the captured gaze information, wherein disregarding the touch input is also based on the gaze location.

### Claim 11

(canceled)

### Claim 12 (depends on 10)

The computer readable medium of claim 10, wherein the instructions further cause the device to:
determine a type of the touch input, wherein disregarding the touch input is further based on the type of the touch input.

### Claim 13 (depends on 10)

The computer readable medium of claim 10, wherein the instructions further cause the device to:
determine a force of the touch input, wherein disregarding the touch input is further based on the force of the touch input.

### Claim 14 (depends on 10)

The computer readable medium of claim 10, wherein disregarding the touch input is further based on an operating state of the device.

### Claim 15 (depends on 10)

The computer readable medium of claim 10, wherein the instructions further causes the device to:
determine whether the user's gaze is detected, wherein disregarding the touch input is based on whether the user's gaze is detected.

### Claim 16

A method, comprising:
sensing, by a touch sensor, a touch from a user;
capturing, by a gaze sensor, gaze information regarding a user's gaze;
determining, by one or more processors, a gaze duration of the user's gaze based on the captured gaze information; and
disregarding the touch input based on the gaze duration of the user's gaze.

### Claim 17 (depends on 16)

The method of claim 16, further comprising:
determining a gaze location of the user's gaze based on the captured gaze information, wherein disregarding the touch input is also based on the gaze location.

### Claim 18

(canceled)

### Claim 19 (depends on 17)

The method of claim 17, further comprising:
determining at least one of a type of the touch input or a force of the touch input, wherein disregarding the touch input is further based on at least one of the type of the touch input or the force of the touch input.

### Claim 20 (depends on 17)

The method of claim 17, further comprising:
determining whether the user's gaze is detected, wherein disregarding the touch input is based on whether the user's gaze is detected.

### Claim 21 (depends on 2)

The device of claim 2, wherein execution of the instructions further causes the device to:
adjust a display region associated with the touch input and the gaze location based on the gaze duration, wherein disregarding the touch input is based on the gaze location being outside of the adjusted display region.

### Claim 22 (depends on 10)

The computer readable medium of claim 10, wherein the instructions further cause the device to:
adjust a display region associated with the touch input and the gaze location based on the gaze duration, wherein disregarding the touch input is based on the gaze location being outside of the adjusted display region.

### Claim 23 (depends on 17)

The method of claim 17, further comprising:
adjust a display region associated with the touch input and the gaze location based on the gaze duration, wherein disregarding the touch input is based on the gaze location being outside of the adjusted display region.
