# US 2025/0085776 A1 · Combined Gaze-Based and Scanning-Based Control of an Apparatus

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0085776 A1
- Document ID: US20250085776A1
- Status: Published application
- Kind: A1
- Application number: 18/929,813
- Filed: 2024-10-29
- Published: 2025-03-13
- Earliest claimed: 2019-02-18
- Assignees: Tobii Dynavox AB
- Applicants: Tobii Dynavox AB
- Inventors: Jaén Cantor
- Web page: https://patentgrep.com/patent/US20250085776A1

## CPC

- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- G06F 3/04842: Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence)
- G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback}
- G06V 40/19: Sensors therefor
- G06V 40/193: {Preprocessing; Feature extraction}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

The present disclosure generally relates to interaction between a user and an apparatus, sometimes referred to as user-apparatus interaction or human-computer interaction. More specifically, the present disclosure generally relates to combined gaze-based and scanning-based control of an apparatus, such as a computer, a tablet computer, or a desktop computer. In more detail, the present disclosure presents methods, apparatuses, computer programs and carriers, which combine gaze-based control with scanning-based control for controlling the apparatus.

## Claims

### Claim 1

A method comprising:
presenting a graphical representation of a plurality of zones via a display of an apparatus;
performing gaze-based control, wherein performing gaze-based control comprises:
receiving, from an eye-tracking device, an input from a user representing a point of a gaze of the user;
identifying a gaze target location on the display, wherein identifying the gaze target location further comprises:
outputting auditory feedback to guide the user in an interaction process of the user with the apparatus; and
detecting a confirmation signal based on information provided by the apparatus by detecting a contact-required input provided by a physical input device; and
selecting, from the plurality of zones presented via the display of the apparatus, a zone based on the identified gaze target location in response to detecting the confirmation signal; and
in response to selecting the zone, performing scanning-based control within the selected zone.

### Claim 2 (depends on 1)

The method of claim 1, further comprising performing the scanning-based control prior to receiving the input representing the point of the gaze of the user, wherein the input representing the point of the gaze of the user is received during the scanning-based control.

### Claim 3 (depends on 1)

The method of claim 1, further comprising: detecting a gaze target fixating at the gaze target location for a predetermined length of time.

### Claim 4 (depends on 1)

The method of claim 1, further comprising: detecting a blink based on information provided by the eye-tracking device.

### Claim 5 (depends on 1)

The method of claim 1, further comprising: detecting a saccade based on information provided by the eye-tracking device.

### Claim 6 (depends on 1)

The method of claim 1, further comprising: detecting an audio input provided by an audio sensing device.

### Claim 7 (depends on 1)

The method of claim 1, wherein the zone is selected only in response to detecting the confirmation signal.

### Claim 8 (depends on 1)

The method of claim 1, wherein the apparatus is one of a computer, a tablet computer, and a desktop computer.

### Claim 9

A system comprising:
at least one processor configured to:
present a graphical representation of a plurality of zones via a display of an apparatus;
perform gaze-based control, wherein when performing gaze-based control, the at least one processor is configured to:
receive, from an eye-tracking device, an input from a user representing a point of a gaze of the user;
identify a gaze target location on the display, wherein, when identifying the gaze target location of the at least one processor is configured to:
output auditory feedback to guide the user in an interaction process of the user with the apparatus; and
detect a confirmation signal based on information provided by the apparatus, wherein detecting a contact-required input provided by a physical input device; and
select, from the plurality of zones presented via the display of the apparatus, a zone based on the identified gaze target location; and
in response to selecting the zone, perform scanning-based control within the selected zone.

### Claim 10 (depends on 9)

The system of claim 9, wherein the at least one processor performs the scanning-based control prior to receiving an input representing the point of the gaze of the user, and wherein the input representing the point of the gaze of the user is received during the scanning-based control.

### Claim 11 (depends on 9)

The system of claim 9, wherein the at least one processor is further configured to detect a gaze target fixating at the gaze target location for a predetermined length of time.

### Claim 12 (depends on 9)

The system of claim 9, wherein the at least one processor is further configured to detect a blink based on information provided by the eye-tracking device.

### Claim 13 (depends on 9)

The system of claim 9, wherein the at least one processor is further configured to detect a saccade based on information provided by the eye-tracking device.

### Claim 14 (depends on 9)

The system of claim 9, wherein the at least one processor is further configured to detecting an audio input provided by an audio sensing device.

### Claim 15 (depends on 9)

The system of claim 9, wherein the zone is selected only in response to detecting the confirmation signal.

### Claim 16 (depends on 9)

The system of claim 9, wherein the apparatus is one of a computer, a tablet computer, and a desktop computer.

### Claim 17

A non-transitory computer-readable storage medium comprising computer-readable instructions stored thereon which, when executed by at least one processor, cause the at least one processor to:
present a graphical representation of a plurality of zones via a display of an apparatus;
perform gaze-based control, wherein when performing gaze-based control, the instructions cause the at least one processor to:
receive, from an eye-tracking device, an input from a user representing a point of a gaze of the user;
identify a gaze target location on the display, wherein when identifying the gaze target location, the instructions further cause the at least one processor to:
output auditory feedback to guide the user in an interaction process of the user with the apparatus; and
detect a confirmation signal based on information provided by the apparatus, wherein detecting a contact-required input provided by a physical input device;
select, from the plurality of zones presented via the display of the apparatus, a zone based on the identified gaze target location, wherein the zone is selected only in response to detecting the confirmation signal; and
in response to selecting the zone, perform scanning-based control within the selected zone.

### Claim 18 (depends on 17)

The non-transitory computer-readable storage medium of claim 17, wherein the instructions cause the at least one processor to perform the scanning-based control prior to receiving the input representing the point of the gaze of the user, wherein the input representing the point of the gaze of the user is received during the scanning-based control.

### Claim 19 (depends on 1)

The method of claim 1, wherein the zone is selected only in response to detecting the confirmation signal.

### Claim 20 (depends on 1)

The method of claim 1, wherein the apparatus is one of a computer, a tablet computer, and a desktop computer.
