# US 2025/0211633 A1 · Multi-device gaze tracking

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0211633 A1
- Document ID: US20250211633A1
- Status: Published application
- Kind: A1
- Application number: 19/075,278
- Filed: 2025-03-10
- Published: 2025-06-26
- Earliest claimed: 2022-03-22
- Assignees: Microsoft Technology Licensing, LLC
- Applicants: Microsoft Technology Licensing, LLC
- Inventors: Jatin SHARMA; Kenneth P. HINCKLEY; Jay C. BEAVERS; Michel PAHUD
- Web page: https://patentgrep.com/patent/US20250211633A1

## CPC

- H04L 67/1008: based on parameters of servers, e.g. available memory or workload (monitoring of computer activity G06F11/30)
- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- H04L 67/535: {Tracking the activity of the user (network monitoring arrangements H04L43/00; recording of computer activity G06F11/34)}
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Aspects of the present disclosure relate to multi-user, multi-device gaze tracking. In examples, a system includes at least one processor, and memory storing instructions that, when executed by the at least one processor, causes the system to perform a set of operations. The set of operations include identifying a plurality of computing devices, and identifying one or more users. The set of operations may further include receiving gaze input data and load data, from two or more of the plurality of computing devices. The set of operations may further include performing load balancing between the plurality of devices, wherein the load balancing comprises assigning one or more tasks from a first of the plurality of computing devices to a second of the plurality of computing devices based upon the gaze input data.

## Claims

### Claim at position 1

1-20. (canceled)

### Claim 21

A method for processing gaze input data to control a computing device, the method comprising:
identifying two or more computing devices associated with a shared computing engine, wherein the shared computing engine is configured to receive state information from each computing device of the two or more computing devices;
receiving gaze input data corresponding to one or more users, from a first computing device of the two or more computing devices, the gaze input data being accessible via a second computing device of the two or more computing devices, via the shared computing engine;
determining, based on the gaze input data, an action;
updating the state information received by the shared computing engine, based on the determined action; and
adapting the second computing device to perform the determined action, based on the updated state information.

### Claim 22 (depends on 21)

The method of claim 21, wherein:
the determined action comprises selecting an application on the second computing device,
the updating the state information received by the shared computing engine comprises storing an indication of the application being selected, and
the adapting the second computing device to perform the determined action comprises causing the application to be selected on the second computing device.

### Claim 23 (depends on 22)

The method of claim 22, wherein the adapting the second computing device to perform the determined action further comprises causing a brightness on the first computing device to be reduced to prioritize the second computing device on which the application was selected.

### Claim 24 (depends on 22)

The method of claim 22, further comprising:
identifying a background process being executed on the second computing device; and
interrupting the background process being executed on the second computing device to prioritize the selected application.

### Claim 25 (depends on 22)

The method of claim 22, wherein:
the one or more users comprise a presenter to whom the gaze data corresponds, and
the adapting the second computing device to perform the determined action comprises causing the selected application to be presented on the second computing device.

### Claim 26 (depends on 22)

The method of claim 22, wherein:
the one or more users comprise a plurality of users to whom the gaze data corresponds, and
the determined action comprises selecting the application on the second computing device by identifying that the application is being viewed by a majority of the plurality of users.

### Claim 27 (depends on 21)

The method of claim 21, wherein:
the determined action comprises at least one of copying, pasting, or cutting an element from the first computing device or the second computing device,
the updating the state information received by the shared computing engine comprises storing an indication of the element being the at least one of copied, pasted, or cut, and
the adapting the second computing device to perform the determined action comprises causing the element to be the at least one of copied, pasted, or cut.

### Claim 28 (depends on 21)

The method of claim 21, wherein:
the one or more users include a primary user participating in a videoconference on the first computing device,
the determined action comprises identifying a participant in the videoconference at whom the primary users is gazing on the first computing device, and
the adapting the second computing device to perform the determined action comprises causing information corresponding to the identified participant to be displayed on the second computing device.

### Claim 29

A method of processing gaze input data to control a computing device, the method comprising:
identifying a first computing device and a second computing device both associated with a shared computing engine, wherein the shared computing engine is configured to receive state information from each of the first computing device and the second computing device;
receiving gaze input data corresponding to a plurality of users, from the first computing device, the gaze input data being accessible via the second computing device, via the shared computing engine;
identifying at what a majority of the plurality of users are looking, based on the gaze input data;
determining, based on at what the majority of the plurality of users are looking, an action;
updating the state information received by the shared computing engine, based on the determined action; and
adapting the second computing device to perform the determined action, based on the updated state information.

### Claim 30 (depends on 29)

The method of claim 29, wherein:
an application on the second computing device is at what the majority of the plurality of users are looking, and
the determined action comprises selecting the application on the second computing device.

### Claim 31 (depends on 30)

The method of claim 30, further comprising:
identifying a background process being executed on the second computing device; and
interrupting the background process being executed on the second computing device to free up one or more computational resources of the second computing device for the selected application.

### Claim 32 (depends on 31)

The method of claim 31, wherein the adapting the second computing device to perform the determined action further comprises causing a brightness on the first computing device to be reduced to prioritize the second computing device on which the application was selected.

### Claim 33

A system for processing gaze input data to control a computing device, the system comprising:
a processor; and
memory storing instructions that, when executed by the processor, cause the system to perform a set of operations, the set of operations comprising:
identifying two or more computing devices associated with a shared computing engine, wherein the shared computing engine is configured to receive state information from each computing device of the two or more computing devices;
receiving gaze input data corresponding to one or more users, from a first computing device of the two or more computing devices, the gaze input data being accessible via a second computing device of the two or more computing devices, via the shared computing engine;
determining, based on the gaze input data, an action;
updating the state information received by the shared computing engine, based on the determined action; and
adapting the second computing device to perform the determined action, based on the updated state information.

### Claim 34 (depends on 33)

The system of claim 33, wherein:
the determined action comprises at least one of copying, pasting, or cutting an element from the first computing device or the second computing device,
the updating the state information received by the shared computing engine comprises storing an indication of the element being the at least one of copied, pasted, or cut, and
the adapting the second computing device to perform the determined action comprises causing the element to be the at least one of copied, pasted, or cut.

### Claim 35 (depends on 33)

The system of claim 33, wherein:
the one or more users include a primary user participating in a videoconference on the first computing device,
the determined action comprises identifying a participant in the videoconference at whom the primary users is gazing on the first computing device, and
the adapting the second computing device to perform the determined action comprises causing information corresponding to the identified participant to be displayed on the second computing device.

### Claim 36 (depends on 33)

The system of claim 33, wherein:
the determined action comprises selecting an application on the second computing device,
the updating the state information received by the shared computing engine comprises storing an indication of the application being selected, and
the adapting the second computing device to perform the determined action comprises causing the application to be selected on the second computing device.

### Claim 37 (depends on 36)

The system of claim 36, wherein the adapting the second computing device to perform the determined action further comprises causing a brightness on the first computing device to be reduced to prioritize the second computing device on which the application was selected.

### Claim 38 (depends on 36)

The system of claim 36, wherein the set of operations further comprise:
identifying a background process being executed on the second computing device; and
interrupting the background process being executed on the second computing device to prioritize the selected application.

### Claim 39 (depends on 36)

The system of claim 36, wherein:
the one or more users comprise a presenter to whom the gaze data corresponds, and
the adapting the second computing device to perform the determined action comprises causing the selected application to be presented on the second computing device.

### Claim 40 (depends on 36)

The system of claim 36, wherein:
the one or more users comprise a plurality of users to whom the gaze data corresponds, and
the determined action comprises selecting the application on the second computing device by identifying that the application is being viewed by a majority of the plurality of users.
