# US 11,307,658 B2 · Binocular system for entering commands

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,307,658 B2
- Document ID: US11307658B2
- Status: Granted
- Kind: B2
- Application number: 16/951,856
- Filed: 2020-11-18
- Published: 2021-03-11
- Granted: 2022-04-19
- Earliest claimed: 2018-06-26
- Assignees: Alcon Inc.
- Applicants: Alcon Inc.
- Inventors: Martin Eil
- Web page: https://patentgrep.com/patent/US11307658B2

## CPC

- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- A61B 3/113: for determining or recording eye movement
- G02B 21/20: Binocular arrangements
- G02B 21/368: {details of associated display arrangements, e.g. mounting of LCD monitor}
- G02B 23/10: reflecting into the field of view additional indications, e.g. from collimator
- G02B 25/001: {Eyepieces}
- G02B 27/0093: {with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking}
- G02B 27/106: {for splitting or combining a plurality of identical beams or images, e.g. image replication}
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/0482: Interaction with lists of selectable items, e.g. menus
- G02B 27/145: {having sequential partially reflecting surfaces}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS

## Abstract

In certain embodiments, a binocular system for entering commands includes a computer and a binocular eyepiece. The computer generates a virtual graphical user interface (GUI) with one or more graphical elements, where each graphical element corresponds to a command. The binocular eyepiece includes of eyepieces. Each eyepiece has an optical path that directs an image of an object towards a corresponding eye of a pair of eyes. The optical path of at least one eyepiece directs the virtual GUI towards the corresponding eye. At least one eyepiece is associated with an eye-tracker that tracks movement of the corresponding eye relative to the virtual GUI to yield a tracked eye. The computer interprets movement of the tracked eye relative to the virtual GUI as an interaction with a selected graphical element, and initiates the command corresponding to the selected graphical element.

## Claims

### Claim 1

A binocular system for entering commands, comprising:
a computer configured to generate a virtual graphical user interface (GUI) comprising one or more graphical elements, each graphical element corresponding to a command; and
a binocular eyepiece comprising a plurality of eyepieces, each eyepiece having an optical path, each optical path configured to direct an image of an object towards a corresponding eye of a pair of eyes:
the optical path of at least one eyepiece configured to direct the virtual GUI towards the corresponding eye; and
at least one eyepiece is associated with an eye-tracker configured to track movement of the corresponding eye relative to the virtual GUI to yield a tracked eye, the eye tracker further comprising abeam-splitter configured to:
receive the image and direct the image along the optical path towards the corresponding eye; and
receive light reflected from the corresponding eye and direct the light towards a sensor of the eye-tracker; and
the computer further configured to:
interpret a movement of the tracked eye relative to the virtual GUI as an interaction with a selected graphical element; and
initiate the command corresponding to the selected graphical element.

### Claim 2 (depends on 1)

The system of claim 1, wherein the eye-tracker comprises:
one or more sensors configured to track the movement of the tracked eye.

### Claim 3 (depends on 1)

The system of claim 1, wherein the eye-tracker comprises:
one or more illuminators configured to illuminate the tracked eye; and
one or more sensors configured to track the movement of the tracked eye.

### Claim 4 (depends on 1)

The system of claim 1, wherein the eyepiece with the optical path configured to direct the virtual GUI comprises a beam-splitter configured to:
receive the virtual GUI;
receive the image; and
direct the virtual GUI and the image along the optical path towards the corresponding eye.

### Claim 5 (depends on 1)

The system of claim 1, wherein the eyepiece with the optical path configured to direct the virtual GUI also comprises the eye-tracker.

### Claim 6 (depends on 1)

The system of claim 1, wherein the plurality of eyepieces comprise:
a first eyepiece comprising the eyepiece with the optical path configured to direct the virtual GUI; and
a second eyepiece comprising the eye-tracker.

### Claim 7 (depends on 1)

The system of claim 1, wherein the optical paths of the plurality of eyepieces are each configured to direct the virtual GUI towards the corresponding eyes.

### Claim 8 (depends on 1)

The system of claim 1, wherein the plurality of eyepieces each comprise an eye-tracker.

### Claim 9 (depends on 1)

The system of claim 1, wherein the graphical elements comprise at least one of the following:
an OK element corresponding to a command to accept;
a PLUS element corresponding to a command to increase; and
a MINUS element corresponding to a command to decrease.

### Claim 10 (depends on 1)

The system of claim 1, wherein the graphical elements comprise at least one of the following:
a previous element corresponding to a command to move forwards; and
a next element corresponding to a command to move backwards.

### Claim 11 (depends on 1)

The system of claim 1, wherein the graphical elements comprise an options element corresponding to a command to display one or more menus of options.

### Claim 12 (depends on 1)

The system of claim 1, further comprising a mount configured to attach to a medical device.

### Claim 13

A method for entering commands using a binocular system, comprising:
generating, by a computer, a virtual graphical user interface (GUI) comprising one or more graphical elements, each graphical element corresponding to a command;
directing, by an optical path of each eyepiece of a plurality of eyepieces of a binocular eyepiece, an image of an object towards a corresponding eye of a pair of eyes;
directing, by the optical path of at least one eyepiece, the virtual GUI towards the corresponding eye;
tracking, by an eye-tracker associated with at least one eyepiece, movement of the corresponding eye relative to the virtual GUI to yield a tracked eye;
receiving, by a beam-splitter of the at least one eyepiece comprising the eye-tracker, the image and directing the image along the optical path towards the corresponding eye;
receiving, by the beam-splitter, light reflected from the corresponding eye and directing the light towards a sensor of the eye-tracker;
interpreting a movement of the tracked eye relative to the virtual GUI as an interaction with a selected graphical element; and
initiating the command corresponding to the selected graphical element.

### Claim 14 (depends on 13)

The method of claim 13, further comprising:
tracking the movement of the tracked eye with one or more sensors.

### Claim 15 (depends on 13)

The method of claim 13, further comprising:
illuminating the tracked eye with one or more illuminators; and
tracking the movement of the tracked eye with one or more sensors.

### Claim 16 (depends on 13)

The method of claim 13, further comprising:
receiving the virtual GUI by a beam-splitter of the eyepiece with the optical path configured to direct the virtual GUI;
receiving, by the beam-splitter, the image; and
directing, by the beam-splitter, the virtual GUI and the image along the optical path towards the corresponding eye.