# US 2018/0321739 A1 · Electronic device and method for controlling display

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2018/0321739 A1
- Document ID: US20180321739A1
- Status: Published application
- Kind: A1
- Application number: 15/529,368
- Filed: 2015-11-23
- Published: 2018-11-08
- Earliest claimed: 2014-11-24
- Assignees: Samsung Electronics Co., Ltd.
- Applicants: Samsung Electronics Co., Ltd.
- Inventors: Jung-Hoon PARK
- Web page: https://patentgrep.com/patent/US20180321739A1

## CPC

- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- G06F 3/04817: using icons (graphical or visual programming using iconic symbols G06F8/34)
- G06F 3/0482: Interaction with lists of selectable items, e.g. menus
- G06F 3/04842: Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence)
- H04N 23/60: Control of cameras or camera modules
- H04N 23/71: Circuitry for evaluating the brightness variation
- H04N 23/74: by influencing the scene brightness using illuminating means
- G06F 2203/04801: Cursor retrieval aid, i.e. visual aspect modification, blinking, colour changes, enlargement or other visual cues, for helping user do find the cursor in graphical user interfaces
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

The present invention relates to an electronic device and method for controlling a display by eye tracking. The method for controlling a display by eye tracking according to the present invention may comprise the steps of: tracking of line of sight of eyes; displaying, on a screen, a user interface for controlling the screen using the tracked line of sight; and executing a function selected in response to a selection of any menu item of the user interface by the tracked line of sight.

## Claims

### Claim 1

A method of capturing an image by an electronic device, the method comprising:
measuring ambient brightness;
making a light source emit light by controlling at least one of a brightness strength of the light source and an exposure time of the light source in order to capture an image according to the measured ambient brightness;
generating a plurality of frames corresponding to the capturing of the image through the emitted light source; and
selecting at least one frame from the plurality of generated frames.

### Claim 2 (depends on 1)

The method of claim 1, wherein the light source is synchronized with at least one of a vertical synchronization signal and a horizontal synchronization signal and then emitted.

### Claim 3 (depends on 1)

The method of claim 1, wherein the controlling comprises controlling the brightness strength to be brighter than the ambient brightness.

### Claim 4 (depends on 1)

The method of claim 1, further comprising tracking the point of a user's eye gaze through the at least one selected frame, wherein the at least one frame is selected through an SNR (Signal to Noise Ratio).

### Claim 5 (depends on 2)

The method of claim 2, wherein the making of the light source to emit the light comprises synchronizing the brightness strength of the light source and the exposure time of the light source with timing of at least one of the vertical synchronization signal and the horizontal synchronization signal.

### Claim 6

(canceled)

### Claim 7 (depends on 1)

The method of claim 1, wherein the making of the light source to emit the light comprises making a first light source and a second light source alternately emit light according to an active interval of a vertical synchronization signal.

### Claim 8 (depends on 1)

The method of claim 1, wherein the plurality of generated frames correspond to frames generated in the unit of predetermined time in an active interval of a vertical synchronization signal.

### Claim 9

An electronic device for capturing an image, the electronic device comprising:
a light emitting unit comprising at least one light emitting element that makes a light source emit light;
a camera unit that captures an image through the emitted light source;
a detection unit that measures ambient brightness to capture the image; and
a controller that makes the light source emit light by controlling at least one of a brightness strength of the light source and an exposure time of the light source to capture the image according to the measured ambient brightness, generates a plurality of frames corresponding to the capturing of the image through the emitted light source, and selects at least one frame from the plurality of generated frames.

### Claim 10 (depends on 9)

The electronic device of claim 9, wherein the controller synchronizes the light source with at least one of a vertical synchronization signal and a horizontal synchronization signal and makes the light source emit light.

### Claim 11

(canceled)

### Claim 12 (depends on 9)

The electronic device of claim 9, wherein the controller controls the brightness of the light source to be brighter than the ambient brightness.

### Claim 13 (depends on 9)

The electronic device of claim 9, wherein the controller tracks the point of a user's eye gaze through the at least one selected frame, and the at least one frame is selected through an SNR (Signal to Noise Ratio).

### Claim at position 14

14-16. (canceled)

### Claim 17 (depends on 9)

The electronic device of claim 9, wherein the controller generates the plurality of frames in the unit of predetermined time in an active interval of a vertical synchronization signal.

### Claim 18

(canceled)

### Claim 19 (depends on 9)

The electronic device of claim 9, wherein the controller controls the brightness strength of the light source by using a number of light emitting elements, brightness of the light emitting elements, and an amount of current converted from the brightness of the light emitting elements.

### Claim 20

(canceled)

### Claim 21

A method of controlling a display by tracking the point of gaze, the method comprising:
tracking the point of eye gaze;
displaying a user interface for controlling a screen based on the tracked point of gaze on the screen; and
executing a selected function according to selection of a predetermined menu on the user interface based on the tracked point of gaze.

### Claim 22 (depends on 21)

The method of claim 21, wherein the executing of the function comprises:
determining whether a cursor displayed according to the tracked point of gaze is located on the predetermined menu of the user interface;
detecting an input for selecting the predetermined menu; and
executing a function of the predetermined menu at a position where the point of eye gaze is located on the screen.

### Claim 23 (depends on 22)

The method of claim 22, wherein the input for selecting the predetermined menu includes at least one of cases where a voice is input, eye blinking is made, and the tracked point of gaze stays on the predetermined menu for a time longer than a predetermined time.

### Claim 24 (depends on 21)

The method of claim 21, wherein a location of the user interface can be changed on the screen and is in a circular type or a rectangular type.

### Claim 25 (depends on 21)

The method of claim 21, wherein the user interface includes a first group having a menu corresponding to at least one function provided by a mouse and a second group having a menu corresponding to at least one function for controlling a display based on the point of eye gaze.

### Claim 26 (depends on 25)

The method of claim 25, wherein the first group includes at least one of a menu corresponding to a left click of the mouse, a menu corresponding to a right click of the mouse, a menu corresponding to a left double click of the mouse, a menu corresponding to a drag using the mouse, a menu corresponding to a scroll using the mouse, and a menu corresponding to page switching using the mouse.

### Claim 27 (depends on 25)

The method of claim 25, wherein the second group includes at least one of a menu for activating the user interface, a menu for deactivating the user interface, a menu for setting the user interface, a menu for enlarging an area where a cursor of the mouse is located, a menu for switching between an eye mouse using the point of eye gaze and a normal mouse, a menu for setting a function of the eye mouse, a menu for setting location information of the eye, a menu for a camera view, a menu for setting a short-cut key, a menu for selecting data displayed on the screen, a menu for copying the selected data, a menu for pasting the copied data, and a menu corresponding to a space bar of a keyboard.

### Claim at position 26

28-47. (canceled)
