# US 2014/0198032 A1 · Method and apparatus for displaying screen with eye tracking in portable terminal

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2014/0198032 A1
- Document ID: US20140198032A1
- Status: Published application
- Kind: A1
- Application number: 14/143,618
- Filed: 2013-12-30
- Published: 2014-07-17
- Earliest claimed: 2013-01-11
- Assignees: Samsung Electronics Co., Ltd.
- Applicants: Samsung Electronics Co., Ltd.
- Inventors: Yonggil HAN; Yeunwook LIM; Gyucheol CHOI; Minho KIM; Kyeongwook MIN; Chulhyung YANG
- Web page: https://patentgrep.com/patent/US20140198032A1

## CPC

- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- H04M 1/72436: for text messaging, e.g. short messaging services [SMS] or e-mails
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04M: TELEPHONIC COMMUNICATION (circuits for controlling other apparatus via a telephone cable and not involving telephone switching apparatus G08)

## Abstract

A method and an apparatus for displaying a screen using an eye tracking in a portable terminal are provided. The method includes displaying a message on the display unit, photographing a user's eyeball through the camera unit when the message is displayed to determine a position of the user's eyeball, determining whether the message is read by comparing eye tracking information gathered by the photographing of the user's eyeball with a message position of a time point of displaying the message, and distinguishing an unread message from a read message based on the determining

## Claims

### Claim 1

A method for displaying a screen by using eye tracking in a portable terminal including a display unit and a camera unit, the method comprising:
displaying a message on the display unit;
photographing a user's eyeball through the camera unit when the message is displayed to determine a position of the user's eyeball;
determining whether the message is read by comparing eye tracking information gathered by the photographing of the user's eyeball with a message position of a time point of displaying the message; and
distinguishing an unread message from a read message based on the determining.

### Claim 2 (depends on 1)

The method of claim 1, wherein the distinguishing of the unread message from the read message comprises displaying letters of the unread message differently from letters of the read message.

### Claim 3 (depends on 1)

The method of claim 1, wherein the determining of whether the message is read comprises determining a line of a specific message that the user read.

### Claim 4 (depends on 1)

The method of claim 1, wherein the determining of whether the message is read comprises determining a specific page including the messages read by the user.

### Claim 5 (depends on 1)

The method of claim 1, wherein the distinguishing comprises displaying the unread message on an upper part of the display unit when it is determined that the message is unread.

### Claim 6 (depends on 1)

The method of claim 1, wherein the distinguishing further comprises stopping and displaying the screen of the display unit.

### Claim 7 (depends on 1)

The method of claim 1, further comprising:
when it is determined that the message is unread, determining whether a message read by the eye tracking exists; and
displaying an initially unread message on an upper part of the display unit.

### Claim 8 (depends on 7)

The method of claim 7, wherein the displaying of the initially unread message comprises stopping the screen of the display unit.

### Claim 9 (depends on 1)

The method of claim 1, further comprising:
determining whether the portable terminal is set in an eyeball recognition mode after the displaying of the message; and
displaying a recognition verification display notifying that a user's eyeball is recognized, when the portable terminal is set in the eyeball recognition mode.

### Claim 10 (depends on 9)

The method of claim 9, wherein the recognition verification display outputs at least one of a pop-up message, an icon, a bit sound, a melody, a preset music, or a preset voice.

### Claim 11 (depends on 1)

The method of claim 1, further comprising:
determining whether an eye tracking error is generated during the photographing of the user's eyeball;
recognizing a face and storing face information;
comparing the stored face information with authorized user information; and
locking the display unit when it is determined that the face information is not substantially identical with the authorized user information.

### Claim 12 (depends on 1)

The method of claim 1, further comprising:
transmitting a transmission message to a reception terminal through a mobile communication network; and
outputting at least one of a pop-up message, an icon, a bit sound, a melody, a preset music, or a preset voice that verifies receipt of the message by the reception terminal

### Claim 13 (depends on 1)

The method of claim 1, further comprising:
transmitting a transmission message to a reception terminal through a mobile communication network; and
outputting at least one of a pop-up message, an icon, a bit sound, a melody, a preset music, or a preset voice that notifies that the reception terminal did not receive the message.

### Claim 14

A method for displaying a screen by using eye tracking in a portable terminal including a display unit and a camera unit, the method comprising:
displaying a text on the display unit;
eye tracking by determining and storing position information of a user's eyeball corresponding to the text through the camera unit;
determining whether the portable terminal enters a sleep mode; and
displaying a text position which the eye last tracked on an upper part of the display unit when a display request for the text occurs in the sleep mode.

### Claim 15 (depends on 14)

The method of claim 14, wherein the position information corresponds one of a line unit or a time interval.

### Claim 16 (depends on 14)

The method of claim 14, further comprising:
determining whether the portable terminal is set in an eyeball recognition mode after the displaying of the text; and
displaying a recognition verification notifying that a user's eyeball is recognized through at least one of a pop-up message, an icon, a bit sound, a melody, a preset music, or a preset voice when the portable terminal is set in the eyeball recognition mode.

### Claim 17

An apparatus for controlling a screen by using an eye tracking, the apparatus comprising:
a display unit configured to display a message on the screen;
a camera unit configured to collect information of a user's eyeball; and
a controller configured to determine a position of the user's eyeball using the information collected through the camera unit, to determine a position of a corresponding message, and to compare the positions to display an unread message on an upper part of the display unit by determining the message as the unread message when the positions are not substantially identical.

### Claim 18 (depends on 17)

The apparatus of claim 17, further comprising a storing unit configured to store information of the user's face.

### Claim 19 (depends on 18)

The apparatus of claim 18, wherein the controller is further configured to compare the stored information of the user's face with information collected by the camera unit and to compare the stored information with the collected information to determine if access is permitted.

### Claim 20 (depends on 1)

A non-transitory computer-readable storage medium storing instructions that, when executed, cause at least one processor to perform the method of claim 1.
