# US 2017/0289518 A1 · Apparatus for replaying content using gaze recognition and method thereof

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2017/0289518 A1
- Document ID: US20170289518A1
- Status: Published application
- Kind: A1
- Application number: 15/474,269
- Filed: 2017-03-30
- Published: 2017-10-05
- Earliest claimed: 2016-03-30
- Assignees: Industry-Academic Cooperation Foundation, Yonsei University
- Applicants: Industry-Academic Cooperation Foundation, Yonsei University
- Inventors: Shi Ho KIM; Sang Ho LEE
- Web page: https://patentgrep.com/patent/US20170289518A1

## CPC

- H04N 13/144: for flicker reduction
- H04N 13/122: Improving the three-dimensional [3D] impression of stereoscopic images by modifying image signal contents, e.g. by filtering or adding monoscopic depth cues (H04N13/128 takes precedence)
- H04N 13/239: using two two-dimensional [2D] image sensors having a relative position equal to or related to the interocular distance (H04N13/243 takes precedence)
- H04N 13/344: with head-mounted left-right displays
- H04N 13/383: for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Disclosed is a technology applicable to stereoscopic three-dimensional image content replaying. More particularly, a technology for alleviating user's discomfort, such as dizziness, or eye fatigue when using a stereoscopic three-dimensional display is disclosed. The apparatus for replaying content according to the present disclosure is at least temporarily by a computer and includes an operation unit that calculates a three-dimensional coordinate using gaze information obtained through gaze-tracking; an extraction unit that extracts a focal length corresponding to the calculated three-dimensional coordinate; and a processing unit that collects at least one of a perspective and a focus in a content for stereoscopic three-dimensional displays based on the calculated focal length.

## Claims

### Claim 1

An apparatus for replaying content, wherein the apparatus is at least temporarily by a computer and comprises:
an operation unit that calculates a three-dimensional coordinate using gaze information obtained through gaze-tracking;
an extraction unit that extracts a focal length corresponding to the calculated three-dimensional coordinate; and
a processing unit that collects at least one of a perspective and a focus in a content for stereoscopic three-dimensional displays based on the calculated focal length.

### Claim 2 (depends on 1)

The apparatus according to claim 1, wherein the operation unit obtains a two-dimensional coordinate on a screen, monitored by a user, as gaze information, by tracking the pupil of the user.

### Claim 3 (depends on 2)

The apparatus according to claim 2, wherein the operation unit calculates a three-dimensional coordinate corresponding to the two-dimensional coordinate by applying a picking technique to the obtained two-dimensional coordinate.

### Claim 4 (depends on 2)

The apparatus according to claim 2, wherein the extraction unit extracts a focal length by calculating a distance between the calculated two-dimensional coordinate and a virtual camera.

### Claim 5 (depends on 1)

The apparatus according to claim 1, wherein the processing unit collects at least one of the perspective and the focus by blurring a focus for another target object outside the calculated focal length.

### Claim 6 (depends on 1)

The apparatus according to claim 1, wherein the processing unit collects at least one of the perspective and the focus by adjusting a direction of a rendering stereo camera to a direction corresponding to a position of the target object.

### Claim 7 (depends on 1)

The apparatus according to claim 1, wherein the processing unit collects at least one of the perspective and the focus by adjusting an inter-pupillary distance (IPD) of a rendering stereo camera based on the object distance.

### Claim 8 (depends on 7)

The apparatus according to claim 7, wherein the operation unit calculates a first object distance between the rendering stereo camera and a first target object and a second object distance between the rendering stereo camera and a second target object, and
the processing unit calculates the inter-pupillary distance (IPD) to be adjusted by reflecting a ratio of the first object distance to the second object distance to the inter-pupillary distance (IPD) of the rendering stereo camera.

### Claim 9

An apparatus for replaying content, wherein the apparatus is at least temporarily realized by a computer and comprises:
a gaze tracking unit that calculates gaze information on a screen coordinate system by performing gaze-tracking;
a conversion unit that performs conversion into a vertex of a three-dimensional object defined on a local coordinate system based on the gaze information on the screen coordinate system;
an extraction unit that extracts a focal length using a distance between the vertex of the converted three-dimensional object and the screen coordinate system; and
a processing unit that adjusts a depth of field (DoF) based on the extracted focal length.

### Claim 10 (depends on 9)

The apparatus according to claim 9, wherein the gaze tracking unit calculates gaze information on the screen coordinate system by tracking the pupil of a user.

### Claim 11

A method of operating an apparatus for replaying content, at least temporarily realized by a computer, the method comprising:
calculating a three-dimensional coordinate using gaze information obtained through gaze-tracking;
extracting a focal length corresponding to the calculated three-dimensional coordinate; and
collecting at least one of a perspective and a focus in a content for stereoscopic three-dimensional displays based on the calculated focal length.

### Claim 12 (depends on 11)

The method according to claim 11, wherein, in the calculating, a two-dimensional coordinate on a screen monitored by a user is obtained as gaze information by tracking the pupil of the user.

### Claim 13 (depends on 12)

The method according to claim 12, wherein, in the calculating, a three-dimensional coordinate corresponding to the two-dimensional coordinate is calculated by applying a picking technique to the obtained two-dimensional coordinate.

### Claim 14 (depends on 11)

The method according to claim 11, wherein, in the extracting, the focal length is extracted by calculating a distance between the calculated two-dimensional coordinate and a virtual camera.
