# US 2021/0278630 A1 · Augmented reality device for adjusting focus region according to direction of user's view and operating method of the same

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0278630 A1
- Document ID: US20210278630A1
- Status: Published application
- Kind: A1
- Application number: 17/323,495
- Filed: 2021-05-18
- Published: 2021-09-09
- Earliest claimed: 2019-05-27
- Assignees: Samsung Electronics Co., Ltd.
- Applicants: Samsung Electronics Co., Ltd.
- Inventors: Kyookeun Lee; Kyusub Kwak; Bonkon Koo; Jeonggeun Yun; Wonjun Lee; Myongjo Choi; Jongchul Choi
- Web page: https://patentgrep.com/patent/US20210278630A1

## CPC

- G02B 7/287: {including a sight line detecting device}
- G02B 3/14: of variable focal length
- G02B 27/0093: {with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking}
- G02B 27/0172: {characterised by optical features}
- G02B 27/0179: {Display position adjusting means not related to the information to be displayed}
- G02F 1/29: for the control of the position or the direction of light beams, i.e. deflection
- G02B 27/0081: {with means for altering, e.g. enlarging, the entrance or exit pupil}
- G02B 2027/0138: {comprising image capture systems, e.g. camera}
- G02B 2027/014: {comprising information/image processing systems}
- G02B 2027/0141: {characterised by the informative content of the display}
- G02B 2027/0185: {Displaying image at variable distance}
- G02B 2027/0187: {slaved to motion of at least a part of the body of the user, e.g. head, eye}
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02F: OPTICAL DEVICES OR ARRANGEMENTS FOR THE CONTROL OF LIGHT BY MODIFICATION OF THE OPTICAL PROPERTIES OF THE MEDIA OF THE ELEMENTS INVOLVED THEREIN; NON-LINEAR OPTICS; FREQUENCY-CHANGING OF LIGHT; OPTICAL LOGIC ELEMENTS; OPTICAL ANALOGUE/DIGITAL CONVERTERS

## Abstract

An augmented reality (AR) device including a variable focus lens of which a focal length may be changed by adjusting refractive power and adjusting the position of a focus adjustment region of the variable focus lens according to a direction of the user's view. The AR device may obtain an eye vector indicating a direction of the user's view using an eye tracker, adjust a refractive power of a first focus adjustment region of a first variable focus lens to change a focal length for displaying a virtual image, and complementarily adjust a refractive power of a second focus adjustment lens with respect to the adjusted refractive power of the first focus adjustment region.

## Claims

### Claim 1

An augmented reality (AR) device comprising:
a plurality of eye tracker;
first variable focus lens and second variable focus lens;
a waveguide disposed between the first variable focus lens and the second variable focus lens;
a display module configured to output light of a virtual image toward the waveguide; and
one or more processors configured to:
obtain, through the plurality of eye tracker, a direction of a left eye of a user of the AR device and a direction of a right eye of the user,
determine a first focus adjustment region of the first variable focus lens based on the direction of the left eye or the direction of the right eye,
obtain a gaze point based on the direction of the left eye and the direction of the right eye,
determine a refractive power of the first focus adjustment region based on the gaze point, and,
determine a refractive power of a second focus adjustment region of the second variable focus lens based on the determined refractive power of the first focus adjustment region.

### Claim 2 (depends on 1)

The AR device of claim 1, wherein the one or more processors are further configured to complementarily determine the refractive power of the second focus adjustment region with respect to the refractive power of the first focus adjustment region.

### Claim 3 (depends on 2)

The AR device of claim 2, wherein the one or more processors are further configured to determine the refractive power of the second focus adjustment region to be the same as the refractive power of the first focus adjustment region in a direction opposite to a direction of the refractive power of the first focus adjustment region.

### Claim 4 (depends on 1)

The AR device of claim 1, wherein the one or more processors are further configured to control to:
apply a control voltage that generates a phase modulation profile relating to a position corresponding to the first focus adjustment region to the first variable focus lens, and
based on the applied control voltage, adjust the refractive power of the first focus adjustment region by changing an angle at which liquid crystal molecules arranged at a position of the first focus adjustment region are arranged among liquid crystal molecules of the first variable focus lens.

### Claim 5 (depends on 1)

The AR device of claim 1, further comprising a depth sensor configured to measure a depth value of a real world object disposed at the gaze point,
wherein the one or more processors are further configured to:
obtain the measured depth value of the real world object from the depth sensor, and
determine the refractive power of the first focus adjustment region based on the obtained depth value so as to determine a focal length of a virtual object which is a partial region of the virtual image.

### Claim 6 (depends on 1)

The AR device of claim 1, wherein the one or more processors are further configured to determine a position of the second focus adjustment region based on the direction of the left eye or the direction of the right eye such that the first focus adjustment region and the second focus adjustment region are aligned in the direction of the left eye or the direction of the right eye.

### Claim 7 (depends on 1)

The AR device of claim 1, wherein a size of the first focus adjustment region is determined based on a size of a virtual object that is a partial region of the virtual image output through the waveguide.

### Claim 8 (depends on 1)

The AR device of claim 1, wherein a size of the second focus adjustment region is determined based on a size of a virtual object that is a partial region of the virtual image output through the waveguide and a spaced distance between the first variable focus lens and the second variable focus lens.

### Claim 9 (depends on 1)

The AR device of claim 1,
wherein a plurality of a first focus adjustment regions are provided on the first variable focus lens, and
wherein the one or more processors are further configured to determine refractive powers of the plurality of first focus adjustment regions such that different vergences are formed according to the plurality of first focus adjustment regions.

### Claim 10 (depends on 1)

The AR device of claim 1, wherein when a user wears the AR device, the first variable focus lens is disposed at a position spaced apart from the user's eyes by a first distance, and the second variable focus lens is disposed at a position spaced apart from the user's eyes by a second distance,
wherein the second distance is greater than the first distance.

### Claim 11

An operating method of an augmented reality (AR) device, the operating method comprising:
obtaining, through a plurality of eye tracker of the AR device, a direction of the left eye of a user of the AR device and a direction of a right eye of the user;
determining a first focus adjustment region of a first variable focus lens based on the direction of the left eye or the direction of the right eye;
obtaining a gaze point based on the direction of the left eye and the direction of the right eye;
determining a refractive power of the first focus adjustment region based on the gaze point; and
determining a refractive power of a second focus adjustment of the second variable focus lens based on the determined refractive power of the first focus adjustment region.

### Claim 12 (depends on 11)

The operating method of claim 11, wherein the determining of the refractive power of the second focus adjustment region comprises:
complementarily determining the refractive power of the second focus adjustment region with respect to the refractive power of the first focus adjustment region.

### Claim 13 (depends on 12)

The operating method of claim 12, wherein the determining of the refractive power of the second focus adjustment region comprises:
determining the refractive power of the second focus adjustment region to be the same as the refractive power of the first focus adjustment region in a direction opposite to a direction of the refractive power of the first focus adjustment region.

### Claim 14 (depends on 11)

The operating method of claim 11, wherein the adjusting of the refractive power of the first focus adjustment region comprises:
applying a control voltage that generates a phase modulation profile relating to a position corresponding to the first focus adjustment region to the first variable focus; and
based on the applied control voltage, adjusting the refractive power of the first focus adjustment region by changing an angle at which liquid crystal molecules arranged at a position of the first focus adjustment region are arranged among liquid crystal molecules of the first variable focus.

### Claim 15 (depends on 11)

The operating method of claim 11, wherein the determining of the refractive power of the first focus adjustment region comprises:
measuring a depth value of a real world object disposed on the gaze point using a depth sensor; and
determining the refractive power of the first focus adjustment region based on the measured depth value so as to adjust a focal length of a virtual object which is a partial region of the virtual image.

### Claim 16 (depends on 11)

The operating method of claim 11, further comprising:
determining a position of the second focus adjustment region based on the direction of the left eye and the direction of the right eye such that the first focus adjustment region and the second focus adjustment region are aligned in the direction of the left eye or the direction of the right eye.

### Claim 17 (depends on 11)

The operating method of claim 11, wherein a size of the first focus adjustment region is determined based on a size of a virtual object that is a partial region of the virtual image output through the waveguide.

### Claim 18 (depends on 11)

The operating method of claim 11, wherein a size of the second focus adjustment region is determined based on a size of a virtual object that is a partial region of the virtual image output through the waveguide and a spaced distance between the first variable focus lens and the second variable focus lens.

### Claim 19 (depends on 11)

The operating method of claim 11, wherein a plurality of a first focus adjustment regions are provided on the first variable focus lens, and
wherein the determining the refractive power of the first focus adjustment region comprises determining refractive powers of the plurality of first focus adjustment regions such that different vergences are formed according to the plurality of first focus adjustment regions.

### Claim 20 (depends on 11)

A non-transitory computer readable recording medium storing a program for executing the operating method of claim 11.
