# US 2025/0093641 A1 · Electronic device for eye-tracking and method of operating the same

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0093641 A1
- Document ID: US20250093641A1
- Status: Published application
- Kind: A1
- Application number: 18/778,045
- Filed: 2024-07-19
- Published: 2025-03-20
- Earliest claimed: 2023-09-14
- Assignees: Samsung Electronics Co., Ltd.
- Applicants: Samsung Electronics Co., Ltd.
- Inventors: Bonkon KOO; Kyookeun LEE; Doyoun KIM; Sunghwan SHIN; Jongchul CHOI
- Web page: https://patentgrep.com/patent/US20250093641A1

## CPC

- G02B 27/0093: {with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking}
- G02B 5/30: Polarising elements (light-modulating devices with active elements G02F1/00)
- G02B 27/00: Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B 27/01: Head-up displays
- G02B 27/10: Beam splitting or combining systems (polarising systems G02B27/28; mixing and splitting light signals using optical waveguides G02B6/28; {beam shaping, e.g. changing the cross-sectional area, by dividing or superposing multiple light beams G02B27/0905})
- G02B 27/28: for polarising (used in stereoscopes G02B30/25)
- G02B 27/286: {for controlling or changing the state of polarisation, e.g. transforming one polarisation state into another (G02B5/3083 takes precedence; light guide coupling means utilising polarising elements G02B6/34)}
- G02B 27/288: {Filters employing polarising elements, e.g. Lyot or Solc filters (G02B5/3016 takes precedence)}
- G06F 3/01: Input arrangements or combined input and output arrangements for interaction between user and computer (G06F3/16 takes precedence)
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Provided are an electronic device for eye tracking, and a method of operating the electronic device. The electronic device generates a plurality of light beams through a polarization filter and a polarization change element, or a plurality of light sources, and obtains a coded image through a metalens configured to refract the generated plurality of light beams into different paths. The electronic device obtains gaze information of a user, based on the coded image, and track the gage of the user.

## Claims

### Claim 1

An electronic device comprising:
a polarization filter configured to receive incident light and to change a polarization of the incident light;
a polarization change element configured to receive light from the polarization filter;
a metalens configured to refract light received from the polarization change element into different paths according to a polarization direction of the light received from the polarization change element;
an image sensor configured to receive the refracted light from the metalens;
at least one processor; and
at least one memory storing at least one instruction that, when executed by the at least one processor, cause the electronic device to:
cause the polarization filter to change the incident light to a first polarized light of a first direction and to transmit the first polarized light,
obtain, through the image sensor, a first coded image based on the first polarized light, wherein the first polarized light is refracted into a first path by the metalens, and
based on identifying that gaze information of a user may not be obtained from the first coded image:
cause the polarization change element to change the first polarized light to a second polarized light of a second direction and transmit the second polarized light,
obtain, through the image sensor, a second coded image based on the second polarized light, wherein the second polarized light is refracted into a second path by the metalens, and
obtain the gaze information of the user from the second coded image.

### Claim 2 (depends on 1)

The electronic device of claim 1, wherein the at least one instruction, when executed by the at least one processor, causes the electronic device to:
based on identifying that the gaze information of the user may be obtained from the first coded image, obtain the gaze information of the user from the first coded image.

### Claim 3 (depends on 1)

The electronic device of claim 1, wherein the first direction is perpendicular to the second direction.

### Claim 4 (depends on 1)

The electronic device of claim 1,
wherein the at least one instruction, when executed by the at least one processor, causes the electronic device to:
based on identifying that the gaze information of the user may not be obtained from the second coded image:
cause the polarization change element to change the first polarized light to a third polarized light of a third direction and transmit the third polarized light,
obtain, through the image sensor, a third coded image based on the third polarized light, wherein the third polarized light is refracted into a third path by the metalens, and
obtain the gaze information of the user from the third coded image.

### Claim 5 (depends on 1)

The electronic device of claim 1,
wherein the first coded image is formed by the first polarized light reaching a first point within an imaging surface of the image sensor along the first path, and
wherein the second coded image is formed by the second polarized light reaching a second point within the imaging surface of the image sensor along the second path.

### Claim 6 (depends on 1)

The electronic device of claim 1,
wherein the first path does not intersect with an imaging surface of the image sensor, and
wherein the second coded image is formed by the second polarized light reaching the imaging surface of the image sensor along the second path.

### Claim 7 (depends on 1)

The electronic device of claim 1, further comprising a first light source configured to output a first light,
wherein the at least one instruction, when executed by the at least one processor, causes the electronic device to:
cause the first polarized light to be transmitted by allowing the first light to pass through the polarization filter.

### Claim 8 (depends on 4)

The electronic device of claim 4, further comprising:
a first light source configured to output a first light; and
a second light source configured to output a second light,
wherein the at least one instruction, when executed by the at least one processor, causes the electronic device to:
cause the first polarized light to be transmitted by allowing the first light to pass through the polarization filter or cause the third polarized light to be transmitted by allowing the second light to pass through the polarization filter.

### Claim 9 (depends on 8)

The electronic device of claim 8, wherein a wavelength region of the first light and a wavelength region of the second light are different from each other.

### Claim 10 (depends on 1)

The electronic device of claim 1, further comprising:
a first light source configured to output a first light; and
a second light source configured to output a second light,
wherein the at least one instruction, when executed by the at least one processor, causes the electronic device to:
cause the first polarized light to be transmitted by allowing the first light to pass through the polarization filter,
cause the polarization change element to transmit the first polarized light or to change the first polarized light to the second polarized light and transmit the second polarized light,
cause a third polarized light of a third direction to be transmitted by allowing the second light to pass through the polarization filter,
cause the polarization change element to transmit the third polarized light or to change the third polarized light to a fourth polarized light of a fourth direction and transmit the fourth polarized light, and
obtain, through the image sensor, the gaze information of the user from a third coded image based on the first polarized light, the second polarized light, the third polarized light, or the fourth polarized light.

### Claim 11 (depends on 1)

The electronic device of claim 1, wherein the at least one instruction, when executed by the at least one processor, causes the electronic device to:
obtain a feature point related to an eye from the second coded image, and
obtain the gaze information of the user based on the feature point.

### Claim 12 (depends on 1)

The electronic device of claim 1, wherein the at least one instruction, when executed by the at least one processor, causes the electronic device to:
obtain a restored image related to an eye from the second coded image, and
obtain the gaze information of the user based on the restored image.

### Claim 13 (depends on 1)

The electronic device of claim 1,
wherein the metalens comprising a surface formed of a plurality of nanostructures arranged on a substrate, wherein the metalens is configured to refract light received from the polarization change element into different paths by modulating a phase of the light received from the polarization change element based on one of a polarization of the light received from the polarization change element and a wavelength of the light received from the polarization change element.

### Claim 14 (depends on 13)

The electronic device of claim 13, wherein the metalens is further configured to refract light received from the polarization change element into different paths based on at least one of a size of each nanostructure of the plurality of nanostructures, a shape of each nanostructure of the plurality of nanostructures, and an arrangement of the plurality of nanostructures on the substrate.

### Claim 15

A method comprising:
obtaining a first coded image by receiving first polarized light refracted into a first path by a metalens, wherein the metalens is configured to refract incident light into different paths according to a polarization direction of the incident light;
identifying whether gaze information of a user may be obtained from the first coded image;
based on identifying that the gaze information of the user may not be obtained from the first coded image: obtaining a second coded image by receiving second polarized light refracted into a second path by the metalens; and
obtaining the gaze information of the user from the second coded image.

### Claim 16

An electronic device comprising:
a first light source configured to output a first light;
a second light source configured to output a second light;
a metalens configured to refract incident light into different paths according to a wavelength of the incident light;
an image sensor configured to receive light refracted by the metalens;
at least one processor; and
at least one memory storing at least one instruction that, when executed by the at least one processor, cause the electronic device to:
obtain, through the image sensor, a first coded image, wherein the first coded image is based on the first light refracted into a first path by the metalens, and
based on identifying that gaze information of a user may not be obtained from the first coded image, obtain gaze information of the user from a second coded image obtained through the image sensor, wherein the second coded image is based on the second light refracted into a second path by the metalens.

### Claim 17 (depends on 16)

The electronic device of claim 16, wherein the at least one instruction, when executed by the at least one processor, causes the electronic device to:
based on identifying that the gaze information of the user may be obtained from the first coded image, obtain the gaze information of the user from the first coded image.

### Claim 18 (depends on 16)

The electronic device of claim 16, wherein a wavelength region of the first light and a wavelength region of the second light are different from each other.

### Claim 19 (depends on 16)

The electronic device of claim 16, further comprising a third light source configured to output a third light,
wherein the at least one instruction, when executed by the at least one processor, causes the electronic device to:
based on identifying that the gaze information of the user may not be obtained from the second coded image, obtain the gaze information of the user from a third coded image obtained through the image sensor, wherein the third coded image is based on the third light refracted into a third path by the metalens.

### Claim 20 (depends on 16)

The electronic device of claim 16,
wherein the first coded image is formed by the first light reaching a first point within an imaging surface of the image sensor along the first path, and
wherein the second coded image is formed by the second light reaching a second point within the imaging surface of the image sensor along the second path.
