# US 2025/0168506 A1 · Phase detection autofocus using liquid crystal device

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0168506 A1
- Document ID: US20250168506A1
- Status: Published application
- Kind: A1
- Application number: 18/517,535
- Filed: 2023-11-22
- Published: 2025-05-22
- Earliest claimed: 2023-11-22
- Assignees: Varjo Technologies Oy
- Applicants: Varjo Technologies Oy
- Inventors: Mikko Strandborg; Mikko Ollila
- Web page: https://patentgrep.com/patent/US20250168506A1

## CPC

- H04N 23/672: {based on the phase difference signals}
- H04N 23/55: Optical parts specially adapted for electronic image sensors; Mounting thereof
- H04N 23/84: for processing colour signals
- G02B 5/201: {in the form of arrays}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS

## Abstract

Disclosed is system with imaging unit(s) and processor(s), imaging unit(s) with image sensor of photo-sensitive cells; and light valve device having array of light valves. The processor(s) is configured to: control light valves to allow light to pass therethrough, while controlling remaining light valves in the array to stop allowing the light to pass therethrough, thereby casting shadows of remaining light valves on first part and second part in first set and second set of photo-sensitive cells, respectively; read out image signals from photo-sensitive cells; select pairs of photo-sensitive cells from first set and second set; for given pair, determine phase difference between image signals read out from photo-sensitive cells of first set and second set; and adjust focus distance of the imaging unit(s), based on phase differences.

## Claims

### Claim 1

A system comprising:
at least one imaging unit comprising:
an image sensor comprising a plurality of photo-sensitive cells arranged on a photo-sensitive surface of the image sensor; and
a light valve device comprising an array of light valves, wherein the array of light valves is arranged on an optical path of the photo-sensitive surface of the image sensor; and
at least one processor configured to:
control a plurality of light valves in said array to allow light to pass therethrough towards the photo-sensitive surface, whilst controlling remaining light valves in said array to stop allowing the light to pass therethrough, thereby casting shadows of the remaining light valves on a first part of each photo-sensitive cell in a first set of photo-sensitive cells and on a second part of each photo-sensitive cell in a second set of photo-sensitive cells;
read out a plurality of image signals from the plurality of photo-sensitive cells;
select a plurality of pairs of photo-sensitive cells from the first set and the second set, each pair of photo-sensitive cells comprising one photo-sensitive cell from the first set and another photo-sensitive cell from the second set;
for a given pair of photo-sensitive cells comprising a first photo-sensitive cell from the first set and a second photo-sensitive cell from the second set, determine a phase difference between a first image signal read out from the first photo-sensitive cell and a second image signal read out from the second photo-sensitive cell; and
adjust a focus distance of the at least one imaging unit, based on phase differences determined for the plurality of pairs of photo-sensitive cells.

### Claim 2 (depends on 1)

The system of claim 1, wherein the at least one processor is configured to:
detect, based on the phase differences, when the at least one imaging unit is focused at a given focus point; and
when it is detected that the at least one imaging unit is focused at the given focus point, process the plurality of image signals to generate at least one image.

### Claim 3 (depends on 2)

The system of claim 2, wherein the at least one imaging unit further comprises a colour filter array arranged between the image sensor and the array of light valves, and wherein when processing the plurality of image signals, the at least one processor is configured to:
determine a colour value for each photo-sensitive cell, based on a corresponding image signal read out from said photo-sensitive cell; and
correct colour values for photo-sensitive cells of the first set and for photo-sensitive cells of the second set on whose respective first parts and respective second parts the shadows were casted by the remaining light valves, based on colour values determined for said photo-sensitive cells and colour values determined for their respective neighbouring photo-sensitive cells,
wherein optionally, the colour values are corrected by employing at least one neural network.

### Claim 4 (depends on 3)

The system of claim 3, wherein the first part is on an opposite side of the second part, and wherein the respective neighbouring photo-sensitive cells comprise other photo-sensitive cells on which the shadows are casted in other parts that are different from the first part and the second part.

### Claim 5 (depends on 1)

The system of claim 1, wherein a given light valve from amongst said remaining light valves covers only a part of each photo-sensitive cell in a group of neighbouring photo-sensitive cells, wherein the given light valve is arranged on an optical path of the group of neighbouring photo-sensitive cells.

### Claim 6 (depends on 1)

The system of claim 1, wherein a selection of the plurality of pairs of photo-sensitive cells is reconfigurable.

### Claim 7 (depends on 1)

The system of claim 1, wherein the at least one processor is configured to:
detect when a given criteria is satisfied, wherein the given criteria is satisfied when at least one of the following is true:
(i) an average illuminance of a real-world environment is lower than a predefined threshold illuminance;
(ii) a signal-to-noise ratio of the plurality of image signals is lower than a predefined threshold value;
when it is detected that the given criteria is satisfied, employ at least a predefined percent of a total number of light valves in said array as the remaining light valves.

### Claim 8 (depends on 1)

The system of claim 1, wherein the at least one imaging unit further comprises a colour filter array arranged between the image sensor and the array of light valves, the colour filter array comprising red colour filters, green colour filters and blue colour filters,
wherein the at least one processor is configured to select at least 50 percent of the remaining light valves as those light valves in said array that correspond to the blue colour filters.

### Claim 9 (depends on 1)

The system of claim 1, wherein the plurality of light valves and the remaining light valves are arranged in an interleaved manner.

### Claim 10 (depends on 1)

The system of claim 1, wherein the at least one processor is configured to:
for each pair of photo-sensitive cells comprising one photo-sensitive cell from the first set and another photo-sensitive cell from the second set, determine a phase difference between an image signal read out from the one photo-sensitive cell and another image signal read out from the another photo-sensitive cell; and
determine an optical depth of a corresponding three-dimensional point in a real-world environment, based on the determined phase difference and a distance between the one photo-sensitive cell and the another photo-sensitive cell.

### Claim 11

A method implemented by a system comprising at least one imaging unit, and at least one processor, the at least one imaging unit comprises an image sensor and a light valve device, the method incorporating phase detection autofocus using light valve device, wherein the method comprises:
controlling a plurality of light valves in an array to allow light to pass therethrough towards a photo-sensitive surface of the image sensor, whilst controlling remaining light valves in said array to stop allowing the light to pass therethrough, thereby casting shadows of the remaining light valves on a first part of each photo-sensitive cell in a first set of photo-sensitive cells and on a second part of each photo-sensitive cell in a second set of photo-sensitive cells;
reading out a plurality of image signals from the plurality of photo-sensitive cells;
selecting a plurality of pairs of photo-sensitive cells from the first set and the second set, each pair of photo-sensitive cells comprising one photo-sensitive cell from the first set and another photo-sensitive cell from the second set;
for a given pair of photo-sensitive cells comprising a first photo-sensitive cell from the first set and a second photo-sensitive cell from the second set, determining a phase difference between a first image signal read out from the first photo-sensitive cell and a second image signal read out from the second photo-sensitive cell; and
adjusting a focus distance of the at least one imaging unit, based on phase differences determined for the plurality of pairs of photo-sensitive cells.

### Claim 12 (depends on 11)

The method of claim 11, the method comprising:
detecting, based on the phase differences, when the at least one imaging unit is focused at a given focus point; and
when it is detected that the at least one imaging unit is focused at the given focus point, processing the plurality of image signals to generate at least one image.

### Claim 13 (depends on 12)

The method of claim 12, wherein the at least one imaging unit further comprises a colour filter array arranged between the image sensor and the array of light valves, and wherein at the step of processing the plurality of image signals, the method comprising:
determining a colour value for each photo-sensitive cell, based on a corresponding image signal read out from said photo-sensitive cell; and
correcting colour values for photo-sensitive cells of the first set and for photo-sensitive cells of the second set on whose respective first parts and respective second parts the shadows were casted by the remaining light valves, based on colour values determined for said photo-sensitive cells and colour values determined for their respective neighbouring photo-sensitive cells,
wherein optionally, the colour values are corrected by employing at least one neural network.

### Claim 14 (depends on 11)

The method of claim 11, wherein the at least one imaging unit further comprises a colour filter array arranged between the image sensor and the array of light valves, the colour filter array comprising red colour filters, green colour filters and blue colour filters,
wherein the method comprises selecting at least 50 percent of the remaining light valves as those light valves in said array that correspond to the blue colour filters.

### Claim 15 (depends on 11)

The method of claim 11, the method comprising:
for each pair of photo-sensitive cells comprising one photo-sensitive cell from the first set and another photo-sensitive cell from the second set, determining a phase difference between an image signal read out from the one photo-sensitive cell and another image signal read out from the another photo-sensitive cell; and
determining an optical depth of a corresponding three-dimensional point in a real-world environment, based on the determined phase difference and a distance between the one photo-sensitive cell and the another photo-sensitive cell.
