# US 2025/0095113 A1 · Gaze-directed denoising in multi-camera systems

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0095113 A1
- Document ID: US20250095113A1
- Status: Published application
- Kind: A1
- Application number: 18/467,800
- Filed: 2023-09-15
- Published: 2025-03-20
- Earliest claimed: 2023-09-15
- Assignees: Varjo Technologies Oy
- Applicants: Varjo Technologies Oy
- Inventors: Mikko Ollila
- Web page: https://patentgrep.com/patent/US20250095113A1

## CPC

- G06T 5/70: Denoising; Smoothing
- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- G06V 10/25: Determination of region of interest [ROI] or a volume of interest [VOI]
- G06V 10/462: {Salient features, e.g. scale invariant feature transforms [SIFT]}
- G06V 10/60: relating to illumination properties, e.g. using a reflectance or lighting model
- H04N 23/74: by influencing the scene brightness using illuminating means
- H04N 23/90: Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

When a first camera has a first value of an illumination parameter in first region(s) of a first field of view (FOV) of the first camera, while a second camera has, in corresponding region(s) of a second FOV of the second camera, a second value of the illumination parameter that is greater than the first value, a denoising technique is applied on first image segment(s) of the first image that represents the first region(s), based on corresponding image segment(s) of the second image that represents the corresponding region(s). The illumination parameter is any one of: (i) a ratio of a per-pixel area to pixels per degree (PPD), (ii) a ratio of a multiplication product of the per-pixel area and a relative illumination to the PPD.

## Claims

### Claim 1

An imaging system comprising:
a first camera and a second camera that are to be employed to simultaneously capture a first image and a second image, respectively, wherein an illumination parameter varies spatially across a first field of view (FOV) of the first camera, and across a second FOV of the second camera, the illumination parameter being any one of:
(i) a ratio of a per-pixel area (A) to pixels per degree (PPD),
(ii) a ratio of a multiplication product of the per-pixel area and a relative illumination (A×RI) to the PPD; and
at least one processor configured to:
detect whether the first camera has a first value of the illumination parameter in at least one first region of the first FOV, while the second camera has, in at least one corresponding region of the second FOV, a second value of the illumination parameter that is greater than the first value; and
when it is detected that the first camera has the first value of the illumination parameter in the at least one first region, while the second camera has the second value of the illumination parameter that is greater than the first value in the at least one corresponding region, apply a denoising technique on at least one first image segment of the first image that represents the at least one first region of the first FOV, based on at least one corresponding image segment of the second image that represents the at least one corresponding region of the second FOV.

### Claim 2 (depends on 1)

The imaging system of claim 1, wherein the at least one processor is configured to apply at least one image restoration technique on the at least one corresponding image segment of the second image, based on the at least one first image segment of the first image, when it is detected that the first camera has the first value of the illumination parameter in the at least one first region, while the second camera has the second value of the illumination parameter that is greater than the first value in the at least one corresponding region.

### Claim 3 (depends on 1)

The imaging system of claim 1, wherein the at least one processor is configured to:
detect whether the second camera has a third value of the illumination parameter in at least one second region of the second FOV, while the first camera has, in at least one corresponding region of the first FOV, a fourth value of the illumination parameter that is greater than the third value; and
when it is detected that the second camera has the third value of the illumination parameter in the at least one second region, while the first camera has the fourth value of the illumination parameter that is greater than the third value in the at least one corresponding region, apply the denoising technique on at least one second image segment of the second image that represents the at least one second region of the second FOV, based on at least one corresponding image segment of the first image that represents the at least one corresponding region of the first FOV.

### Claim 4 (depends on 3)

The imaging system of claim 3, wherein the at least one processor is configured to apply at least one image restoration technique on the at least one corresponding image segment of the first image, based on the at least one second image segment of the second image, when it is detected that the second camera has the third value of the illumination parameter in the at least one second region, while the first camera has the fourth value of the illumination parameter that is greater than the third value in the at least one corresponding region.

### Claim 5 (depends on 1)

The imaging system of claim 1, wherein the at least one processor is configured to:
obtain information indicative of a first gaze direction of a first eye;
determine a gaze region within the first FOV, based on the first gaze direction; and
select the at least one first region of the first FOV, based on the gaze region within the first FOV, wherein the at least one first region includes and surrounds the gaze region.

### Claim 6 (depends on 1)

The imaging system of claim 1, wherein the at least one processor is configured to:
obtain information indicative of a first gaze direction of a first eye;
determine a gaze region within the first FOV, based on the first gaze direction; and
select the at least one first region of the first FOV, based on the gaze region within the first FOV, wherein the at least one first region is a peripheral region that surrounds the gaze region.

### Claim 7 (depends on 1)

The imaging system of claim 1, wherein the at least one processor is configured to:
identify at least one salient feature in the first image;
identify at least one image segment of the first image that includes the at least one salient feature; and
select the at least one first region of the first FOV as at least one region of the first FOV that corresponds to the at least one image segment of the first image.

### Claim 8 (depends on 1)

The imaging system of claim 1, further comprising at least one third camera that is to be employed to capture at least one third image simultaneously with the first image and the second image, wherein the illumination parameter varies spatially across at least one third FOV of the at least one third camera, wherein the at least one processor is configured to:
detect when a region of interest within a given FOV, from amongst the first FOV, the second FOV and the at least one third FOV, has a value of the illumination parameter that is smaller than a first predefined threshold or is smaller than at least one of individual values of the illumination parameter in corresponding regions of a remainder of the first FOV, the second FOV and the at least one third FOV by at least a second predefined threshold;
calculate respectively differences between the value of the illumination parameter in the region of interest of the given FOV and the individual values of the illumination parameter in the corresponding regions of the remainder of the first FOV, the second FOV and the at least one third FOV;
determine one of the remainder whose difference is largest amongst the calculated differences; and
apply the denoising technique on an image segment of a given image that represents the region of interest of the given FOV, based on a corresponding image segment of another image that represents a corresponding region of the determined one of the remainder, wherein the given image corresponds to the given FOV, while the another image corresponds to the determined one of the remainder.

### Claim 9 (depends on 1)

The imaging system of claim 1, wherein the at least one processor is configured to:
detect when a difference between a value of the illumination parameter of a given region of the first FOV and another value of the illumination parameter of a corresponding region of the second FOV is smaller than a third predefined threshold; and
when it is detected that the difference is smaller than the third predefined threshold, apply at least one of: another denoising technique, at least one image restoration technique on at least one of:
(a) a given image segment of the first image that represents the given region of the first FOV, based on a corresponding image segment of the second image that represents the corresponding region of the second FOV,
(b) the corresponding image segment of the second image that represents the corresponding region of the second FOV, based on the given image segment of the first image that represents the given region of the first FOV.

### Claim 10

A method comprising:
detecting whether a first camera has a first value of an illumination parameter in at least one first region of a first field of view (FOV) of the first camera, while a second camera has, in at least one corresponding region of a second FOV of the second camera, a second value of the illumination parameter that is greater than the first value, wherein the first camera and the second camera are to be employed to simultaneously capture a first image and a second image, respectively, and wherein the illumination parameter varies spatially across the first FOV and the second FOV, the illumination parameter being any one of:
(i) a ratio of a per-pixel area (A) to pixels per degree (PPD),
(ii) a ratio of a multiplication product of the per-pixel area and a relative illumination (A×RI) to the PPD; and
when it is detected that the first camera has the first value of the illumination parameter in the at least one first region, while the second camera has the second value of the illumination parameter that is greater than the first value in the at least one corresponding region, applying a denoising technique on at least one first image segment of the first image that represents the at least one first region of the first FOV, based on at least one corresponding image segment of the second image that represents the at least one corresponding region of the second FOV.

### Claim 11 (depends on 10)

The method of claim 10, further comprising applying at least one image restoration technique on the at least one corresponding image segment of the second image, based on the at least one first image segment of the first image, when it is detected that the first camera has the first value of the illumination parameter in the at least one first region, while the second camera has the second value of the illumination parameter that is greater than the first value in the at least one corresponding region.

### Claim 12 (depends on 10)

The method of claim 10, further comprising:
detecting whether the second camera has a third value of the illumination parameter in at least one second region of the second FOV, while the first camera has, in at least one corresponding region of the first FOV, a fourth value of the illumination parameter that is greater than the third value; and
when it is detected that the second camera has the third value of the illumination parameter in the at least one second region, while the first camera has the fourth value of the illumination parameter that is greater than the third value in the at least one corresponding region, applying the denoising technique on at least one second image segment of the second image that represents the at least one second region of the second FOV, based on at least one corresponding image segment of the first image that represents the at least one corresponding region of the first FOV.

### Claim 13 (depends on 12)

The method of claim 12, further comprising applying at least one image restoration technique on the at least one corresponding image segment of the first image, based on the at least one second image segment of the second image, when it is detected that the second camera has the third value of the illumination parameter in the at least one second region, while the first camera has the fourth value of the illumination parameter that is greater than the third value in the at least one corresponding region.

### Claim 14 (depends on 10)

The method of claim 10, wherein at least one third camera is to be employed to capture at least one third image simultaneously with the first image and the second image, wherein the illumination parameter varies spatially across at least one third FOV of the at least one third camera, wherein the method further comprises:
detecting when a region of interest within a given FOV, from amongst the first FOV, the second FOV and the at least one third FOV, has a value of the illumination parameter that is smaller than a first predefined threshold or is smaller than at least one of individual values of the illumination parameter in corresponding regions of a remainder of the first FOV, the second FOV and the at least one third FOV by at least a second predefined threshold;
calculating respectively differences between the value of the illumination parameter in the region of interest of the given FOV and the individual values of the illumination parameter in the corresponding regions of the remainder of the first FOV, the second FOV and the at least one third FOV;
determining one of the remainder whose difference is largest amongst the calculated differences; and
applying the denoising technique on an image segment of a given image that represents the region of interest of the given FOV, based on a corresponding image segment of another image that represents a corresponding region of the determined one of the remainder, wherein the given image corresponds to the given FOV, while the another image corresponds to the determined one of the remainder.

### Claim 15 (depends on 10)

The method of claim 10, further comprising:
detecting when a difference between a value of the illumination parameter of a given region of the first FOV and another value of the illumination parameter of a corresponding region of the second FOV is smaller than a third predefined threshold; and
when it is detected that the difference is smaller than the third predefined threshold, applying at least one of: another denoising technique, at least one image restoration technique on at least one of:
(a) a given image segment of the first image that represents the given region of the first FOV, based on a corresponding image segment of the second image that represents the corresponding region of the second FOV,
(b) the corresponding image segment of the second image that represents the corresponding region of the second FOV, based on the given image segment of the first image that represents the given region of the first FOV.