# US 10,455,169 B2 · Method and apparatus for correcting vignetting effect caused on an image captured by lightfield cameras

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,455,169 B2
- Document ID: US10455169B2
- Status: Granted
- Kind: B2
- Application number: 15/379,710
- Filed: 2016-12-15
- Published: 2017-06-15
- Granted: 2019-10-22
- Earliest claimed: 2015-12-15
- Assignees: InterDigital CE Patent Holdings, SAS
- Applicants: Interdigital Ce Patent Holdings
- Inventors: Mozhdeh Seifi; Valter Drazic; Paul Kerbiriou
- Web page: https://patentgrep.com/patent/US10455169B2

## CPC

- H04N 25/61: the noise originating only from the lens unit, e.g. flare, shading, vignetting or "cos4"
- G06T 5/80: Geometric correction
- H04N 9/646: {for image enhancement, e.g. vertical detail restoration, cross-colour elimination, contour correction, chrominance trapping filters}
- H04N 23/12: with one sensor only
- H04N 23/55: Optical parts specially adapted for electronic image sensors; Mounting thereof
- H04N 23/75: by influencing optical camera components
- H04N 23/957: Light-field or plenoptic cameras or camera modules
- H04N 25/41: {Extracting pixel data from a plurality of image sensors simultaneously picking up an image, e.g. for increasing the field of view by combining the outputs of a plurality of sensors}
- G06T 7/557: from light fields, e.g. from plenoptic cameras
- G06T 2207/10052: Images from lightfield camera
- H04N 2209/045: using mosaic colour filter
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

The disclosure addresses the vignetting effect caused on an image captured by lightfield camera. A method to compensate for the vignetting effect for a lightfield camera comprising an image sensor array including plurality of photosites. The method includes the operations of obtaining luminance values from the each photosite; obtaining a set of weight values for compensating the vignetting effect for the each photosite being associated with a present setting of the lightfield camera; and changing the luminance values of the each photosite based on the obtained a set of the weight values.

## Claims

### Claim 1

A method for correcting vignetting effect caused on an image captured by a lightfield camera comprising an image sensor array including plurality of photosites, the method comprising:
obtaining luminance values from each photosite;
obtaining a set of weight values for compensating the vignetting effect for each photosite, wherein said set of weight values is associated with a present setting of the lightfield camera; and
changing the luminance values of each photosite based on the obtained set of the weight values wherein luminance values of each photosite are normalized to be transformed to a maximum magnitude,
wherein a Lambertian object image is captured to generate luminance values of each photosite and wherein the weight values are calculated by:
determining a maximum luminance value from the generated luminance values;
dividing the maximum luminance value by the generated luminance values of the photosites when the Lambertian object image is captured to calculate the weight values;
comparing each luminance value of the generated luminance values with a first value; and
if the compared luminance value of a corresponding photosite is less than the first value, setting a respective weight value of the corresponding photosite equal to 0.

### Claim 2 (depends on 1)

The method according to claim 1, wherein the changing the luminance values of each photosite is performed by multiplying the luminance values of each photosite by the respective weight values associated with each photosite.

### Claim 3

A device for correcting vignetting effect caused on an image captured by a lightfield camera comprising image sensor array including plurality of photosites, the device comprising a storage storing a set of weight values for compensating the vignetting effect for each photosite and a processor configured to perform:
obtaining luminance values of each photosite;
obtaining a set of weight values for each photosite; and
changing the luminance values of each photosite based on the obtained set of weight values wherein luminance values of each photosite are normalized to be transformed to a maximum magnitude,
wherein a Lambertian object image is captured to generate luminance values of each photosite and wherein the weight values are calculated by:
determining a maximum luminance value from the generated luminance values;
dividing the maximum luminance value by the generated luminance values of the photosites when the Lambertian object image is captured to calculate the weight values;
comparing each luminance value of the generated luminance values with a first value; and
if the compared luminance value of a corresponding photosite is less than the first value, setting a respective weight value of the corresponding photosite equal to 0.

### Claim 4 (depends on 3)

The device according to claim 3, wherein the lightfield camera further comprises:
a primary lens;
a lenslet array including a plurality of microlenses located between the image sensor array and the primary lens;
an additional lens being arranged between the primary lens (10) and the microlenses at a distance (L1) from the primary lens, the additional lens having a focal length corresponding to the distance (L1).

### Claim 5 (depends on 1)

Non-transitory tangible computer-readable medium comprising a computer program product recorded thereon and capable of being run by a processor, including program code instructions for implementing the steps of a method according to claim 1.
