# US 2019/0318458 A1 · Method For Rendering A Final Image From Initial Images Acquired By A Camera Array, Corresponding Device, Computer Program Product And Computer-Readable Carrier Medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0318458 A1
- Document ID: US20190318458A1
- Status: Published application
- Kind: A1
- Application number: 16/465,094
- Filed: 2017-11-24
- Published: 2019-10-17
- Earliest claimed: 2016-11-30
- Assignees: InterDigital CE Patent Holdings, SAS
- Applicants: Interdigital Ce Patent Holdings
- Inventors: Neus SABATER; Matthieu HOG; Guillaume BOISSON
- Web page: https://patentgrep.com/patent/US20190318458A1

## CPC

- G06T 5/70: Denoising; Smoothing
- G06T 5/50: using two or more images, e.g. averaging or subtraction
- G06T 7/557: from light fields, e.g. from plenoptic cameras
- G06T 7/90: Determination of colour characteristics
- H04N 23/13: with multiple sensors
- H04N 23/90: Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
- G06T 2207/10024: Color image
- G06T 2207/10052: Images from lightfield camera
- H04N 2013/0088: {Synthesising a monoscopic image signal from stereoscopic images, e.g. synthesising a panoramic or high resolution monoscopic image}
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A method for rendering an image, called a final image, from at least one image acquired by a camera array, is provided. According to such a method, the determination of a color value for at least one pixel of the final image, called a current pixel, comprises: for at least one initial image acquired by the camera array, obtaining a color value of a pixel associated with said current pixel within said at least one initial image, acquiring at least one color value called a real color value; computing at least one interpolated color value, from said at least one real color value; determining the color value for said current pixel, as a function of said at least one real color value and said at least one interpolated color value.

## Claims

### Claim 1

A method for rendering an image, called a final image, from at least one image acquired by a camera array, wherein the determination of a color value for at least one pixel of the final image, called a current pixel, comprises:
for at least one initial image acquired by the camera array, obtaining a color value of a pixel associated with said current pixel within said at least one initial image, called a real color value of the current pixel;
for at least one initial image acquired by the camera array, obtaining a color value of a pixel located in a vicinity of said pixel associated with said current pixel within said at least one initial image, called a real color value of the at least one neighbour pixel;
computing at least one interpolated color value, from real color values;
determining the color value for said current pixel, as a function of said at least one real color value of the associated pixel and said at least one interpolated color value.

### Claim 2 (depends on 1)

The method of claim 1, wherein said current pixel is an out-of-focus pixel, belonging to a blurred region of said final image.

### Claim 3 (depends on 1)

The method of claim 1, wherein computing at least one interpolatedcolor value from said at least one real color value comprises performing an angular nearest neighbors interpolation.

### Claim 4 (depends on 2)

The method of claim 2, wherein computing at least one interpolated color value consists in computing a number of interpolated color values, said number being a function of a difference between a depth of said current pixel and a depth of an in-focus region of said final image.

### Claim 5 (depends on 4)

The method of claim 4, wherein said number of interpolated color values increases as said difference between a depth of said current pixel and a depth of an in-focus region of said final image increases.

### Claim 6 (depends on 1)

The method of claim 1, wherein said at least one real color value of the associated pixel and said at least one interpolated color value used to determine the color value for said current pixel are determined as a function of a predetermined blur shape.

### Claim 7 (depends on 1)

The method of claim 1, wherein determining the color value for said current pixel comprises determining an arithmetic average of said at least one real color value of the associated pixel and said at least one interpolated color value.

### Claim 8 (depends on 1)

The method of claim 1, wherein determining the color value for said current pixel comprises determining a weighted average of said at least one real color value of the current pixel and said at least one interpolated color value.

### Claim 9

A device for rendering an image, called a final image, from at least one image acquired by a camera array, wherein said device comprises, for the determination of a color value for at least one pixel of the final image, called a current pixel:
a module for obtaining, for at least one initial image acquired by the camera array, a color value of a pixel associated with said current pixel within said at least one initial image, acquiring at least one color value called a real color value of said associated pixel;
a module for obtaining, for at least one initial image acquired by the camera array, a color value of a pixel located in a vicinity of said pixel associated with the current pixel within said at least one initial image, acquiring at least one color value called a real color value of at least one neighbour pixel;
a module for computing at least one interpolated color value, from said at least one real color value;
a module for determining the color value for said current pixel, as a function of said at least one real color value of said associated pixel and said at least one interpolated color value.

### Claim 10

A computer program product downloadable from a communication network and/or recorded on a medium readable by a computer and/or executable by a processor, comprising program code instructions for implementing a method comprising:
for at least one initial image acquired by the camera array, obtaining a color value of a pixel associated with said current pixel within said at least one initial image, called a real color value of the current pixel;
for at least one initial image acquired by the camera array, obtaining a color value of a pixel located in a vicinity of said pixel associated with said current pixel within said at least one initial image, called a real color value of the at least one neighbour pixel;
computing at least one interpolated color value, from real color values;
determining the color value for said current pixel, as a function of said at least one real color value of the associated pixel and said at least one interpolated color value.

### Claim 11

A non-transitory computer-readable medium comprising a computer program product recorded thereon and capable of being run by a processor, including program code instructions for implementing a method according to comprising:
for at least one initial image acquired by the camera array, obtaining a color value of a pixel associated with said current pixel within said at least one initial image, called a real color value of the current pixel;
for at least one initial image acquired by the camera array, obtaining a color value of a pixel located in a vicinity of said pixel associated with said current pixel within said at least one initial image, called a real color value of the at least one neighbour pixel;
computing at least one interpolated color value, from real color values;
determining the color value for said current pixel, as a function of said at least one real color value of the associated pixel and said at least one interpolated color value.