# US 2015/0103197 A1 · Technique for view synthesis

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2015/0103197 A1
- Document ID: US20150103197A1
- Status: Published application
- Kind: A1
- Application number: 14/511,481
- Filed: 2014-10-10
- Published: 2015-04-16
- Earliest claimed: 2013-10-11
- Assignees: Telefonaktiebolaget L M Ericsson (publ)
- Applicants: Telefonaktiebolaget L M Ericsson (Publ)
- Inventors: Branko DJORDJEVIC; Can Cagman; Alexander Langer
- Web page: https://patentgrep.com/patent/US20150103197A1

## CPC

- H04N 23/698: for achieving an enlarged field of view, e.g. panoramic image capture
- G06T 15/205: {Image-based rendering}
- H04N 23/45: for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
- H04N 23/90: Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A technique for computing an image of a virtual view based on a plurality of camera views is presented. One or more cameras provide the plurality of camera views. As to a method aspect of the technique, two or three camera views that at least partially overlap and that at least partially overlap with the virtual view are selected among the plurality of camera views. The image of the virtual view is computed based on objects in the selected camera views using a multilinear relation that relates the selected camera views and the virtual view.

## Claims

### Claim 1

A method of computing an image of a virtual view based on a plurality of camera views, wherein one or more cameras in hardware provide the plurality of camera views, the method comprising
selecting among the plurality of camera views two or three camera views that at least partially overlap and that at least partially overlap with the virtual view; and
computing the image of the virtual view based on objects in the selected camera views using a multilinear relation that relates the selected camera views and the virtual view.

### Claim 2 (depends on 1)

The method of claim 1, wherein different parts of the image of the virtual view are computed based on different selections of two or three camera views.

### Claim 3 (depends on 2)

The method of claim 2, wherein the different parts form a partition that is indicative of the two or three at least partially overlapping camera views among the plurality of camera views for each of the parts.

### Claim 4 (depends on 1)

The method of claim 1, wherein the virtual view is specified by parameters of a projection.

### Claim 5 (depends on 4)

The method of claim 4, wherein at least one of the partition and the selection depends on the projection parameters of the virtual view.

### Claim 6 (depends on 4)

The method of claim 4, wherein parameters of a projection are specified for each of the camera views.

### Claim 7 (depends on 6)

The method of claim 6, wherein a mesh is represented in memory, the mesh including a vertex for each of the camera views and an edge for each pair of overlapping camera views among the plurality of camera views.

### Claim 8 (depends on 7)

The method of claim 7, wherein the mesh indicates pairs and triples of overlapping camera views as a function of the projection parameters of the virtual view.

### Claim 9 (depends on 4)

The method of claim 4, further comprising
computing the multilinear relation as a function of one or more of the projection parameters of the virtual view.

### Claim 10 (depends on 9)

The method of claim 9, wherein a projection matrix (P) is specified for each of the selected camera views and the virtual view, and wherein the multilinear relation (T; Q) is computed based on the projection matrices.

### Claim 11 (depends on 4)

The method of claim 4, wherein the projection parameters of the virtual view specify at least one of a position of a projection center of the virtual view; an orientation of an optical axis and/or a projection plane of the virtual view; and a zoom level of the virtual view.

### Claim 12 (depends on 4)

The method of claim 4, wherein a sequence of images of the virtual view is computed based on changing projection parameters of the virtual view.

### Claim 13 (depends on 1)

The method of claim 1, wherein the multilinear relation is represented by a trifocal tensor (T), if two camera views are selected, and wherein the multilinear relation is represented by a quadrifocal tensor (Q), if three camera views are selected.

### Claim 14 (depends on 1)

A computer program product comprising a non-transitory computer readable medium comprising program code for carrying out the method according to claim 1 when the computer program product is executed on one or more computing devices.

### Claim 15

A device for computing an image of a virtual view based on a plurality of camera views, wherein one or more cameras in hardware provide the plurality of camera views, the device comprising
a selecting unit adapted to select among the plurality of camera views two or three camera views that at least partially overlap and that at least partially overlap with the virtual view; and
a computing unit adapted to compute the image of the virtual view based on objects in the selected camera views using a multilinear relation that relates the selected camera views and the virtual view.

### Claim 16 (depends on 15)

The device of claim 15, further comprising a receiver adapted to wirelessly receive image data from the one or more cameras in hardware.
