# US 2014/0192165 A1 · Signaling of camera and/or depth parameters

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2014/0192165 A1
- Document ID: US20140192165A1
- Status: Published application
- Kind: A1
- Application number: 14/238,341
- Filed: 2012-06-01
- Published: 2014-07-10
- Earliest claimed: 2011-08-12
- Assignees: Telefonaktiebolaget L M Ericsson (publ)
- Inventors: Andrey Norkin; Zhuangfei Wu; Thomas Rusert
- Web page: https://patentgrep.com/patent/US20140192165A1

## CPC

- H04N 13/25: using two or more image sensors with different characteristics other than in their location or field of view, e.g. having different resolutions or colour pickup characteristics; using image signals from one sensor to control the characteristics of another sensor
- H04N 13/161: Encoding, multiplexing or demultiplexing different image signal components (for multi-view video sequence encoding H04N19/597)
- H04N 13/178: Metadata, e.g. disparity information
- H04N 19/463: by compressing encoding parameters before transmission
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

An encoder and a method therein for providing an update message relating to at least one of camera parameters and depth parameters “the parameters”, a decoder and a method therein for decoding the update message, a first device comprising the encoder and a second device comprising the decoder are provided. The parameters enable the decoder to synthesize a first view for a first camera position based on a second view for a second camera position and the parameters of the second view. The encoder detects which of the parameters are changing over time. Next, the encoder modularizes the parameters into a respective module. Furthermore, the encoder encodes each respective module into the update message and sends the update message to the decoder. Next, the decoder decodes each respective module of the update message to obtain the parameters which are to be updated.

## Claims

### Claim at position 1

1-54. (canceled)

### Claim 55

A method in an encoder for providing an update message relating to at least one of camera parameters and depth parameters, wherein said at least one of the camera parameters and the depth parameters enables a decoder to synthesize a first view for a first camera position based on a second view for a second camera position and said at least one of the camera parameters and the depth parameters, wherein said at least one of the camera parameters and depth parameters relate to the second view, wherein the method comprises:
detecting which of said at least one of the camera parameters and the depth parameters are changing over time;
modularizing the detected said at least one of the camera parameters and the depth parameters into a respective module;
encoding each respective module into the update message; and
sending the update message to the decoder.

### Claim 56 (depends on 55)

The method according to claim 55, wherein the camera parameters comprise intrinsic parameters, extrinsic parameters and/or wherein the depth parameters comprise znear and/or zfar values.

### Claim 57 (depends on 55)

The method according to claim 55, wherein the respective module relates to intrinsic parameters, extrinsic parameters or depth parameters.

### Claim 58 (depends on 55)

The method according to claim 55, wherein the method further comprises, before the modularizing:
linearly predicting, based on camera parameters and/or depth parameters for a first frame and a second frame, said at least one of the camera parameters and the depth parameters for a third frame in the vicinity of the first and second frames.

### Claim 59 (depends on 55)

The method according to claim 55, wherein the update message comprises a first message and a second message, wherein the first message comprises the camera parameters and the second message comprises the depth parameters.

### Claim 60 (depends on 55)

The method according to claim 55, wherein the camera parameters comprises a rotation matrix, wherein the update message comprises an indication for indicating that the rotation matrix is an identity matrix.

### Claim 61 (depends on 55)

The method according to claim 55, wherein the method further comprises:
predicting the camera parameters and/or the depth parameters for a camera based on further camera parameters and/or further depth parameters for a further camera.

### Claim 62

A method in a decoder for decoding an update message relating to at least one of camera parameters and depth parameters, wherein said at least one of the camera parameters and the depth parameters enables the decoder to synthesize a first view for a first camera position based on a second view for a second camera position and said at least one of the camera parameters and the depth parameters, wherein said at least one of the camera parameters and the depth parameters relate to the second view, wherein the method comprises:
receiving the update message from an encoder, wherein the update message comprises a respective module for at least one of the camera parameters and the depth parameters; and
decoding each respective module of the update message to obtain said at least one of the camera parameters and the depth parameters which are to be updated.

### Claim 63 (depends on 62)

The method according to claim 62, wherein the camera parameters comprise intrinsic parameters, extrinsic parameters and/or translation parameters, and/or wherein the depth parameters comprise znear and/or zfar values.

### Claim 64 (depends on 62)

The method according to claim 62, wherein the respective module relates to intrinsic parameters, extrinsic parameters or depth parameters.

### Claim 65 (depends on 62)

The method according to claim 62, wherein the method further comprises, after the decoding:
extracting based on camera parameters and/or depth parameters for a first frame and a second frame, said at least one of the camera parameters and the depth parameters for a third frame in the vicinity of the first and second frames.

### Claim 66 (depends on 65)

The method according to claim 65, wherein each respective module includes a respective difference parameter indicating difference between the predicted camera parameters and real camera parameters and/or the predicted depth parameters and real depth parameters.

### Claim 67 (depends on 62)

The method according to claim 62, wherein the update message comprises a first message and a second message, wherein the first message comprises the camera parameters and the second message comprises the depth parameters.

### Claim 68

An encoder configured to provide an update message relating to at least one of camera parameters and depth parameters, wherein said at least one of the camera parameters and the depth parameters enables a decoder to synthesize a first view for a first camera position based on a second view for a second camera position and said at least one of the camera parameters and the depth parameters, wherein said at least one of the camera parameters and the depth parameters relate to the second view, wherein the encoder comprises a processing circuit configured to:
detect which of said at least one of the camera parameters and the depth parameters are changing over time;
modularize said at least one of the camera parameters and the depth parameters into a respective module;
encode each respective module into the update message; and
send the update message to the decoder.

### Claim 69 (depends on 68)

The encoder according to claim 68, wherein the camera parameters comprise intrinsic parameters, extrinsic parameters, and/or wherein the depth parameters comprise znear and/or zfar values.

### Claim 70 (depends on 68)

The encoder according to claim 68, wherein the respective module relates to intrinsic parameters, extrinsic parameters or depth parameters.

### Claim 71 (depends on 68)

The encoder according to claim 68, wherein the processing circuit further is configured to:
before the modularizing, linearly predict, based on camera parameters and/or depth parameters for a first frame and a second frame, said at least one of the camera parameters and the depth parameters for a third frame in the vicinity of the first and second frames.

### Claim 72 (depends on 71)

The encoder according to claim 71, wherein each respective module includes a respective difference parameter indicating difference between the predicted camera parameters and real camera parameters and/or the predicted depth parameters and real depth parameters.

### Claim 73 (depends on 68)

The encoder according to claim 68, wherein the update message comprises a first message and a second message, wherein the first message comprises the camera parameters and the second message comprises the depth parameters.

### Claim 74 (depends on 68)

A first device comprising the encoder according to claim 68.

### Claim 75

A decoder configured to decode an update message relating to at least one of camera parameters and depth parameters, wherein said at least one of the camera parameters and the depth parameters enables the decoder to synthesize a first view for a first camera position based on a second view for a second camera position and said at least one of the camera parameters and the depth parameters, wherein said at least one of the camera parameters and depth parameters relate to the second view, wherein the decoder comprises a processing circuit configured to:
receive the update message from an encoder, wherein the update message comprises a respective module for at least one of the camera parameters and the depth parameters; and
decode each respective module of the update message to obtain said at least one of the camera parameters and the depth parameters.

### Claim 76 (depends on 75)

The decoder according to claim 75, wherein the camera parameters comprise intrinsic parameters, extrinsic parameters and/or translation parameters, and/or wherein the depth parameters comprise znear and/or zfar values.

### Claim 77 (depends on 75)

The decoder according to claim 75, wherein the respective module relates to intrinsic parameters, extrinsic parameters or depth parameters.

### Claim 78 (depends on 75)

The decoder according to claim 75, wherein the processing circuit is configured to, after the decoding, extract based on camera parameters and/or depth parameters for a first frame and a second frame, said at least one of the camera parameters and the depth parameters for a third frame in the vicinity of the first and second frames.

### Claim 79 (depends on 78)

The decoder according to claim 78, wherein each respective module includes a respective difference parameter indicating difference between the predicted camera parameters and real camera parameters and/or the predicted depth parameters and real depth parameters.

### Claim 80 (depends on 75)

The decoder according to claim 75, wherein the update message comprises a first message and a second message, wherein the first message comprises the camera parameters and the second message comprises the depth parameters.

### Claim 81 (depends on 75)

A second device comprising the decoder according to claim 75.
