# US 2013/0156332 A1 · System and method for depth-guided image filtering in a video conference environment

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2013/0156332 A1
- Document ID: US20130156332A1
- Status: Published application
- Kind: A1
- Application number: 13/329,943
- Filed: 2011-12-19
- Published: 2013-06-20
- Earliest claimed: 2011-12-19
- Assignees: Cisco Technology, Inc.
- Inventors: Dihong Tian
- Web page: https://patentgrep.com/patent/US20130156332A1

## CPC

- H04N 21/816: {involving special video data, e.g 3D video}
- H04N 7/148: {Interfacing a video terminal to a particular transmission medium, e.g. ISDN}
- H04N 13/128: Adjusting depth or disparity
- H04N 13/161: Encoding, multiplexing or demultiplexing different image signal components (for multi-view video sequence encoding H04N19/597)
- H04N 13/194: Transmission of image signals
- H04N 19/117: Filters, e.g. for pre-processing or post-processing (sub-band filter banks H04N19/635)
- H04N 19/136: Incoming video signal characteristics or properties
- H04N 19/182: the unit being a pixel
- H04N 19/82: involving filtering within a prediction loop
- H04N 21/234345: {the reformatting operation being performed only on part of the stream, e.g. a region of the image or a time segment}
- H04N 21/2662: Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities
- H04N 21/4223: Cameras (H04N23/00 takes precedence)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A method is provided in one example embodiment that includes receiving a plurality of depth values corresponding to pixels of an image; and filtering the image as a function of a plurality of variations in the depth values between adjacent pixels of a window associated with the image. In more detailed embodiments, the method may include encoding the image into a bit stream for transmission over a network. The filtering can account for a bit rate associated with the encoding of the image.

## Claims

### Claim 1

A method, comprising:
receiving a plurality of depth values corresponding to pixels of an image; and
filtering the image as a function of a plurality of variations in the depth values between adjacent pixels of a window associated with the image.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
encoding the image into a bit stream for transmission over a network, wherein the filtering includes accounting for a bit rate associated with the encoding of the image.

### Claim 3 (depends on 1)

The method of claim 1, further comprising:
receiving intensity values corresponding to the pixels, wherein the filtering is a function of variations in the intensity values between the adjacent pixels.

### Claim 4 (depends on 1)

The method of claim 1, wherein filtering the image comprises smoothing certain adjacent pixels having variations of depth values below a threshold value.

### Claim 5 (depends on 1)

The method of claim 1, wherein the image is filtered in a loop comprising an inverse transform, an inverse quantization, and a prediction compensation that is based on previous encoding.

### Claim 6 (depends on 1)

The method of claim 1, wherein the window comprises pixels from a spatial region.

### Claim 7 (depends on 1)

The method of claim 1, wherein the window comprises pixels from a temporal region.

### Claim 8 (depends on 1)

The method of claim 1, wherein the filtering preserves pixels corresponding to depth values closer to a viewpoint over pixels corresponding to depth values further away from the viewpoint.

### Claim 9

Logic encoded in one or more non-transitory media that includes code for execution and when executed by one or more processors is operable to perform operations comprising:
receiving a plurality of depth values corresponding to pixels of an image; and
filtering the image as a function of a plurality of variations in the depth values between adjacent pixels of a window associated with the image.

### Claim 10 (depends on 9)

The logic of claim 9, the operations further comprising:
encoding the image into a bit stream for transmission over a network, wherein the filtering includes accounting for a bit rate associated with the encoding of the image.

### Claim 11 (depends on 9)

The logic of claim 9, the operations further comprising:
receiving intensity values corresponding to the pixels, wherein the filtering is a function of variations in the intensity values between the adjacent pixels.

### Claim 12 (depends on 9)

The logic of claim 9, wherein filtering the image comprises smoothing certain adjacent pixels having variations of depth values below a threshold value.

### Claim 13 (depends on 9)

The logic of claim 9, wherein the image is filtered in a loop comprising an inverse transform, an inverse quantization, and a prediction compensation that is based on previous encoding.

### Claim 14 (depends on 9)

The logic of claim 9, wherein the window comprises pixels from a spatial region.

### Claim 15 (depends on 9)

The logic of claim 9, wherein the window comprises pixels from a temporal region.

### Claim 16 (depends on 9)

The logic of claim 9, wherein the filtering preserves pixels corresponding to depth values closer to a viewpoint over pixels corresponding to depth values further away from the viewpoint.

### Claim 17

An apparatus, comprising:
one or more processors;
a memory; and
a video encoder with a depth-guided filter, wherein the apparatus is configured for:
receiving a plurality of depth values corresponding to pixels of an image; and
filtering the image as a function of a plurality of variations in the depth values between adjacent pixels of a window associated with the image.

### Claim 18 (depends on 17)

The apparatus of claim 17, the apparatus being further configured for:
encoding the image into a bit stream for transmission over a network, wherein the filtering includes accounting for a bit rate associated with the encoding of the image.

### Claim 19 (depends on 17)

The apparatus of claim 17, the apparatus being further configured for:
receiving intensity values corresponding to the pixels, wherein the filtering is a function of variations in the intensity values between the adjacent pixels.

### Claim 20 (depends on 17)

The apparatus of claim 17, wherein the filtering is configured to preserve pixels corresponding to depth values closer to a viewpoint over pixels corresponding to depth values further away from the viewpoint.
