# US 10,375,371 B2 · Method and apparatus for filtering 360-degree video boundaries

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,375,371 B2
- Document ID: US10375371B2
- Status: Granted
- Kind: B2
- Application number: 15/647,630
- Filed: 2017-07-12
- Published: 2018-01-18
- Granted: 2019-08-06
- Earliest claimed: 2016-07-15
- Assignees: Mediatek Inc.
- Applicants: MediaTek Inc.
- Inventors: Xiaozhong Xu; Shan Liu
- Web page: https://patentgrep.com/patent/US10375371B2

## CPC

- H04N 13/106: Processing image signals (for multi-view video sequence encoding H04N19/597)
- G06T 3/053: Detail-in-context presentations (fisheye or wide-angle transformations G06T3/047)
- H04N 13/161: Encoding, multiplexing or demultiplexing different image signal components (for multi-view video sequence encoding H04N19/597)
- H04N 19/117: Filters, e.g. for pre-processing or post-processing (sub-band filter banks H04N19/635)
- H04N 19/136: Incoming video signal characteristics or properties
- H04N 19/167: Position within a video image, e.g. region of interest [ROI]
- H04N 19/182: the unit being a pixel
- H04N 19/46: Embedding additional information in the video signal during the compression process (H04N19/517, H04N19/68, H04N19/70 take precedence)
- H04N 19/86: involving reduction of coding artifacts, e.g. of blockiness
- H04N 19/423: characterised by memory arrangements (H04N19/433 takes precedence)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A video system for encoding or decoding 360-degree virtual reality (360VR) video is provided. The system performs filtering operations to reduce coding artifacts and discontinuities in a projection image of an omnidirectional image. The video system identifies first and second edges of the projection image. The first and second edges are physically correlated as a common edge in the omnidirectional image but not physically connected in the projection image. The system computes a set of filtered pixels based on a first set of pixels near the first edge and a second set of pixels near the second edge.

## Claims

### Claim 1

A method comprising:
receiving a projection image of an omnidirectional image;
identifying a first edge of the projection image;
identifying a second edge of the projection image, wherein the first and second edges are physically correlated as a common edge in the omnidirectional image but not physically connected in the projection image; and
computing a set of filtered pixels based on a first set of pixels near the first edge and a second set of pixels near the second edge,
wherein the omnidirectional image is a platonic solid having a plurality of faces and the projection image comprises a layout of the faces of the platonic solid, and
wherein the first edge is an edge of a first face of the platonic solid, the second edge is an edge of a second face of the platonic solid, the first set of pixels is in the first face of the platonic solid, and the second set of pixels is in the second face of the platonic solid.

### Claim 2 (depends on 1)

The method of claim 1, wherein said filtering is deblock filtering that reduces discontinuity and compression artifacts across the common edge.

### Claim 3 (depends on 1)

The method of claim 1, wherein said filtering comprises rearranging pixels of the second face of the platonic solid according to a geographical relationship between the first face and the second face, the geographical relationship defined by the layout of the faces of the platonic solid in the projection image.

### Claim 4 (depends on 3)

The method of claim 3, wherein rearranging pixels of the second face comprises rotating or flipping pixels of the second face based on the geographical relationship between the first face and the second face.

### Claim 5 (depends on 3)

The method of claim 3, wherein said filtering further comprises storing the rearranged pixels of the second face at a blank area of the projection image adjacent to the first edge.

### Claim 6 (depends on 3)

The method of claim 3, wherein said filtering further comprises storing the rearranged pixels of the second face at a temporary buffer that does not store pixels from a blank area of the projection image.

### Claim 7 (depends on 3)

The method of claim 3, wherein said filtering further comprising computing a set of filtered values for the first and second sets of pixels based on the pixels of the first face and the rearranged pixels of the second face.

### Claim 8

A method comprising:
receiving a projection image of an omnidirectional image;
identifying a first edge of the projection image;
identifying a second edge of the projection image, wherein the first and second edges are physically correlated as a common edge in the omnidirectional image but not physically connected in the projection image; and
computing a set of filtered pixels based on a first set of pixels near the first edge and a second set of pixels near the second edge,
wherein the omnidirectional image is a sphere and the projection image comprises an equirectangular projection of the sphere, and
wherein both the first edge and the second edge extend from a north pole to a south pole of the sphere.

### Claim 9

An electronic apparatus comprising:
a decoded picture storage capable of receiving and storing a projection image of an omnidirectional image; and
a filtering circuit capable of:
identifying a first edge of the projection image;
identifying a second edge of the projection image, wherein the first and second edges are physically correlated as a common edge in the omnidirectional image but not physically connected in the projection image; and
computing a set of filtered pixels based on a first set of pixels near the first edge and a second set of pixels near the second edge,
wherein the omnidirectional image is a platonic solid having a plurality of faces and the projection image comprises a layout of the faces of the platonic solid, and
wherein the first edge is an edge of a first face of the platonic solid, the second edge is an edge of a second face of the platonic solid, the first set of pixels is in the first face of the platonic solid, and the second set of pixels is in the second face of the platonic solid.

### Claim 10 (depends on 9)

The electronic apparatus of claim 9, wherein said filtering is deblock filtering that reduces discontinuity and compression artifacts across the common edge.

### Claim 11 (depends on 9)

The electronic apparatus of claim 9 further comprising a rearranging circuit capable of rearranging pixels of the second face of the platonic solid according to a geographical relationship between the first face and the second face, the geographical relationship defined by the layout of the faces of the platonic solid in the projection image.

### Claim 12 (depends on 11)

The electronic apparatus of claim 11, wherein rearranging pixels of the second face comprises rotating or flipping pixels of the second face based on the geographical relationship between the first face and the second face.

### Claim 13 (depends on 11)

The electronic apparatus of claim 11, wherein said rearranged pixels of the second face are stored at a blank area of the projection image adjacent to the first edge.

### Claim 14 (depends on 11)

The electronic apparatus of claim 11, wherein said rearranged pixels of the second face are stored at a temporary buffer that does not store pixels from a blank area of the projection image.

### Claim 15 (depends on 11)

The electronic apparatus of claim 11, wherein the filtering circuit computes a set of filtered values for the first and second sets of pixels based on the pixels of the first face and the rearranged pixels of the second face.

### Claim 16 (depends on 9)

The electronic apparatus of claim 9, wherein the omnidirectional image is a sphere and the projection image comprises an equirectangular projection of the sphere.

### Claim 17 (depends on 15)

The electronic apparatus of claim 15, wherein both the first edge and the second edge extend from the north pole to the south pole of the sphere.
