# US 2019/0379877 A1 · Method for transmitting/receiving 360-degree video including fisheye video information, and device therefor

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0379877 A1
- Document ID: US20190379877A1
- Status: Published application
- Kind: A1
- Application number: 16/490,047
- Filed: 2018-10-24
- Published: 2019-12-12
- Earliest claimed: 2017-10-24
- Assignees: LG Electronics Inc.
- Applicants: LG Electronics Inc.
- Inventors: Hyunmook OH; Sejin OH
- Web page: https://patentgrep.com/patent/US20190379877A1

## CPC

- H04N 13/194: Transmission of image signals
- H04N 13/232: using fly-eye lenses, e.g. arrangements of circular lenses
- G06T 3/047: Fisheye or wide-angle transformations
- H04N 13/117: the virtual viewpoint locations being selected by the viewers or determined by viewer tracking
- H04N 13/139: Format conversion, e.g. of frame-rate or size
- H04N 13/161: Encoding, multiplexing or demultiplexing different image signal components (for multi-view video sequence encoding H04N19/597)
- H04N 13/178: Metadata, e.g. disparity information
- H04N 21/2343: involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements {(video transcoding H04N19/40; media packet handling at the source H04L65/762)}
- H04N 21/235: Processing of additional data, e.g. scrambling of additional data or processing content descriptors
- H04N 21/236: Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream {(multiplexing of data packets for data networks, e.g. RTP/UDP H04L65/00)}
- H04N 21/81: Monomedia components thereof
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A method by which a 360-degree video receiving device performs 360-degree image data processing, according to the present invention, comprises the steps of: receiving 360-degree image data; acquiring information on an encoded picture and metadata from the 360-degree image data; decoding a picture having a fisheye video format on the basis of the information on the encoded picture; deriving a circular image including a fisheye image from the picture on the basis of the metadata; and processing the circular image on the basis of the metadata and rendering the same, wherein the picture having a fisheye video format includes a tetragonal region in which the circular image is mapped, and the metadata includes fisheye video information.

## Claims

### Claim 1

A 360-degree video data processing method performed by a 360-degree video reception apparatus, the 360-degree video data processing method comprising:
receiving 360-degree video data;
obtaining information about an encoded picture and metadata from the 360-degree video data;
decoding a picture having a fisheye video format based on the information about the encoded picture;
deriving a circular image comprising a fisheye video from the picture based on the metadata; and
processing and rendering the circular image based on the metadata,
wherein the picture having the fisheye video format comprises a rectangular region mapped to the circular image, and
wherein the metadata comprises fisheye video information.

### Claim 2 (depends on 1)

The 360-degree video data processing method according to claim 1, wherein the fisheye video information comprises information indicating a lens type.

### Claim 3 (depends on 2)

The 360-degree video data processing method according to claim 2, wherein the lens type is one of an equidistant type, a stereographic type, an equisolid angle type, an orthographic type, and a user-defined type.

### Claim 4 (depends on 3)

The 360-degree video data processing method according to claim 3, wherein the processing and rendering of the circular image based on the metadata comprises mapping the circular image to a 3D space based on a spherical coordinate system mapping equation derived based on the lens type.

### Claim 5 (depends on 1)

The 360-degree video data processing method according to claim 1, wherein the fisheye video information comprises information about a region not mapped to the 360-degree video data.

### Claim 6 (depends on 5)

The 360-degree video data processing method according to claim 5, wherein the information about the region not mapped to the 360-degree video data comprises information indicating a radius of a circular region not mapped to the 360-degree video data.

### Claim 7 (depends on 5)

The 360-degree video data processing method according to claim 5, wherein the information about the region not mapped to the 360-degree video comprises information indicating a number of rectangular regions mapped to the 360-degree video data.

### Claim 8 (depends on 7)

The 360-degree video data processing method according to claim 7, wherein the information about the region not mapped to the 360-degree video data comprises information indicating a top left point of a rectangular region not mapped to the 360-degree video data, information indicating a height of the rectangular region, and information indicating a width of the rectangular region.

### Claim 9 (depends on 5)

The 360-degree video data processing method according to claim 5, wherein samples in the region not mapped to the 360-degree video data are set to the same sample value, and the sample value is a value representing black.

### Claim 10 (depends on 1)

The 360-degree video data processing method according to claim 1, wherein the fisheye video information comprises information indicating a focal length of a fisheye lens for the 360-degree video data.

### Claim 11 (depends on 1)

The 360-degree video data processing method according to claim 1, wherein the fisheye video information comprises information indicating a center of a 3D space in which the circular image is rendered.

### Claim 12 (depends on 1)

The 360-degree video data processing method according to claim 1, wherein the fisheye video information comprises is received in a form of a Dynamic Adaptive Streaming over HTTP (DASH) descriptor comprised in a media presentation description (MPD).

### Claim 13

A 360-degree video data processing method performed by a 360-degree video transmission apparatus, the 360-degree video data processing method comprising:
obtaining a circular image comprising a 360-degree video captured by a camera having at least one fisheye lens;
mapping the circular image to a rectangular region of a picture having a fisheye video format;
encoding the picture mapped to the circular image;
generating metadata about the 360-degree video; and
performing a process for storage or transmission on the encoded current picture and the metadata,
wherein the metadata comprises fisheye video information.

### Claim 14 (depends on 13)

The 360-degree video data processing method according to claim 13, wherein the fisheye video information comprises information indicating a lens type.

### Claim 15 (depends on 14)

The 360-degree video data processing method according to claim 14, wherein the lens type is one of an equidistant type, a stereographic type, an equisolid angle type, an orthographic type, and a user-defined type.

### Claim 16 (depends on 13)

The 360-degree video data processing method according to claim 13, wherein the fisheye video information comprises information about a region not mapped to the 360-degree video data.

### Claim 17 (depends on 16)

The 360-degree video data processing method according to claim 16, wherein the information about the region not mapped to the 360-degree video comprises information indicating a number of rectangular regions mapped to the 360-degree video data, and
the information about the region not mapped to the 360-degree video data comprises information indicating a top left point of a rectangular region not mapped to the 360-degree video data, information indicating a height of the rectangular region, and information indicating a width of the rectangular region.
