# US 2019/0174116 A1 · Method for transmitting 360-degree video, method for receiving 360-degree video, apparatus for transmitting 360-degree video, and apparatus for receiving 360-degree video > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2019/0174116 A1 - Document ID: US20190174116A1 - Status: Published application - Kind: A1 - Application number: 16/304,540 - Filed: 2017-05-19 - Published: 2019-06-06 - Earliest claimed: 2016-05-26 - Assignees: LG Electronics Inc. - Applicants: LG Electronics Inc. - Inventors: Sejin OH; Jangwon LEE; Jongyeul SUH - Web page: https://patentgrep.com/patent/US20190174116A1 ## CPC - H04N 13/194: Transmission of image signals - H04N 5/2628: {Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation} - H04N 13/00: Stereoscopic video systems; Multi-view video systems; Details thereof - H04N 13/161: Encoding, multiplexing or demultiplexing different image signal components (for multi-view video sequence encoding H04N19/597) - H04N 13/178: Metadata, e.g. disparity information - H04N 19/46: Embedding additional information in the video signal during the compression process (H04N19/517, H04N19/68, H04N19/70 take precedence) - H04N 19/597: specially adapted for multi-view video sequence encoding - H04N 21/21805: {enabling multiple viewpoints, e.g. using a plurality of cameras} - H04N 21/816: {involving special video data, e.g 3D video} - H04N 23/698: for achieving an enlarged field of view, e.g. panoramic image capture - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract A 360-degree video data processing method performed by an apparatus for transmitting a 360-degree video according to the present invention comprises the steps of: obtaining 360-degree video data captured by at least one camera; obtaining a 2D-based picture by processing the 360-degree video data; generating metadata associated with the 360-degree video data; encoding the picture; and performing processing for storing or transmitting the encoded picture and the metadata, wherein the metadata includes information on the central point of the picture, and the information on the central point of the picture indicates whether spherical coordinates in a spherical plane corresponding to the central point of the picture have a yaw value of 0 and a pitch value of 0, respectively. ## Claims ### Claim 1 A 360-degree video processing method performed by a 360-degree video transmission apparatus, the method comprising: acquiring 360-degree video; obtaining a 2D (two-dimensional) image based on projection for the 360-degree video; generating metadata about the 360-degree video; encoding the 2D image; and performing processing for storage or transmission of the encoded 2D image and the metadata, wherein the metadata includes mapping information for the 2D image, wherein the mapping information includes information on a yaw value and a pitch value for spherical coordinates of a 3D (three-dimensional) space. ### Claim 2 (canceled) ### Claim 3 (depends on 1) The 360-degree video processing method of claim 1, wherein when a projection format for the 2D image indicates equirectangular projection, the mapping information includes information on the yaw value and the pitch value for the spherical coordinates of the 3D space corresponding to a center of the 2D image. ### Claim 4 (depends on 1) The 360-degree video processing method of claim 1, wherein when a projection format for the 2D image indicates cubic projection, the mapping information includes the information on the yaw value and the pitch value for the spherical coordinates of the 3D space corresponding to a center of a specific region in the 2D image, wherein the specific region corresponds to a front face according to the cubic projection. ### Claim 5 (depends on 1) The 360-degree video processing method of claim 1, wherein the mapping information is configured based on a projection related box in International Organization for Standardization (ISO) based media file format, wherein when a projection format for the 2D image is equirectangular projection and the projection related box is not present, the yaw value and the pitch value for the spherical coordinates of the 3D space indicate 0. ### Claim 6 (depends on 1) The 360-degree video processing method of claim 1, wherein the metadata includes information about the center pixel of an image region acquired by each camera, wherein the information about the center pixel indicates a yaw value, a pitch value and a roll value for the spherical coordinates of the 3D space corresponding to the position of the center pixel of the image region. ### Claim 7 (depends on 6) The 360-degree video processing method of claim 6, wherein, when the at least one camera is a fish-eye camera, the metadata includes information about the center pixel of an image region acquired by each camera. ### Claim 8 (depends on 7) The 360-degree video processing method of claim 7, wherein an image acquired by each camera is a circular image. ### Claim 9 (depends on 1) The 360-degree video processing method of claim 1, wherein the metadata includes initial view information indicating an initial view region initially viewed by a user, wherein the initial view information indicates the initial view region on the 3D space through a yaw value, a pitch value and a roll value. ### Claim 10 (depends on 1) The 360-degree video processing method of claim 1, wherein the metadata includes a field of view (FOV) flag indicating presence or absence of information about a field of view (FOV) with respect to the 360-degree video data, wherein, when the FOV flag indicates presence of the information about the FOV, signaling information includes information about a horizontal FOV and information about a vertical FOV. ### Claim 11 (canceled) ### Claim 12 (canceled) ### Claim 13 A 360-degree video processing method performed by a 360-degree video reception apparatus, the method comprising: receiving a signal about 360-degree video, wherein the signal includes information on a 2D image and metadata; obtaining the information on the 2D image and the metadata from the signal; decoding the 2D image based on the information on the 2D image; and processing the decoded 2D image based on the metadata to render at least one part of the decoded 2D image on a 3D space, wherein the metadata includes mapping information for the decoded 2D image, and wherein the mapping information includes information on a yaw value and a pitch value for spherical coordinates of the 3D space to be rendered. ### Claim 14 (depends on 13) The 360-degree video processing method of claim 13, wherein when at least one of the yaw value and the pitch value is not equal to 0 the decoded 2D image is rendered based on a rotation using the yaw value and the pitch value. ### Claim 15 (depends on 13) The 360-degree video processing method of claim 13, wherein when a projection format for the decoded 2D image indicates equirectangular projection, the mapping information includes the information on the yaw value and the pitch value for the spherical coordinates of the 3D space corresponding to a center of the decoded 2D image. ### Claim 16 (depends on 13) The 360-degree video processing method of claim 13, wherein when a projection format for the decoded 2D image indicates cubic projection, the mapping information includes the information on the yaw value and the pitch value for the spherical coordinates of the 3D space corresponding to a center of a specific region in the decoded 2D image, wherein the specific region corresponds to a front face according to the cubic projection. ### Claim 17 (depends on 13) The 360-degree video processing method of claim 13, wherein the mapping information is configured based on a projection related box in International Organization for Standardization (ISO) based media file format, wherein when a projection format for the decoded 2D image is equirectangular projection and the projection related box is not present, the yaw value and the pitch value for the spherical coordinates of the 3D space indicate 0. ### Claim 18 (depends on 13) The 360-degree video processing method of claim 13, wherein the metadata includes information about the center pixel of an image region acquired by each camera, wherein the information about the center pixel indicates a yaw value, a pitch value and a roll value for the spherical coordinates of the 3D space corresponding to the position of the center pixel of the image region. ### Claim 19 (depends on 18) The 360-degree video processing method of claim 18, wherein, when the at least one camera is a fish-eye camera, the metadata includes information about the center pixel of an image region acquired by each camera. ### Claim 20 (canceled) ### Claim 21 A 360-degree video reception apparatus comprising: a receiver configured to receive a signal about 360-degree video, wherein the signal includes information on a 2D image and metadata; a reception processor configured to obtain the information on the 2D image and the metadata from the signal; a data decoder configured to decode the 2D image based on the information on the 2D image; and a renderer configured to process the decoded 2D image based on the metadata to render at least one part of the decoded 2D image on a 3D space, wherein the metadata includes mapping information for the decoded 2D image, and wherein the mapping information includes information on a yaw value and a pitch value for spherical coordinates of the 3D space to be rendered. ### Claim 22 (depends on 21) The 360-degree video reception apparatus of claim 21, wherein when at least one of the yaw value and the pitch value is not equal to 0 the decoded 2D image is rendered based on a rotation using the yaw value and the pitch value. ### Claim 23 (depends on 21) The 360-degree video reception apparatus of claim 21, wherein when a projection format for the decoded 2D image indicates equirectangular projection, the mapping information includes the information on the yaw value and the pitch value for the spherical coordinates of the 3D space corresponding to a center of the decoded 2D image. ### Claim 24 (depends on 21) The 360-degree video reception apparatus of claim 21, wherein when a projection format for the decoded 2D image indicates cubic projection, the mapping information includes the information on the yaw value and the pitch value for the spherical coordinates of the 3D space corresponding to a center of a specific region in the decoded 2D image, wherein the specific region corresponds to a front face according to the cubic projection.