# US 2019/0320157 A1 · Method of transmitting 360-degree video, method of receiving 360-degree video, device for transmitting 360-degree video, and device for receiving 360-degree video > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2019/0320157 A1 - Document ID: US20190320157A1 - Status: Published application - Kind: A1 - Application number: 16/454,540 - Filed: 2019-06-27 - Published: 2019-10-17 - Earliest claimed: 2017-05-15 - Assignees: LG Electronics Inc. - Applicants: LG Electronics Inc. - Inventors: Soojin HWANG; Sejin OH; Tung Chin LEE - Web page: https://patentgrep.com/patent/US20190320157A1 ## CPC - H04N 13/183: On-screen display [OSD] information, e.g. subtitles or menus - H04N 13/128: Adjusting depth or disparity - H04N 13/156: Mixing image signals - H04N 13/161: Encoding, multiplexing or demultiplexing different image signal components (for multi-view video sequence encoding H04N19/597) - H04N 13/178: Metadata, e.g. disparity information - H04N 13/194: Transmission of image signals - H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards - H04N 19/88: involving rearrangement of data among different coding units, e.g. shuffling, interleaving, scrambling or permutation of pixel data or permutation of transform coefficient data among different blocks - H04N 21/4884: {for displaying subtitles} - H04N 21/816: {involving special video data, e.g 3D video} - H04N 21/8451: {using Advanced Video Coding [AVC]} - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract The present invention suggests a method of providing subtitles for a 360 content, the method comprising: generating 360 video data captured by at least one camera; stitching the 360 video data; projecting the 360 video data to a 2D image; encoding the 2D image into a video stream; generating a 360 subtitle Supplemental Enhancement Information (SEI) message for signaling a subtitle for the 360 content; inserting the 360 subtitle SEI message into the video stream; and generating a broadcast signal including the video stream, and transmitting the broadcast signal. ## Claims ### Claim 1 A digital receiver for providing at least one subtitle for a VR (virtual reality) service, the digital receiver comprising: a controller configured to: extract bitstreams for audio data and video data; parse metadata related to the VR service; decode the audio data and the video data based on the metadata related to the VR service; render the audio data and the video data based on a user's viewport detected by a head or eye tracking component; a display configured to: display the video data in a display module and outputting the audio data in a speaker or a headphone; display a first subtitle for a first object and a second subtitle for a second object when the displayed video data includes the first and second objects depending on the user's viewport; display the first subtitle without rendering the second subtitle when the displayed video data includes the first object and does not include the second object depending on the user's viewport; and display the second subtitle without rendering the first subtitle when the displayed video data includes the second object and does not include the first object depending on the user's viewport. ### Claim 2 (depends on 1) The digital receiver of claim 1, further comprising: a network interface configured to send feedback information about the user's viewport to a streaming server, wherein the feedback information is used for the streaming server to determine a next sending data. ### Claim 3 (depends on 1) The digital receiver of claim 1, wherein the metadata related to the VR service corresponds to a SEI message, further the SEI message includes a subtitle ID for identifying the at least one subtitle, a region ID for identifying a subtitle region where the at least one subtitle is overlaid in a 360-degree space, and subtitle region information being fixed region information for specifying the subtitle region fixed in the 360-degree space or offset region information for specifying the subtitle region changing in the 360-degree space based on the user's viewport. ### Claim 4 (depends on 3) The digital receiver of claim 3, wherein the fixed region information includes center information indicating yaw, pitch and roll values of a center point of the subtitle region, and range information indicating horizontal and vertical ranges of the subtitle region from the center point. ### Claim 5 (depends on 3) The digital receiver of claim 3, wherein the offset region information includes offset center information indicating yaw, pitch and roll offsets for a center point of the subtitle region, range information indicating horizontal and vertical ranges of the subtitle region from the center point, and type information for indicating a type of the offset center information. ### Claim 6 A digital receiver for providing at least one subtitle for a VR (virtual reality) service, the digital receiver comprising: a controller configured to: extract bitstreams for audio data and video data; parse metadata related to the VR service; decode the audio data and the video data based on the metadata related to the VR service; render the audio data and the video data based on a user's viewport detected by a head or eye tracking component; a display configured to: display the video data in a display module and outputting the audio data in a speaker or a headphone; display a first subtitle for a first object and a second subtitle for a second object when the displayed video data includes the first and second objects depending on the user's viewport; and continue to display the first subtitle and the second subtitle by rendering the first and the second subtitles even when the displayed video data includes either the first object or the second object depending on the user's viewport. ### Claim 7 (depends on 6) The digital receiver of claim 6, wherein a style of the displayed first subtitle is different from a style of the displayed second subtitle when the displayed video data includes either the first object or the second object depending on the user's viewport. ### Claim 8 (depends on 6) The digital receiver of claim 6, further comprising: a network interface configured to send feedback information about the user's viewport to a streaming server, wherein the feedback information is used for the streaming server to determine a next sending data. ### Claim 9 (depends on 6) The digital receiver of claim 6, wherein the metadata related to the VR service corresponds to a SEI message, further the SEI message includes a subtitle ID for identifying the at least one subtitle, a region ID for identifying a subtitle region where the at least one subtitle is overlaid in a 360-degree space, and subtitle region information being fixed region information for specifying the subtitle region fixed in the 360-degree space or offset region information for specifying the subtitle region changing in the 360-degree space based on the user's viewport. ### Claim 10 (depends on 9) The digital receiver of claim 9, wherein the fixed region information includes center information indicating yaw, pitch and roll values of a center point of the subtitle region, and range information indicating horizontal and vertical ranges of the subtitle region from the center point, wherein the offset region information includes offset center information indicating yaw, pitch and roll offsets for a center point of the subtitle region, range information indicating horizontal and vertical ranges of the subtitle region from the center point, and type information for indicating a type of the offset center information. ### Claim 11 A method of providing at least one subtitle for a VR (virtual reality) service in a receiver, the method comprising: extracting bitstreams for audio data and video data; parsing metadata related to the VR service; decoding the audio data and the video data based on the metadata related to the VR service; rendering the audio data and the video data based on a user's viewport detected by a head or eye tracking component; displaying the video data in a display module and outputting the audio data in a speaker or a headphone; displaying a first subtitle for a first object and a second subtitle for a second object when the displayed video data includes the first and second objects depending on the user's viewport; displaying the first subtitle without rendering the second subtitle when the displayed video data includes the first object and does not include the second object depending on the user's viewport; and displaying the second subtitle without rendering the first subtitle when the displayed video data includes the second object and does not include the first object depending on the user's viewport. ### Claim 12 (depends on 11) The method of claim 11, further comprising: sending feedback information about the user's viewport to a streaming server, wherein the feedback information is used for the streaming server to determine a next sending data. ### Claim 13 (depends on 11) The method of claim 11, wherein the metadata related to the VR service corresponds to a SEI message, further the SEI message includes a subtitle ID for identifying the at least one subtitle, a region ID for identifying a subtitle region where the at least one subtitle is overlaid in a 360-degree space, and subtitle region information being fixed region information for specifying the subtitle region fixed in the 360-degree space or offset region information for specifying the subtitle region changing in the 360-degree space based on the user's viewport. ### Claim 14 (depends on 13) The method of claim 13, wherein the fixed region information includes center information indicating yaw, pitch and roll values of a center point of the subtitle region, and range information indicating horizontal and vertical ranges of the subtitle region from the center point. ### Claim 15 (depends on 13) The method of claim 13, wherein the offset region information includes offset center information indicating yaw, pitch and roll offsets for a center point of the subtitle region, range information indicating horizontal and vertical ranges of the subtitle region from the center point, and type information for indicating a type of the offset center information. ### Claim 16 A method of providing at least one subtitle for a VR (virtual reality) service in a receiver, the method comprising: extracting bitstreams for audio data and video data; parsing metadata related to the VR service; decoding the audio data and the video data based on the metadata related to the VR service; rendering the audio data and the video data based on a user's viewport detected by a head or eye tracking component; displaying the video data in a display module and outputting the audio data in a speaker or a headphone; displaying a first subtitle for a first object and a second subtitle for a second object when the displayed video data includes the first and second objects depending on the user's viewport; continuing to display the first subtitle and the second subtitle by rendering the first and the second subtitles even when the displayed video data includes either the first object or the second object depending on the user's viewport. ### Claim 17 (depends on 16) The method of claim 16, wherein a style of the displayed first subtitle is different from a style of the displayed second subtitle when the displayed video data includes either the first object or the second object depending on the user's viewport. ### Claim 18 (depends on 16) The method of claim 16, further comprising: sending feedback information about the user's viewport to a streaming server, wherein the feedback information is used for the streaming server to determine a next sending data. ### Claim 19 (depends on 16) The method of claim 16, wherein the metadata related to the VR service corresponds to a SEI message, further the SEI message includes a subtitle ID for identifying the at least one subtitle, a region ID for identifying a subtitle region where the at least one subtitle is overlaid in a 360-degree space, and subtitle region information being fixed region information for specifying the subtitle region fixed in the 360-degree space or offset region information for specifying the subtitle region changing in the 360-degree space based on the user's viewport. ### Claim 20 (depends on 19) The method of claim 19, wherein the fixed region information includes center information indicating yaw, pitch and roll values of a center point of the subtitle region, and range information indicating horizontal and vertical ranges of the subtitle region from the center point, wherein the offset region information includes offset center information indicating yaw, pitch and roll offsets for a center point of the subtitle region, range information indicating horizontal and vertical ranges of the subtitle region from the center point, and type information for indicating a type of the offset center information.