# US 2019/0379856 A1 · Method for processing overlay in 360-degree video system and apparatus for the same

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0379856 A1
- Document ID: US20190379856A1
- Status: Published application
- Kind: A1
- Application number: 16/436,352
- Filed: 2019-06-10
- Published: 2019-12-12
- Earliest claimed: 2018-06-08
- Assignees: LG Electronics Inc.
- Applicants: LG Electronics Inc.
- Inventors: Hyejung HUR; Sejin OH; Jangwon LEE
- Web page: https://patentgrep.com/patent/US20190379856A1

## CPC

- G06T 3/12: Panospheric to cylindrical image transformations
- H04N 5/44504: {Circuit details of the additional information generator, e.g. details of the character or graphics signal generator, overlay mixing circuits}
- G06F 16/583: using metadata automatically derived from the content
- G06F 16/5866: {using information manually generated, e.g. tags, keywords, comments, manually generated location and time information}
- H04N 5/2624: {for obtaining an image which is composed of whole input images, e.g. splitscreen}
- H04N 23/698: for achieving an enlarged field of view, e.g. panoramic image capture
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A 360-degree image data processing method performed by a 360-degree video reception apparatus, the method including: receiving 360-degree image data, obtaining information on an encoded picture and metadata from the 360-degree image data, decoding a picture based on the information on the encoded picture, and rendering the decoded picture and an overlay based on the metadata, wherein the metadata includes overlay related metadata, wherein the overlay is rendered based on the overlay related metadata, and wherein the overlay related metadata include packing information of the overlay.

## Claims

### Claim 1

A 360-degree image data processing method performed by a 360-degree video reception apparatus, the method comprising:
receiving 360-degree image data;
obtaining information on an encoded picture and metadata from the 360-degree image data;
decoding a picture based on the information on the encoded picture; and
rendering the decoded picture and an overlay based on the metadata,
wherein the metadata includes overlay related metadata,
wherein the overlay is rendered based on the overlay related metadata, and wherein the overlay related metadata include packing information of the overlay.

### Claim 2 (depends on 1)

The method of claim 1, wherein the packing information of the overlay includes information as to whether region-wise packing is applied to the overlay.

### Claim 3 (depends on 1)

The method of claim 1, wherein the packing information includes information on whether a texture atlas is applied to the overlay.

### Claim 4 (depends on 1)

The method of claim 1, wherein the overlay related metadata includes location information, size information, and transform_type information of the overlay.

### Claim 5 (depends on 4)

The method of claim 4, wherein transform_type information indicates one among none, mirroring horizontally, rotation by 180 degrees, mirroring horizontally after rotation by 180 degrees, mirroring horizontally after rotation by 90 degrees, rotation by 90 degrees, mirroring horizontally after rotation by 270 degrees, and rotation by 270 degrees.

### Claim 6 (depends on 1)

The method of claim 1, wherein the overlay related metadata includes information as to whether the overlay is projected to a projected picture as a rectangle when the overlay is placed on a sphere.

### Claim 7 (depends on 1)

The method of claim 1, wherein the overlay related metadata includes static metadata of the overlay,
the static metadata of the overlay is stored in an OverlayConfigBox.

### Claim 8 (depends on 7)

The method of claim 7, wherein the OverlayConfigBox is included in a ProjectedOmniVideoBox.

### Claim 9 (depends on 1)

The method of claim 1, wherein the overlay related metadata includes static metadata of the overlay,
the static metadata of the overlay is stored in an OverlayConfigProperty.

### Claim 10 (depends on 9)

The method of claim 9, wherein the OverlayConfigProperty is included in an ItemPropertyContainerBox.

### Claim 11 (depends on 1)

The method of claim 1, wherein the overlay related metadata includes information on opacity of the overlay.

### Claim 12 (depends on 1)

The method of claim 1, wherein the overlay related metadata includes information on a blending_type to be applied to the overlay.

### Claim 13 (depends on 12)

The method of claim 12, wherein the blending_type includes source_over.

### Claim 14 (depends on 1)

The method of claim 1, wherein the overlay related metadata includes interaction information of the overlay, and
wherein the interaction information of the overlay includes at least one of information on whether on/off switching of the overlay is possible, information on whether the overlay is movable by the user, information on whether depth of the overlay is changeable, information on whether rotation of the overlay is possible, and information on whether resizing of the overlay is possible.

### Claim 15 (depends on 1)

The method of claim 1, wherein the overlay related metadata includes group information indicating picture to be rendered with the overlay.

### Claim 16 (depends on 1)

The method of claim 1, wherein the 360 video reception apparatus is connected to a self-driving vehicle and provides an image of an inside or outside of the self-driving vehicle to a user.

### Claim 17

A 360-degree image data processing method performed by a 360-degree image transmission apparatus, the method comprising:
obtaining a 360-degree image;
deriving a picture by processing the 360-degree image;
generating metadata related to the 360-degree image;
encoding the picture; and
performing a process for storing or transmitting the encoded picture and the metadata,
wherein the metadata includes metadata related to an overlay, and
wherein the metadata related to the overlay comprises packing information of the overlay

### Claim 18 (depends on 17)

The method of claim 17, wherein the packing information of the overlay includes information whether region-wise packing is applied to the overlay.

### Claim 19 (depends on 17)

The method of claim 17, wherein the meatadata related to the overlay further includes location information, size information, and transform_type information of the overlay in the decoded picture.

### Claim 20

A 360-degree video reception apparatus comprising
a reception processor configured to receive 360-degree image data, and obtain information on an encoded picture and metadata from the 360-degree image data;
a data decoder configured to decode a picture based on the information on the encoded picture; and
a renderer configured to render the decoded picture and an overlay based on the metadata,
wherein the metadata includes overlay related metadata,
wherein the renderer is configured to render the overlay based on the overlay related metadata, and
wherein the overlay related metadata include packing information of the overlay.
