# US 2012/0075420 A1 · Method and apparatus for generating datastream for displaying three-dimensional user recognition information, and method and apparatus for reproducing the datastream

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2012/0075420 A1
- Document ID: US20120075420A1
- Status: Published application
- Kind: A1
- Application number: 13/244,338
- Filed: 2011-09-24
- Published: 2012-03-29
- Earliest claimed: 2010-09-28
- Assignees: Samsung Electronics Co., Ltd.
- Inventors: Bong-je CHO; Kil-soo JUNG; Jae-seung KIM; Hong-seok PARK
- Web page: https://patentgrep.com/patent/US20120075420A1

## CPC

- H04N 13/178: Metadata, e.g. disparity information
- H04N 13/161: Encoding, multiplexing or demultiplexing different image signal components (for multi-view video sequence encoding H04N19/597)
- H04N 13/183: On-screen display [OSD] information, e.g. subtitles or menus
- H04N 13/194: Transmission of image signals
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A method of generating a datastream including two-dimensional (2D) video content or three-dimensional (3D) video content includes: inserting video data of the 2D video content or the 3D video content into the datastream; inserting into the datastream recognition information insertion information indicating whether 3D user recognition information including a mark used for a user to recognize that a 3D video is being reproduced is inserted in the datastream and display rights information indicating whether displaying of 3D user recognition information unique to a reproduction device is authorized; and transmitting the datastream.

## Claims

### Claim 1

A method of generating a datastream including two-dimensional (2D) video content or three-dimensional (3D) video content, the method comprising:
inserting video data of the 2D video content or the 3D video content into the datastream;
inserting into the datastream recognition information insertion information indicating whether 3D user recognition information including a mark used for a user to recognize that a 3D video is being reproduced is inserted in the datastream and display rights information indicating whether displaying of the 3D user recognition information unique to a reproduction device is authorized; and
transmitting the datastream.

### Claim 2 (depends on 1)

The method of claim 1, wherein the inserting of the recognition information insertion information and the display rights information comprises inserting the recognition information insertion information and the display rights information into one of a Transport Stream (TS) packet, a Packetized Elementary Stream (PES) packet, and an Elementary Stream (ES) stream of the datastream.

### Claim 3 (depends on 2)

The method of claim 2, wherein the inserting into the datastream of the recognition information insertion information and the display rights information comprises allocating Packet IDentifier (PID) information of a header field of a predetermined TS packet as one of reserved values and inserting a video descriptor including the recognition information insertion information and the display rights information into a data field of the predetermined TS packet.

### Claim 4 (depends on 2)

The method of claim 2, wherein the inserting of the recognition information insertion information and the display rights information comprises, if determined that reserved values, which are allocated to PID information of a header field of a TS packet, correspond to combinations of 2D/3D video characteristics of the video data inserted into the datastream, and the recognition information insertion information and the display rights information on a one-to-one basis, allocating reserved values corresponding to combinations of current 2D/3D video characteristics, and the recognition information insertion information and the display rights information to PID information of TS packets of the datastream.

### Claim 5 (depends on 2)

The method of claim 2, wherein the inserting of the recognition information insertion information and the display rights information comprises inserting the recognition information insertion information and the display rights information into a PES private data field, which is a lower field of an optional header field of a predetermined PES packet among PES packets of the datastream.

### Claim 6 (depends on 2)

The method of claim 2, wherein the inserting of the recognition information insertion information and the display rights information comprises inserting the recognition information insertion information and the display rights information into a user data field, which is a lower field of an extension and user field of an ES stream of the datastream.

### Claim 7 (depends on 1)

The method of claim 1, wherein, if the recognition information insertion information indicates that the 3D user recognition information is included in the datastream, the display rights information is set so that displaying of the unique 3D user recognition information is not authorized to the reproduction device.

### Claim 8 (depends on 1)

The method of claim 1, further comprising inserting the 3D user recognition information provided by a content provider into an auxiliary ES stream besides a main ES stream into which the video data is inserted in the datastream,
wherein the main ES stream and the auxiliary ES stream are multiplexed to one stream.

### Claim 9 (depends on 1)

The method of claim 1, further comprising inserting the 3D user recognition information provided by a content provider into an ES stream separate from an ES stream into which the video data is inserted in the datastream.

### Claim 10 (depends on 1)

The method of claim 1, further comprising inserting the 3D user recognition information provided by a content provider as additional data of an ES stream into which the video data is inserted in the datastream.

### Claim 11 (depends on 1)

The method of claim 1, wherein, if the recognition information insertion information is set so that the 3D user recognition information provided by a content provider is not included in the datastream, and if the display rights information is set so that displaying of corresponding unique 3D user recognition information is authorized to two or more reproduction devices, the two or more reproduction devices set priority of rights of displaying the corresponding unique 3D user recognition information.

### Claim 12

A method of reproducing a datastream, comprising:
receiving and parsing a datastream including video data of two-dimensional (2D) video content or three-dimensional (3D) video content;
extracting from the datastream recognition information insertion information indicating whether 3D user recognition information including a mark used for a user to recognize that a 3D video is being reproduced is inserted in the datastream and display rights information indicating whether displaying of 3D user recognition information unique to an external reproduction device and a display device is authorized;
extracting the video data from the parsed datastream; and
displaying by one of the external reproduction device and the display device one of the 3D user recognition information and the unique 3D user recognition information on the video content based on the extracted recognition information insertion information and display rights information.

### Claim 13 (depends on 12)

The method of claim 12, wherein the extracting of the recognition information insertion information and the display rights information comprises extracting the recognition information insertion information and the display rights information from one of a Transport Stream (TS) packet, a Packetized Elementary Stream (PES) packet, and an Elementary Stream (ES) stream of the datastream.

### Claim 14 (depends on 13)

The method of claim 13, wherein the extracting of the recognition information insertion information and the display rights information comprises extracting a video descriptor including the recognition information insertion information and the display rights information from a data field of a TS packet of Packet IDentifier (PID) information allocated as one of reserved values among TS packets of the datastream.

### Claim 15 (depends on 13)

The method of claim 13, wherein the extracting of the recognition information insertion information and the display rights information comprises, if determined that reserved values, which are allocated to PID information of a header field of a TS packet, correspond to combinations of 2D/3D video characteristics of the video data inserted into the datastream, and the recognition information insertion information and the display rights information on a one-to-one basis, reading current 2D/3D video characteristics, and the recognition information insertion information and the display rights information based on PID information of TS packets of the datastream.

### Claim 16 (depends on 13)

The method of claim 13, wherein the extracting of the recognition information insertion information and the display rights information comprises extracting the recognition information insertion information and the display rights information from a PES private data field, which is a lower field of an optional header field of a predetermined PES packet among PES packets of the datastream.

### Claim 17 (depends on 13)

The method of claim 13, wherein the extracting of the recognition information insertion information and the display rights information comprises extracting the recognition information insertion information and the display rights information from a user data field, which is a lower field of an extension and user field of an ES stream of the datastream.

### Claim 18 (depends on 12)

The method of claim 12, wherein the displaying of the 3D user recognition information comprises:
confirming based on the recognition information insertion information that the 3D user recognition information provided by a provider of the video content is not inserted in the datastream and confirming based on the display rights information that displaying of the unique 3D user recognition information on the video content is authorized to the external reproduction device; and
outputting by the external reproduction device a video stream on which the 3D user recognition information is displayed, by blending the 3D user recognition information unique to the external reproduction device and the video data.

### Claim 19 (depends on 12)

The method of claim 12, wherein the displaying of the 3D user recognition information comprises:
confirming based on the recognition information insertion information that the 3D user recognition information provided by a provider of the video content is not inserted in the datastream and confirming based on the display rights information that displaying of the unique 3D user recognition information on the video content is authorized to the display device; and
outputting by the display device a video stream on which the 3D user recognition information is displayed, by blending the 3D user recognition information unique to the display device and the video data.

### Claim 20 (depends on 12)

The method of claim 12, wherein the displaying of the 3D user recognition information comprises:
confirming based on the recognition information insertion information that the 3D user recognition information provided by a provider of the video content is not inserted in the datastream and confirming based on the display rights information that displaying of the unique 3D user recognition information on the video content is authorized to the external reproduction device and the display device;
determining priority of rights of displaying the unique 3D user recognition information on the video content between the external reproduction device and the display device; and
outputting a video stream on which the 3D user recognition information is displayed, based on the priority of display rights between the external reproduction device and the display device.

### Claim 21 (depends on 20)

The method of claim 20, wherein the outputting of the video stream on which the 3D user recognition information is displayed comprises: determining a display capability of each of the external reproduction device and the display device for displaying each unique 3D user recognition information and outputting by a device having the display capability the video stream on which the 3D user recognition information is displayed by blending the corresponding unique 3D user recognition information with the video data as a result of the determining the display capability.

### Claim 22 (depends on 20)

The method of claim 20, wherein the determining of the priority comprises: determining a display capability of each of the external reproduction device and the display device for displaying each unique 3D user recognition information and, if both the external reproduction device and the display device have the display capability, determining the priority.

### Claim 23 (depends on 22)

The method of claim 22, wherein the determining of the priority comprises determining the priority between the external reproduction device and the display device based on a user's input or an initial setup and setting by a device having the priority determination information and transmitting the priority determination information to a device having no priority.

### Claim 24 (depends on 22)

The method of claim 22, wherein the determining of the priority comprises exchanging 3D user recognition information processing prohibition information through an interface supporting data transmission/reception between the external reproduction device and the display device.

### Claim 25 (depends on 24)

The method of claim 24, wherein the determining of the priority comprises, if data between the external reproduction device and the display device is exchanged through a High-Definition Multimedia Interface (HDMI) interface, transmitting the priority determination information through one channel of a Transition Minimized Differential Signaling (TMDS) channel and a Consumer Electronics Control (CEC) line.

### Claim 26 (depends on 25)

The method of claim 25, wherein the determining of the priority comprises, if a video data period is transmitted next to a control period of the TMDS channel, allocating the 3D user recognition information processing prohibition information to the last bit of preamble data transmitted in the control period and transmitting the preamble data to the other device.

### Claim 27 (depends on 25)

The method of claim 25, wherein the determining of the priority comprises inserting an operation code (opcode) for indicating information for controlling the 3D user recognition information and an address of the other device receiving the priority determination information and control data of the CES line into the control data of the CES line and transmitting the control data to the other device through the CES line.

### Claim 28 (depends on 23)

The method of claim 23, wherein the displaying of the 3D user recognition information comprises restricting a blending function of the corresponding unique 3D user recognition information and the video data for a device which has received the priority determination information

### Claim 29 (depends on 23)

The method of claim 23, wherein the displaying of the 3D user recognition information comprises changing display rights information for a device which has received the priority determination information so that the display rights information indicates no display rights.

### Claim 30 (depends on 12)

The method of claim 12, wherein the displaying of the 3D user recognition information comprises, if confirmed based on the recognition information insertion information that the 3D user recognition information provided by a provider of the video content is inserted in the datastream, outputting the video data on which the 3D user recognition information is displayed, extracted from the datastream.

### Claim 31 (depends on 12)

The method of claim 12, wherein the displaying of the 3D user recognition information comprises:
if confirmed based on the recognition information insertion information that the 3D user recognition information provided by a provider of the video content is inserted in the datastream, extracting the 3D user recognition information from the datastream; and
blending and outputting the extracted 3D user recognition information and the extracted video data.

### Claim 32 (depends on 31)

The method of claim 31, wherein the extracting of the 3D user recognition information comprises extracting the 3D user recognition information from an auxiliary ES stream besides a main ES stream into which the video data is inserted in the datastream, and
the main ES stream and the auxiliary ES stream are demultiplexed from one stream.

### Claim 33 (depends on 31)

The method of claim 31, wherein the extracting of the 3D user recognition information comprises extracting the 3D user recognition information from an ES stream separate from an ES stream into which the video data is inserted in the datastream.

### Claim 34 (depends on 31)

The method of claim 31, wherein the extracting of the 3D user recognition information comprises extracting the 3D user recognition information as additional information of an ES stream into which the video data is inserted, in the datastream.

### Claim 35

An apparatus for generating a datastream including two-dimensional (2D) video content or three-dimensional (3D) video content, the apparatus comprising:
a video data inserter which inserts video data of the 2D video content or the 3D video content into the datastream;
a 3D user recognition information inserter which inserts into the datastream 3D user recognition information including a mark used for a user to recognize that a 3D video is being reproduced;
a recognition information related information inserter which inserts into the datastream recognition information insertion information indicating whether the 3D user recognition information is inserted in the datastream and display rights information indicating whether displaying of 3D user recognition information unique to a reproduction device is authorized; and
a transmitter which transmits the datastream.

### Claim 36 (depends on 35)

The apparatus of claim 35, wherein the 3D user recognition information inserter inserts the recognition information insertion information and the display rights information into one of a Transport Stream (TS) packet, a Packetized Elementary Stream (PES) packet, and an Elementary Stream (ES) stream of the datastream.

### Claim 37

An apparatus for reproducing a datastream, the apparatus comprising:
a receiver which receives and parses a datastream including video data of 2D video content or 3D video content;
a recognition information related information extractor which extracts from the datastream recognition information insertion information indicating whether 3D user recognition information including a mark used for a user to recognize that a 3D video is being reproduced is inserted in the datastream and display rights information indicating whether displaying of 3D user recognition information unique to an external reproduction device and a display device is authorized;
a 3D user recognition information extractor which extracts the 3D user recognition information from the datastream based on the recognition information insertion information;
a video data extractor which extracts the video data from the parsed datastream; and
an output unit which displays via one of the external reproduction device and the display device one of the 3D user recognition information and the unique 3D user recognition information on the video content based on the extracted recognition information insertion information and display rights information.

### Claim 38 (depends on 37)

The apparatus of claim 37, wherein each of the external reproduction device and the display device comprises a priority determiner for determining priority of rights of displaying the unique 3D user recognition information on the video content between the external reproduction device and the display device if confirmed based on the recognition information insertion information that the 3D user recognition information provided by a provider of the video content is not inserted in the datastream and if confirmed based on the display rights information that displaying of the unique 3D user recognition information on the video content is authorized to the external reproduction device and the display device, and
the output unit outputs a video stream on which the 3D user recognition information is displayed, based on the priority of display rights between the external reproduction device and the display device.

### Claim 39

An apparatus for reproducing a datastream, the apparatus comprising:
a receiver which receives and parses a datastream including video data of two-dimensional (2D) video content or three-dimensional (3D) video content;
a recognition information related information extractor which extracts from the datastream recognition information insertion information indicating whether 3D user recognition information including a mark used for a user to recognize that a 3D video is being reproduced is inserted in the datastream and display rights information indicating whether displaying of 3D user recognition information unique to an external reproduction device and a display device is authorized;
a 3D user recognition information extractor which extracts the 3D user recognition information from the datastream based on the recognition information insertion information;
a video data extractor which extracts the video data from the parsed datastream; and
an output unit which displays, via the display device, one of the 3D user recognition information and the unique 3D user recognition information on the video content based on the extracted recognition information insertion information and display rights information.

### Claim 40 (depends on 1)

A non-transitory computer readable recording medium having recorded thereon a computer readable program for executing the method of claim 1.

### Claim 41 (depends on 12)

A non-transitory computer readable recording medium having recorded thereon a computer readable program for executing the method of claim 12.

### Claim 42

A method of generating a datastream including two-dimensional (2D) video content or three-dimensional (3D) video content, the method comprising:
inserting video data of the 2D video content or the 3D video content into the datastream;
inserting into the datastream information for displaying an icon illustrating a dimension of a video being reproduced or to be reproduced and for authorizing a reproduction device to display the icon illustrating the dimension of the video being reproduced; and
transmitting the datastream.
