# US 11,310,560 B2 · Bitstream merger and extractor

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,310,560 B2
- Document ID: US11310560B2
- Status: Granted
- Kind: B2
- Application number: 15/929,631
- Filed: 2020-05-13
- Published: 2020-11-19
- Granted: 2022-04-19
- Earliest claimed: 2019-05-17
- Assignees: Samsung Electronics Co., Ltd.
- Applicants: Samsung Electronics Co., Ltd.
- Inventors: Youngkwon Lim
- Web page: https://patentgrep.com/patent/US11310560B2

## CPC

- H04N 21/4728: for selecting a Region Of Interest [ROI], e.g. for requesting a higher resolution version of a selected region
- H04N 21/434: Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream {(demultiplexing of data packets for data networks, e.g. RTP/UDP H04L65/00)}
- H04N 21/44008: {involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream (arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)}
- H04N 21/44012: {involving rendering scenes according to scene graphs, e.g. MPEG-4 scene graphs}
- H04N 21/816: {involving special video data, e.g 3D video}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Methods and apparatuses for extracting and merging bitstreams. An apparatus includes a communication interface and a processor. The communication interface receives a plurality of bitstreams for a video and a processor. The processor identifies information about independently coded regions in each of the plurality of bitstreams, receives a region of interest in the video, selects, based on the identified information, one or more independently coded regions in each of the plurality of bitstreams that corresponds to the region of interest, and extracts the selected independently coded regions to generate one or more extracted bitstreams.

## Claims

### Claim 1

An apparatus comprising:
a communication interface configured to receive a plurality of bitstreams for a video; and
a processor operably connected to the communication interface, the processor configured to:
identify information about independently coded regions in each of the plurality of bitstreams,
receive information regarding a relevant region in the video,
receive parameters regarding a capacity of a decoder for the video,
receive information about profile, tier, and level (PTL) parameters of the decoder,
extract one or more independently coded regions in each of the plurality of bitstreams based on the identified information for the one or more independently coded regions corresponding to the relevant region required by an application of the decoder and based on the parameters regarding the capacity of the decoder to manage a fullness of the decoder, and
generate one or more extracted bitstreams with the extracted one or more independently coded regions to conform to the PTL parameters of the decoder.

### Claim 2 (depends on 1)

The apparatus of claim 1, wherein the processor is further configured to identify the information about the independently coded regions from one or more network abstract layer (NAL) units received in the plurality of bitstreams.

### Claim 3 (depends on 1)

The apparatus of claim 1, wherein:
the information about the independently coded regions includes information about a size of each of the independently coded regions and a location of each of the independently coded regions within the video, and
the processor is further configured to determine the independently coded regions to extract that include the relevant region based on the information about the size and the location.

### Claim 4 (depends on 1)

The apparatus of claim 1, wherein the
parameters regarding the capacity of the decoder that decodes the one or more extracted bitstreams are received from the decoder.

### Claim 5 (depends on 1)

The apparatus of claim 1, wherein the
information about the PTL parameters of the decoder is received from the decoder.

### Claim 6 (depends on 1)

The apparatus of claim 1, wherein the information about the independently coded regions includes at least one of:
a number of luma samples in each of the identified independently coded regions, and
a number of coded data bits in each of the identified independently coded regions.

### Claim 7 (depends on 1)

The apparatus of claim 1, wherein the communication interface is further configured to transmit the one or more extracted bitstreams to an external decoder for decoding and rendering of the video.

### Claim 8 (depends on 1)

The apparatus of claim 1, further comprising the decoder configured to decode the one or more extracted bitstreams for rendering as the video.

### Claim 9 (depends on 1)

The apparatus of claim 1, further comprising:
a display,
wherein the relevant region corresponds to a field of view of the display, and
wherein the information regarding the relevant region is received based on inputs from one or more sensors associated with the display.

### Claim 10

A method performed by an apparatus, the method comprising:
receiving a plurality of bitstreams for a video;
identifying information about independently coded regions in each of the plurality of bitstreams;
receiving information regarding a relevant region in the video;
receiving parameters regarding a capacity of a decoder for the video,
receiving information about profile, tier, and level (PTL) parameters of the decoder,
extracting one or more independently coded regions in each of the plurality of bitstreams based on the identified information for the one or more independently coded regions corresponding to the relevant region required by an application of the decoder and based on the parameters regarding the capacity of the decoder to manage a fullness of the decoder; and
generating one or more extracted bitstreams with the extracted one or more independently coded regions to conform to the PTL parameters of the decoder.

### Claim 11 (depends on 10)

The method of claim 10, further comprising identifying the information about the independently coded regions from one or more network abstract layer (NAL) units received in the plurality of bitstreams.

### Claim 12 (depends on 10)

The method of claim 10, wherein:
the information about the independently coded regions includes information about a size of each of the independently coded regions and a location of each of the independently coded regions within the video, and
the method further comprises determining the independently coded regions to extract that include the relevant region based on the information about the size and the location.

### Claim 13 (depends on 10)

The method of claim 10, wherein the
parameters regarding the capacity of the decoder that decodes the one or more extracted bitstreams are received from the decoder.

### Claim 14 (depends on 10)

The method of claim 10, wherein the further comprising:
information about the PTL parameters of the decoder is received from the decoder.

### Claim 15 (depends on 10)

The method of claim 10, wherein the information about the independently coded regions includes at least one of:
a number of luma samples in each of the identified independently coded regions, and
a number of coded data bits in each of the identified independently coded regions.

### Claim 16 (depends on 10)

The method of claim 10, further comprising transmitting the one or more extracted bitstreams to an external decoder for decoding and rendering of the video.

### Claim 17 (depends on 10)

The method of claim 10, further comprising decoding, by the apparatus, the one or more extracted bitstreams for rendering as the video at the apparatus.

### Claim 18 (depends on 10)

The method of claim 10, wherein:
the relevant region corresponds to a field of view of a display of the apparatus, and
the information regarding the relevant region is received based on inputs from one or more sensors associated with the display.

### Claim 19

An apparatus comprising:
a processor configured to:
independently encode regions of a video in each of a plurality of bitstreams for the video, and
include information about the independently encoded regions in one or more network abstract layer (NAL) units in the plurality of bitstreams, the information about the independently encoded regions including information about a size of each of the independently encoded regions and a location of each of the independently encoded regions within the video, wherein the information includes profile, tier, and level (PTL) parameters of the one or more independently coded regions in each of the plurality of bitstreams; and
a communication interface configured to transmit the plurality of bitstreams.

### Claim 20 (depends on 19)

The apparatus of claim 19, wherein the information about the independently encoded regions further includes at least one of:
a number of luma samples in each of the independently encoded regions, and
a number of coded picture data bits in each of the independently encoded regions.
