# US 2024/0007675 A1 · Video Data Stream Concept

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0007675 A1
- Document ID: US20240007675A1
- Status: Published application
- Kind: A1
- Application number: 18/359,791
- Filed: 2023-07-26
- Published: 2024-01-04
- Earliest claimed: 2012-06-29
- Assignees: Ge Video Compression, LLC
- Applicants: Ge Video Compression, LLC
- Inventors: Thomas Schierl; Valeri George; Anastasia Henkel; Detlev Marpe; Karsten Grueneberg; Robert Skupin
- Web page: https://patentgrep.com/patent/US20240007675A1

## CPC

- H04N 19/167: Position within a video image, e.g. region of interest [ROI]
- H04L 47/10: Flow control; Congestion control
- H04N 19/174: the region being a slice, e.g. a line of blocks or a group of blocks
- H04N 19/188: {the unit being a video data packet, e.g. a network abstraction layer [NAL] unit}
- H04N 19/423: characterised by memory arrangements (H04N19/433 takes precedence)
- H04N 19/436: using parallelised computational arrangements
- H04N 19/46: Embedding additional information in the video signal during the compression process (H04N19/517, H04N19/68, H04N19/70 take precedence)
- H04N 19/55: Motion estimation with spatial constraints, e.g. at image or region borders
- H04N 19/67: involving unequal error protection [UEP], i.e. providing protection according to the importance of the data
- H04N 19/68: involving the insertion of resynchronisation markers into the bitstream
- H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards
- H04N 19/91: Entropy coding, e.g. variable length coding [VLC] or arithmetic coding
- H04N 21/234327: {by decomposing into layers, e.g. base layer and one or more enhancement layers}
- H04N 21/4621: {Controlling the complexity of the content stream or additional data, e.g. lowering the resolution or bit-rate of the video stream for a mobile client with a small screen (arrangements for using the results of monitoring on user's side in broadcast systems H04H60/65; flow control in packet networks H04L47/10)}
- H04N 21/4728: for selecting a Region Of Interest [ROI], e.g. for requesting a higher resolution version of a selected region
- G06F 15/173: using an interconnection network, e.g. matrix, shuffle, pyramid, star, snowflake
- H04L 12/56: {Packet switching systems}
- H04L 12/66: Arrangements for connecting between networks having differing types of switching systems, e.g. gateways
- H04L 47/31: by tagging of packets, e.g. using discard eligibility [DE] bits
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Decoder retrieval timing information, ROI information and tile identification information are conveyed within a video data stream at a level which allows for an easy access by network entities such as MANEs or decoder. In order to reach such a level, information of such types are conveyed within a video data stream by way of packets interspersed into packets of access units of a video data stream. In accordance with an embodiment, the interspersed packets are of a removable packet type, i.e. the removal of these interspersed packets maintains the decoder's ability to completely recover the video content conveyed via the video data stream.

## Claims

### Claim at position 1

1-25. (canceled)

### Claim 26

A method for encoding video content into a video data stream, the method comprising:
encoding the video content into the video data stream using predictive and entropy coding, in units of slices into which pictures of the video content are spatially sub-divided, using a coding order among the slices, with restricting predictions of the predictive coding and/or entropy coding to the inner of tiles into which the pictures of the video content are spatially sub-divided; and
packetizing the sequence of the slices into payload packets of a sequence of packets of the video data stream in the coding order, the sequence of packets being divided into a sequence of access units so that each access unit collects the payload packets having packetized thereinto slices relating to a respective picture of the video content,
wherein the sequence of packets has tile identification packets interspersed thereinto between payload packets of one access unit, identifying one or more tiles overlaid by any slice packetized into one or more payload packets immediately following the respective tile identification packet in the sequence of packets.

### Claim 27 (depends on 26)

The method of claim 26, wherein the tile identification packets identify the one or more tiles overlaid by any slice packetized into exactly the immediately following payload packet.

### Claim 28 (depends on 26)

The method of claim 26, wherein the tile identification packets identify the one or more tiles overlaid by any slice packetized into the one or more payload packets immediately following the respective tile identification packet in the sequence of packets until the earlier of an end of the current access unit, and the next tile identification packet, respectively, in the sequence of packets.

### Claim 29 (depends on 26)

The method of claim 26, wherein the video data stream is a scalable video coding (SVC) data stream.

### Claim 30 (depends on 26)

A network entity comprising:
a microprocessor configured to receive a video data stream encoded by the method of claim 26, and to identify, based on the tile identification packets, tiles which are overlaid by slices packetized into one or more payload packets immediately following the respective tile identification packet in the sequence of packets.

### Claim 31 (depends on 30)

The network entity of claim 30, wherein the network entity is configured to use a result of the identification so as to decide on transmission tasks pertaining the video data stream.

### Claim 32 (depends on 31)

The network entity of claim 31, wherein the transmission tasks comprise re-transmission requests concerning defect packets.

### Claim 33 (depends on 30)

The network entity of claim 30, wherein the network entity is configured to handle different tiles with different priority by assigning a higher priority to tile identification packets and the payload packets immediately following the respective tile identification packet having slices packetized thereinto which overlay tiles identified by the respective tile identification packets for which the priority is higher, then to tile identification packets and the payload packets immediately following the respective tile identification packet having slices packetized thereinto which overlay tiles identified by the respective tile identification packets for which the priority is lower.

### Claim 34 (depends on 33)

The network entity of claim 33, wherein the network entity is configured to first request a retransmission of payload packets having the higher priority assigned thereto, before requesting any retransmission of payload packets having the lower priority assigned thereto.

### Claim 35 (depends on 30)

The network entity of claim 30, wherein the video data stream is a scalable video coding (SVC) data stream.

### Claim 36 (depends on 30)

The network entity of claim 30, wherein the network entity is a decoder.

### Claim 37 (depends on 26)

A method comprising:
receiving a video data stream encoded by the method of claim 26; and
identifying, based on the tile identification packets, tiles which are overlaid by slices packetized into one or more payload packets immediately following the respective tile identification packet in the sequence of packets.

### Claim 38 (depends on 37)

The method as of claim 37, wherein the video data stream is a scalable video coding (SVC) data stream.

### Claim 39

An encoder configured to:
code into a video data stream video content using predictive and entropy coding in units of slices into which pictures of the video content are spatially sub-divided, and using a coding order among the slices, with restricting predictions of the predictive coding and/or entropy coding to the inner of tiles into which the pictures of the video content are spatially sub-divided; and
packetize the sequence of the slices into payload packets of a sequence of packets of the video data stream in the coding order, the sequence of packets being divided into a sequence of access units so that each access unit collects the payload packets having packetized thereinto slices relating to a respective picture of the video content,
wherein the sequence of packets has tile identification packets interspersed thereinto between payload packets of one access unit, identifying one or more tiles overlaid by any slice packetized into one or more payload packets immediately following the respective tile identification packet in the sequence of packets.

### Claim 40 (depends on 39)

The encoder of claim 39, wherein the video data stream is a scalable video coding (SVC) data stream.
