# US 2019/0174161 A1 · Scene section and region of interest handling in video streaming

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0174161 A1
- Document ID: US20190174161A1
- Status: Published application
- Kind: A1
- Application number: 16/052,132
- Filed: 2018-08-01
- Published: 2019-06-06
- Earliest claimed: 2016-02-02
- Assignees: Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.
- Applicants: Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.
- Inventors: Robert Skupin; Yago Sánchez; Thomas Schierl; Cornelius Hellge; Karsten Grüneberg
- Web page: https://patentgrep.com/patent/US20190174161A1

## CPC

- H04N 21/4728: for selecting a Region Of Interest [ROI], e.g. for requesting a higher resolution version of a selected region
- H04N 19/167: Position within a video image, e.g. region of interest [ROI]
- H04N 19/174: the region being a slice, e.g. a line of blocks or a group of blocks
- H04N 21/234327: {by decomposing into layers, e.g. base layer and one or more enhancement layers}
- H04N 21/6547: comprising parameters, e.g. for client setup
- H04N 21/8456: {by decomposing the content in the time domain, e.g. in time segments}
- H04N 21/85406: {involving a specific file format, e.g. MP4 format}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A section-specific video data stream is derived by reducing a video data stream pertaining an entire scene with conservation of conformance by use of a file format and incorporating slices into which tiles of a set of tiles are encoded which forms the section, are incorporated into a set of one or more source tracks and a set of one or more gathering tracks including construction instructions is used in order to indicate a synthesis of the section-specific video data stream by signaling replacements of certain portions of the slices and instructing to copy certain portions of the slices. Further, there is described a concept pertaining an indication of a position of a region of interest.

## Claims

### Claim 1

A video streaming server configured to
access slices of a video data stream into which pictures of a video are coded each of which shows a scene, wherein the pictures are spatially subdivided into tiles and each slice has encoded thereinto no more than one tile; and
render available to the client a streaming of a stream concerning a section of the scene, the stream being formatted in a file format and comprising
a set of one or more source tracks incorporating the slices into which tiles within the section, being a set of one or more tiles wide, are encoded, and
a set of one or more gathering tracks comprising construction instructions indicating a synthesis of a section-specific video data stream into which pictures showing the scene's section are encoded, by
signaling replacements for first portions of the slices incorporated into the one or more source tracks, and/or
instructing to copy second portions of the slices incorporated into the one or more source tracks.

### Claim 2 (depends on 1)

The video streaming server according to claim 1 wherein the pictures are encoded into the slices of the video data stream with interruption of coding interdependencies across tile boundaries.

### Claim 3 (depends on 1)

The video streaming server according to claim 1 wherein each source track is associated with a respective one of the tiles into which the pictures of the video are spatially subdivided and incorporates the slices into which the tile of the picture associated with the respective source track is encoded.

### Claim 4 (depends on 1)

The video streaming server according to claim 1 configured to send to the client a manifest which treats
each of the set of one or more source tracks and
the set of one or more gathering tracks
as separate representations and indicates the set of one or more gathering tracks as being dependent on the one or more source tracks.

### Claim 5 (depends on 1)

The video streaming server according to claim 1 configured so that the video data stream and the section-position-specific video data stream are decodable by one video decoder.

### Claim 6 (depends on 1)

The video streaming server according to claim 1 configured to render available to the client a streaming of a further stream concerning a further section of the scene, the further stream being formatted in the file format and comprising
a further set of one or more source tracks incorporating the slices into which tiles within the further section, being a further set of one or more tiles wide, are encoded, and
a further set of one or more gathering tracks comprising construction instructions indicating a synthesis of a further section-specific video data stream into which pictures showing the scene's further section are encoded, by
signaling replacements for first portions of the slices incorporated into the further set of one or more source tracks, and/or
instructing to copy second portions of the slices incorporated into the further set of the one or more source tracks.

### Claim 7 (depends on 6)

The video streaming server according to claim 6 configured to provide a manifesto the client which treats
each source track of the set and further set of one or more source tracks,
the set of one or more gathering tracks and
the further set of one or more gathering tracks
as separate representations and indicates the set of one or more gathering tracks as being dependent on the set of one or more source tracks and the further set of one or more gathering tracks as being dependent on the further set of one or more source tracks.

### Claim 8 (depends on 7)

The video streaming server according to claim 7 wherein the video streaming server is configured to provide the manifest with an explicit signaling of mutually distinct URL bases for the representations pertaining the set of one or more gathering tracks and the further set of one or more gathering tracks, respectively.

### Claim 9 (depends on 7)

The video streaming server according to claim 7 wherein the section and further section are of equal size in terms of tiles, and the video streaming server is configured to provide the manifest with an URL template defining a calculation regulation for determining URLs of segments of the representations pertaining the set of one or more gathering tracks and the further set of one or more gathering tracks, respectively, dependent on a spatial position of the section of the scene to be retrieved.

### Claim 10 (depends on 7)

The video streaming server according to claim 7 configured to
provide a manifest to the client which treats each of the set and further set of one or more source tracks as separate representations and
convey the set of one or more gathering tracks within segments of representations which correspond to the source tracks comprising the slices having encoded thereinto tiles within the scene's section and convey the further set of one or more gathering tracks within segments of representations which correspond to source tracks comprising the slices having encoded thereinto tiles within the further scene's section.

### Claim 11 (depends on 10)

The video streaming server according to claim 10 configured to
convey the set of one or more gathering tracks within segments of a representation which corresponds to the source track comprising the slices having encoded thereinto the tile which is located at a predetermined tile position within the scene's section, and convey the further set of one or more gathering tracks within segments of a representation which correspond to the source track comprising the slices having encoded thereinto the tile which is located at the predetermined tile position within the further scene's section.

### Claim 12 (depends on 10)

The video streaming server according to claim 10 configured to
provide the manifest with an information indicating that the set of one or more source tracks and the further set of one or more source tracks may be retrieved in a manner separate from other source tracks and convey the set of one or more gathering tracks and the further set of one or more gathering tracks within their segments.

### Claim 13 (depends on 12)

The video streaming server according to claim 12 configured to
for each tile lying within the scene's section, convey within segments of a representation which corresponds to the source track comprising the slices having encoded thereinto the respective tile, one of the set of one or more gathering tracks which is specific for the synthesis of the section-position-specific video data stream within the respective tile, and
for each tile lying within the further scene's section, convey within segments of a representation which corresponds to the source track comprising the slices having encoded thereinto the respective tile, one of the further set of one or more gathering tracks which is specific for the synthesis of the further section-position-specific video data stream within the respective tile.

### Claim 14 (depends on 13)

The video streaming server according to claim 13
wherein the section and the further section overlap each other so that there is a predetermined tile lying within the scene's section and the further scene's section, and
the video streaming server is configured to
convey within segments of the representation which corresponds to the source track comprising the slices having encoded thereinto the predetermined tile, a parametrizable gathering track which is parametrizable so as to,
according to a first parametrizing setting, become the gathering track of the set of one or more gathering tracks which is specific for the synthesis of the section-position-specific video data stream within the predetermined tile, and
according to a second parametrizing setting, become the gathering track of the further set of one or more gathering tracks which is specific for the synthesis of the further section-position-specific video data stream within the predetermined tile.

### Claim 15 (depends on 14)

The video streaming server according to claim 14, wherein the parametrizable gathering track comprises construction instructions comprising an index with
the gathering track of the set of one or more gathering tracks which is specific for the synthesis of the section-position-specific video data stream within the predetermined tile resulting from skipping within the parametrizable gathering track those construction instructions the index comprised by which is different from a first setting, and
the gathering track of the further set of one or more gathering tracks which is specific for the synthesis of the further section-position-specific video data stream within the predetermined tile resulting from skipping within the parametrizable gathering track those construction instructions the index comprised by which is different from a second setting.

### Claim 16 (depends on 1)

The video streaming server according to claim 1 wherein the first portions are, or lie within, syntax-element-wise coded data stream portions preserving boarders between syntax elements in transitioning between coded bit level and syntax level.

### Claim 17 (depends on 1)

The video streaming server according to claim 1 wherein the second portions are, or encompass, arithmetically coded data stream portions.

### Claim 18 (depends on 1)

The video streaming server according to claim 1 wherein the construction instructions comprise
an insertion instruction
comprising
a constructor tag,
a data field length indication and
a data field of the data field length corresponding to a replacement of a non-copied portion of the slices of the set of one or more source tracks, and
instructing to insert the replacement into the section-specific video data stream.

### Claim 19 (depends on 1)

The video streaming server according to claim 1 wherein the construction instructions comprise
a copying instruction
comprising
a further constructor tag,
a further data field length indication and
a further data field of the further data field length, comprising an index to a reference track of the set of one or more source tracks,
an indicator of the sample or picture or access unit of the reference track which the copying instruction refers to, and an indication of a portion to be copied out of the sample or picture or access unit of the reference track by data offset and data length, and
instructing to copy the portion to be copied into the section-specific video data stream.

### Claim 20 (depends on 1)

The video streaming server according to claim 1 wherein the construction instructions form a sequence of copying instructions which copy certain portions from the slices of the set of one or more source tracks to synthesize the section-specific video data stream.

### Claim 21 (depends on 20)

The video streaming server according to claim 20 wherein the sequence of copying instructions has one or more insertion instructions interspersed thereinto a content of an operator field of which is to be inserted to synthesize the section-specific video data stream.

### Claim 22 (depends on 20)

The video streaming server according to claim 20 wherein the construction instructions signal the synthesis of the section-specific video data stream in bitstream domain without transcoding.

### Claim 23

Client configured to retrieve from a video streaming server a video concerning a section of a scene, the client configured to
retrieve from the video streaming server a stream formatted in a file format and comprising
a set of one or more source tracks incorporating slices, the slices in the set of one or more source tracks forming a subset of slices of a video data stream into which pictures of a video are coded each which shows the scene, wherein the pictures are spatially subdivided into tiles and each slice of the video data stream has encoded thereinto no more than one tile, the subset of slices incorporating the slices into which tiles within the section being a set of one or more tiles wide are encoded; and
a set of one or more gathering tracks comprising construction instructions indicating a synthesis of a section-position-specific video data stream into which pictures showing the scene's section are encoded;
synthesize the section-specific video data stream according to construction instructions in the set of one or more gathering tracks by
replacing first portions of the slices incorporated into the one or more source tracks by replacements signaled by the construction instructions, and/or
copying second portions of the slices incorporated into the one or more source tracks,
subjecting the section-position-specific video data stream to decoding by a video decoder.

### Claim 24 (depends on 23)

The client according to claim 23 wherein the pictures are encoded into the slices of the video data stream with interruption of coding interdependencies across tile boundaries such that each slice has encoded thereinto the no more than one tile independent from any other tile covering a spatially distinct portion of the picture comprising the one tile or any other picture.

### Claim 25 (depends on 23)

The client according to claim 23 wherein each source track is associated with a respective one of the tiles into which the pictures of the video are spatially subdivided and incorporates the slices into which the tile of the pictures associated with the respective source track is encoded.

### Claim 26 (depends on 23)

The client according to claim 23 configured to receive from the video streaming server a manifest which treats
each of the one or more source tracks and
the set of one or more gathering tracks
as separate representations and indicates the set of one or more gathering tracks as being dependent on the one or more source tracks, and retrieve the separate representations from the video streaming server as the stream.

### Claim 27 (depends on 23)

The client according to claim 23 wherein the video data stream and the section-position-specific video data stream are both decodable by the video decoder.

### Claim 28 (depends on 23)

The client according to claim 23 configured to
retrieve a further stream concerning a further section of the scene from the video streaming server, the further stream being formatted in the file format and comprising
a further set of one or more source tracks incorporating the slices into which tiles of a further set of tiles are encoded which spatially forms the further section,
a further set of one or more gathering tracks comprising construction instructions indicating a synthesis of a further section-position-specific video data stream into which pictures showing the scene's further section are encoded,
synthesize the further section-position-specific video data stream according to construction instructions in the further set of one or more gathering tracks by
replacing first portions of the slices incorporated into the further set of one or more source tracks with replacement signaled by the construction instructions in the further set of one or more gathering tracks, and/or
copying second portions of the slices incorporated into the further set of the one or more source tracks, and
subjecting the further section-position-specific video data stream to decoding by the video decoder.

### Claim 29 (depends on 28)

The client according to claim 28 configured to
receive from the video streaming server a manifest which treats
each source track of the set and further set of one or more source tracks,
the set of one or more gathering tracks and
the set of one or more further gathering tracks
as separate representations and indicates the set of one or more gathering tracks as being dependent on the set of one or more source tracks and the further set of one or more gathering tracks as being dependent on the further set of one or more source tracks, and
in retrieving the stream from the video streaming server, retrieve the representations associated with the set of one or more source tracks and the set of one or more gathering tracks from the video streaming server, and in retrieving the further stream from the video streaming server, retrieve the representations associated with the further set of one or more source tracks and the further set of one or more gathering tracks from the video streaming server.

### Claim 30 (depends on 29)

The client according to claim 29 wherein the client is configured to derive from the manifest an explicit signaling of mutually distinct URL bases for the representations pertaining the set of one or more gathering tracks and the further set of one or more gathering tracks, respectively.

### Claim 31 (depends on 29)

The client according to claim 29 wherein the section and further section are of equal size in terms of tiles, and the client is configured to, in retrieving from the video streaming server the stream and in retrieving from the video streaming server the further stream,
derive from the manifest a URL template defining a calculation regulation,
using the calculation regulation, determining URLs of segments of the representations pertaining the set of one or more gathering tracks and the further set of one or more gathering tracks, respectively, dependent on a spatial position of the section of the scene to be retrieved,
retrieve the segments on the basis of the URLs determined which convey the set of one more gathering tracks in case of retrieval of the stream and the further set of one or more gathering tracks in case of retrieval of the further stream.

### Claim 32 (depends on 29)

The client according to claim 29 configured to
receive from the video streaming server a manifest which treats each of the set and further set of one or more source tracks as separate representations and
in retrieving the stream from the video streaming server, read the one or more gathering tracks from segments of representations which correspond to the source tracks comprising the slices having encoded thereinto tiles within the scene's section, and in retrieving the further stream from the video streaming server, read the further set of one or more gathering tracks from segments of representations which correspond to the source tracks comprising the slices having encoded thereinto tiles within the further scene's section.

### Claim 33 (depends on 32)

The client according to claim 32 configured to
in retrieving the stream from the video streaming server, read the set of one or more gathering tracks from segments of a representation which corresponds to the source track comprising the slices having encoded thereinto the tile which is located at a predetermined tile position within the scene's section, and in retrieving the further stream from the video streaming server, read the further set of one or more gathering tracks from segments of a representation which correspond to the source track comprising the slices having encoded thereinto the tile which is located at the predetermined tile position within the further scene's section.

### Claim 34 (depends on 32)

The client according to claim 32 configured to
in retrieving the stream from the video streaming server, read, for each tile lying within the scene's section, from segments of a representation which corresponds to the source track comprising the slices having encoded thereinto the respective tile, one of the set of one or more gathering tracks which is specific for the synthesis of the section-position-specific video data stream within the respective tile, and
in retrieving the further stream from the video streaming server, read, for each tile lying within the further scene's section, from segments of a representation which corresponds to the source track comprising the slices having encoded thereinto the respective tile, one of the further set of one or more gathering tracks which is specific for the synthesis of the further section-position-specific video data stream within the respective tile.

### Claim 35 (depends on 34)

The client according to claim 34
wherein the section and the further section overlap each other so that there is a predetermined tile lying within the scene's section and the further scene's section, and
the client is configured to, in retrieving from the video streaming server the stream and in retrieving from the video streaming server the further stream,
read from segments of the representation which corresponds to the source track comprising the slices having encoded thereinto the predetermined tile, a parametrizable gathering track,
in case of retrieval of the stream, parameterize the parametrizable gathering track using a first parametrizing setting so that the parametrizable gathering track becomes the gathering track of the set of one or more gathering tracks which is specific for the synthesis of the section-position-specific video data stream within the predetermined tile, and
in case of retrieval of the further stream, parameterize the parametrizable gathering track using a second parametrizing setting so that the parametrizable gathering track becomes the gathering track of the further set of one or more gathering tracks which is specific for the synthesis of the section-position-specific video data stream within the predetermined tile.

### Claim 36 (depends on 35)

The client according to claim 35 configured to
in parametrizing the parametrizable gathering track using the first parametrizing setting, skipping within the parametrizable gathering track construction instructions comprising an index which is different from a first setting, and
in parametrizing the parametrizable gathering track using the second parametrizing setting, skipping within the parametrizable gathering track construction instructions comprising an index which is different from a second setting.

### Claim 37 (depends on 23)

The client according to claim 23 wherein the second portions are, or lie within, syntax-element-wise coded data stream portions preserving boarders between syntax elements in transitioning between coded bit level and syntax level.

### Claim 38 (depends on 23)

The client according to claim 23 wherein the first portions are, or encompass, arithmetically coded data stream portions.

### Claim 39 (depends on 23)

The client according to claim 23 wherein the construction instructions comprise
an insertion instruction
comprising
a constructor tag,
a data field length indication and
a data field of the data field length corresponding to a replacement
of a non-copied portion of the slices of the set of one or more source tracks,
the client configured to, according to the insertion instruction, insert the replacement into the section-specific video data stream.

### Claim 40 (depends on 23)

The client according to claim 23 wherein the construction instructions comprise
a copying instruction
comprising
a further constructor tag,
a further data field length indication and
a further data field of the further data field length, comprising
an index to a reference track of the set of one or more source tracks,
an indicator of the sample or picture or access unit of the reference track which the copying instruction refers to, and
an indication of a portion to be copied out of the sample or picture or access unit of the reference track by data offset and data length,
the client configured to, according to the copying instruction, copy the portion to be copied into the section-specific video data stream.

### Claim 41 (depends on 23)

The client according to claim 23 wherein the construction instructions form a sequence of copying instructions and the client is configured to, according to the sequence of copying instructions, copy certain portions from the slices of the set of one or more source tracks to synthesize the section-specific video data stream.

### Claim 42 (depends on 41)

The client according to claim 41 wherein the sequence of copying instructions has one or more insertion instructions interspersed thereinto and the client is configured to, according to the one or more insertion instructions, insert a content of an operator field of the one or more insertion instructions to synthesize the section-specific video data stream.

### Claim 43 (depends on 41)

The client according to claim 41 wherein the client is configured to, according to the construction instructions, synthesize the section-specific video data stream in bitstream domain without transcoding.

### Claim 44

Video data conceptualized for streaming a spatially variable section of a scene to a client, the video data being formatted in a file format and comprising
a set of one or more source tracks, each source track being associated with a respective one of tiles into which pictures of a video which capture the scene entirely are spatially subdivided, wherein the source tracks have distributed thereinto slices of a video data stream into which the pictures of the video are coded such that each slice has encoded thereinto no more than one tile; and
a set of one or more gathering tracks, each set of which is associated with a respective one of a plurality of positions of the section formed by a corresponding subset of the tiles and comprising construction instructions indicating a synthesis of a section-position-specific video data stream into which pictures showing the scene's section at the respective position are coded by
signaling replacements for first portions of slices having encoded thereinto any tile of the subset of tiles from the source tracks, and/or
copying second portions of the slices having encoded thereinto any tile of the subset of tiles.

### Claim 45 (depends on 44)

The video data according to claim 44 wherein the second portions comprise syntax elements in slice headers of slices, the syntax elements indicating
whether the slice to which the slice header belongs, is a, in terms of a picture traversing decoding order, first slice of a picture of the video, and/or
a position of slice to which the slice header belongs, measured relative to a predetermined picture's corner.

### Claim 46 (depends on 44)

The video data according to claim 44 wherein the construction instructions comprise
an insertion instruction
comprising
a constructor tag,
a data field length indication and
a data field of the data field length corresponding to a replacement of a non-copied portion of the slices of the set of one or more source tracks, and
instructing to insert the replacement into the section-specific video data stream.

### Claim 47 (depends on 44)

The video data according to claim 44 wherein the construction instructions comprise
a copying instruction
comprising
a further constructor tag,
a further data field length indication and
a further data field of the further data field length, comprising
an index to a reference track of the set of one or more source tracks,
an indicator of the sample or picture or access unit of the reference track which the copying instruction refers to, and
an indication of a portion to be copied out of the sample or picture or access unit of the reference track by data offset and data length, and
instructing to copy the portion to be copied into the section-specific video data stream.

### Claim 48 (depends on 44)

The video data according to claim 44 wherein the construction instructions form a sequence of copying instructions which copy certain portions from the slices of the set of one or more source tracks to synthesize the section-specific video data stream.

### Claim 49 (depends on 48)

The video data according to claim 48 wherein the sequence of copying instructions has one or more insertion instructions interspersed thereinto a content of an operator field of which is to be inserted to synthesize the section-specific video data stream.

### Claim 50 (depends on 48)

The video data according to claim 48 wherein the construction instructions signal the synthesis of the section-specific video data stream in bitstream domain without transcoding.

### Claim 51

A video streaming server configured to accompany a video stream representing a scene and being streamed from the video streaming server to a client, with an information indicating a position of a region of interest within the scene in a manner so that the position temporally varies.

### Claim 52 (depends on 51)

The video streaming server according to claim 51 wherein the video streaming server is configured to convey the information within a file format box of the video stream.

### Claim 53 (depends on 51)

The video streaming server according to claim 51 wherein the video streaming server is a DASH server and configured to convey the information out-of-band by way of SAND messages.

### Claim 54 (depends on 51)

The video streaming server according to claim 51 wherein the video streaming server is configured to intermittently update the information so as to update the position.

### Claim 55 (depends on 53)

The video streaming server according to claim 53 wherein the video streaming server is configured to schedule the intermittent update of the information at time instances independent from client requests.

### Claim 56 (depends on 51)

The video streaming server according to claim 51 wherein the video streaming server is configured to convey the information at a start of the streaming in a manner so that the information schedules forthcoming changes of the position of the region of interest.

### Claim 57 (depends on 56)

The video streaming server according to claim 56 wherein the video streaming server is configured to provide the client with the information at the start of the streaming within a manifest of the video stream or within an initial segment of the video stream.

### Claim 58

A client configured to retrieve a video stream representing a scene from a video streaming server, and use information with which the video stream is accompanied to determine a position of a region of interest within the scene in a manner so that the position temporally varies.

### Claim 59 (depends on 58)

The client according to claim 58 wherein the client is configured to derive the information from file format boxes of the video stream.

### Claim 60 (depends on 58)

The client according to claim 58 wherein the client is a DASH client and configured to derive the information out-of-band from SAND messages.

### Claim 61 (depends on 58)

The client according to claim 58 wherein the client is configured to receive intermittent updates of the information from the video streaming server so as to update the position.

### Claim 62 (depends on 60)

The client according to claim 60 wherein the client is configured to receive the intermittent update of the information at time instances independent from client requests sent by the client to the video streaming server.

### Claim 63 (depends on 58)

The client according to claim 58 wherein the client is configured to derive the information at a start of the streaming in a manner so that the information schedules forthcoming changes of the position of the region of interest.

### Claim 64 (depends on 63)

The client according to claim 63 wherein the client is configured to derive the information at the start of the streaming from a manifest of the video stream sent by the video streaming server or within an initial segment of the video stream fetched by the client before retrieving media segments of the video stream.

### Claim 65 (depends on 58)

The client according to claim 58 configured to prioritize a prefetch of first future portions of the video stream pertaining the region of interest compared to second future portions pertaining a surrounding of the region of interest.

### Claim 66 (depends on 58)

The client according to claim 58 configured to start the retrieval of the video stream at a portion of the video stream pertaining the region of interest and continue the retrieval with portions pertaining a surrounding of the region of interest.

### Claim 67

A method for video streaming comprising
receiving slices of a video data stream into which pictures of a video are coded each of which shows a scene, wherein the pictures are spatially subdivided into tiles and each slice has encoded thereinto no more than one tile; and
rendering available to the client a streaming of a stream concerning a section of the scene, the stream being formatted in a file format and comprising
a set of one or more source tracks incorporating the slices into which tiles within the section, being a set of one or more tiles wide, are encoded, and
a set of one or more gathering tracks comprising construction instructions indicating a synthesis of a section-specific video data stream into which pictures showing the scene's section are encoded, by
signaling replacements for first portions of the slices incorporated into the one or more source tracks, and/or
instructing to copy second portions of the slices incorporated into the one or more source tracks.

### Claim 68

A method for retrieving from a video streaming server a video concerning a section of a scene, the method comprising
retrieving from the video streaming server a stream formatted in a file format and comprising
a set of one or more source tracks incorporating slices, the slices in the set of one or more source tracks forming a subset of slices of a video data stream into which pictures of a video are coded each which shows the scene, wherein the pictures are spatially subdivided into tiles and each slice of the video data stream has encoded thereinto no more than one tile, the subset of slices incorporating the slices into which tiles within the section being a set of one or more tiles wide are encoded; and
a set of one or more gathering tracks comprising construction instructions indicating a synthesis of a section-position-specific video data stream into which pictures showing the scene's section are encoded;
synthesizing the section-specific video data stream according to construction instructions in the set of one or more gathering tracks by
replacing first portions of the slices incorporated into the one or more source tracks by replacements signaled by the construction instructions, and/or
copying second portions of the slices incorporated into the one or more source tracks,
subjecting the section-position-specific video data stream to decoding by a video decoder.

### Claim 69

A method for video streaming comprising
accompanying a video stream representing a scene and being streamed from the video streaming server to a client, with an information indicating a position of a region of interest within the scene in a manner so that the position temporally varies.

### Claim 70

A method for retrieving a video stream representing a scene from a video streaming server, comprising using information with which the video stream is accompanied to determine a position of a region of interest within the scene in a manner so that the position temporally varies.

### Claim 71

A non-transitory digital storage medium having a computer program stored thereon to perform the method for video streaming comprising
receiving slices of a video data stream into which pictures of a video are coded each of which shows a scene, wherein the pictures are spatially subdivided into tiles and each slice has encoded thereinto no more than one tile; and
rendering available to the client a streaming of a stream concerning a section of the scene, the stream being formatted in a file format and comprising
a set of one or more source tracks incorporating the slices into which tiles within the section, being a set of one or more tiles wide, are encoded, and
a set of one or more gathering tracks comprising construction instructions indicating a synthesis of a section-specific video data stream into which pictures showing the scene's section are encoded, by
signaling replacements for first portions of the slices incorporated into the one or more source tracks, and/or
instructing to copy second portions of the slices incorporated into the one or more source tracks,
when said computer program is run by a computer.

### Claim 72

A non-transitory digital storage medium having a computer program stored thereon to perform the method for retrieving from a video streaming server a video concerning a section of a scene, the method comprising
retrieving from the video streaming server a stream formatted in a file format and comprising
a set of one or more source tracks incorporating slices, the slices in the set of one or more source tracks forming a subset of slices of a video data stream into which pictures of a video are coded each which shows the scene, wherein the pictures are spatially subdivided into tiles and each slice of the video data stream has encoded thereinto no more than one tile, the subset of slices incorporating the slices into which tiles within the section being a set of one or more tiles wide are encoded; and
a set of one or more gathering tracks comprising construction instructions indicating a synthesis of a section-position-specific video data stream into which pictures showing the scene's section are encoded;
synthesizing the section-specific video data stream according to construction instructions in the set of one or more gathering tracks by
replacing first portions of the slices incorporated into the one or more source tracks by replacements signaled by the construction instructions, and/or
copying second portions of the slices incorporated into the one or more source tracks,
subjecting the section-position-specific video data stream to decoding by a video decoder,
when said computer program is run by a computer.

### Claim 73

A non-transitory digital storage medium having a computer program stored thereon to perform the method for video streaming comprising
accompanying a video stream representing a scene and being streamed from the video streaming server to a client, with an information indicating a position of a region of interest within the scene in a manner so that the position temporally varies,
when said computer program is run by a computer.

### Claim 74

A non-transitory digital storage medium having a computer program stored thereon to perform the method for retrieving a video stream representing a scene from a video streaming server, comprising using information with which the video stream is accompanied to determine a position of a region of interest within the scene in a manner so that the position temporally varies,
when said computer program is run by a computer.

### Claim 75 (depends on 44)

Digital storage medium having stored thereon video data according to claim 44.

### Claim 76

A stream streamed by a video streaming method for video streaming comprising
receiving slices of a video data stream into which pictures of a video are coded each of which shows a scene, wherein the pictures are spatially subdivided into tiles and each slice has encoded thereinto no more than one tile; and
rendering available to the client a streaming of a stream concerning a section of the scene, the stream being formatted in a file format and comprising
a set of one or more source tracks incorporating the slices into which tiles within the section, being a set of one or more tiles wide, are encoded, and
a set of one or more gathering tracks comprising construction instructions indicating a synthesis of a section-specific video data stream into which pictures showing the scene's section are encoded, by
signaling replacements for first portions of the slices incorporated into the one or more source tracks, and/or
instructing to copy second portions of the slices incorporated into the one or more source tracks.

### Claim 77

A stream streamed by a video streaming method for video streaming comprising
accompanying a video stream representing a scene and being streamed from the video streaming server to a client, with an information indicating a position of a region of interest within the scene in a manner so that the position temporally varies.
