Spatially Tiled Omnidirectional Video Streaming

A client device for processing an omnidirectional video, said omnidirectional video being associated with a 3D coordinate system for determining a spatial position of video data of said omnidirectional video on a curved surface, the client device comprising:

• a computer readable storage medium having at least part of a program embodied therewith, the computer readable storage medium comprising a manifest file;
• and,
• a computer readable storage medium having computer readable program code embodied therewith, and a processor coupled to the computer readable storage medium, wherein responsive to executing the computer readable program code, the processor is configured to perform executable operations comprising:
• receiving a manifest file, the manifest file comprising a plurality of tile stream identifiers for identifying a plurality of tile streams, the tile streams comprising video frames with 2D projected video data, the video frames having image views, whereby the image views of video frames of different tile streams cover different regions of a 2D projection of the omnidirectional video, a region defining a tile;
• and,
• selecting on the basis of spatial relation information in the manifest file and on the basis of a viewpoint of a user of the client device a first tile stream associated with a first resolution and a first tile position and a second tile stream associated with a second resolution and a second tile position, the second resolution being lower than the first resolution, wherein the spatial relation information defines for each tile a tile position and wherein the viewpoint defines a viewing direction of the user, the tile position and the viewpoint being defined on the basis of coordinates of the 3D coordinate system.

Non-transitory computer-readable storage media for storing a manifest file for a client device, said client device being configured to process an omnidirectional video by on the basis of said manifest file, said omnidirectional video being associated with a 3D coordinate system for determining a spatial position of video data of said omnidirectional video on a curved surface, said manifest file comprising computer readable data, said data comprising:

• a plurality of tile stream identifiers for identifying a plurality of tile streams, the tile streams comprising video frames with 2D projected video data, the video frames having image views, whereby the image views of video frames of different tile streams cover different regions of a 2D projection of the omnidirectional video, a region defining a tile;
• spatial relation information, the spatial relation information defining for each tile a tile position, the tile position and the viewpoint being defined on the basis of coordinates of the 3D coordinate system;
• and,
• mapping information for providing the client device with information for enabling the client device to map the 2D projected video data of the tile streams identified in the manifest file as omnidirectional video data onto the curved surface.