System And Method For Delivering Media Over Network

A system for delivering media over a network, comprising:

• a server for running a Virtual-Reality (VR) scene application to generate a virtual VR 3D environment containing a plurality of 3D models;
• each of the 3D models being associated with a status for indicating whether or not the 3D model is pre-stored in a client device;
• and
• the client device for connecting to the server via a network in order to retrieve media containing at least some of the 3D models generated by the VR scene application;
• wherein, said media comprises a plurality of graphics which are transmitted by the following steps:
• Step (B):
• the server checking the statuses of the 3D models in order to decide which 3D models are to be encoded as a left eye frame and a right eye frame of a 2D video stream in such a manner that, those 3D models which are not pre-stored in the client device will all be encoded into the left eye frame and the right eye frame;
• Step (C):
• the server sending at least the left eye frame and the right eye frame of the 2D video stream to the client device via the network;
• wherein in Step (C), the server also sends the 3D models that are not pre-stored in the client device to the client device in a predetermined order;
• when the client device receives the 3D model sent by the server, the client device stores the 3D model and then sends a message to the server in order to change the status of the 3D model for indicating the 3D model is now pre-stored in the client device;
• Step (D):
• the client device decoding the left eye frame and the right eye frame received from the server, and combining the left eye frame and the right eye frame into a combined VR frame, and then using said combined VR frame as a background for rendering the 3D models which are pre-stored in the client device but not included within the combined VR frame, so as to generate a mixed VR frame of an output video stream containing VR scenes;
• and
• Step (E):
• the client device outputting the mixed VR frame as a frame of the output video stream containing VR scenes.

A method for delivering media over a network, said media comprising a plurality of graphics, said method comprising the following steps:

• Step (A):
• running a Virtual-Reality (VR) scene application on a server for generating a virtual VR 3D environment containing a plurality of 3D models;
• each of the 3D models being associated with a status for indicating whether or not the 3D model is pre-stored in a client device;
• Step (B):
• the server checking the statuses of the 3D models in order to decide which 3D models are to be encoded as a left eye frame and a right eye frame of a 2D video stream in such a manner that, those 3D models which are not pre-stored in the client device will all be encoded into the left eye frame and a right eye frame;
• and then, the server combining the left eye frame and the right eye frame into one combined VR frame of the 2D video stream;
• Step (C):
• the server sending at least the combined VR frame of the 2D video stream to the client device via a network;
• wherein in Step (C), the server also sends the 3D models that are not pre-stored in the client device to the client device in a predetermined order;
• when the client device receives the 3D model sent by the server, the client device stores the 3D model and then sends a message to the server in order to change the status of the 3D model for indicating the 3D model is now pre-stored in the client device;
• and
• Step (D):
• the client device decoding the combined VR frame of the 2D video stream received from the server and using said combined VR frame as a background for rendering the 3D models which are pre-stored in the client device but not included within the combined VR frame, so as to generate a mixed VR frame of an output video stream containing VR scenes.