Method and apparatus for split rendering for lightfield/immersive media using proxy edge cloud architecture

An apparatus for split rendering immersive media using proxy edge cloud computing architecture, the apparatus comprising:

• at least one memory configured to store program code;
• and
• at least one processor configured to read the program code and operate as instructed by the program code, the program code including:
• first determining code configured to cause the at least one processor to determine, by a rendering proxy server, that an end device consuming immersive media has a limited resource capacity;
• splitting code configured to cause the at least one processor to split, by the rendering proxy server, a task of rendering amore than one scene in an immersive media stream into a plurality of tasks;
• first grouping code configured to cause the at least one processor to dynamically group, by the rendering proxy server, the plurality of tasks into two or more computational tasks based on one or more processing delays, wherein a first group of the two or more computational tasks is to be performed by an edge computing system and a second group of the two or more computational tasks is to be performed by a cloud computing system;
• first receiving code configured to cause the at least one processor to receive, by the rendering proxy server, first parts of the more than one scene corresponding to the first group from the edge computing system;
• second transmitting receiving code configured to cause the at least one processor to receive, by the rendering proxy server, second parts of the more than one scene corresponding to the second group of the two or more computational tasks to from the cloud computing system;
• first transcoding code configured to cause the at least one processor to transcode, by the rendering proxy server, a first scene among the more than one scene into a less computationally demanding format based on a resource capability of the end device;
• and
• first transmitting code configured to cause the at least one processor to transmit, by the rendering proxy server, the first scene that is transcoded and non-transcoded scenes from among the more than one scene to the end device,
• wherein the non-transcoded scenes from among the more than one scene are transmitted as received from the edge computing system and the cloud computing system.

A non-transitory computer-readable medium storing instructions, the instructions comprising:

• one or more instructions that, when executed by one or more processors of a device for split rendering immersive media using proxy edge cloud computing architecture, cause the one or more processors to:
• determine that an end device consuming immersive media has a limited resource capacity;
• split a task of rendering amore than one scene in an immersive media stream into a plurality of tasks;
• dynamically group the plurality of tasks into two or more computational tasks based on one or more processing delays, wherein a first group of the two or more computational tasks is to be performed by an edge computing system and a second group of the two or more computational tasks is to be performed by a cloud computing system;
• receive first parts of the more than one scene corresponding to the first group from the edge computing system;
• receive second parts of the more than one scene corresponding to the second group from the cloud computing system;
• transcode a first scene among the more than one scene into a less computationally demanding format based on a resource capability of the end device;
• and
• transmit the first scene that is transcoded and non-transcoded scenes from among the more than one scene to the end device,
• wherein the non-transcoded scenes from among the more than one scene are transmitted as received from the edge computing system and the cloud computing system.