Method and apparatus for delivering 5G AR/MR cognitive experience to 5G devices

A device for cognitive immersive experiences to augmented reality (AR)/mixed reality (MR) devices, the device comprising:

• at least one memory configured to store program code;
• and
• at least one processor implementing a Cognitive Immersive Server (CIS), configured to read the program code and operate as instructed by the program code, the program code including:
• first receiving code configured to cause the at least one processor to receive captured media data that is associated with a plurality of scenes, the captured media data comprising cognitive media data, interaction information, and pose information;
• first configuring code configured to cause the at least one processor to configure an immersive media streaming session, the first configuring code comprising:
• establishing transport sessions between the CIS and a Media Client of a Cognitive Media Client for exchange of delivery manifests associated with a plurality of immersive media scenes;
• receiving information associated with a first number of initialized media pipelines based on the delivery manifests where each initialized media pipeline is associated with a respective media stream according to the plurality of immersive media scenes;
• establishing a first number of transport sessions between the CIS and the Media Client of the Cognitive Media Client for exchange of immersive media associated with the plurality of immersive media scenes;
• and
• receiving information on the first number of initialized media pipelines associated with the Media Client of the Cognitive Media Client;
• processing code configured to cause the at least one processor to process, by the CIS, the captured media data to generate the immersive media associated with the plurality of immersive media scenes;
• and
• second transmitting code configured to cause the at least one processor to transmit the cognitive media data to the Media Client of the Cognitive Media Client.

A non-transitory computer-readable medium storing instructions, the instructions comprising:

• one or more instructions that, when executed by one or more processors of a Cognitive Immersive Server (CIS) for delivering a cognitive immersive experiences to augmented reality (AR)/mixed reality (MR) devices, cause the one or more processors of the CIS to:
• receive captured media data that is associated with a plurality of scenes, the captured media data comprising cognitive media data, interaction information, and pose information;
• configure an immersive media streaming session, the configuring comprising:
• establishing transport sessions between the CIS and a Media Client of a Cognitive Media Client for exchange of delivery manifests associated with a plurality of immersive media scenes;
• receiving information associated with a first number of initialized media pipelines based on the delivery manifests where each initialized media pipeline is associated with a respective media stream according to the plurality of immersive media scenes;
• establishing a first number of transport sessions between the CIS and the Media Client of the Cognitive Media Client for exchange of immersive media associated with the plurality of immersive media scenes;
• and
• receiving information on the first number of initialized media pipelines associated with the Media Client of the Cognitive Media Client;
• process, by the CIS, the captured media data to generate the immersive media associated with the plurality of immersive media scenes;
• and
• transmit the immersive media to the Media Client of the Cognitive Media Client based on the first number of media pipelines.