Cloud platform capable of providing real-time streaming services for heterogeneous applications including ar, vr, xr, and mr irrespective of specifications of hardware of user

A cloud platform capable of providing a real-time streaming service for heterogeneous applications including augmented reality (AR), virtual reality (VR), extended reality (XR), and mixed reality (MR) irrespective of specifications of hardware of a user, the cloud platform comprising:

• an image input unit 10 configured to receive an image captured by a user, to process the received image through non-compression conversion, and to transmit the processed image to an application program unit;
• a controller 20 configured to receive control event data input through a control terminal of the user, to analyze the control event data, and to transmit a driving control signal to the application program unit;
• wherein the application program unit 30 includes a plurality of image content generators 31 configured to select and execute one of the heterogeneous applications according to the control signal transmitted from the controller 20 and to combine a virtual image realized by the selected application and the processed image transmitted from the image input unit 10 to generate an image content, and
• wherein each image content generator 31 includes:
• an AV input processor 311 configured to receive the image transmitted from the image input unit 10;
• a control input processor 312 configured to receive the control signal transmitted from the controller 20;
• the application 313 selected from the plurality of heterogeneous applications ;
• and a result processing and generation unit 314 configured to combine the processed image input through the AV input processor 311 and the virtual image generated by the application 313 according to the control signal of the control input processor 312 to generate the image content, to synchronize the image content, and to transmit the synchronized image content to the result output unit 40;
• a result output unit 40 configured to receive the image content generated through the application unit 30, to convert the image content through compression, and to stream the image content to an image terminal of the user in real time through a streaming engine, and
• a data synchronization processor 50 configured to synchronize the image input unit 10, the controller 20, and the result output unit 40 with the application program unit 30.

A cloud platform capable of providing a real-time streaming service for heterogeneous applications including augmented reality (AR), virtual reality (VR), extended reality (XR), and mixed reality (MR) irrespective of specifications of hardware of a user, the cloud platform comprising:

• an image input unit 10 configured to receive an image captured by a user, to process the received image through non-compression conversion, and to transmit the processed image to an application program unit;
• a controller 20 configured to receive control event data input through a control terminal of the user, to analyze the control event data, and to transmit a driving control signal to the application program unit;
• wherein the application program unit 30 is configured to select and execute one of the heterogeneous applications according to the control signal transmitted from the controller 20 and to combine a virtual image realized by the application and the processed image transmitted from the image input unit 10 to generate an image content;
• a result output unit 40 configured to receive the image content generated through the application unit 30, to convert the image content through compression, and to stream the image content to an image terminal of the user in real time through a streaming engine and including an output receiver 401 configured to receive the image content generated through the application program unit 30, an AV compression converter 402 configured to compress the image content received through the output receiver 410, and a streaming engine 404 configured to stream the image content transmitted through the AV compression converter 402 to a terminal of the user in real time;
• and
• a data synchronization processor 50 configured to synchronize the image input unit 10, the controller 20, the result output unit 40 with the application program unit 30.