System and method for enhancing augmented reality (AR) experience on user equipment (UE) based on in-device contents

A method for enhancing augmented reality experience on one or more connected electronic devices using in-device content, the method comprising:

• receiving external content depicting an environment surrounding an augmented reality (AR) device and obtained by the AR device;
• identifying, by the AR device, at least one real object (RO) in the external content;
• obtaining, by the AR device, a set of visual cues of the at least one RO;
• sharing, by the AR device, the obtained set of visual cues with the one or more connected electronic devices;
• comparing, by one of the one or more connected electronic devices, the set of visual cues received from the AR device with a predefined model object category, the predefined model object category comprising a plurality of model objects;
• associating, by the one of the one or more connected electronic devices, an in-device content for the RO with at least one model object, among the plurality of model objects, the in-device content being received from a first application, among a plurality of applications installed and running on the electronic device, and the first application being different and separately running from a second application, from among the plurality of applications, which provides the augmented reality experience on the electronic device;
• based on the obtained set of visual cues, identifying, by the one of the one or more connected electronic devices, a model object associated with the in-device content;
• and
• providing the augmented reality experience by overlapping and displaying AR information corresponding to the in-device content from the first application associated with the identified model object on the external content including the RO displayed on a screen.

An electronic device for enhancing augmented reality experience, the electronic device comprising:

• a display;
• processor;
• wherein the processor is configured to:
• register a model object in a model object category, the model object category comprising a plurality of model objects,
• receive external content including Real Object (RO) from an augmented reality (AR) device, the external content depicting an environment surrounding the AR device and obtained by the AR device,
• analyze in-device content from a first application, among a plurality of applications installed and running on the electronic device, the first application being different and separately running from a second application, from among the plurality of applications, which provides the augmented reality experience on the electronic device,
• associate the in-device content with at least one model object, among the plurality of model objects based on analysis results of the in-device content,
• identify, based on a set of visual cues obtained from the RO, a model object corresponding to the set of visual cues from among the plurality of model objects associated with the in-device content, and
• control the display to provide the augmented reality experience by overlapping and displaying AR information corresponding to the in-device content from the first application associated with the identified model object on the external content including the RO displayed on a screen.