Systems and methods for personalized and interactive extended reality experiences

A non-transitory computer readable storage medium comprising computer program instructions configured to instruct a computer processor to perform at least the steps of:

• recording a first lux value in response to determining that application of a camera-assisted virtual experience method provides unstable results when said first lux value is sensed by a light sensor,
• assessing the camera-assisted virtual experience method by determining whether a light sensor value received from the light sensor matches any previously recorded lux value of a set of previously recorded lux values, which includes the first lux value,
• if the light sensor value does not match any previously recorded lux value of the set of previously recorded lux values, generating, by applying the camera-assisted virtual experience method, a virtual experience on a device, wherein the camera-assisted virtual experience method detects feature points to track in camera frames, and
• if the light sensor value matches any previously recorded lux value of the set of previously recorded lux values, refraining from applying the camera-assisted virtual experience to generate the virtual experience and generating, by applying a motion sensor-assisted virtual experience method, the virtual experience on the device,
• wherein the generating of the virtual experience is based on predetermined settings and wherein the virtual experience comprises digital elements,
• wherein the generating of the virtual experience comprises generating a real world image and virtual objects, and
• wherein the digital elements comprise the real world image and the virtual objects;
• outputting the real world image to be displayed on a display screen;
• outputting the virtual objects to be displayed on the display screen, wherein the virtual objects overlap the real world image to provide the virtual experience;
• determining an initial location of a user device to correctly place the virtual experience based on information sensed by a plurality of sensors that are in a real world location that is proximate to a location recorded in the real world image;
• determining, by the computer processor, movement metrics of said user device, based on information sensed by the plurality of sensors, wherein movement metrics comprise at least one of:
• accelerometer readings, gyroscope readings, GPS coordinates, location and positional change appropriated from readings from IoT devices or stationary wireless devices;
• and
• continuing to output the movement of the digital elements and said user device in the virtual experience in accordance with the movement metrics.

A computing device comprising:

• at least one processor;
• and
• a storage medium tangibly storing thereon program logic configured to instruct the at least one processor to at least:
• record a first lux value in response to determining that application of a camera-assisted virtual experience method provides unstable results when said first lux value is sensed by a light sensor,
• assess the camera-assisted virtual experience method by determining whether a light sensor value received from the light sensor matches any previously recorded lux value of a set of previously recorded lux values, which includes the first lux value,
• if the light sensor value does not match any previously recorded lux value of the set of previously recorded lux values, generate, by applying the camera-assisted virtual experience method, a virtual experience on a device, wherein the camera-assisted virtual experience method detects feature points to track in camera frames, and
• if the light sensor value matches any previously recorded lux value of the set of previously recorded lux values, refrain from applying the camera-assisted virtual experience to generate the virtual experience and generate, by applying a motion sensor-assisted virtual experience method, the virtual experience on the device,
• wherein the generating of the virtual experience is based on predetermined settings and wherein the virtual experience comprises digital elements,
• wherein the generating of the virtual experience comprises generating a real world image and virtual objects, and
• wherein the digital elements comprise the real world image and the virtual objects;
• output the real world image to be displayed on a display screen;
• output the virtual objects to be displayed on the display screen, wherein the virtual objects overlap the real world image to provide the virtual experience;
• determine an initial location of a user device to correctly place the virtual experience based on information sensed by a plurality of sensors that are in a real world location that is proximate to a location recorded in the real world image;
• determine movement metrics of said user device, based on information sensed by the plurality of sensors, wherein movement metrics comprise at least one of:
• accelerometer readings, gyroscope readings, GPS coordinates, location and positional change appropriated from readings from IoT devices or stationary wireless devices;
• and
• continue to output the movement of the digital elements and said user device in the virtual experience in accordance with the movement metrics.