Hybrid Method to Identify AR Target Images in Augmented Reality Applications

A user device configured to detect an augmented reality (AR) target image and retrieve AR content for the detected AR target image, comprising:

• one or more processors;
• and
• memory storing one or more programs to be executed by the one or more processors, the one or more programs comprising instructions for:
• receiving data of the AR target image;
• detecting, based on the data of the AR target image, a plurality of markers on the AR target image;
• calculating a set of cross ratios based on locations of the plurality of markers;
• retrieving, from a database and based on the set of cross ratios, AR content associated with the AR target image;
• and
• displaying the retrieved AR content and the AR target image in a single AR scene.

A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which, when executed by one or more processors, cause the processors to perform operations comprising:

• at a user device:
• receiving data of the AR target image;
• detecting, based on the data of the AR target image, a plurality of markers on the AR target image;
• calculating a set of cross ratios based on locations of the plurality of markers;
• retrieving, from a database and based on the set of cross ratios, AR content associated with the AR target image;
• and
• displaying the retrieved AR content and the AR target image in a single AR scene.

A method of searching and retrieving augmented reality (AR) content for an AR target image, comprising:

• at a computer system having one or more processors and memory for storing programs to be executed by the one or more processors:
• receiving a set of cross ratios associated with the AR target image;
• comparing the received set of cross ratios with a group of predefined sets of cross ratios, each predefined set of cross ratios from the group of predefined sets of cross ratios being associated with an AR content file from a group of AR content files;
• determining, based on the comparison result, an AR content file from the group of AR content files;
• sending AR content associated with the AR content file to a user device such that the user device displays the AR content and the AR target image in a single AR scene.

A system comprising a user device and a server device, wherein:

• the user device is configured to receive data of an augmented reality (AR) target image;
• the user device configured to detect, based on the data of the AR target image, a plurality of markers on the AR target image;
• the user device configured to calculate a set of cross ratios based on locations of the plurality of markers;
• the user device configured to send the calculated set of cross ratios to the server device;
• the server device configured to compare the set of cross ratios received from the user device with a group of predefined sets of cross ratios, each predefined set of cross ratios from the group of predefined sets of cross ratios being associated with an AR content file from a group of AR content files;
• the server device configured to determine, based on the comparison result, an AR content file from the group of AR content files;
• the server device configured to send AR content associated with the determined AR content file to the user device such that the user device displays the AR content and the AR target image in a single AR scene.

A method of detecting an augment reality (AR) target image and retrieving AR content for the detected AR target image using a computer system having one or more processors and memory for storing programs to be executed by the one or more processors, comprising:

• receiving data of the AR target image;
• detecting, based on the data of the AR target image, a plurality of markers on the AR target image;
• calculating a set of cross ratios based on locations of the plurality of markers;
• comparing the calculated set of cross ratios with a group of predefined sets of cross ratios;
• if the calculated set of cross ratios matches a predefined set of cross ratios from the group of predefined sets of cross ratios,
• retrieving AR content associated with the matching predefined set of cross ratios;
• displaying the retrieved AR content and the AR target image in a single AR scene
• if the calculated set of cross ratios does not match any predefined set of cross ratios from the group of predefined sets of cross ratios,
• detecting, based on the data of the AR target image, a keypoint of the AR target image;
• calculating a keypoint descriptor of the detected keypoint of the AR target image;
• comparing the calculated keypoint descriptor with a group of predetermined keypoint descriptors;
• if the calculated keypoint descriptor matches a predetermined keypoint descriptor from the group of predetermined keypoint descriptors,
• retrieving AR content associated with the matching predetermined keypoint descriptor;
• and
• displaying the retrieved AR content and the AR target image in a single AR scene.