Image template-based AR form experiences

A system comprising:

• one or more processors;
• and
• a memory storing instructions that, when executed by the one or more processors, cause the system to:
• receive, by an image sensor of an electronic device, an image of a physical document;
• determine an augmented reality template to display on a display of the electronic device;
• display the augmented reality template on the display of the electronic device, wherein the augmented reality template is aligned in three dimensions with the physical document;
• determine a distance between the physical document and the electronic device;
• determine the distance satisfies a threshold distance;
• based on the distance between the physical document and the electronic device satisfying the threshold distance;
• perform a template detection to determine a document template for the physical document, the document template defining a location and a type of information on the physical document and define an interactivity rule;
• define an overlay including one or more structures aligned with the location and the type of the information on the physical document and display one or more interactive user interface elements;
• enable the one or more interactive user interface elements within the augmented reality template displayed on the display of the electronic device;
• and
• change a display of a particular text box of the physical document according to the interactivity rule and in response to receiving a user interaction associated by the interactivity rule with the particular text box;
• determine that the distance between the physical document and the electronic device no longer satisfies the threshold distance;
• and
• based on the distance between the physical document and the electronic device no longer satisfying the threshold distance, disable the one or more interactive user interface elements.

A method of providing an augmented reality user interface, comprising:

• receiving, by an image sensor of an electronic device, an image of a physical document;
• determining, based on a document type of the physical document, an augmented reality template to display on a display of the electronic device;
• displaying the augmented reality template on the display of the electronic device, wherein the augmented reality template is aligned in three dimensions with the physical document;
• determining a distance between the physical document and the electronic device based on data captured using the image sensor or a different distance sensor associated with the electronic device;
• determining the distance satisfies a threshold distance;
• based on the distance between the physical document and the electronic device satisfying the threshold distance;
• performing a template detection to determine a document template for the physical document, the document template defining a location and a type of information on the physical document;
• defining an overlay including one or more structures aligned with the location and the type of the information on the physical document and displaying one or more interactive user interface elements and defining an interactivity rule;
• enabling the one or more interactive user interface elements within the augmented reality template displayed on the display of the electronic device;
• and
• changing a display of a particular text box of the physical document according to the interactivity rule and in response to receiving a user interaction associated by the interactivity rule with the particular text box;
• determining that the distance between the physical document and the electronic device no longer satisfies the threshold distance;
• and
• based on the distance between the physical document and the electronic device no longer satisfying the threshold distance, disabling the one or more interactive user interface elements.