System and Method to Create Configurable, Context Sensitive Functions in AR Experiences

A system for performing functions in AR experiences, comprising:

• a computer configured to receive an image of a monitored device having at least one object;
• the computer configured to process said image to determine a plurality of feature points;
• a database in data communication with said computer;
• the database configured to store a plurality of reference images with reference feature points and reference object zones, each reference object zone having a property associated therewith;
• the computer configured to match at least some of the plurality of feature points with at least some of the plurality of reference feature points to compute a homography matrix;
• the computer configured to transform the image into a transformed image using the homography matrix;
• the computer configured to identify an object zone in the transformed image based on the reference object zone;
• the computer configured to determine an object state by processing a sub-image in the object zone of the transformed image based on a property associated with the reference object zone.