Augmented reality glasses with object recognition using artifical intelligence

A wearable augmented reality eyewear system, comprising:

• a frame having at least one transparent lens and configured to be worn by a user and adjacent to the user's eyes;
• a plurality of outward-facing cameras coupled to at least one of the frame or the transparent lens, and configured to capture live multimedia images of objects that are visually present by the user within a field of vision through the at least one transparent lens;
• at least one inward-facing camera coupled to at least one of the frame or the transparent lenses configured to detect movement, dilation and gaze direction of the pupil;
• a gesture recognition system coupled to at least one inward-facing camera configured to interpret blinking patterns and eye glances;
• an object recognition processor coupled to a remote database and the plurality of outward-facing cameras and configured to receive in real-time the captured live multimedia images of the objects and compare the captured live multimedia images of the objects to information of known objects in the database to automatically recognize and identify the objects and gather information about the recognized and identified objects;
• a pupillary movements tracking system coupled to the at least one inward-facing camera and configured to interact with the pupil movements of the user's eye and use the movement, dilation and gaze direction of the pupil to track at least one object in the user's field of vision that the user is looking at;
• wherein the object recognition processor is further configured to determine a gaze vector based on detected pupil position relative to a virtual coordinate grid, to identify a region of the captured live multimedia images within the user's field of view corresponding to the gaze vector, and to perform object recognition processing on the identified region when gaze fixation exceeds a predefined duration threshold indicating intentional observation by the user;
• wherein the object recognition processor is further configured to detect a hand gesture performed by the user within the field of view of the at least one outward-facing camera and control object recognition processing of the captured live multimedia images in response to the detected hand gesture;
• a projector wirelessly coupled to the object recognition processor and the pupillary movements tracking system and configured to project to the user via the at least one transparent lens readable information associated with the gathered information about the recognized and identified objects;
• and
• a speaker coupled to the frame, the object recognition processor and the pupillary movements tracking system and configured to transmit audio information associated with the gathered information about the recognized and identified objects.

A wearable augmented reality eyewear system, comprising:

• a frame having at least one transparent lens and configured to be worn by a user and adjacent to the user's eyes;
• a plurality of outward-facing cameras coupled to at least one of the frame or the transparent lens, and configured to capture live multimedia images of objects that are visually present by the user within a field of vision through the at least one transparent lens;
• at least one inward-facing camera coupled to at least one of the frame or the transparent lenses configured to detect movement, dilation and gaze direction of the pupil;
• a gesture recognition system coupled to at least one inward-facing camera configured to interpret blinking patterns and eye glances;
• a location module configured to track a real-time geographical location of the user;
• an object recognition processor coupled to a remote database and the at least one camera and configured to receive in real-time the captured live multimedia images of the objects and compare the captured live multimedia images of the objects to information of known objects in the database that are associated with the real-time geographical location of the user to automatically recognize and identify the objects and gather information about the recognized and identified objects;
• a pupillary movements tracking system coupled to the at least one inward-facing camera and configured to interact with the pupil movements of the user's eye and use the movement, dilation and gaze direction of the pupil to track at least one object in the user's field of vision that the user is looking at;
• wherein the object recognition processor is further configured to determine a gaze vector based on detected pupil position relative to a virtual coordinate grid corresponding to the at least one transparent lens, to identify a region of the captured live multimedia images within the user's field of view corresponding to the gaze vector, and to perform object recognition processing on the identified region when gaze fixation exceeds a predefined duration threshold indicating intentional observation by the user;
• wherein the object recognition processor is further configured to detect a hand gesture performed by the user within the field of view of the at least one outward-facing camera and control object recognition processing of the captured live multimedia images in response to the detected hand gesture;
• a projector wirelessly coupled to the object recognition processor and the pupillary movements tracking system and configured to project to the user via the at least one transparent lens readable information associated with the gathered information about the recognized and identified objects;
• and
• a speaker coupled to the frame, the object recognition processor and the pupillary movements tracking system and configured to transmit audio information associated with the gathered information about the recognized and identified objects.