System for interactive image based game

A computer system comprised of a central processing unit and a memory, the memory storing instructions for a mobile computing device to perform actions comprising:

• receiving images of a real world environment from one or more rear facing image sensors of the mobile computing device;
• generating a game environment comprising images of the real world environment;
• receiving images of one or more objects from one or more front facing image sensors of the mobile computing device;
• generating modified images of a certain size and certain shape by processing the images of the one or more objects from the one or more front facing image sensors;
• overlaying the modified images onto the game environment;
• displaying on a screen of the mobile computing device a preview of the modified images overlaid on the game environment in real time;
• algorithmically detecting a face within the modified images;
• tracking the detected face within the modified images to preview face images in real time overlaid on the game environment;
• algorithmically recognizing one or more objects in the images of the real world environment, wherein each recognized object corresponds to one or more graphics stored in the memory;
• displaying on the screen of the mobile computing device the one or more graphics overlaid on the game environment;
• and
• controlling the position of the face images to interact with the one or more graphics and the game environment during gameplay.

A computer implemented method for real time processing of images of a user's face and images of a real world environment for interaction, the method comprising the steps of:

• a) providing a mobile computing device comprising an image signal processor, a memory, one or more front facing image sensors, one or more rear facing image sensors and a screen;
• b) employing the mobile computing device to provide images of a real world environment received from the one or more rear facing image sensors;
• c) employing the mobile computing device to provide images of one or more objects received from the one or more front facing image sensors;
• d) employing the image signal processor to process the images of the one or more objects to generate modified images of a certain size and certain shape;
• e) employing the image signal processor to overlay the modified images onto the images of the real world environment;
• f) employing the mobile computing device to display on the screen a preview of the modified images overlaid on the images of the real world environment in real time;
• g) employing the mobile computing device to algorithmically detect a face within the modified images and to track the detected face within the modified images to preview face images overlaid on the images of the real world environment in real time;
• h) employing the mobile computing device to algorithmically recognize one or more objects in the images of the real world environment, wherein each recognized object corresponds to one or more graphics stored in the memory;
• i) displaying on the screen the corresponding graphics overlaid on the images of the real world environment;
• and
• j) controlling the position of the displayed face images to interact with the displayed graphics and the images of the real world environment during gameplay.