Augmented, virtual and mixed-reality content selection & display

A method of providing a message to a user of a portable device comprising portable camera and a portable display, the portable device of the type that is freely movable relative to a billboard, package, object with print on its surface, flyer or other printed representation so images of the billboard, package, object with print on its surface, flyer or other printed representation captured by the portable camera change in position and/or orientation, and displays captured images of the billboard, package, object with print on its surface, flyer or other printed representation on the portable display, the method comprising:

• defining an area of recognition to exclude at least one indicium within the captured images, and area of recognition being defined to enable the portable device or a server operatively connected to the portable device to recognize the billboard, package, object with print on its surface, flyer, or other printed representation based on grey scale and/or color values within the area of recognition;
• and
• providing an augmented reality, virtual reality or mixed reality overlay for being overlaid by the portable device onto the displayed image, the provided overlay providing an adjunct message associated with content of the billboard, package, object with print on its surface, flyer or other printed representation,
• the overlay being configured to enable the portable device to move the overlay on the display in response to changing position and/or orientation of the captured images of the billboard, package, object with print on its surface, flyer, or other printed representation to simulate the overlay adhering to the billboard, package, object with print on its surface, flyer, or other printed representation or being displayed from a display window on the billboard, package, object with print on its surface, flyer, or other printed representation.

A server for presenting image information to a user of a portable device having a portable display and a portable camera that is freely movable relative to a printed object having indicia printed thereon so images of the printed object captured by the portable camera change in position and/or orientation, comprising:

• a processor in communication with the portable camera and the portable display, the processor being configured to perform operations including:
• using an area of recognition that is defined to exclude at least one indicium on images of the printed object captured by the portable camera to recognize a pattern associated with the printed object based on color and/or grey scale information in the area of recognition;
• selecting a media item in response to the recognized pattern;
• and
• controlling the portable device to superimpose the selected media item onto the captured image or an image derived therefrom displayed on the portable display, including moving the superimposed selected media item in response to changing position and/or orientation of the captured images of the printed object.