Augmented reality display system, program, and method

A computer program product configured to cause a computer to function as:

• an imaging portion configured to capture an image of the real world, wherein the image of the real world comprises image information from at least two points that are physically separate from each other;
• a location information acquiring portion configured to acquire location information comprising coordinates and orientation at the moment at which the image is captured;
• an image analyzing portion configured to analyze, as depth information, relative distances to imaging subjects of individual pixels that constitute the image of the real world that has been captured;
• a virtual display data generating portion configured to generate virtual display data that expresses the state of placement of virtual objects on real map information that includes geographical information in the real world, based on location information acquired by the location information acquiring portion;
• a compositing processing portion configured to display the virtual display data superimposed on the image that has been captured by the imaging portion, including color and position of each individual pixel that constitute the image of the real world;
• and
• a learning processing portion configured to generate correlation information between colors and locations within the image, location information at the moment of image capture, the pixels that constitute the image, relating to a relative distance at the moment of image capture, and other relative distances calculated by the image analyzing portion,
• wherein the image analyzing portion is further configured to analyze depth information of a single image of the real world using correlation results from the learning processing portion,
• wherein the learning processing portion is configured to store a distance to an object obtained by analyzing a parallax of an image captured at the two physically separate points as the correlation information in association with a hierarchical combination pattern of characteristics for each pixel and position information at the real world location of image capture, and the image analyzing portion is configured to store the correlation information, and
• wherein the image of the real world captured by the imaging portion references the correlation information and the depth information of the image of the real world to determine the degree of match to the hierarchical combination patterns.