Computer-readable storage medium having information processing program stored therein, information processing apparatus, information processing system, and information processing method

An information processing apparatus comprising:

• a camera configured to capture a taken image;
• a sensor configured to obtain orientation information indicating an orientation of the camera;
• and
• at least one processor being configured to:
• detect a specific object from the taken image captured by the camera;
• calculate a relative positional relation between the specific object and the camera;
• determine virtual object information including a virtual object display form, a virtual object type, and/or a number of virtual objects, based on the orientation information;
• generate an image of one or more virtual objects corresponding to the virtual object information based on the calculated positional relation between the specific object and the camera;
• and
• display the image of the one or more virtual objects on a display device.

An information processing system comprising:

• a camera configured to capture a taken image;
• a sensor configured to obtain orientation information indicating an orientation of the camera;
• and
• at least one processor being configured to:
• detect a specific object from the taken image obtained by the camera;
• calculate a relative positional relation between the specific object and the camera;
• determine virtual object information including a virtual object display form, a virtual object type, and/or a number of virtual objects, based on the orientation information;
• generate an image of one or more virtual objects corresponding to the virtual object information based on the calculated positional relation between the specific object and the camera;
• and
• display the image of the one or more virtual objects on a display device.

An information processing method comprising:

• obtaining a taken image that is taken by a camera of an imaging apparatus;
• obtaining orientation information from a sensor in the imaging apparatus, the orientation information indicating an orientation of the camera;
• detecting a specific object from the taken image;
• calculating a relative positional relation between the specific object and the camera;
• determining virtual object information including a virtual object display form, a virtual object type, and/or a number of virtual objects, based on at least the orientation information;
• generating an image of one or more virtual objects corresponding to the virtual object information based on the calculated positional relation;
• and
• displaying the image of the one or more virtual objects on a display device.

An information processing system comprising an information processing apparatus and a marker,

• the information processing apparatus comprising:
• a camera;
• a sensor configured to detect an orientation of the camera;
• and
• at least one processor coupled to the camera and the sensor, the at least one processor being configured to:
• take an image of the marker using the camera;
• obtain the taken image;
• obtain orientation information indicating an orientation of the camera from the sensor;
• detect the marker from the taken image;
• calculate a relative positional relation between the marker and the camera;
• determine virtual object information including a virtual object display form, a virtual object type, and/or a number of virtual objects, based on at least the orientation information;
• generate an image of one or more virtual objects corresponding to the virtual object information based on the calculated positional relation;
• and
• display the image of the one or more virtual objects on a display device.

An information processing apparatus comprising:

• a camera for capturing an image;
• a gravity sensor commonly housed with the camera;
• a display;
• and
• processing circuitry coupled to the camera, the gravity sensor and the display, the processing circuitry detecting a marker from the image captured by the camera, calculating a relative positional relationship between the marker and the camera, determining virtual object information including a virtual object display form, a virtual object type, and/or a number of virtual objects, based on at least a direction of gravity determined in accordance with an output of the gravity sensor, generating one or more virtual objects based on the virtual object information and in accordance with the calculated positional relationship between the marker and the camera, and controlling the display to display the one or more virtual objects.