Information processing device and method of processing information

A method for superimposing a virtual object in a view of a real scene, wherein a real object is identified in the scene, a relative orientation of the real object with respect to a viewpoint is determined, and a first virtual object is rendered in accordance with said determined relative orientation, the method comprising:

• detecting a change in said relative orientation exceeding a threshold,
• selecting a second, different, virtual object based on the direction of change and the first virtual object, in response to the detected change;
• and
• rendering said second virtual object in place of said first virtual object.

A method comprising:

• obtaining a position and orientation of a viewpoint of an imaging apparatus which images a real space;
• obtaining a position and orientation of a real object which exists in the real space;
• calculating a relative orientation between the viewpoint of the imaging apparatus and the real object;
• switching a first virtual object to be displayed to a second virtual object to be displayed which is different from the first virtual object to be displayed when an amount of change in the relative orientation exceeds a predetermined threshold;
• and
• supplying a representation of the second virtual object to be displayed, to be superimposed on the view of the real space in accordance with the position and orientation of the viewpoint and the position of the real object.