Information terminal apparatus, information processing method, and system

An information processing method, comprising:

• capturing an image of a subject by an imaging unit to generate a captured image;
• setting an initial posture of the imaging unit;
• detecting posture information indicating a change in posture from the initial posture of the imaging unit;
• correcting a posture of a preset virtual object arranged on an object coordinate which is a virtual three-dimensional space depending on the posture information;
• generating, based on a conversion function for projecting the virtual object on a device coordinate which is a two-dimensional coordinate representing a display screen of the captured image, an object image as a result of a projection, on the device coordinate, of the virtual object whose posture is corrected;
• generating a synthetic image in which the object image is synthesized with the captured image;
• displaying the synthetic image;
• recording the captured image;
• and
• recording the posture information in synchronization with the captured image.

A system comprising:

• a terminal device;
• an information processing device connectable to the terminal device via a network;
• an imaging unit configured to capture an image of a subject to generate a captured image;
• an initial setting unit configured to set an initial posture of the imaging unit;
• a posture detector configured to detect posture information indicating a change in posture from the initial posture of the imaging unit;
• a posture corrector configured to correct a posture of a preset virtual object arranged on an object coordinate which is a virtual three-dimensional space depending on the posture information;
• a projector configured to generate, based on a conversion function for projecting the virtual object on a device coordinate which is a two-dimensional coordinate representing a display screen of the captured image, an object image as a result of a projection, on the device coordinate, of the virtual object whose posture is corrected;
• a synthesizer configured to generate a synthetic image in which the object image is synthesized with the captured image;
• a display unit configured to display the synthetic image;
• an image recording unit configured to record the captured image;
• and
• a posture recording unit configured to record the posture information in synchronization with the captured image.