Non-transitory computer-readable medium, image processing method, and image processing system for controlling progress of information processing in response to a user operation

An image processing method of controlling progress of information processing in response to a user operation, the image processing method comprising:

• specifying a virtual space corresponding to a captured image, the captured image being taken by an image capturing apparatus connected to a computer;
• generating a virtual space image, the virtual space image being obtained by photographing the virtual space including at least one virtual object by means of a virtual camera corresponding to the image capturing apparatus;
• outputting a synthetic image to a display device, the synthetic image being obtained by, synthesizing the captured image and the virtual space image, the display device including a touch panel;
• determining a content of a user operation against the touch panel;
• updating, in a case where it is determined that the user operation is a first operation, a position or a posture of each of the virtual camera and the virtual object in a state where a relationship between the virtual camera and the virtual object is fixed in accordance with movement or a change in a posture of the image capturing apparatus while the first operation is continuing, the first operation being an operation in which a touch position against the touch panel does not move after the touch panel is touched;
• determining that the first operation is continuing until a predetermined end condition is satisfied regardless of whether the touch position is lost after it is determined that the user operation is the first operation;
• and
• rotating the virtual object in a predetermined direction in a case where it is determined that the user operation is a second operation, the second operation being an operation in which the touch position is slid on the touch panel, the predetermined direction being defined by the second operation.

An image processing system for controlling progress of information processing in response to a user operation, the image processing system comprising a communication network, a server, and a user terminal to which an image capturing apparatus is connected, the image processing system further comprising:

• a specifying unit configured to specify a virtual space corresponding to a captured image, the captured image being taken by the image capturing apparatus;
• a generating unit configured to generate a virtual space image, the virtual space image being obtained by photographing the virtual space including at least one virtual object by means of a virtual camera corresponding to the image capturing apparatus;
• an outputting unit configured to synthesize the captured image and the virtual space image into a synthetic image and further configured to output the synthetic image to a display device including a touch panel;
• a determining unit configured to determine a content of a user operation against the touch panel;
• an updating unit configured to update, in a case where it is determined that the user operation is a first operation, a position or a posture of each of the virtual camera and the virtual object in a state where a relationship between the virtual camera and the virtual object is fixed in accordance with movement or a change in a posture of the image capturing apparatus while the first operation is continuing, the first operation being an operation in which a touch position against the touch panel does not move after the touch panel is touched, and further configured to determine that the first operation is continuing until a predetermined end condition is satisfied regardless of whether the touch position is lost after it is determined that the user operation is the first operation;
• and
• a rotating unit configured to rotate the virtual object in a predetermined direction in a case where it is determined that the user operation is a second operation, the second operation being an operation in which the touch position is slid on the touch panel, the predetermined direction being defined by the second operation.