AR space image projecting system, AR space image projecting method, and user terminal

An AR space image projecting method executed by a server apparatus and at least one user terminal, the server apparatus storing information on a plurality of three-dimensional objects, each user terminal including a camera and a display, the AR space image projecting method comprising:

• acquiring a depth map of an area, the area being photographed by the camera;
• specifying at least two three-dimensional objects, the at least two three-dimensional objects existing in the area photographed by the camera;
• receiving designation of a projected image;
• receiving a projection execution input in a state where the projected image is superimposed across the two three-dimensional objects photographed by the camera and the projected image thus superimposed is displayed on the display, the projected image being divided into at least two portions across the two three-dimensional objects;
• specifying, when the projection execution input is received, onto what initial positions of the two three-dimensional objects the two portions of the projected image are projected, and registering information on the two portions of the projected image and information on the initial positions so as to be associated with information on the two three-dimensional objects;
• and
• superimposing the two portions of the projected image on the two three-dimensional objects reflected on the display of the user terminal and displaying the two portions of the projected image thus superimposed in a case where the two three-dimensional objects onto which the two portions of the projected image are superimposed are photographed by the camera of the user terminal, the two portions of the projected image being superimposed on the two three-dimensional objects at the initial positions in a case where a positional relation between the two three-dimensional objects changes.

A user terminal for an AR space image projecting system, the AR space image projecting system including

• a server apparatus configured to store information on a plurality of three-dimensional objects, and
• one or more user terminals, the one or more user terminals including the user terminal, each of the one or more user terminals including a camera and a display,
• the user terminal configured to:
• acquire a depth map of an area, the area being photographed by the camera;
• a specify at least two three-dimensional objects, the at least two three-dimensional objects existing in the area photographed by the camera;
• to receive designation of a projected image;
• receive a projection execution input in a state where the projected image is superimposed across the two three-dimensional objects photographed by the camera and the projected image thus superimposed is displayed on the display, the projected image being divided into at least two portions across the two three-dimensional objects;
• transmit, when the projection execution input is received, information on the two portions of the projected image and information on projected positions to the server apparatus to cause the server apparatus to specify onto what initial positions of the two three-dimensional objects the two portions of the projected image are projected and register the information on the two portions of the projected image and information on the initial positions so as to be associated with information of the two three-dimensional objects;
• and
• acquire projected image information from the server apparatus in a case where the two three-dimensional objects onto which the two portions of the projected image are superimposed are photographed by the camera, the user terminal being configured to superimpose the two portions of the projected image on the two three-dimensional objects reflected on the display and display the two portions of the projected image thus superimposed, the two portions of the projected image being superimposed on the two three-dimensional objects at the initial positions in a case where a positional relation between the two three-dimensional objects changes.