Mixed reality space sharing system, sharing information management server, mixed reality terminal, mixed reality space sharing method, and sharing information management program

A shared information management server comprising:

• a memory configured to store a program;
• and
• a processor configured to execute the program so as to:
• create a room by associating 3D information regarding a real space and anchor information for anchoring virtual information and the 3D information;
• manage the 3D information, the 3D information and the anchor information being used by a plurality of mixed reality terminals, each of the plurality of mixed reality terminals creating a mixed reality space in which the virtual information is mapped onto the 3D information based on the 3D information and the anchor information to visualize the mixed reality space wherein the 3D information is acquired by repeatedly sensing a 3D object in the real space via a first 3D sensor of a first terminal of the plurality of mixed reality terminals and includes points and surfaces disposed at the 3D object in the real space, the points disposed at the 3D object including vertexes of the 3D object, each of the surfaces disposed at the 3D object being surrounded by linear lines disposed at the 3D object, the surfaces being generated by connecting between adjacent points of the points by the linear lines;
• transmit the 3D information and the anchor information to a second terminal of the plurality of mixed reality terminals, the second terminal being different from the first terminal;
• receive first updated information of only a portion with a significant change of the 3D information corresponding to a part of the 3D object, the first updated information being transmitted from the first terminal when a difference value between a first number of the points and the surfaces of the 3D information acquired by the first 3D sensor at a first time that is a later time than a second time and a second number of the points and the surfaces of immediately previously acquired 3D information acquired by the first 3D sensor at the second time via the first terminal is a first threshold or more;
• and
• update the 3D information with the first updated information transmitted from the first terminal.

A mixed reality space sharing method to be used in a mixed reality space sharing system including:

• a plurality of mixed reality terminals, each of the plurality of mixed reality terminals creating a mixed reality space in which virtual information is mapped onto 3D information regarding a real space based on the 3D information and anchor information for anchoring between the virtual information and the 3D information to visualize the mixed reality space;
• and a shared information management server to which the plurality of mixed reality terminals are connected, the mixed reality space sharing method for causing a processor to execute a program stored in a memory, the mixed reality space sharing method comprising executing on the processor the steps of:
• repeatedly acquiring the 3D information by sensing a 3D object in the real space via a first 3D sensor of a first terminal of the plurality of mixed reality terminals, the 3D information including points and surfaces disposed at the 3D object in the real space, the points disposed at the 3D object including vertexes of the 3D object, each of the surfaces disposed at the 3D object being surrounded by linear lines disposed at the 3D object, the surfaces being generated by connecting between adjacent points of the points by the linear lines;
• generating the anchor information to anchor between the 3D information and the virtual information;
• uploading the 3D information and the anchor information to the shared information management server;
• creating a room by associating the 3D information and the anchor information uploaded from the first terminal with each other, and managing 3D information, in the shared information management server;
• transmitting the 3D information and the anchor information from the shared information management server to a second terminal of the plurality of mixed reality terminals, the second terminal being different from the first terminal, in accordance with a request from the second terminal;
• downloading the 3D information and the anchor information that are transmitted from the shared information management server, and creating the mixed reality space using the downloaded 3D information and anchor information, in the second terminal;
• periodically comparing the 3D information acquired by the first 3D sensor at a first time that is a later time than a second time with immediately previously acquired 3D information acquired by the first 3D sensor at the second time with respect to a first number of the points and the surfaces in the 3D information and a second number of the points and the surfaces of the immediately previously acquired 3D information via the first terminal;
• transmitting, as first updated information, 3D information of only a portion with a significant change corresponding to a part of the 3D object from the first terminal to the shared information management server when a difference value between the first number and the second number is a first threshold or more;
• and
• updating the 3D information with the first updated information transmitted from the first terminal via the shared information management server.