# US 2019/0318504 A1 · Determination program, determination method, and information processing apparatus > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2019/0318504 A1 - Document ID: US20190318504A1 - Status: Published application - Kind: A1 - Application number: 16/364,148 - Filed: 2019-03-25 - Published: 2019-10-17 - Earliest claimed: 2018-04-12 - Assignees: Fujitsu Limited - Applicants: Fujitsu Limited - Inventors: Takuya Kozaki - Web page: https://patentgrep.com/patent/US20190318504A1 ## CPC - G06T 7/75: {involving models} - G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)} - G06T 7/73: using feature-based methods - G06T 15/20: Perspective computation - G06T 19/20: Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts - G06T 2207/20096: Interactive definition of curve of interest - G06T 2207/20101: Interactive definition of point of interest, landmark or seed - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL ## Abstract A computer acquires a captured image obtained by capturing an image of an object existing in a space and an image capturing position where the image was captured. Then, the computer determines a virtual-image capturing position, a virtually captured image, obtained when an image of a model generated based on structure data of the object is captured from the virtual-image capturing position, satisfying a specified correspondence relationship with the captured image having been obtained; and determines a position in the space with which the model is associated, based on the acquired image capturing position and positional relationship between the model and the virtual-image capturing position. ## Claims ### Claim 1 A non-transitory computer-readable recording medium having stored therein a determination program for causing a computer to execute a process comprising: acquiring a captured image obtained by capturing an image of an object existing in a space and an image capturing position where the image was captured; determining a virtual-image capturing position, a virtually captured image, obtained when an image of a model generated based on structure data of the object is captured from the virtual-image capturing position, satisfying a specified correspondence relationship with the captured image having been obtained; and determining a position in the space with which the model is associated, based on the acquired image capturing position and positional relationship between the model and the virtual-image capturing position. ### Claim 2 (depends on 1) The recording medium according to claim 1, wherein the specified correspondence relationship is positional relationship that makes degree of agreement satisfy a criterion, the degree of agreement being degree to which the virtually captured image viewed from the virtual-image capturing position and an image of the object included in the captured image obtained from the acquisition agree with each other. ### Claim 3 (depends on 1) The recording medium according to claim 1, wherein in the determining the position in the space with which the model is associated, the position of the model in the space is determined such that the positional relationship between the model and the virtual-image capturing position corresponds to positional relationship between the object and the image capturing position. ### Claim 4 (depends on 1) The recording medium according to claim 1, wherein the structure data is design data created in advance when the object is designed, and the model is a three-dimensional model based on the structure data. ### Claim 5 An information processing apparatus for determining a position of a model, the apparatus comprising: a memory, and a processor coupled to the memory and configured to: acquire a captured image obtained by capturing an image of an object existing in a space and an image capturing position where the image was captured; determine a virtual-image capturing position, a virtually captured image, obtained when an image of a model generated based on structure data of the object is captured from the virtual-image capturing position, satisfying a specified correspondence relationship with the captured image having been obtained; and determine a position in the space with which the model is associated, based on the acquired image capturing position and positional relationship between the model and the virtual-image capturing position. ### Claim 6 A determination method performed by a computer for determining a position of a model, the method comprising: acquiring a captured image obtained by capturing an image of an object existing in a space and an image capturing position where the image was captured; determining a virtual-image capturing position, a virtually captured image, obtained when an image of a model generated based on structure data of the object is captured from the virtual-image capturing position, satisfying a specified correspondence relationship with the captured image having been obtained; and determining a position in the space with which the model is associated, based on the acquired image capturing position and positional relationship between the model and the virtual-image capturing position. ### Claim 7 (depends on 1) The recording medium according to claim 1, the process further comprising: receiving a designation of a specific direction from which the model of the object to be displayed is viewed; determining, among parts included in the object, a first part hidden by another part when the object is viewed from the designated direction and a second part different from the first part, by referring to a storage that stores the structure data of the object; and displaying a region in the model corresponding to the determined first part at a first transparency rate and displaying a region in the model corresponding to the determined second part at a second transparency rate which is lower than the first transparency rate. ### Claim 8 (depends on 5) The information processing apparatus according to claim 5, the processor is further configured to: receive a designation of a specific direction from which the model of the object to be displayed is viewed; determine, among parts included in the object, a first part hidden by another part when the object is viewed from the designated direction and a second part different from the first part, by referring to a storage that stores the structure data of the object; and display a region in the model corresponding to the determined first part at a first transparency rate and displaying a region in the model corresponding to the determined second part at a second transparency rate which is lower than the first transparency rate. ### Claim 9 (depends on 6) The determination method according to claim 6 further comprising: receiving a designation of a specific direction from which the model of the object to be displayed is viewed; determining, among parts included in the object, a first part hidden by another part when the object is viewed from the designated direction and a second part different from the first part, by referring to a storage that stores the structure data of the object; and displaying a region in the model corresponding to the determined first part at a first transparency rate and displaying a region in the model corresponding to the determined second part at a second transparency rate which is lower than the first transparency rate.