# US 12,217,370 B2 · Information processing apparatus and information processing > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,217,370 B2 - Document ID: US12217370B2 - Status: Granted - Kind: B2 - Application number: 17/755,722 - Filed: 2020-11-10 - Published: 2022-12-08 - Granted: 2025-02-04 - Earliest claimed: 2019-11-15 - Assignees: Sony Group Corporation - Applicants: Sony Group Corporation - Inventors: Tomu Tahara; Tomoya Ishikawa; Gaku Narita; Takashi Seno - Web page: https://patentgrep.com/patent/US12217370B2 ## CPC - G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)} - G06F 18/22: Matching criteria, e.g. proximity measures - G06F 18/2413: based on distances to training or reference patterns - G06T 19/20: Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts - G06V 20/20: in augmented reality scenes - G06T 2219/2004: Aligning objects, relative positioning of parts - G06T 2219/2021: Shape modification - G06T 2219/2024: Style variation - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING ## Abstract A template AR content can be favorably used in an application scene different from the scene at the time of creation. An environment map of an augmented reality application scene is generated. An abstract representation of the augmented reality application scene is generated on the basis of the environment map of the augmented reality scene. The abstract representation of the augmented reality application scene is compared with an abstract representation of a template augmented reality generated on the basis of a template augmented reality environment map, and template augmented reality content is mapped to the augmented reality application scene on the basis of a result of the comparison. Thus, augmented reality content for display is generated. For example, the abstract representation of the augmented reality application scene or the abstract representation of the template augmented reality can be edited. ## Claims ### Claim 1 An information processing apparatus, comprising: at least one processor configured to: generate an environment map of an augmented reality application scene; generate a first abstract representation of the augmented reality application scene based on the environment map of the augmented reality application scene; and generate augmented reality content based on: comparison of first relationships between a first plurality of nodes of the first abstract representation of the augmented reality application scene with second relationships between a second plurality of nodes of a second abstract representation of a template augmented reality, wherein the second abstract representation is generated based on a template augmented reality environment map, and template augmented reality content that is mapped to the augmented reality application scene based on a result of the comparison. ### Claim 2 (depends on 1) The information processing apparatus according to claim 1, wherein each of the first abstract representation and the second abstract representation includes a graph structure. ### Claim 3 (depends on 1) The information processing apparatus according to claim 1, wherein the at least one processor is further configured to edit the first abstract representation of the augmented reality application scene or the second abstract representation of the template augmented reality. ### Claim 4 (depends on 3) The information processing apparatus according to claim 3, wherein the at least one processor is further configured to: control display of the first abstract representation of the augmented reality application scene and the second abstract representation of the template augmented reality side by side; and receive an operation related to a change to the displayed first abstract representation of the augmented reality application scene or the displayed second abstract representation of the template augmented reality. ### Claim 5 (depends on 4) The information processing apparatus according to claim 4, wherein the at least one processor is further configured to: determine whether a plurality of partially isomorphic portions corresponding to the second abstract representation of the template augmented reality exists in the first abstract representation of the augmented reality application scene; and present the plurality of partially isomorphic portions such that the plurality of partially isomorphic portions is user recognizable. ### Claim 6 (depends on 3) The information processing apparatus according to claim 3, wherein based on the edit of the first abstract representation of the augmented reality application scene or the second abstract representation of the template augmented reality, the at least one processor is further configured to compare the first relationships of the first abstract representation of the augmented reality application scene with the second relationships of the second abstract representation of the template augmented reality. ### Claim 7 (depends on 3) The information processing apparatus according to claim 3, wherein the at least one processor is further configured to automatically edit the first abstract representation of the augmented reality application scene based on information regarding the edit of the augmented reality application scene. ### Claim 8 An information processing apparatus, comprising: at least one processor configured to: generate an environment map of an augmented reality application scene; generate a first abstract representation of the augmented reality application scene based on the environment map of the augmented reality application scene; generate augmented reality content based on: comparison of the first abstract representation of the augmented reality application scene with a second abstract representation of a template augmented reality, wherein the second abstract representation is generated based on a template augmented reality environment map, and template augmented reality content that is mapped to the augmented reality application scene based on a result of the comparison; and edit the first abstract representation of the augmented reality application scene or the second abstract representation of the template augmented reality, wherein each of the first abstract representation and the second abstract representation includes a graph structure, and the edit of the first abstract representation or the second abstract representation includes an operation to change a relationship between nodes of the graph structure or an operation to change an attribute of a node of the nodes. ### Claim 9 An information processing method, comprising: in an information processing apparatus: generating an environment map of an augmented reality application scene; generating a first abstract representation of the augmented reality application scene based on the environment map of the augmented reality application scene; and generating augmented reality content based on: comparison of first relationships between a first plurality of nodes of the first abstract representation of the augmented reality application scene with second relationships between a second plurality of nodes of a second abstract representation of a template augmented reality, wherein the second abstract representation is generated based on a template augmented reality environment map, and mapping of template augmented reality content to the augmented reality application scene based on a result of the comparison. ### Claim 10 A non-transitory computer-readable medium having stored thereon, computer-executable instructions which, when executed by an information processing apparatus, cause the information processing apparatus to execute operations, the operations comprising: generating an environment map of an augmented reality application scene; generating a first abstract representation of the augmented reality application scene based on the environment map of the augmented reality application scene; and generating augmented reality content for display based on: comparison of first relationships between a first plurality of nodes of the first abstract representation of the augmented reality application scene with second relationships between a second plurality of nodes of a second abstract representation of a template augmented reality, wherein the second abstract representation is generated based on a template augmented reality environment map, and mapping of template augmented reality content to the augmented reality application scene based on a result of the comparison.