# US 12,437,495 B1 · Content item display method and computer-readable medium > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,437,495 B1 - Document ID: US12437495B1 - Status: Granted - Kind: B1 - Application number: 19/229,322 - Filed: 2025-06-05 - Published: 2025-09-25 - Granted: 2025-10-07 - Earliest claimed: 2022-12-06 - Assignees: CELSYS, Inc. - Applicants: CELSYS, Inc. - Inventors: Yosuke Kawakami; Taiki Maruya; Takeshi Sasame - Web page: https://patentgrep.com/patent/US12437495B1 ## CPC - G06T 19/20: Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts - G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object - G06F 3/0484: for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range - G06F 3/14: Digital output to display device {; Cooperation and interconnection of the display device with other functional units} - G06T 1/00: General purpose image data processing - G06T 19/00: Manipulating three-dimensional [3D] models or images for computer graphics - G06T 2219/2004: Aligning objects, relative positioning of parts - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract Method for instructing display device to express relationship between content pieces and folders, using a virtual space and virtual camera, including: when first, second, and third objects have a hierarchical relationship between parent, child, and grandchild, arranging such objects in virtual space with a first face of the first object being adjacent to part of a second face of the second object, and part of a third face of the second object is adjacent to part of a face of the third object; when the first and fourth objects have a hierarchical relationship between parent and a child, arranging such objects in virtual space with part of the first face of the first object being adjacent to part of a face of the fourth object; instructing display device to display image of the virtual space captured by the virtual camera using an instruction of the user to the virtual camera. ## Claims ### Claim 1 A content display method for instructing a display device to express a hierarchical relationship between a plurality of content pieces and a plurality of folders, for which prepared are a virtual space in which arranged are the plurality of content pieces that may have a hierarchical relationship with each other and are possessed by a user and a plurality of objects representing each of the plurality of folders that may have the content pieces at a lower level in the hierarchical relationship, and a virtual camera that captures and generates an image of the virtual space, the method comprising: when a first object, a second object, and a third object have a hierarchical relationship between a parent, a child, and a grandchild, arranging the first object, the second object, and the third object in the virtual space so that a part of a first face of the first object is adjacent to a part of a second face of the second object, and a part of a third face of the second object is adjacent to a part of a face of the third object; when the first object and a fourth object have a hierarchical relationship between a parent and a child, arranging the first object and the fourth object in the virtual space so that a part of the first face of the first object is adjacent to a part of a face of the fourth object; instructing the display device to display the image of the virtual space captured by the virtual camera according to an instruction of the user to the virtual camera; and when a first adjacency in which a part of the face of the second object is adjacent to a part of the first face of the first object has already been achieved, and a second adjacency in which a part of the face of the fourth object is further adjacent to a part of the first face is to be achieved, if the second adjacency cannot be achieved because the first face does not have enough area, transforming the first object so that the second adjacency can be achieved by enlarging the first face. ### Claim 2 (depends on 1) The content display method according to claim 1, wherein the face is either a plane of a solid that approximates an inner shape of the object or a plane of a solid that approximates an outer shape of the object, or both. ### Claim 3 (depends on 1) The content display method according to claim 1, further comprising: if there is a predetermined object and an object subordinate to the predetermined object among the plurality of objects, determining respective positions of the plurality of objects in the virtual space so that, upon instruction of an operator to move the predetermined object in the virtual space, the predetermined object and the object subordinate thereto move in the virtual space while maintaining their mutual adjacency. ### Claim 4 (depends on 1) The content display method according to claim 1 wherein when the plurality of content pieces include a content piece A and a content piece B, a hierarchical relationship is permitted in which the parent content piece A has the child content piece B, and there is no folder between the content piece A and the content piece B. ### Claim 5 (depends on 1) The content display method according to claim 1, further comprising: when a mutual adjacency relationship between the plurality of objects is changed according to an instruction of the user regarding the movement of the positions of the plurality of objects in the virtual space, changing the hierarchical relationship in response to the change. ### Claim 6 (depends on 1) The content display method according to claim 1, further comprising: applying a visual effect to a portion of the image showing a content piece selected by the user from among the plurality of content pieces, the portion corresponding to the selected content piece. ### Claim 7 (depends on 1) A non-transitory computer-readable medium storing a program for causing a computer to execute the method according to claim 1. ### Claim 8 A content display method for instructing a display device to express a hierarchical relationship between a plurality of content pieces and a plurality of folders, for which prepared are a virtual space in which arranged are the plurality of content pieces that may have a hierarchical relationship with each other and are possessed by a user and a plurality of objects representing each of the plurality of folders that may have the content pieces at a lower level in the hierarchical relationship, and a virtual camera that captures and generates an image of the virtual space, the method comprising: when a first object, a second object, and a third object have a hierarchical relationship between a parent, a child, and a grandchild, arranging the first object, the second object, and the third object in the virtual space so that a part of a first face of the first object is adjacent to a part of a second face of the second object, and a part of a third face of the second object is adjacent to a part of a face of the third object; when the first object and a fourth object have a hierarchical relationship between a parent and a child, arranging the first object and the fourth object in the virtual space so that a part of the first face of the first object is adjacent to a part of a face of the fourth object; instructing the display device to display the image of the virtual space captured by the virtual camera according to an instruction of the user to the virtual camera; and when a first adjacency in which a part of the face of the second object is adjacent to a part of the first face of the first object has already been achieved, and a second adjacency in which a part of the face of the fourth object is further adjacent to a part of the first face is to be achieved, if the second adjacency cannot be achieved because the first face does not have enough area, transforming the second object and/or the fourth object so that the second adjacency can be achieved by reducing the face of the second object and/or the face of the fourth object. ### Claim 9 (depends on 8) The content display method according to claim 8, wherein the face is either a plane of a solid that approximates an inner shape of the object or a plane of a solid that approximates an outer shape of the object, or both. ### Claim 10 (depends on 8) The content display method according to claim 8, further comprising: if there is a predetermined object and an object subordinate to the predetermined object among the plurality of objects, determining respective positions of the plurality of objects in the virtual space so that, upon instruction of an operator to move the predetermined object in the virtual space, the predetermined object and the object subordinate thereto move in the virtual space while maintaining their mutual adjacency. ### Claim 11 (depends on 8) The content display method according to claim 8 wherein when the plurality of content pieces include a content piece A and a content piece B, a hierarchical relationship is permitted in which the parent content piece A has the child content piece B, and there is no folder between the content piece A and the content piece B. ### Claim 12 A content display method for instructing a display device to express a hierarchical relationship between a plurality of content pieces and a plurality of folders, for which prepared are a virtual space in which arranged are the plurality of content pieces that may have a hierarchical relationship with each other and are possessed by a user and a plurality of objects representing each of the plurality of folders that may have the content pieces at a lower level in the hierarchical relationship, and a virtual camera that captures and generates an image of the virtual space, the method comprising: when a first object, a second object, and a third object have a hierarchical relationship between a parent, a child, and a grandchild, arranging the first object, the second object, and the third object in the virtual space so that a part of a first face of the first object is adjacent to a part of a second face of the second object, and a part of a third face of the second object is adjacent to a part of a face of the third object; when the first object and a fourth object have a hierarchical relationship between a parent and a child, arranging the first object and the fourth object in the virtual space so that a part of the first face of the first object is adjacent to a part of a face of the fourth object; instructing the display device to display the image of the virtual space captured by the virtual camera according to an instruction of the user to the virtual camera; saving a predetermined hierarchical relationship, which is the hierarchical relationship at a predetermined point in time, in a storage device; and upon instructions of an operator to edit an object A and to change the hierarchical relationship after the predetermined point in time, restoring the hierarchical relationship to the saved predetermined hierarchical relationship while keeping the object A edited. ### Claim 13 (depends on 12) The content display method according to claim 12, wherein the face is either a plane of a solid that approximates an inner shape of the object or a plane of a solid that approximates an outer shape of the object, or both. ### Claim 14 (depends on 12) The content display method according to claim 12, further comprising: if there is a predetermined object and an object subordinate to the predetermined object among the plurality of objects, determining respective positions of the plurality of objects in the virtual space so that, upon instruction of an operator to move the predetermined object in the virtual space, the predetermined object and the object subordinate thereto move in the virtual space while maintaining their mutual adjacency. ### Claim 15 (depends on 12) The content display method according to claim 12 wherein when the plurality of content pieces include a content piece A and a content piece B, a hierarchical relationship is permitted in which the parent content piece A has the child content piece B, and there is no folder between the content piece A and the content piece B. ### Claim 16 A content display method for instructing a display device to express a hierarchical relationship between a plurality of content pieces and a plurality of folders, for which prepared are a virtual space in which arranged are the plurality of content pieces that may have a hierarchical relationship with each other and are possessed by a user and a plurality of objects representing each of the plurality of folders that may have the content pieces at a lower level in the hierarchical relationship, and a virtual camera that captures and generates an image of the virtual space, the method comprising: when a first object, a second object, and a third object have a hierarchical relationship between a parent, a child, and a grandchild, arranging the first object, the second object, and the third object in the virtual space so that a part of a first face of the first object is adjacent to a part of a second face of the second object, and a part of a third face of the second object is adjacent to a part of a face of the third object; when the first object and a fourth object have a hierarchical relationship between a parent and a child, arranging the first object and the fourth object in the virtual space so that a part of the first face of the first object is adjacent to a part of a face of the fourth object; and instructing the display device to display the image of the virtual space captured by the virtual camera according to an instruction of the user to the virtual camera, wherein when one object and the other object have a parent-child relationship, a plurality of combination rules are predetermined for a predetermined face X of the one object and a predetermined face Y of the other object when the predetermined face X and the predetermined face Y are adjacent to each other, so that a part of the face X is adjacent to a part of the face Y, and one of the plurality of combination rules is selected depending on whether the one object and the other object are adjacent one above the other or one behind the other. ### Claim 17 (depends on 16) The content display method according to claim 16, wherein, in any of the plurality of combination rules, if there are a plurality of the predetermined faces X or the predetermined faces Y, a part of one of the plurality of predetermined faces X or a part of one of the plurality of predetermined faces Y is specified according to an instruction of the user. ### Claim 18 (depends on 16) The content display method according to claim 16, wherein the face is either a plane of a solid that approximates an inner shape of the object or a plane of a solid that approximates an outer shape of the object, or both. ### Claim 19 (depends on 16) The content display method according to claim 16, further comprising: if there is a predetermined object and an object subordinate to the predetermined object among the plurality of objects, determining respective positions of the plurality of objects in the virtual space so that, upon instruction of an operator to move the predetermined object in the virtual space, the predetermined object and the object subordinate thereto move in the virtual space while maintaining their mutual adjacency. ### Claim 20 (depends on 16) The content display method according to claim 16 wherein when the plurality of content pieces include a content piece A and a content piece B, a hierarchical relationship is permitted in which the parent content piece A has the child content piece B, and there is no folder between the content piece A and the content piece B.