# US 12,118,137 B2 · Boundary setting device, boundary setting method, and program > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,118,137 B2 - Document ID: US12118137B2 - Status: Granted - Kind: B2 - Application number: 17/436,839 - Filed: 2020-03-27 - Published: 2022-06-09 - Granted: 2024-10-15 - Earliest claimed: 2019-03-29 - Assignees: Sony Interactive Entertainment Inc. - Applicants: Sony Interactive Entertainment Inc. - Inventors: Yuto Hayakawa - Web page: https://patentgrep.com/patent/US12118137B2 ## CPC - G06F 3/012: {Head tracking input arrangements} - G06T 19/20: Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts - G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)} - G06F 3/147: using display panels - G06T 7/60: Analysis of geometric attributes - G06T 7/73: using feature-based methods - G06T 11/00: Two-dimensional [2D] image generation - G06V 20/20: in augmented reality scenes - G09G 5/377: for mixing or overlaying two or more graphic patterns (G09G5/02, G09G5/397 take precedence) - G06T 2207/30241: Trajectory - G06T 2219/012: Dimensioning, tolerancing - G06T 2219/2021: Shape modification - G09G 2354/00: Aspects of interface with display user - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00) ## Abstract A boundary surface setting section sets the boundary surface for delimiting a permissible region that is the region which is located inside the real space and in which the user wearing a head-mounted display is permitted to exist and an impermissible region that is the region which is located inside the real space and in which the user is not permitted to exist. A display control section causes a portion or a whole of a virtual object representing the boundary surface to be displayed on the head-mounted display. The boundary surface includes a first boundary line having a first height and a second boundary line having a second height, and a portion or all of the first boundary line is different from the second boundary line. ## Claims ### Claim 1 A boundary setting device comprising: a boundary surface setting section that sets a boundary surface for delimiting a permissible region that is a region which is located inside a real space and in which a user wearing a head-mounted display is permitted to exist and an impermissible region that is a region which is located inside the real space and in which the user is not permitted to exist; and a display control section that causes a portion or a whole of a virtual object representing the boundary surface to be displayed on the head-mounted display, wherein the boundary surface includes a first boundary line having a first height and a second boundary line having a second height, and a portion or all of the first boundary line is different from the second boundary line, wherein: according to an operation of setting the first boundary line and the second boundary line, the boundary surface setting section sets the boundary surface including the first boundary line and the second boundary line, and according to the operation of setting the first boundary line and the second boundary line, the boundary surface setting section sets the boundary surface that, for a height lower than the first height, includes a boundary line obtained by parallel-shifting of the first boundary line and that, for a height higher than the second height, includes a boundary line obtained by parallel-shifting of the second boundary line. ### Claim 2 (depends on 1) The boundary setting device according to claim 1, wherein the boundary surface setting section sets the boundary surface including the first boundary line and the second boundary line that are set on a basis of a trajectory of a sensor that the user moves inside the real space. ### Claim 3 (depends on 1) The boundary setting device according to claim 1, wherein, according to an operation by the user for setting a point located inside the real space, the boundary surface setting section sets the boundary surface that is a spherical surface having a center on the point. ### Claim 4 (depends on 3) The boundary setting device according to claim 3, wherein, according to an operation of further setting a length, the boundary surface setting section sets the boundary surface that is a spherical surface having a center on the point and having a radius according to the length. ### Claim 5 (depends on 1) The boundary setting device according to claim 1, wherein the boundary surface setting section sets the boundary surface circumscribing a trajectory of a sensor that the user moves inside the real space. ### Claim 6 (depends on 1) The boundary setting device according to claim 1, wherein the boundary surface setting section sets the boundary surface for delimiting a region that is a field-of-view range of a camera arranged in the real space and a region that is not the field-of-view range. ### Claim 7 (depends on 1) The boundary setting device according to claim 1, wherein the boundary surface setting section specifies an object arranged inside the real space, on a basis of a result of image recognition processing on an image shot by a camera arranged in the real space, and sets the boundary surface such that a region occupied by the object is included in the impermissible region. ### Claim 8 (depends on 1) The boundary setting device according to claim 1, wherein, according to an operation by the user for setting a region located more inside than the boundary surface, the boundary surface setting section changes the boundary surface such that the region is included in the impermissible region. ### Claim 9 (depends on 1) The boundary setting device according to claim 1, wherein, according to an operation by the user for setting a region located more outside than the boundary surface, the boundary surface setting section changes the boundary surface such that the region is included in the permissible region. ### Claim 10 A boundary setting method comprising: setting a boundary surface for delimiting a permissible region that is a region which is located inside a real space and in which a user wearing a head-mounted display is permitted to exist and an impermissible region that is a region which is located inside the real space and in which the user is not permitted to exist; and causing a portion or a whole of a virtual object representing the boundary surface to be displayed on the head-mounted display, wherein the boundary surface includes a first boundary line having a first height and a second boundary line having a second height, and a portion or all of the first boundary line is different from the second boundary line, wherein: according to an operation of setting the first boundary line and the second boundary line, the setting includes setting the boundary surface including the first boundary line and the second boundary line, and according to the operation of setting the first boundary line and the second boundary line, the setting includes setting the boundary surface that, for a height lower than the first height, includes a boundary line obtained by parallel-shifting of the first boundary line and that, for a height higher than the second height, includes a boundary line obtained by parallel-shifting of the second boundary line. ### Claim 11 A non-transitory, computer readable storage medium containing a computer program, which when executed by a computer, causes the computer to perform a boundary setting method by carrying out actions, comprising: setting a boundary surface for delimiting a permissible region that is a region which is located inside a real space and in which a user wearing a head-mounted display is permitted to exist and an impermissible region that is a region which is located inside the real space and in which the user is not permitted to exist; and causing a portion or a whole of a virtual object representing the boundary surface to be displayed on the head-mounted display, wherein the boundary surface includes a first boundary line having a first height and a second boundary line having a second height, and a portion or all of the first boundary line is different from the second boundary line, wherein: according to an operation of setting the first boundary line and the second boundary line, the setting includes setting the boundary surface including the first boundary line and the second boundary line, and according to the operation of setting the first boundary line and the second boundary line, the setting includes setting the boundary surface that, for a height lower than the first height, includes a boundary line obtained by parallel-shifting of the first boundary line and that, for a height higher than the second height, includes a boundary line obtained by parallel-shifting of the second boundary line.