# US 10,768,711 B2 · Mediated reality > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,768,711 B2 - Document ID: US10768711B2 - Status: Granted - Kind: B2 - Application number: 15/579,403 - Filed: 2016-05-26 - Published: 2018-05-24 - Granted: 2020-09-08 - Earliest claimed: 2015-06-04 - Assignees: Nokia Technologies Oy - Applicants: Nokia Technologies Oy - Inventors: Jussi Leppänen; Antti Eronen; Arto Lehtiniemi - Web page: https://patentgrep.com/patent/US10768711B2 ## CPC - G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)} - G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)} - G06F 3/0346: with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors - G06T 19/20: Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL ## Abstract A method comprising: enabling viewing by a user of a virtual scene of a virtual space; mapping a three-dimensional gesture of the user to a corresponding three-dimensional gesture in the virtual space; and in response to determining that the corresponding three-dimensional gesture in a virtual space is a first predetermined gesture or predetermined gestures in relation to a first portion of the virtual space, analyzing the virtual space over time to detect an event in the virtual space relating to the first portion of the virtual space. ## Claims ### Claim 1 A method comprising: displaying to a user a virtual scene of a virtual space; mapping a three-dimensional gesture of the user to a corresponding three-dimensional gesture in the virtual space; and in response to determining that the corresponding three-dimensional gesture in the virtual space is a first predetermined gesture or predetermined gestures in relation to a first portion of the virtual space, analyzing the virtual space over time to detect an event in the virtual space relating to the first portion of the virtual space, where the detected event comprises an arrival of an object at the first portion of the virtual space, where a three-dimensional position of the first portion comprises an allowable position relative to at least one of: one or more predetermined positions in the virtual space, or one or more virtual objects in the virtual space, where the virtual space further comprises non-allowable positions for the first portion. ### Claim 2 (depends on 1) A method as claimed in claim 1, wherein the first portion of the virtual space is specified through the user using first three-dimensional gestures. ### Claim 3 (depends on 1) A method as claimed in claim 1, wherein the first portion of the virtual space defines a boundary; and further comprising mapping one or more first three-dimensional gestures of the user to one or more corresponding first three-dimensional gestures in the virtual space and defining at least one dimension of the boundary in response to the one or more first three-dimensional gestures. ### Claim 4 (depends on 1) A method as claimed in claim 1, comprising mapping one or more first three-dimensional gestures of the user to one or more corresponding first three-dimensional gestures in the virtual space to define a change in position and/or orientation of the first portion of the virtual space, wherein the mapping of the three-dimensional gesture of the user to the corresponding three-dimensional gesture in the virtual space is dependent upon a field of view used to define the virtual scene of the virtual space. ### Claim 5 (depends on 1) A method as claimed in claim 1, wherein the first portion of the virtual space is defined automatically in relation to one or more virtual objects. ### Claim 6 (depends on 1) A method as claimed in claim 1, further comprising generating a response in response to the detected event, wherein the response is a real time alert for the user. ### Claim 7 (depends on 1) A method as claimed in claim 1, further comprising generating a response to the detected event, the response comprising logging information. ### Claim 8 (depends on 1) A method as claimed in claim 1, wherein the object comprises a moving virtual object in the virtual space. ### Claim 9 (depends on 1) A method as claimed in claim 1, wherein the first portion of the virtual space is a boundary and the detected event is a crossing event wherein the object comprises a moving virtual object that crosses the boundary. ### Claim 10 An apparatus comprising at least one processor and at least one non-transitory memory, the non-transitory memory comprising machine-readable instructions, that when executed cause the apparatus to: display to a user a virtual scene of a virtual space; map a three-dimensional gesture of the user to a corresponding three-dimensional gesture in the virtual space; and in response to determining that the corresponding three-dimensional gesture in the virtual space is a first predetermined gesture or predetermined gestures in relation to a first portion of the virtual space, analyze the virtual space over time to detect an event in the virtual space relating to the first portion of the virtual space, where the detected event comprises an arrival of an object at the first portion of the virtual space, where a three-dimensional position of the first portion comprises an allowable position relative to at least one of: one or more predetermined positions in the virtual space, or one or more virtual objects in the virtual space, where the virtual space further comprises non-allowable positions for the first portion. ### Claim 11 (depends on 10) An apparatus as claimed in claim 10, wherein the first portion of the virtual space is specified through the user using first three-dimensional gestures. ### Claim 12 (depends on 10) An apparatus as claimed in claim 10, wherein the first portion of the virtual space defines a boundary; and wherein the apparatus is further caused to map one or more first three-dimensional gestures of the user to one or more corresponding first three-dimensional gestures in the virtual space and defining at least one dimension of the boundary in response to the one or more first three-dimensional gestures. ### Claim 13 (depends on 10) An apparatus as claimed in claim 10, further caused to map one or more first three-dimensional gestures of the user to one or more corresponding first three-dimensional gestures in the virtual space to define a change in position and/or orientation of the first portion of the virtual space, wherein the mapping of the three-dimensional gesture of the user to the corresponding three-dimensional gesture in the virtual space is dependent upon a field of view used to define the virtual scene of the virtual space. ### Claim 14 (depends on 10) An apparatus as claimed in claim 10, wherein the first portion is displayed in the virtual scene with at least one indicator for positioning. ### Claim 15 (depends on 10) An apparatus as claimed in claim 10, wherein the first portion of the virtual space is defined automatically in relation to one or more virtual objects. ### Claim 16 (depends on 10) An apparatus as claimed in claim 10, further caused to generate a response in response to the detected event, wherein the response is a real time alert for the user. ### Claim 17 (depends on 16) An apparatus as claimed in claim 16, wherein the response to the detected event is specified through the user. ### Claim 18 (depends on 10) An apparatus as claimed in claim 10, further caused to generate a response to the detected event, the response comprising logging information. ### Claim 19 (depends on 10) An apparatus as claimed in claim 10, wherein the object comprises a moving virtual object in the virtual space. ### Claim 20 (depends on 10) An apparatus as claimed in claim 10, wherein the first portion of the virtual space is a boundary and the detected event is a crossing event wherein the object comprises a moving virtual object that crosses the boundary.