Back to results
US 10,832,480 B2Granted
Apparatuses, methods and systems for application of forces within a 3D virtual environment
AssigneeMeta View, Inc.
InventorsRaymond Chun Hing Lo, Yishai Gribetz
Life of this patent
Estimating the term…
Abstract
Aspects of the disclosed apparatuses, methods and systems provide manipulation of a virtual world three dimensional (3D) space based on input translated from the real world. Elements in the virtual world may have an associated charge and field. An element in the virtual world becomes interactive with an element translated from the real world when the translated real world element interacts with a field associated with the virtual element according to the charges. Forces may be applied to the virtual element using a real world physics model to determine a response by the virtual element to the applied force.
Claims27
A virtual or augmented reality display system that facilitates interaction between a user of the display system and a virtual element presented by the display system, the display system comprising:
- one or more sensor interfaces;
- one or more displays;
- one or more storage devices storing instructions;
- one or more processing devices configured to:
- receive sensor inputs from the one or more sensor interfaces that correspond to a location of a real-world object;
- render an image associated with the virtual element;
- cause the one or more displays to project light forming the rendered image of the virtual element;
- access the instructions from the one or more storage devices and execute the instructions, the instructions configured to cause the one or more processing devices to:
- determine properties of the virtual element including a core, a constraint parameter, and an interactive field of the virtual element;
- determine coordinates in a virtual three-dimensional (3D) space corresponding to a location of the core and a location of the interactive field of the virtual element within the virtual 3D space;
- translate the sensor inputs corresponding to real-world coordinates of the location of the real-world object into virtual coordinates corresponding to locations of the sensor inputs in the virtual 3D space;
- determine whether the locations of any of the sensor inputs are within a volume demarcated by the virtual coordinates corresponding to the interactive field;
- determine a shortest distance from the location of each sensor input within the volume to the location of the core;
- determine a force vector along each distance;
- apply the force vectors to the virtual element;
- render the one or more images of the virtual element in response to the applied force vectors;
- determine coordinates in the 3D virtual space of a new location of the core and the interactive field in response to the applied force vectors;
- and
- cause the one or more displays to project light corresponding to the rendered images of the virtual element that is perceived by the user as his or her interaction with the virtual element,
- wherein the virtual element is part of a virtual sliding user interface controlling a process associated with or implemented by the display system;
- and rendering the one or more images of the virtual element in response to the applied force vectors cause the light projected by the one or more displays to be perceived as movement of the virtual element within in a 3D field of view of the user to manipulate the virtual sliding user interface, where the constraint parameter limits movement in the virtual 3D space along a line segment and a location of the virtual element on the line segment corresponds to an input of the virtual sliding user interface.
18 more elements
A virtual or augmented reality display system that facilitates interaction between a user of the display system and a virtual element presented by the display system, the display system comprising:
- one or more sensor interfaces;
- one or more displays;
- one or more storage devices storing instructions;
- one or more processing devices configured to:
- receive sensor inputs from the one or more sensor interfaces that correspond to a location of a real-world object, render an image associated with the virtual element cause the one or more displays to project light forming the rendered image of the virtual element access the instructions from the one or more storage devices and execute the instructions, the instructions configured to cause the one or more processing devices to:
- determine properties of the virtual element including a core and an interactive field of the virtual element;
- determine coordinates in a virtual three-dimensional (3D) space corresponding to a location of the core and a location of the interactive field of the virtual element within the virtual 3D space;
- determine properties of the virtual element including another interactive field of the virtual element;
- determine coordinates in the virtual three-dimensional (3D) space corresponding to a location of the another interactive field of the virtual element within the virtual 3D space;
- translate the sensor inputs corresponding to real-world coordinates of the location of the real-world object into virtual coordinates corresponding to locations of the sensor inputs in the virtual 3D space;
- determine whether the locations of any of the sensor inputs are outside of a volume demarcated by the another interactive field and within the volume demarcated by the virtual coordinates corresponding to the interactive field;
- determine a shortest distance to the core from the location of each sensor input outside of the volume demarcated by the another interactive field and within the volume demarcated by the interactive field,
- determine a force vector along each distance of each sensor input outside of the volume demarcated by the another interactive field and within the volume demarcated by the interactive field;
- apply the force vectors to the virtual element;
- render the one or more images of the virtual element in response to the applied force vectors;
- and
- cause the one or more displays to project light corresponding to the rendered images of the virtual element that is perceived by the user as his or her interaction with the virtual element.
14 more elements
A method facilitating interaction between a user of virtual or augmented reality display system and a virtual element presented by the display system, the method comprising:
- determining properties of the virtual element including a core, a constraint parameter, and an interactive field of the virtual element;
- determining coordinates in a virtual three-dimensional (3D) space corresponding to a location of the core and a location of the interactive field of the virtual element within the virtual 3D space;
- translating the sensor inputs corresponding to real-world coordinates of the location of the real-world object into virtual coordinates corresponding to locations of the sensor inputs in the virtual 3D space;
- determining whether the locations of any of the sensor inputs are within a volume demarcated by the virtual coordinates corresponding to the interactive field;
- determining a shortest distance from the location of each sensor input within the volume to the location of the core;
- determining a force vector along each distance;
- applying the force vectors to the virtual element;
- rendering the one or more images of the virtual element in response to the applied force vectors;
- determining coordinates in the 3D virtual space of a new location of the core and the interactive field in response to the applied force vectors;
- and
- causing one or more displays to project light corresponding to the rendered images of the virtual element that is perceived by the user as his or her interaction with the virtual element
- wherein the virtual element is part of a virtual sliding user interface controlling a process associated with or implemented by the display system;
- and rendering the one or more images of the virtual element in response to the applied force vectors cause the light projected by the one or more displays to be perceived as movement of the virtual element within in a 3D field of view of the user to manipulate the virtual sliding user interface, where the constraint parameter limits movement in the virtual 3D space along a line segment and a location of the virtual element on the line segment corresponds to an input of the virtual sliding user interface.
10 more elements
A method facilitating interaction between a user of virtual or augmented reality display system and a virtual element presented by the display system, the method comprising:
- determining properties of the virtual element including a core and an interactive field of the virtual element;
- determining coordinates in a virtual three-dimensional (3D) space corresponding to a location of the core and a location of the interactive field of the virtual element within the virtual 3D space;
- determining properties of the virtual element including another interactive field of the virtual element;
- determining coordinates in the virtual three-dimensional (3D) space corresponding to a location of the another interactive field of the virtual element within the virtual 3D space;
- translating the sensor inputs corresponding to real-world coordinates of the location of the real-world object into virtual coordinates corresponding to locations of the sensor inputs in the virtual 3D space;
- determining whether the locations of any of the sensor inputs are outside of a volume demarcated by the another interactive field and within the volume demarcated by the virtual coordinates corresponding to the interactive field;
- determining a shortest distance to the core from the location of each sensor input outside of the volume demarcated by the another interactive field and within the volume demarcated by the interactive field;
- determining a force vector along each distance of each sensor input outside of the volume demarcated by the another interactive field and within the volume demarcated by the interactive field;
- applying the force vectors to the virtual element;
- rendering the one or more images of the virtual element in response to the applied force vectors;
- and
- causing one or more displays to project light corresponding to the rendered images of the virtual element that is perceived by the user as his or her interaction with the virtual element.
9 more elements
Dependencies are inferred from the claim text.