Drift cancelation for portable object detection and tracking
AssigneeUltrahaptics IP Two Limited
InventorDavid S. Holz
Life of this patent
Estimating the term…
Abstract
The technology disclosed can provide capabilities such as using motion sensors and/or other types of sensors coupled to a motion-capture system to monitor motions within a real environment. A virtual object can be projected to a user of a portable device integrated into an augmented rendering of a real environment about the user. Motion information of a user body portion is determined based at least in part upon sensory information received from imaging or acoustic sensory devices. Control information is communicated to a system based in part on a combination of the motion of the portable device and the detected motion of the user. The virtual device experience can be augmented in some implementations by the addition of haptic, audio and/or other sensory information projectors.
Claims17
A method of integrating real three-dimensional (3D) space sensing with an augmented reality or virtual reality head mounted device, the method including:
- obtaining a first position, at a first time t0, of at least one hand in a first reference frame of a three-dimensional (3D) sensory space;
- initiating display of a first virtual representation of the hand at the first position, wherein the first virtual representation is rendered in a virtual environment of the augmented reality or virtual reality head mounted device;
- obtaining, in the 3D sensory space, a second position, at a second time t1, of the hand different from the first position responsive to repositioning of the virtual reality head mounted device and an attached sensor wherein the hand has not moved in the 3D sensory space between t0 and t1;
- obtaining an actual second position for the hand, the actual second position generated by:
- obtaining a second reference frame that accounts for repositioning of the attached sensor;
- and
- obtaining transformed first and second positions of the hand into a common reference frame using a transformation that renders the first position in the first reference frame and the second position in the second reference frame into the common reference frame, wherein the common reference frame has a fixed point of reference and an initial orientation of axes, whereby the sensed second position is transformed to the actual second position;
- and
- initiating display of a second virtual representation of the hand at the actual second position.
A method of integrating real three-dimensional (3D) space sensing with an augmented reality or virtual reality head mounted device that renders a virtual background and one or more virtual objects, the method including:
- at a first time, obtaining a first position of at least one hand in a first reference frame of a three-dimensional (3D) sensory space;
- at a second time,
- obtaining a second position of the hand;
- obtaining a second reference frame that accounts for repositioning of an attached sensor;
- and
- obtaining transformed first and second positions of the hand into a common reference frame using a transformation that renders the first position in the first reference frame and the second position in the second reference frame into a common reference frame, wherein the common reference frame has a fixed point of reference and an initial orientation of axes.
A system of integrating real three-dimensional (3D) space sensing with an augmented reality or virtual reality head mounted device, the system including:
- a processor and a computer readable storage medium storing computer instructions configured to cause the processor to:
- obtain a first position, at a first time t0, of at least one hand in a first reference frame of a three-dimensional (3D) sensory space, including at least portions of the hand;
- initiate display of a first virtual representation of the hand at the first position, wherein the first virtual representation is rendered in a virtual environment of the augmented reality or virtual reality head mounted device;
- obtain, in the 3D sensory space, a second position, at a second time t1, of the hand different from the first position responsive to repositioning of the virtual reality head mounted device and an attached sensor wherein the hand has not moved in the 3D sensory space between t0 and t1;
- obtain an actual second position for the hand, the actual second position generated by:
- obtaining a second reference frame that accounts for repositioning of the attached sensor;
- and
- obtaining transformed first and second positions of the hand into a common reference frame using a transformation that renders the first position in the first reference frame and the second position in the second reference frame into the common reference frame, wherein the common reference frame has a fixed point of reference and an initial orientation of axes, whereby the sensed second position is transformed to the actual second position.
A system of integrating real three-dimensional (3D) space sensing with an augmented reality or virtual reality head mounted device that renders a virtual background and one or more virtual objects, the system including:
- a processor and a computer readable storage medium storing computer instructions configured to cause the processor to:
- at a first time, obtain a first position of at least one hand in a first reference frame of a three- dimensional (3D) sensory space;
- at a second time,
- obtain a second position of the hand;
- obtain a second reference frame that accounts for repositioning of an attached sensor;
- and
- obtain transformed first and second positions of the hand into a common reference frame using a transformation that renders the first position in the first reference frame and the second position in the second reference frame into a common reference frame, wherein the common reference frame has a fixed point of reference and an initial orientation of axes.
Dependencies are inferred from the claim text.