Determining input modality of head-mounted device based on input modality of handheld device
AssigneeGoogle Inc.
InventorsRuofei Du, David Kim, Fengyuan Zhu, Daniel Kalmar
Life of this patent
Estimating the term…
Abstract
A method can include determining, by a head-mounted device mounted on a head of a user, a number of degrees of freedom of an input modality of an auxiliary device; determining an input modality of the head-mounted device based on the number of degrees of freedom of the input modality of the auxiliary device; and presenting the input modality of the head-mounted device to the user.
Claims20
A method comprising:
- determining, by a head-mounted device mounted on a head of a user, a number of degrees of freedom of an input modality of an auxiliary device;
- determining an input modality of the head-mounted device based on the number of degrees of freedom of the input modality of the auxiliary device;
- and
- presenting the input modality of the head-mounted device to the user.
A non-transitory computer-readable storage medium comprising instructions stored thereon that, when executed by at least one processor, are configured to cause a computing device to:
- determine, by a head-mounted device mounted on a head of a user, a number of degrees of freedom of an input modality of an auxiliary device held by a hand of the user;
- determine an input modality of the head-mounted device based on the number of degrees of freedom of the input modality of the auxiliary device;
- and
- present the input modality of the head-mounted device to the user.
A method comprising:
- generating, by a head-mounted device within an extended Reality (XR) environment, a virtual display, the virtual display being based on a touchscreen display presented by an auxiliary device held by a user who is wearing the head-mounted device;
- generating, within the XR environment, a virtual hand based on first image data captured by a camera, the camera being included in the head-mounted device;
- presenting, within the XR environment, the virtual hand contacting the virtual display based on second image data captured by the camera;
- determining at least one of a time or location of contact by a hand of the user onto the touchscreen display based on a signal received from the auxiliary device;
- determining an adjustment based on the at least one of the time or location of the contact and the presentation of the virtual hand contacting the virtual display;
- and
- presenting, within the XR environment, the virtual hand contacting the virtual display based on third image data captured by the camera and the adjustment.
Dependencies are inferred from the claim text.