Back to results
US 12,639,027 B2Granted
Determining input modality of head-worn device based on input modality of handheld device
AssigneeGoogle Inc.
InventorsRuofei Du, David Kim, Fengyuan Zhu, Daniel Kalmar
Life of this patent
Estimating the term…
Abstract
A method can include determining, by a head-mounted device mounted on a head of a user, a number of degrees of freedom of an input modality of an auxiliary device; determining an input modality of the head-mounted device based on the number of degrees of freedom of the input modality of the auxiliary device; and presenting the input modality of the head-mounted device to the user.
Claims20
A method comprising:
- capturing, by a head-worn device worn on a head of a user, at least one image of an input modality of a handheld device held by the user;
- determining, based on the at least one image, a number of degrees of freedom of the input modality;
- generating an input modality of the head-worn device based on the number of degrees of freedom of the input modality of the handheld device, the input modality of the head-worn device including at least one user interface element corresponding to at least one element of the input modality of the handheld device;
- and
- presenting the input modality of the head-worn device to the user.
2 more elements
A non-transitory computer-readable storage medium comprising instructions stored thereon that, when executed by at least one processor, are configured to cause a computing device to:
- capture, by a head-worn device worn on a head of a user, at least one image of an input modality of a handheld device held by the user;
- determine, based on the at least one image, a number of degrees of freedom of an input modality of the handheld device;
- generate an input modality of the head-worn device based on the number of degrees of freedom of the input modality of the handheld device, the input modality of the head-worn device including at least one user interface element corresponding to at least one element of the input modality of the handheld device;
- and
- present the input modality of the head-worn device to the user.
2 more elements
A method comprising:
- capturing, by a head-worn device worn on a head of a user, at least one image of a touchscreen display presented by a handheld device held by the user, the at least one image being captured by a camera included in the head-worn device;
- generating, within an extended Reality (XR) environment, a virtual display, the virtual display being based on the touchscreen display;
- generating, within the XR environment, a virtual hand based on first image data captured by the camera;
- presenting, within the XR environment, the virtual hand contacting the virtual display based on second image data captured by the camera;
- determining at least one of a time or location of contact by a hand of the user onto the touchscreen display based on a signal received from the handheld device;
- determining an adjustment based on the at least one of the time or location of the contact and the presentation of the virtual hand contacting the virtual display;
- and
- presenting, within the XR environment, the virtual hand contacting the virtual display based on third image data captured by the camera and the adjustment.
5 more elements
Dependencies are inferred from the claim text.