Back to results
US 2021/0228978 A1Published application
Virtual reality hand gesture generation
AssigneeValve Corporation
InventorsScott Douglas Nietfeld, Joe van den Heuvel
Life of this patent
Estimating the term…
Abstract
A method including receiving at least one of touch data or force data representing a touch input received at the controller, determining one or more model(s), generating image data using the one or more models, the image data representing at least a hand gesture corresponding to the touch input received at the controller, and transmitting the image data to a virtual reality (VR) environment for display.
Claims20
A system comprising:
- one or more processors;
- and
- one or more non-transitory computer-readable media storing computer-executable instructions that, when executed by the one or more processors, cause the one or more processors to perform acts comprising:
- receiving, from a handheld controller:
- touch data generated by one or more first sensors of the handheld controller, the touch data indicating a touch input received at the handheld controller;
- and
- force data generated by one or more second sensors of the handheld controller, the force data indicating an amount of force associated with the touch input;
- selecting a trained model from among a plurality of trained models based at least in part on a characteristic of at least one of the touch data or the force data;
- inputting the touch data and the force data to the trained model;
- determining, using the trained model, that the touch data and the force data correspond to a hand gesture;
- generating image data representing the hand gesture;
- and
- causing an image of the hand gesture to be presented on a display based at least in part on the image data.
10 more elements
A method comprising:
- receiving, by one or more processors, from a handheld controller, at least one of:
- touch data generated by one or more first sensors of the handheld controller, the touch data indicating a proximity of at least a portion of a hand relative to the handheld controller;
- or
- force data generated by one or more second sensors of the handheld controller, the force data indicating an amount of force of a press on the handheld controller;
- selecting a trained model from among a plurality of trained models based at least in part on a characteristic of the at least one of the touch data or the force data;
- inputting, by the one or more processors, the at least one of the touch data or the force data to the trained model;
- determining, using the trained model, that the at least one of the touch data or the force data corresponds to a hand gesture;
- generating, by the one or more processors, image data representing the hand gesture;
- and
- causing an image of the hand gesture to be presented on a display based at least in part on the image data.
7 more elements
A system comprising:
- one or more processors;
- and
- one or more non-transitory computer-readable media storing computer-executable instructions that, when executed by the one or more processors, cause the one or more processors to perform acts comprising:
- receiving, from a handheld controller, at least one of:
- touch data indicating a proximity of at least a portion of a hand relative to the handheld controller;
- or
- force data indicating an amount of force of a press on the handheld controller;
- selecting a trained model from among a plurality of trained models based at least in part on a characteristic of the at least one of the touch data or the force data;
- inputting the at least one of the touch data or the force data to the trained model;
- determining, using the trained model, that the at least one of the touch data or the force data corresponds to a hand gesture;
- generating image data representing the hand gesture;
- and
- causing an image of the hand gesture to be presented on a display based at least in part on the image data.
10 more elements
Dependencies are inferred from the claim text.