Back to results
US 12,681,559 B2Granted
Model display method, apparatus and system
AssigneeBeijing Source Technology Co., Ltd.
InventorZixiong Luo
Life of this patent
Estimating the term…
Abstract
The present disclosure relates to a model display method, apparatus, and system. The method includes: acquiring a hand location of a hand model in the virtual reality scene in real time, receiving an input signal from an input device, determining a key position corresponding to the input signal in the 3D model, determining model location of the 3D model in the virtual reality according to the key position in the 3D model and the hand location, and displaying the 3D model at the model location in the virtual reality scene. By this method, the 3D model of the input device in real space can be accurately displayed in the virtual reality scene.
Claims21
A method for projecting a three-dimensional (3D) model of an input device into a virtual reality, comprising:
- in response to a hand of a user in real space activating at least one physical key in the input device, receiving at least one input signal from at least one physical key in the input device, wherein the input device comprises a keyboard or a mouse;
- obtaining at least one hand location of a hand model in the virtual reality corresponding to the at least one physical key activated by the hand of the user, wherein the hand model corresponds to the hand of the user, and wherein each hand location of the at least one hand location in the virtual reality is corresponding to a position of the hand of the user in real space when activating a physical key from the at least one physical key;
- for each physical key from the at least one physical key, determining, based on the at least one input signal from the physical key activated by the hand of the user, a virtual key within the 3D model of the input device that corresponds to the physical key, and obtaining a key position in the virtual reality of the virtual key within the 3D model of the input device;
- determining a model location of the 3D model within the virtual reality based on the at least one hand location and the at least one key position, wherein the model location comprises a spatial position and an attitude of the 3D model;
- wherein determining the model location of the 3D model within the virtual reality based on the at least one hand location and the at least one key position comprises:
- in response to a number of the at least one physical key is less than three, determining the model location of the 3D model within the virtual reality based on a hand location and a key position corresponding to a physical key activated by the hand of the user;
- and
- in response to the number of the at least one physical key is equal to or greater than three, determining the model location of the 3D model within the virtual reality based on at least three hand locations and at least three key positions in the virtual reality corresponding to at least three physical keys activated by the hand of the user;
- and
- displaying the 3D model at the model location in a virtual reality scene to implement interaction between the input device and the virtual reality scene.
7 more elements
An electronic apparatus, comprising:
- one or more processors;
- a memory coupled to the one or more processors;
- a display device that is configured to display a virtual reality scene;
- and
- a plurality of programs for projecting a virtual reality (VR) model stored in the memory that, when executed by the one or more processors, cause the electronic apparatus to perform the plurality of operations comprising:
- in response to a hand of a user in real space activating at least one physical key in the input device, receiving at least one input signal from at least one physical key in an input device, wherein the input device comprises a keyboard or a mouse;
- obtaining at least one hand location of a hand model in the virtual reality corresponding to the at least one physical key activated by the hand of the user, wherein the hand model corresponds to the hand of the user, and wherein each hand location of the at least one hand location in the virtual reality is corresponding to a position of the hand of the user in real space when activating a physical key from the at least one physical key;
- for each physical key from the at least one physical key, determining, based on the at least one input signal from the physical key activated by the hand of the user, a virtual key within a three-dimensional (3D) model of the input device that corresponds to the physical key, and obtaining a key position in the virtual reality of the virtual key within a three-dimensional (3D) model of the input device;
- determining a model location of the 3D model within the virtual reality based on the at least one hand location and the at least one key position, wherein the model location comprises a spatial position and an attitude of the 3D model;
- wherein determining the model location of the 3D model within the virtual reality based on the at least one hand location and the at least one key position comprises:
- in response to a number of the at least one physical key is less than three, determining the model location of the 3D model within the virtual reality based on a hand location and a key position corresponding to a physical key activated by the hand of the user;
- and
- in response to the number of the at least one physical key is equal to or greater than three, determining the model location of the 3D model within the virtual reality based on at least three hand locations and at least three key positions in the virtual reality corresponding to at least three physical keys activated by the hand of the user;
- and
- displaying the 3D model at the model location in a virtual reality scene to implement interaction between the input device and the virtual reality scene.
12 more elements
A non-transitory computer readable storage medium storing a plurality of programs for execution by an electronic device having one or more processors, wherein the plurality of programs, when executed by the one or more processors, cause the electronic device to perform acts comprising:
- in response to a hand of a user in real space activating at least one physical key in the input device, receiving at least one input signal from at least one physical key in an input device, wherein the input device comprises a keyboard or a mouse;
- obtaining at least one hand location of a hand model in the virtual reality corresponding to the at least one physical key activated by the hand of the user, wherein the hand model corresponds to the hand of the user, and wherein each hand location of the at least one hand location in the virtual reality is corresponding to a position of the hand of the user in real space when activating a physical key from the at least one physical key;
- for each physical key from the at least one physical key, determining, based on the at least one input signal from the physical key activated by the hand of the user, a virtual key within a three-dimensional (3D) model of the input device that corresponds to the physical key, and obtaining a key position in the virtual reality of the virtual key within the 3D model of the input device;
- determining a model location of the 3D model within the virtual reality based on the at least one hand location and the at least one key position, wherein the model location comprises a spatial position and an attitude of the 3D model;
- wherein determining the model location of the 3D model within the virtual reality based on the at least one hand location and the at least one key position comprises:
- in response to a number of the at least one physical key is less than three, determining the model location of the 3D model within the virtual reality based on a hand location and a key position corresponding to a physical key activated by the hand of the user;
- and
- in response to the number of the at least one physical key is equal to or greater than three, determining the model location of the 3D model within the virtual reality based on at least three hand locations and at least three key positions in the virtual reality corresponding to at least three physical keys activated by the hand of the user;
- and
- displaying the 3D model at the model location in a virtual reality scene to implement interaction between the input device and the virtual reality scene.
7 more elements
Dependencies are inferred from the claim text.