Systems and Methods for Determining Movement of a Controller With Respect to an HMD
AssigneeSony Interactive Entertainment Inc.
InventorsJeffrey Roger Stafford, Todd Tokubo
Life of this patent
Estimating the term…
Abstract
Systems and methods for determining movement of a hand-held controller (HHC) with respect to a head-mounted display (HMD) are described. A camera is located at a lower region of the HMD for capturing images of the HHC. The images of the HHC are used to determine a position and an orientation of the HHC with reference to the HMD. Also, the camera or another camera can be used to determine a position and orientation of the HMD with respect to a real-world environment. The position and orientation of the HMD and the position and orientation of the HHC are used to change to state of an application executed on a game cloud.
Claims22
A head-mounted display (HMD) comprising:
- a front region located adjacent to a top surface;
- a lower region located adjacent to the front region, the lower region having a first camera, wherein the first camera has a first field-of-view (FOV) directed downward from the HMD and is configured to capture a first plurality of images of a hand-held controller (HHC) when the HHC is within the first FOV;
- wherein the front region includes a second camera having a second FOV different from the first FOV, wherein the second camera is configured to capture a second plurality of images of the HHC when the HHC is within the second FOV;
- wherein the first plurality of images and the second plurality of images comprise images of a real-world environment surrounding the HMD,
- wherein a determination of a position and movement of the HMD within the real-world environment is made based on at least one of:
- (i) the first plurality of images and (ii) the second plurality of images,
- wherein a determination of an orientation of the HHC with reference to the HMD is made based on at least one of (i) the first plurality of images or (ii) the second plurality of images, and wherein the HMD is configured to display a plurality of image scenes having content generated by execution of an application in accordance with (i) the position and movement of the HMD, and (ii) the orientation of the HHC with reference to the HMD.
A method comprising:
- capturing a first plurality of images of a hand-held controller (HHC) within a first field of view (FOV) of a first camera, the first FOV directed downward from a lower region of a head mounted display (HMD);
- capturing a second plurality of images of the HHC within a second FOV of a second camera, the second FOV different from the first FOV, and the second camera on a front region of the HMD, wherein the first plurality of images and the second plurality of images comprise images of a real-world environment surrounding the HMD and a determination of a position and movement of the HMD within the real-world environment is made based on at least one of (i) the first plurality of images or (ii) the second plurality of images;
- determining based on at least one of (i) the first plurality of images or (ii) the second plurality of images, an orientation of the HHC with reference to the HMD;
- and
- displaying, at the HMD, a plurality of image scenes having content generated by execution of an application in accordance with (i) the position and movement of the HMD, and (ii) the orientation of the HHC with reference to the HMD.
A non-transitory computer-readable storage media storing one or more instructions that, when executed by one or more computers, cause the one or more computers to perform operations comprising:
- capturing a first plurality of images of a hand-held controller (HHC) within a first field of view (FOV) of a first camera, the first FOV directed downward from a lower region of a head mounted display (HMD);
- capturing a second plurality of images of the HHC within a second FOV of a second camera, the second FOV different from the first FOV, and the second camera on a front region of the HMD, wherein the first plurality of images and the second plurality of images comprise images of a real-world environment surrounding the HMD and a determination of a position and movement of the HMD within the real-world environment is based on at least one of (i) the first plurality of images or (ii) the second plurality of images;
- determining based on at least one of (i) the first plurality of images or (ii) the second plurality of images an orientation of the HHC with reference to the HMD;
- and
- displaying, at the HMD, a plurality of image scenes having content generated by execution of an application in accordance with (i) the position and movement of the HMD, and (ii) the orientation of the HHC with reference to the HMD.
Dependencies are inferred from the claim text.