Back to results
US 9,959,679 B2Granted
Floating graphical user interface
AssigneeColopl, Inc.
InventorShuhei Terahata
Life of this patent
Estimating the term…
Abstract
A method of controlling a widget in a virtual space is disclosed, comprising: moving a field-of-view and a point of gaze in the virtual space; determining if the widget and the point of gaze overlap each other, and providing an input to the widget if the widget and the point of gaze overlap; determining if at least a part of the widget is positioned outside the field of view; and moving the widget so that the part of the widget is positioned inside the field of view if it is determined that at least a part of the widget is positioned outside the field of view.
Claims15
A method of controlling a widget floating in an immersive virtual space, comprising:
- generating, based on stored immersive three-dimensional virtual space information, a position of the widget floating in the immersive virtual space, and a direction of a virtual camera in the immersive virtual space on the basis of a detected attitude and a detected position of a head mounted display, a field of view image in the virtual space regardless of an environment outside of the head mounted display to be displayed on a non-transmissive screen of the head mounted display;
- determining whether a point of gaze in the field of view image displayed on the non-transmissive screen is overlapped with the floating widget in the displayed field of view image, to allow an input to the floating widget in a condition in which the floating widget and the point of gaze overlap;
- determining whether at least a part of the floating widget is positioned outside the displayed field of view image regardless of a moving speed of the floating widget;
- and
- moving, when it is determined that the at least a part of the floating widget is positioned outside the displayed field of view image regardless of the moving speed of the floating widget, the floating widget so that the at least a part of the floating widget is positioned inside the displayed field of view image.
2 more elements
An input method of inputting using a widget floating in an immersive virtual space, comprising:
- generating, based on stored immersive three-dimensional virtual space information, a position of the widget floating in the immersive virtual space, and a direction of a virtual camera in the immersive virtual space on the basis of a detected attitude and a detected position of a head mounted display, a field of view image in the virtual space regardless of an environment outside of the head mounted display to be displayed on a non-transmissive screen of the head mounted display;
- and
- determining whether a point of gaze in the field of view image displayed on the non-transmissive screen is overlapped with the floating widget in the displayed field of view image, to allow an input to the floating widget in a condition in which the point of gaze and the floating widget overlap;
- initializing to place the floating widget at position in the virtual space that corresponds to an initial state position in the displayed field of view image, and initializing a moving speed vector V of the floating widget in the virtual space to 0;
- moving the floating widget at the moving speed vector V in the virtual space;
- re-initializing the moving speed vector V of the floating widget to 0, if the position of the floating widget in the displayed field of view image coincides with the initial state position in the displayed field of view image;
- determining whether at least a part of the floating widget has become positioned outside the displayed field of view image regardless of the moving speed vector V of the floating widget;
- and
- setting, when it is determined that the at least a part of the floating widget is positioned outside the displayed field of view image regardless of the moving speed vector V of the floating widget, the moving speed vector V of the floating widget to a value that makes the floating widget return to the initial state position in the displayed field of view image within the displayed field of view image in which the floating widget has been moved.
6 more elements
A non-transitory computer-readable medium with an executable program stored thereon, wherein the program instructs a processor to perform the following:
- generating, based on stored immersive three-dimensional virtual space information, a position of a widget floating in the immersive virtual space, and a direction of a virtual camera in the immersive virtual space on the basis of a detected attitude and a detected position of a head mounted display, a field of view image in the virtual space regardless of an environment outside of the head mounted display to be displayed on a non-transmissive screen of the head mounted display;
- determining whether a point of gaze in the field of view image displayed on the non-transmissive screen is overlapped with a floating widget in the displayed field of view image, to allow an input to the floating widget in a condition in which the floating widget and the point of gaze overlap;
- determining whether at least a part of the floating widget is positioned outside the displayed field of view image regardless of a moving speed of the floating widget;
- and
- moving, when it is determined that the at least a part of the floating widget is positioned outside the displayed field of view image regardless of the moving speed of the floating widget, the floating widget so that the at least a part of the floating widget is positioned inside the displayed field of view image.
2 more elements
A system of controlling a widget floating in an immersive virtual space, comprising one or more processors configured to execute operations comprising:
- generating, based on stored immersive three-dimensional virtual space information, a position of a widget floating in the immersive virtual space, and a direction of a virtual camera in the immersive virtual space on the basis of a detected attitude and a detected position of a head mounted display, a field of view image in the virtual space regardless of an environment outside of the head mounted display to be displayed on a non-transmissive screen of the head mounted display;
- determining whether a point of gaze in the field of view image displayed on the non-transmissive screen is overlapped with the floating widget in the displayed field of view image to allow an input to the floating widget in a condition in which the floating widget and the point of gaze overlap;
- determining whether at least a part of the floating widget is positioned outside the displayed field of view image regardless of a moving speed of the floating widget;
- and
- moving, when it is determined that the at least a part of the floating widget is positioned outside the displayed field of view image regardless of the moving speed of the floating widget, the floating widget so that the at least a part of the floating widget is positioned inside the displayed field of view image based on determining that the at least a part of the floating widget is positioned outside the displayed field of view image.
2 more elements
Dependencies are inferred from the claim text.