Back to results
US 11,386,600 B2Granted
System and method for displaying virtual image through HMD device
AssigneeSamsung Electronics Co., Ltd.
InventorGa-hyun Joo
Life of this patent
Estimating the term…
Abstract
Provided are a system and method for displaying a virtual image through a head mounted display (HMD) device. A method by which a device displays a virtual image through an HMD device includes: receiving, from the HMD device, an object image of a real space captured through a camera included in the HMD device; determining a virtual image to be displayed at a particular position around the captured object; determining an operation of the virtual image corresponding to the object and the particular position; and providing the virtual image and operation information about the determined operation to the HMD device, wherein the provided virtual image is displayed through the HMD device.
Claims18
A method by which a head mounted display (HMD) device displays a virtual image, the method comprising:
- capturing an image of an eye of a user by using a camera;
- providing the image of the eye of the user to a device for determining a position of the eye of the user;
- receiving a user input for selecting an operation mode, wherein the operation mode is a mode set for the virtual image to perform a predetermined action in a predetermined situation;
- providing information regarding the operation mode selected by the user;
- receiving information on the virtual image related to an object viewed by the user and determined based on the position of the eye of the user from the device, wherein the information on the virtual image comprises information indicating an action performed by the virtual image determined based on the operation mode, and wherein the action performed by the virtual image comprises at least one of an animation of a virtual object and a sound associated with the virtual object;
- displaying the virtual image on the HMD device based on the received information at a first display position in response to the position of the eye of the user being a first position relative to the HMD device, and displaying the virtual image based on the received information at a second display position in response to the position of the eye of the user being a second position different from the first position, relative to the HMD device;
- and
- displaying a changed virtual image in response to information about a changed state of a peripheral device connected to at least one of the HMD device or the device and the operation mode,
- wherein an action performed by the virtual image in a first operation mode is different from an action performed by the virtual image in a second operation mode, and
- wherein a plurality of actions performed by the virtual image are respectively matched with a plurality of states of the peripheral device, and an action performed by the changed virtual image is selected from among the plurality of the actions performed by the virtual image.
7 more elements
A method by which a device displays a virtual image through a head mounted display (HMD) device, the method comprising:
- receiving an image of an eye of a user from the HMD device;
- receiving information regarding an operation mode selected by the user from the HMD device, wherein the operation mode is a mode set for the virtual image to perform a predetermined action in a predetermined situation;
- determining a position of the eye of the user based on the image of the eye of the user;
- determining an object that is viewed by the user based on the determined position;
- determining an action performed by the virtual image based on the operation mode;
- providing information on the virtual image related to the object, wherein the information on the virtual image related to the object comprises a display position of the virtual image and operation information indicating an action performed by the virtual image determined based on an operation mode of the virtual image selected by an interaction of the user with the HMD device, the display position of the virtual image comprises a first display position in response to the position of the eye of the user being a first position, and the display position of the virtual image comprises a second display position different from the first display position in response to the position of the eye of the user being a second position;
- receiving information about a changed state of a peripheral device connected to at least one of the HMD device or the device;
- changing the action performed by the virtual image in response to the received information about the changed state and the operation mode;
- and
- providing information regarding the changed action performed by the virtual image to the HMD device,
- wherein the action performed by the virtual image comprises at least one of an animation of a virtual object or a sound associated with the virtual object, and the action performed by the virtual image in a first operation mode is different from an action performed by the virtual image in a second operation mode, and
- wherein a plurality of actions performed by the virtual image are respectively matched with a plurality of states of the peripheral device, and the changed action performed by the virtual image is selected from among the plurality of the actions performed by the virtual image.
9 more elements
A head mounted display (HMD) device for displaying a virtual image, the HMD device comprising:
- a communicator;
- and
- a controller configured to:
- capture an image of an eye of a user by using a camera,
- provide the image of the eye of the user to a device for determining a position of the eye of the user,
- receive a user input for selecting an operation mode, wherein the operation mode is a mode set for the virtual image to perform a predetermined action in a predetermined situation, provide information regarding the operation mode selected by the user,
- receive information on the virtual image related to an object viewed by the user and determined based on the position of the eye of the user from the device, wherein the information on the virtual image comprises information indicating an action performed by the virtual image determined based on the operation mode, and wherein the action performed by the virtual image comprises at least one of an animation of a virtual object and a sound associated with the virtual object, and
- display the virtual image on the HMD device based on the received information at a first display position in response to the position of the eye of the user being a first position relative to the HMD device, and display the virtual image based on the received information at a second display position in response to the position of the eye of the user being a second position different from the first position, relative to the HMD device, and display a changed virtual image in response to information about a changed state of a peripheral device connected to at least one of the HMD device or the device and the operation mode,
- wherein an action performed by the virtual image in a first operation mode is different from an action performed by the virtual image in a second operation mode, and
- wherein a plurality of actions performed by the virtual image are respectively matched with a plurality of states of the peripheral device, and an action performed by the changed virtual image is selected from among the plurality of the actions performed by the virtual image.
7 more elements
A device for displaying a virtual image through a head mounted display (HMD) device, the device comprising:
- a communicator;
- and
- a controller configured to:
- receive an image of an eye of a user from the HMD device,
- receive information regarding an operation mode selected by the user from the HMD device, wherein the operation mode is a mode set for the virtual image to perform a predetermined action in a predetermined situation,
- determine a position of the eye of the user based on the image of the eye of the user,
- determine an object that is viewed by the user based on the determined position, determine an action performed by the virtual image based on the operation mode, provide information on the virtual image related to the object, wherein the information on the virtual image related to the object comprises a display position of the virtual image and operation information indicating an action performed by the virtual image, determined based on an operation mode of the virtual image selected by an interaction of the user with the HMD device, the display position of the virtual image comprises a first display position in response to the position of the eye of the user being a first position, and the display position of the virtual image comprises a second display position different from the first display position in response to the position of the eye of the user being a second position,
- receive information about a changed state of a peripheral device connected to at least one of the HMD device or the device,
- change the action performed by the virtual image in response to the received information about the changed state and the operation mode, and
- provide information regarding the changed action performed by the virtual image to the HMD device,
- wherein the action performed by the virtual image comprises at least one of an animation of a virtual object or a sound associated with the virtual object and the action performed by the virtual image in a first operation mode is different from an action performed by the virtual image in a second operation mode, and
- wherein a plurality of actions performed by the virtual image are respectively matched with a plurality of states of the peripheral device, and the changed action performed by the virtual image is selected from among the plurality of the actions performed by the virtual image.
9 more elements
Dependencies are inferred from the claim text.