Device and method for providing augmented reality for user styling
AssigneeKyungpook National University Industry-Academic Cooperation Foundation
InventorsSoon Ki Jung, Hak-Rin Kim, Gi-Sook Jung, Jae Seok Jang, Min-Kyu Park
Life of this patent
Estimating the term…
Abstract
Provided is a an augmented reality providing device including: a sensing unit configured to sense a body part of a user; a display unit configured to display an image; a semi-transparent mirror unit disposed spaced from the display unit and configured to reflect light incident from the user to emit the reflected light to the user, and transmit light incident from the display unit to provide the transmitted light to the user; and a control unit configured to determine a position at which the image is displayed on the display unit based on the sensed body part.
Claims10
An augmented reality providing device comprising:
- a camera configured to capture a body part of a user and generate an image;
- a display panel configured to display an image of an accessory wearable by the user for styling of the user;
- a semi-transparent mirror disposed spaced from the display panel and configured to reflect light incident from the user to emit the reflected light to the user, and transmit light incident from the display panel to provide the transmitted light to the user;
- and
- a processor configured to determine a position at which the image is displayed on the display panel based on the sensed body part,
- wherein the processor is configured to:
- sense a face object corresponding to the user's face and an eye object corresponding to the user's eye from the image,
- calculate a view point coordinate in a predetermined spatial coordinate system based on the eye object,
- calculate a gaze vector in the spatial coordinate system based on the face object,
- calculate an intersection point coordinate in the spatial coordinate system, the intersection point being where a straight line extending in a direction parallel to the gaze vector while passing through the view point coordinate and a plane corresponding to the display panel intersect in the spatial coordinate system,
- transform the intersection point coordinate in the spatial coordinate system to a plane coordinate in a plane coordinate system set on the plane corresponding to the display panel, and
- control the display panel to display the image of the accessory at a position apart from a predetermined distance in a predetermined direction from the plane coordinate in the plane coordinate system, the predetermined distance and the predetermined direction being predetermined to the accessory.
A method of providing augmented reality to a user by an augmented reality providing device in which a semi-transparent mirror and a display panel are spaced apart, the method comprising:
- sensing the user's body part;
- determining a position at which an image is displayed on the display panel based on the sensed body part;
- and
- displaying the image based on the determined position,
- wherein the sensing of the user's body part comprises generating an image by capturing the user,
- wherein the displaying of the image based on the determined position comprises displaying a virtual image for styling of the user, the virtual image comprising an image of an accessory wearable by the user,
- wherein the determining of the position at which the image is displayed on the display panel based on the sensed body part comprises:
- sensing a face object corresponding to the user's face and an eye object corresponding to the user's eye from the image,
- calculating a view point coordinate in a predetermined spatial coordinate system based on the eye object,
- calculating a gaze vector in the spatial coordinate system based on the face object,
- calculating an intersection point coordinate in the spatial coordinate system, the intersection point being where a straight line extending in a direction parallel to the gaze vector while passing through the view point coordinate and a plane corresponding to the display panel intersect in the spatial coordinate system,
- transform the intersection point coordinate in the spatial coordinate system to a plane coordinate in a plane coordinate system set on the plane corresponding to the display panel, and
- wherein the displaying of the image based on the determined position comprises displaying an image of the accessory at a position apart from a predetermined distance in a predetermined direction from the plane coordinate in the plane coordinate system, the predetermined distance and the predetermined direction being predetermined to the accessory.
Dependencies are inferred from the claim text.