Back to results
US 12,602,879 B2Granted
Method and device for providing surgical guide using augmented reality
AssigneeKorea University Research and Business Foundation
InventorHijin You
Life of this patent
Estimating the term…
Abstract
A method and device for a surgical guide using augmented reality (AR) is disclosed. The surgical guide method using AR includes obtaining an image showing a surgery subject by using a camera of a wearable device worn by a user, recognizing a marker predefined in the image, determining expression attribute information of a three-dimensional (3D) image model to be projected onto the surgery subject based on the recognized marker, and displaying the 3D image model through the wearable device by projecting the 3D image model onto the surgery subject, based on the determined expression attribute information.
Claims13
A surgical guide method using augmented reality (AR), the method comprising:
- obtaining an image showing a surgery subject by using a camera of a wearable device worn by a user;
- recognizing a marker predefined in the image;
- wherein the marker is attached to a flat surface, not the surgery subject, of an operating table of the image,
- determining expression attribute information of a three-dimensional (3D) image model to be projected onto the surgery subject based on the recognized marker;
- when an input of a user's gesture is detected, determining the expression attribute information of the 3D image model based on the gesture;
- and
- displaying the 3D image model through the wearable device by projecting the 3D image model onto the surgery subject, based on the determined expression attribute information,
- based on a position where the marker is attached to the operating table, the surgery subject is positioned at a predetermined position,
- wherein the recognizing of the marker comprises:
- recognizing position information of the marker attached to the operating table, size information of the marker, and shape information of the marker,
- wherein the determining of the expression attribute information of the 3D image model comprises:
- tracking a space in which the surgery subject is positioned, based on the position information, the shape information, and rotation information of the recognized marker,
- based on the result of the tracking the space, determining a position, a size, and a rotation angle of the surgery subject of the image;
- and
- determining the expression attribute information of the 3D image model to be projected onto the surgery subject based on the determined the position, the size, and the rotation angle of the surgery subject.
12 more elements
A surgical guide method using augmented reality (AR), the method comprising:
- obtaining an image showing a surgery subject by using a camera of a wearable device worn by a user;
- receiving a user input comprising points selected based on the image;
- calculating a target direction based on coordinate values of the selected points;
- determining expression attribute information of a three-dimensional (3D) image model to be projected onto the surgery subject based on the target direction;
- when an input of a user's gesture is detected, determining the expression attribute information of the 3D image model based on the gesture;
- and
- displaying the 3D image model through the wearable device by projecting the 3D image model onto the surgery subject, based on the determined expression attribute information,
- wherein the receiving the user input comprising:
- displaying the image through the wearable device;
- and
- receiving the user's gesture about selecting two eyes and the tip of the chin of the surgery subject based on the displayed image, as the user input;
- wherein the displaying the 3D image model comprising:
- calculating an angle between a first straight line between reference points corresponding to the two eyes among the reference points, and a second straight line between points corresponding to the two eyes among the selected points;
- and
- mapping the 3D image model to the surgery subject by rotating the 3D image model by the calculated angle such that the straight line between the reference points corresponding to the two eyes among the reference points matches to the straight line between the points corresponding to the two eyes among the selected points.
12 more elements
A surgical guide device for performing a surgical guide method using augmented reality (AR), the surgical guide device comprising:
- a processor configured to recognize a marker predefined in an image showing a surgery subject by using a camera of a wearable device worn by a user,
- wherein the marker is attached to a flat surface, not the surgery subject, of an operating table of the image,
- based on a position where the marker is attached to the operating table, the surgery subject is positioned at a predetermined position,
- recognize position information of the marker attached to the operating table, size information of the marker, and shape information of the marker,
- and configured to determine expression attribute information of a three-dimensional (3D) image model to be projected onto the surgery subject based on the recognized marker, when an input of a user's gesture is detected, determined the expression attribute information of the 3D image model based on the gesture,
- track a space in which the surgery subject is positioned, based on the position information, the shape information, and rotation information of the recognized marker,
- based on the result of the tracking the space, determine a position, a size, and a rotation angle of the surgery subject of the image;
- and
- determine the expression attribute information of the 3D image model to be projected onto the surgery subject based on the determined the position, the size, and the rotation angle of the surgery subject,
- a display configured to display the 3D image model through the wearable device by projecting the 3D image model onto the surgery subject, based on the determined expression attribute information.
7 more elements
Dependencies are inferred from the claim text.