Back to results
US 7,379,077 B2Granted
Augmented and virtual reality guided instrument positioning using along-the-line-of-sight alignment
AssigneeSiemens Corporate Research, Inc.
InventorsAli Bani-Hashemi, Nassir Navab, Frank Sauer
Life of this patent
Estimating the term…
Abstract
There is provided a method for augmented reality guided instrument positioning. A viewpoint is established, from which a line of sight to a point on a target defines a path for an instrument to follow during a positioning of the instrument to the point on the target. The instrument is aligned along the line of sight to the point on the target.
Claims23
A method for augmented reality guided instrument positioning, comprising the steps of:
- defining a target point on or within a real object;
- defining a path to reach the target point with a real instrument;
- rendering a graphical representation to mark the path in the form of at least one graphical axis marker to be viewed in the direction of the path towards the target on a display overlaid onto a direct optical or video view of a real scene that comprises said real instrument, and said real object, so that a user can perceive said real instrument and said at least one graphical axis marker and their spatial relationship in an augmented reality view, said user performing the following steps:
- aligning said user's augmented reality line-of-sight with the at least one graphical axis marker so that said path to reach said target point with the real instrument is aligned along said augmented reality line-of-sight;
- aligning the real instrument to the path by aligning the real instrument with the augmented reality line-of-sight towards the target point;
- and
- moving the real instrument along the path towards the actual target point while keeping the real instrument aligned with the augmented reality line-of-sight.
4 more elements
A method for virtual reality guided instrument positioning, comprising the steps of:
- defining a real target point on or within a real object;
- defining a path to reach the real target point on or within said real object;
- tracking a pose of a real instrument with respect to a pose of the real object;
- rendering a graphical representation of the real instrument and the path to obtain a virtual instrument and a graphical virtual guide on a display, the graphical representation being rendered with respect to a virtual viewpoint chosen so that a virtual line of sight is viewed in the direction of the virtual path towards the target point for the virtual instrument to follow during a positioning of the real instrument to the real target point, the graphical virtual guide corresponding to the path, the virtual instrument comprising a 3D structure for line of sight alignment, the 3D structure comprising a plurality of markers centered on and distributed along an axis of the virtual instrument, so that a user can perceive said virtual instrument and the graphical virtual guide and their spatial relationship in a virtual reality view;
- aligning the virtual instrument along the virtual line of sight according to the graphical virtual guide in order to accordingly align the real instrument along the path;
- and
- moving the real instrument by the user in response to viewing the virtual instrument and said graphical virtual guide on the display, the real instrument moving along the path towards the real target point keeping the correct alignment by observing and keeping in alignment with the virtual instrument and graphical virtual guide.
4 more elements
Dependencies are inferred from the claim text.