Back to results
US 12,755,496 B2Granted
Distance calibration in augmented reality display
AssigneeMedivis, Inc.
InventorsLong Qian, Osamah Choudhry, Christopher Morley
Life of this patent
Estimating the term…
Abstract
Various embodiments of an apparatus, methods, systems and computer program products described herein are directed to a Calibration Engine for detecting first coordinates for a first physical instrument that correspond to poses of the first physical instrument in a unified three-dimensional (3D) coordinate space. The Calibration Engine detects second coordinates for a second physical instrument that correspond to poses of the second physical instrument in the unified 3D coordinate space. Based on the detected first and second coordinates, the Calibration Engine determines a distance from a tip of the first physical instrument to a predefined calibration location of the second physical instrument.
Claims20
A computer-implemented method, comprising:
- detecting first coordinates for a first physical instrument that correspond to at least one pose of the first physical instrument in a unified three-dimensional (3D) coordinate space,
- wherein the first physical instrument comprises one or more first instrument reference markers,
- wherein distances between the calibration location and the first instrument reference markers are fixed;
- detecting the first coordinates by tracking the first instrument reference markers, via an augmented reality (AR) headset, wherein tracking comprises determining coordinates of the first instrument reference markers in the unified 3D coordinate space,
- wherein the first physical instrument comprises a surface for attachment of the first physical instrument to a medical instrument;
- detecting second coordinates for a second physical instrument that correspond to at least one pose of the second physical instrument in the unified 3D coordinate space,
- wherein the second physical instrument comprises second instrument reference markers,
- wherein the second physical instrument further comprises a calibration location on the surface of the second physical instrument, compatible with a portion of the medical instrument,
- wherein distances between the second instrument reference markers and the calibration location are fixed;
- detecting the second coordinates by tracking the second instrument reference markers and the calibration location, via the AR headset;
- based on the detected first and second coordinates, determining a terminus distance from a terminus of the first physical instrument to the calibration location of the second physical instrument;
- and
- based on the terminus distance, displaying in the AR headset a visual comprising the distance the medical instrument extends away from the terminus of the first physical instrument.
10 more elements
A system comprising one or more processors, and a non-transitory computer-readable medium including one or more sequences of instructions that, when executed by the one or more processors, cause the system to perform operations comprising:
- detecting first coordinates for a first physical instrument that correspond to at least one pose of the first physical instrument in a unified three-dimensional (3D) coordinate space,
- wherein the first physical instrument comprises one or more first instrument reference markers,
- wherein distances between the calibration location and the first instrument reference markers are fixed;
- detecting the first coordinates by tracking the first instrument reference markers, via an augmented reality (AR) headset, wherein tracking comprises determining coordinates of the first instrument reference markers in the unified 3D coordinate space,
- wherein the first physical instrument comprises a surface for attachment of the first physical instrument to a medical instrument;
- detecting second coordinates for a second physical instrument that correspond to at least one pose of the second physical instrument in the unified 3D coordinate space,
- wherein the second physical instrument comprises second instrument reference markers,
- wherein the second physical instrument further comprises a calibration location on the surface of the second physical instrument, compatible with a portion of the medical instrument,
- wherein distances between the second instrument reference markers and the calibration location are fixed;
- detecting the second coordinates by tracking the second instrument reference markers and the calibration location, via the AR headset;
- based on the detected first and second coordinates, determining a terminus distance from a terminus of the first physical instrument to the calibration location of the second physical instrument;
- and
- based on the terminus distance, displaying in the AR headset a visual comprising the distance the medical instrument extends away from the terminus of the first physical instrument.
10 more elements
A computer program product comprising a non-transitory computer-readable medium having a computer-readable program code embodied therein to be executed by one or more processors, the program code including instructions for:
- detecting first coordinates for a first physical instrument that correspond to at least one pose of the first physical instrument in a unified three-dimensional (3D) coordinate space,
- wherein the first physical instrument comprises one or more first instrument reference markers,
- wherein distances between the calibration location and the first instrument reference markers are fixed;
- detecting the first coordinates by tracking the first instrument reference markers, via an augmented reality (AR) headset, wherein tracking comprises determining coordinates of the first instrument reference markers in the unified 3D coordinate space,
- wherein the first physical instrument comprises a surface for attachment of the first physical instrument to a medical instrument;
- detecting second coordinates for a second physical instrument that correspond to at least one pose of the second physical instrument in the unified 3D coordinate space,
- wherein the second physical instrument comprises second instrument reference markers,
- wherein the second physical instrument further comprises a calibration location on the surface of the second physical instrument, compatible with a portion of the medical instrument,
- wherein distances between the second instrument reference markers and the calibration location are fixed;
- detecting the second coordinates by tracking the second instrument reference markers and the calibration location, via the AR headset;
- based on the detected first and second coordinates, determining a terminus distance from a terminus of the first physical instrument to the calibration location of the second physical instrument;
- and
- based on the terminus distance, displaying in the AR headset a visual comprising the distance the medical instrument extends away from the terminus of the first physical instrument.
10 more elements
Dependencies are inferred from the claim text.