Environment property estimation and graphical display
AssigneeThe Johns Hopkins University
InventorsAllison M. Okamura, Tomonori Yamamoto, Balazs P. Vagvolgyi
Life of this patent
Estimating the term…
Abstract
A surgical robot including an imaging system comprising at least one camera, a processor in communication with the imaging system, a manipulation system in communication with the processor, and a visual display in communication with the processor. The processor is operable to calculate a mechanical property estimate for an area of an environment based on an environment model of tool-environment interaction data, create a composite image comprising a mechanical property map of the mechanical property estimate overlaid on an environment image from the at least one camera, and output the composite image on the visual display.
Claims15
A surgical robot, comprising:
- an imaging system comprising at least one camera;
- a processor in communication with said imaging system;
- a manipulation system in communication with said processor;
- and
- a visual display in communication with said processor,
- wherein said processor is operable to:
- calculate a mechanical property estimate for an area of an environment based on an environment model of tool-environment interaction data;
- create a composite image comprising a mechanical property map of the mechanical property estimate overlaid on an environment image from said at least one camera;
- and
- output the composite image on said visual display.
A data processing unit for use with a surgical robot, comprising:
- at least one input port adapted to receive an environment image from the surgical robot and to receive tool-environment interaction data from the surgical robot;
- an overlay component in communication with said at least one input port;
- and
- an output port in communication with said overlay component,
- wherein said overlay component is adapted to calculate a mechanical property estimate for an area of an environment based on an environment model of tool-environment interaction data, create a composite image comprising a mechanical property map of the mechanical property estimate overlaid on the environment image, and output the composite image to said output port.
The data processing unit of claim 15, wherein said overlay component is operable to create the mechanical property map based on translation of the mechanical property estimate to the environment image.
The data processing unit of claim 15, wherein an area of said mechanical property map overlaid on the environment image corresponds to the area of the environment shown overlaid by said area of said mechanical property map in the environment image.
The data processing unit of claim 17, wherein said mechanical property map comprises a hue-saturation-luminence colored mechanical property map, wherein the hue corresponds to a mechanical property value for an area of said mechanical property map and the saturation corresponds to a confidence level for the area of said mechanical property map.
The data processing unit of claim 15, wherein said mechanical property map comprises a blended mechanical property map.
The data processing unit of claim 15, wherein said tool-environment interaction data comprise an amount of force applied by a manipulation system to the environment.
The data processing unit of claim 15, wherein said tool-environment interaction data comprises an amount of displacement in the environment caused by a manipulation system.
The data processing unit of claim 15, wherein said overlay component is further adapted to create the composite image in real time.
The data processing unit of claim 15, wherein said environment model comprises a linear or nonlinear equation using the mechanical property of the environment to relate force and movement variables.
The data processing unit of claim 15, wherein said overlay component is further adapted to apply an algorithm to estimate the mechanical property using the environment model and said tool-environment interaction data.
The data processing unit of claim 15, wherein said mechanical property map comprises a 3-D mechanical property map.
The data processing unit of claim 15, wherein said environment comprises at least one of tissue or an organ.
The data processing unit of claim 15, wherein said mechanical property comprises stiffness.
A tangible machine readable storage medium that provides instructions, which when executed by a computing platform, cause said computing platform to pertain operations comprising a method comprising:
- determining tool-environment interaction data from a palpation of an area of an environment;
- calculating a mechanical property estimate of the area of the environment based on the tool-environment interaction data;
- receiving an environment image;
- generating a composite image comprising a mechanical property map of the 1c) mechanical property estimate overlaid on the environment;
- and
- outputting the composite image on a visual display.
Dependencies are inferred from the claim text.