US 2018/0322806 A1Published application

Hybrid image/scene renderer with hands free control

AssigneeSurgical Theater, Inc.

InventorsMordechai Avisar, Alon Yakob Geri

Life of this patent

Estimating the term…

Loading patent…

Abstract

A system and method for converting static/still medical images of a particular patient into dynamic and interactive images interacting with medical tools including medical devices by coupling a model of tissue dynamics and tool characteristics to the patient specific imagery for simulating a medical procedure in an accurate and dynamic manner by coupling a model of tissue dynamics to patient specific imagery for simulating surgery on the particular patient. The method includes a tool to add and/or to adjust the dynamic image of tissues and ability to draw any geometric shape on the dynamic image of tissues and to add the shape into the modeling system.

Claims28

Dependent claims

A modeling system for enabling a user to perform a simulated medical procedure, said system comprising:

one or more computers;
a display for displaying images to the user;
a database for storing characteristics of the tissues of a particular patient;
an image generator using one or more of said computers for executing software for generating a dynamic realistic image of the tissues of the particular patient based on the stored characteristics of the particular patient for displaying on said display, wherein said realistic image of the tissues is provided showing an appearance including shadowing and textures indicative of the tissues of the particular patient;
a database for storing a user tool library for providing a plurality of user tool models of actual user tools used in medical procedures;
a user interface for accepting inputs from the user for selecting one of the user tool models;
a user tool generator using one or more of said computers for executing software for generating a realistic tool image of the selected user tool model for displaying on said display;
and
a user interface including a camera for accepting inputs from the user based on motions of the user's hands, said inputs for dynamically manipulating said selected user tool image and/or the image of the tissues for dynamically interacting with the realistic image of the tissues during the simulated medical procedure for display to the user on said display in real-time, wherein
the dynamic interaction between the user tool image and the image of the tissues is displayed on said display using images with realistic visual features exhibiting realistic mechanical interactions.

7 more elements

A modeling system for enabling a user to perform a simulated medical procedure, said system comprising:

one or more computers;
a display for displaying images to the user;
a database for storing physical characteristics of the tissues of a particular patient;
an image generator using one or more of said computers for executing software for generating a dynamic realistic image of the tissues of the particular patient for displaying on said display, wherein said realistic image of the tissues is provided showing an appearance including shadowing and textures indicative of the tissues of the particular patient;
a database comprising a user tool library for providing a plurality of user tool models of actual user tools used in medical procedures;
a user interface for accepting inputs from the user for selecting one of the user tool models;
a user tool generator using one or more of said computers for executing software for generating a realistic tool image of the selected user tool model for displaying on said display;
a user interface for accepting inputs from the user, said inputs for dynamically manipulating said selected user tool image for dynamically interacting with said realistic image of the tissues during the simulated medical procedure for display to the user on said display in real-time;
a user interface including a camera for accepting inputs from the user based on motions of the user's hands, said inputs for dynamically manipulating said selected user tool image and/or the image of the tissues for dynamically interacting with the realistic image of the tissues during the simulated medical procedure for display to the user on said display in real-time, wherein
the dynamic interaction between the user tool image and the image of the tissues is displayed on said display using images with realistic visual features exhibiting realistic mechanical interactions;
and
a user interface providing a tool to adjust the dynamic image of the tissues displayed on said display by adding or modifying features of said tissues for display to compensate for anatomical structures that are in the actual biological tissue of the particular patient but are missing from the dynamic image of tissues originally displayed such that the dynamic image of tissues displayed are subsequently displayed on the display with the added or modified features, wherein
the dynamic interaction between the user tool image and the image of the tissues is displayed on said display providing realistic visual features exhibiting realistic mechanical interactions based on the stored physical characteristics.

10 more elements

A modeling system for enabling a user to perform a simulated medical procedure, said system comprising:

one or more computers;
a display for displaying images to the user;
an image generator using one or more of said computers for executing software for generating a dynamic realistic image of the tissues for particular patient for displaying on said display, wherein said realistic image of the tissues is provided showing an appearance including shadowing and textures indicative of actual tissues;
a database for storing a user tool library for providing a plurality of user tool models of actual user tools used in medical procedures;
a user interface for accepting inputs from the user for selecting one of the user tool models;
a user tool generator using one or more of said computers for executing software for generating a realistic tool image of the selected user tool model for displaying on said display;
and
a user interface that can track the motions of an actual surgical instrument being used by the user with the particular patient, such that said motions are used for dynamically manipulating said selected user tool image and/or the image of the tissues for dynamically interacting with the realistic image of the tissues during the simulated medical procedure for display to the user on said display in real-time.
GPS, accelerometers, magnetic detection, or other location and motion detecting devices.

6 more elements

Dependencies are inferred from the claim text.

Facts

Application: 16/033,937Filed 12 Jul 2018
Priority: 25 May 2012
Published: 8 Nov 2018
Term ends: Not estimatedThe source records don’t support an estimate.

Classification13 codes

G09B 23/28
Models for scientific, medical, or mathematical purposes, e.g. full-sized devices for demonstration purposes: for medicine
A61B 17/1227
Clamps or clips, e.g. for the umbilical cord: spring clips
A61B 34/10
Computer-aided surgery; Manipulators or robots specially adapted for use in surgery: computer-aided planning, simulation or modelling of surgical…
G06F 3/016
Input arrangements or combined input and output arrangements for interaction between user and computer: input arrangements with force or tactile…

Family

Application61/651,775Us provisional application · filed 25 May 2012
Application14/402,746Continuation · filed 21 Nov 2014
Application16/033,937Continuation
US 10,056,012 B2Related patent
US 10,943,505 B2Related patent
US 2015/0140535 A1Published application
US 2018/0322806 A1This patent

From the US filing history. Foreign family members aren’t listed.

Timeline

Citations

Open elsewhere

Building an agent or pulling many patents? Use the API or MCP server instead of scraping pages. Get an API key