US 6,346,940 B1 · Virtualized endoscope system

Abstract

An image processing system displaying an endoscopic image of a three-dimensional object from a desired viewpoint position and view direction. A three-dimensional model preparation unit prepares a three-dimensional model of the object and an endoscopic image preparation unit prepares a first image of the three-dimensional model as viewed from the viewpoint position and view direction. A simulated endoscopic examination of a virtual subject can be realized by permitting an operator to change the viewpoint position and view direction to coincide with the movement of a virtual endoscope. The usefulness of the virtual endoscope is enhanced with various features of the invention which facilitate control over the virtual endoscope and make the virtual images useful in the insertion of a real endoscope. Such features include: the superimposition of endoscopic images; an indicator image which indicates the orientation of the virtual endoscope relative to the organ being examined; a compass image indicating the orientation of a virtual subject relative to the virtual endoscope tip; guiding markers which indicate the direction in which the virtual or real endoscope is to be advanced; and focus markers which reveal the location of predetermined conditions such as a nidus within the virtual subject. A virtual operation device, modeled after an actual endoscope operating member, is used to control movement of the virtual endoscope tip within the virtual subject.

Claims29

Dependent claims

An image processing system for displaying a three-dimensional object from a viewpoint position and in a view direction, comprising:

a three-dimensional model preparation unit configured to construct a three-dimensional model of the three-dimensional object;
an input unit configured to change the viewpoint position and the view direction by receiving commands to change the viewpoint position and the view direction from an input device;
an endoscopic image preparation unit configured to prepare for displaying an endoscopic image of the three-dimensional object as viewed from the viewpoint position and in the view direction;
an endoscopic image display which displays the endoscopic image;
an outer shape image preparation unit configured to prepare an outer shape image of the three-dimensional object from the three-dimensional model;
an indicator preparation unit configured to prepare for displaying an indicator image based on the viewpoint position, the view direction and a body position reference information, wherein the indicator image indicates the viewpoint position, the view direction and a reference direction;
and
an outer shape image display which displays the indicator image and the outer shape image simultaneously next to the displayed endoscopic image such that the location and orientation of the indicator image relative to the three-dimensional model indicates at least the viewpoint position and view direction relative to the three-dimensional model.

5 more elements

Dependencies are inferred from the claim text.

Virtualized endoscope system

Life of this patent

Virtualized endoscope system

Life of this patent

Abstract

Claims29