# US 2001/0040990 A1 · Display methods and apparatus particularly useful for displaying surgical working operations

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2001/0040990 A1
- Document ID: US20010040990A1
- Status: Published application
- Kind: A1
- Application number: 09/060,545
- Filed: 1998-04-15
- Published: 2001-11-15
- Earliest claimed: 1997-04-15
- Inventors: MICHEL DADI
- Web page: https://patentgrep.com/patent/US20010040990A1

## CPC

- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- A61B 90/36: {Image-producing devices or illumination devices not otherwise provided for}
- A61C 1/084: {of implanting tools}
- A61B 2090/364: {Correlation of different images or relation of image positions in respect to the body}
- A61B 2090/366: {using projection of images directly onto the body}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- A61C: DENTISTRY; APPARATUS OR METHODS FOR ORAL OR DENTAL HYGIENE (non-driven toothbrushes A46B; {tongue scrapers A61B17/24;} preparations for dentistry A61K6/00; preparations for cleaning the teeth or mouth A61K8/00, A61Q11/00)

## Abstract

A method of displaying a point of interest on an object, comprising preparing a reference pattern of the object, which reference pattern includes the point of interest in a visually-discernible manner on the object and further includes three visually-discernible reference points on the object, superposing the reference pattern on the object, effecting relative movement between the reference pattern and the object to optically align the three reference points on the reference pattern with three corresponding reference points on the subject and displaying the reference pattern superposed on the object such that the point of interest on the reference pattern is visually indicated on the object.

## Claims

### Claim 1

A method of displaying a point of interest on an object, comprising:
preparing a reference pattern of said object, which reference pattern includes said point of interest in a visually-discernible manner on the object and further includes three visually-discernible reference points on said object;
superposing said reference pattern on said object;
effecting relative movement between said reference pattern and said object to optically align said three reference points on the reference pattern with three corresponding reference points on the subject;
and displaying said reference pattern superposed on said object such that said point of interest on the reference pattern is visually indicated on the object.

### Claim 2 (depends on 1)

The method according to claim 1, wherein said object is a physical object, and said point of interest indicates the location, direction and/or magnitude a working operation is to be performed on the physical object.

### Claim 3 (depends on 2)

The method according to claim 2, wherein said reference pattern is prepared in the form of a physical member having the configuration of said physical object, and relative moment is effected between said reference pattern and said object by manipulating said physical member.

### Claim 4 (depends on 2)

The method according to claim 2, wherein said reference pattern is prepared in the form of a computer-generated image having the configuration of said physical object, and said reference pattern is manipulated by electronically manipulating said computer-generated image.

### Claim 5 (depends on 2)

The method according to claim 2, wherein said reference pattern superposed on said object is displayed to a viewer via an eyepiece oriented to view said object with the reference pattern superposed thereon.

### Claim 6 (depends on 2)

The method according to claim 2, wherein said reference pattern superposed on said object is displayed to a viewer via a monitor controlled by an electronic camera oriented to view said object with the reference pattern superposed thereon.

### Claim 7 (depends on 5)

The method according to claim 5, wherein said reference pattern superposed on said object is displayed to the viewer via a beam splitter having a first face aligned with said object, a second face aligned with said optically-projected reference pattern, and a third face through which the object and the superposed reference pattern are viewed.

### Claim 8 (depends on 7)

The method according to claim 7, wherein said apparatus further includes a first shutter between said first face of the beam splitter and said object, and a second shutter between said second face of the beam splitter and said optically-projected reference pattern.

### Claim 9 (depends on 8)

The method according to claim 8, wherein said shutters are alternately actuated during the alignment of said reference pattern with said object.

### Claim 10 (depends on 2)

The method according to claim 2, wherein said reference pattern superposed on said object is displayed at a single station to a single viewer for purposes of aiding the performance of said working operation on the object.

### Claim 11 (depends on 2)

The method according to claim 2, wherein said reference pattern superposed on said object is displayed at a plurality of stations to a plurality of viewers for purposes of simultaneously instructing a plurality of persons in the performance of said working operation on the object.

### Claim 12 (depends on 2)

The method according to claim 2, wherein said working operation a surgical operation.

### Claim 13 (depends on 2)

The method according to claim 2, wherein said working operation is a dental operation.

### Claim 14 (depends on 12)

The method according to claim 12, wherein said working operation is the drilling of a hole through a patient's bone for purposes of implanting a device, the visually-discernible guide of the reference pattern being in the form of a pin received within a hole indicating the location, orientation and depth of the hole to be drilled in the patient's bone.

### Claim 15 (depends on 1)

The method according to claim 1, wherein said object is an image of the physical object.

### Claim 16 (depends on 15)

The method according to claim 15, wherein said point of interest indicates the location of an element in the physical object, or the location, direction and/or magnitude a working operation is to be performed on the physical object.

### Claim 17 (depends on 15)

The method according to claim 15, wherein said reference pattern is a pre-recorded image of the physical object containing the point of interest, and said object is a real-time image of the physical object not containing said point of interest.

### Claim 18 (depends on 1)

The method according to claim 1, wherein said physical object is coupled to the display of said reference pattern such that after the superposition of the reference pattern image on said object, any movement of the physical object produces a corresponding movement of the reference pattern image.

### Claim 19 (depends on 18)

The method according to claim 18, wherein said coupling is a mechanical coupling.

### Claim 20 (depends on 18)

The method according to claim 18, wherein said coupling is an electrical coupling.

### Claim 21

Apparatus for displaying a point of interest on an object, comprising:
a reference pattern of said object, which reference pattern includes said point of interest in a visually discernible manner on the object, and further includes three visually-discernible reference points on said object;
a superposing device for superposing said reference pattern on said object;
means for effecting relative movement between said reference pattern and said object to optically align said three reference points on the reference pattern with three corresponding reference points on the object;
and display means for displaying said reference pattern superposed on said object such that said point of interest on the reference pattern is visually indicated on said object.

### Claim 22 (depends on 21)

The apparatus according to claim 21, wherein said object is a physical object, and said point of interest indicates the location, direction and/or magnitude a working operation is to be performed on the physical object.

### Claim 23 (depends on 22)

The apparatus according to claim 22, wherein said reference pattern is in the form of a physical member having the configuration of said object, said reference pattern being movable with respect to said object by manipulating said physical member.

### Claim 24 (depends on 23)

The apparatus according to claim 23, wherein said reference pattern is in the form of a computer-generated image having the configuration of said physical object, said reference pattern being manipulatable by electronically manipulating said computer-generated image.

### Claim 25 (depends on 22)

The apparatus according to claim 22, wherein said display means includes an eyepiece oriented to view said object with the reference pattern superposed thereon.

### Claim 26 (depends on 22)

The apparatus according to claim 22, wherein said display means includes an electronic camera oriented to view said object with the reference pattern superposed thereon, and a monitor controlled by said electronic camera to display said object with the reference pattern superposed thereon.

### Claim 27 (depends on 25)

The apparatus according to claim 25, wherein said reference pattern superposed on said object is viewed via a beam splitter having a first face aligned with said object, a second face aligned with said optically-projected reference pattern, and a third face through which the object and the superposed reference pattern are viewed.

### Claim 28 (depends on 27)

The apparatus according to claim 27, wherein said apparatus further includes a first shutter between said first face of the beam splitter and said object, and a second shutter between said second face of the beam splitter and said optically-projected reference pattern.

### Claim 29 (depends on 28)

The apparatus according to claim 28, further including control means for alternately opening and closing said shutters.

### Claim 30 (depends on 27)

The apparatus according to claim 27, wherein said apparatus further includes a 45° mirror between said reference pattern and said second face of the beam splitter.

### Claim 31 (depends on 27)

The apparatus according to claim 27, wherein said apparatus further includes a second beam splitter between said reference pattern and said second face of the first-mentioned beam splitter.

### Claim 32 (depends on 22)

The apparatus according to claim 22, wherein said display means displays said reference pattern superposed on said object at a single station for purposes of aiding the performance of said working operation on the object.

### Claim 33 (depends on 22)

The apparatus according to claim 22, wherein said display means displays said reference pattern superposed on said object at a plurality of stations for purposes of simultaneously instructing a plurality of persons for performing said working operation on the object.

### Claim 34 (depends on 22)

The apparatus according to claim 22, further including fixing means for fixing said object with respect to said reference pattern and said display means when said reference pattern is displayed superposed on said object.

### Claim 35 (depends on 34)

The apparatus according to claim 34, wherein said fixing means fixes a body part of a subject with respect to said reference pattern and display means for performing a surgical operation on said subject.

### Claim 36 (depends on 34)

The apparatus according to claim 34, wherein said fixing means fixes the head of a subject with respect to said reference pattern and display means for performing a dental working operation on said subject.

### Claim 37 (depends on 28)

The apparatus according to claim 28, wherein said fixing means also fixes both jaws of the subject for drilling a hole in the subject's jaw to implant a dental device therein, the visually-discernible guide of the reference pattern being in the form of a pin received within a hole indicating the location, orientation and depth of the hole to be drilled in the patient's bone.

### Claim 38 (depends on 21)

The apparatus according to claim 21, wherein said object is an image of the physical object.

### Claim 39 (depends on 38)

The apparatus according to claim 38, wherein said point of interest indicates the location of an element in the physical object, or the location, direction and/or magnitude a working operation is to be performed on the physical object.

### Claim 40 (depends on 38)

The apparatus according to claim 38, wherein said reference pattern is a pre-recorded image of the physical object containing the point of interest, and said object is a real-time image of the physical object not containing said point of interest.

### Claim 41 (depends on 21)

The apparatus according to claim 21, wherein said physical object is coupled to the display of said reference pattern such that after the super-position of the reference pattern image on said object, any movement of the physical object produces a corresponding movement of the reference pattern image.

### Claim 42 (depends on 41)

The apparatus according to claim 41, wherein said coupling is a mechanical coupling.

### Claim 43 (depends on 41)

The apparatus according to claim 41, wherein said coupling is an electrical coupling.

### Claim 44 (depends on 1)

The method of displaying the location, direction, and/or magnitude a working operation is to be performed on an object according to claim 1, substantially as described with reference to and as illustrated in the accompanying drawings.

### Claim 45 (depends on 21)

The apparatus for displaying the location, direction, and/or magnitude a working operation is to be performed on an object according to claim 21, substantially as described with reference to and as illustrated in the accompanying drawings.
