# US 10,368,720 B2 · System for stereo reconstruction from monoscopic endoscope images

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,368,720 B2
- Document ID: US10368720B2
- Status: Granted
- Kind: B2
- Application number: 14/548,948
- Filed: 2014-11-20
- Published: 2016-05-26
- Granted: 2019-08-06
- Earliest claimed: 2014-11-20
- Assignees: The Johns Hopkins University
- Applicants: The Johns Hopkins University
- Inventors: Kevin C. Olds; Tae Soo Kim; Russell H. Taylor; Austin Reiter
- Web page: https://patentgrep.com/patent/US10368720B2

## CPC

- A61B 1/000094: {extracting biological structures}
- A61B 1/00193: {adapted for stereoscopic vision}
- A61B 1/00194: {adapted for three-dimensional imaging}
- A61B 1/05: characterised by the image sensor, e.g. camera, being in the distal end portion
- A61B 1/0605: {for spatially modulated illumination}
- A61B 1/063: {for monochromatic or narrow-band illumination}
- A61B 1/0638: {providing two or more wavelengths}
- A61B 1/0684: {using light emitting diodes [LED]}
- A61B 1/07: using light-conductive means, e.g. optical fibres
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)

## Abstract

A system for stereo reconstruction from a monoscopic endoscope includes an image pick-up element at a distal end thereof and a working channel defined by a body of the monoscopic endoscope. The system comprises a light patterning component configured to be disposed within the working channel such that a light emitting end of the light patterning component will be fixed with a defined relative distance from the distal end of the image pick-up element. The system also includes a data processor adapted to be in communication with the image pick-up element. The light patterning component forms a pattern of light that is projected onto a region of interest. The data processor receives an image signal of the region of interest that includes the pattern, and determines a distance from the endoscope to the region of interest based on the image signal and based on the defined relative distance.

## Claims

### Claim 1

A system for stereo reconstruction from a monoscopic endoscope, said monoscopic endoscope comprising an image pick-up element at a distal end thereof and a working channel within a body of said monoscopic endoscope so as to provide a port at said distal end of said monoscopic endoscope, said system for stereo reconstruction comprising:
a first illumination source and a second illumination source being configured to emit light of different colors;
a light patterning component configured to be disposed within said working channel of said monoscopic endoscope such that a light emitting end of said light patterning component will be fixed with a defined relative distance from said distal end of said monoscopic endoscope, said light patterning component being further configured to receive the light of different colors at a proximal end of said monoscopic endoscope; and
a data processor adapted to be in communication with said image pick-up element,
wherein the first illumination source is configured to emit a first plurality of lines extending in a first direction and the second illumination source is configured to emit a second plurality of lines extending in a second direction different from said first direction,
wherein said first plurality of lines and said second plurality of lines are of said different colors,
wherein said first plurality of lines and said second plurality of lines together form a pattern of light in a shape of a grid that is projected onto a region of interest,
wherein said data processor is configured to receive an image signal of said region of interest that includes said pattern, and
wherein said data processor is further configured to determine a distance from said monoscopic endoscope to said region of interest based on said image signal and based on said defined relative distance between said light emitting end of said light patterning component and said distal end of said image pick-up element.

### Claim 2 (depends on 1)

The system for stereo reconstruction from a monoscopic endoscope according to claim 1, wherein said data processor is configured to construct a three-dimensional image of said region of interest based on said image signal and based on said defined relative distance between said light emitting end of said light patterning component and said distal end of said image pick-up element.

### Claim 3 (depends on 1)

The system for stereo reconstruction from a monoscopic endoscope according to claim 1, wherein said pattern comprises at least one dot.

### Claim 4 (depends on 1)

The system for stereo reconstruction from a monoscopic endoscope according to claim 1, wherein said pattern further includes a swept line.

### Claim 5 (depends on 1)

The system for stereo reconstruction from a monoscopic endoscope according to claim 1, wherein said light patterning component is configured to emit light upon receipt of a command from said data processor.

### Claim 6 (depends on 1)

The system for stereo reconstruction from a monoscopic endoscope according to claim 1, wherein said first illumination source is a laser.

### Claim 7 (depends on 1)

The system for stereo reconstruction from a monoscopic endoscope according to claim 1, wherein said first illumination source is a light emitting diode (LED).

### Claim 8 (depends on 1)

The system for stereo reconstruction from a monoscopic endoscope according to claim 1, wherein said first illumination source is a projector.

### Claim 9 (depends on 1)

The system for stereo reconstruction from a monoscopic endoscope according to claim 1, wherein said first illumination source is external to said working channel.

### Claim 10 (depends on 1)

The system for stereo reconstruction from a monoscopic endoscope according to claim 1, wherein the light patterning component further comprises a first transmission component and a second transmission component, said first transmission component having a first end axially aligned with said first illumination source and said second transmission component having a first end axially aligned with said second illumination source, wherein said first transmission component transmits light from said first illumination source and said second transmission component transmits light from said second illumination source.

### Claim 11 (depends on 10)

The system for stereo reconstruction from a monoscopic endoscope according to claim 10, wherein said first transmission component is an optical fiber.

### Claim 12 (depends on 10)

The system for stereo reconstruction from a monoscopic endoscope according to claim 10, wherein said first transmission component is an optical fiber bundle.

### Claim 13 (depends on 10)

The system for stereo reconstruction from a monoscopic endoscope according to claim 10, further comprising a lens adhered to a second end of said first transmission component.

### Claim 14 (depends on 10)

The system for stereo reconstruction from a monoscopic endoscope according to claim 10, further comprising a diffraction grating adhered to a second end of said first transmission component.

### Claim 15 (depends on 10)

The system for stereo reconstruction from a monoscopic endoscope according to claim 10, further comprising a transparent plate with an opaque pattern on said transparent plate adhered to a second end of said first transmission component.

### Claim 16 (depends on 1)

The system for stereo reconstruction from a monoscopic endoscope according to claim 1, further comprising:
an adapter disposed around a distal end of said monoscopic endoscope and defining a first channel for receiving said light patterning component and a second channel enabling said image pick-up element to capture an image.

### Claim 17 (depends on 1)

The system for stereo reconstruction from a monoscopic endoscope according to claim 1, wherein said light patterning component is configured to be attached to and detached from said monoscopic endoscope, and wherein said monoscopic endoscope is a conventional monoscopic endoscope.

### Claim 18

An endoscopic system for stereo reconstruction, comprising:
a monoscopic endoscope comprising an image pick-up element at a distal end thereof and a working channel within a body of said monoscopic endoscope so as to provide a port at said distal end of said monoscopic endoscope;
a first illumination source and a second illumination source being configured to emit light of different colors;
a light patterning component configured to be disposed within said working channel of said monoscopic endoscope such that a light emitting end of said light patterning component will be fixed with a defined relative distance from said distal end of said monoscopic endoscope, said light patterning component being further configured to receive the light of different colors at a proximal end of said monoscopic endoscope; and
a data processor adapted to be in communication with said image pick-up element,
wherein the first illumination source is configured to emit a first plurality of lines extending in a first direction and the second illumination source is configured to emit a second plurality of lines extending in a second direction different from said first direction,
wherein said first plurality of lines and said second plurality of lines are of different colors,
wherein said first plurality of lines and said second plurality of lines together form a pattern of light in a shape of a grid that is projected onto a region of interest,
wherein said data processor is configured to receive an image signal of said region of interest that includes said pattern, and
wherein said data processor is further configured to determine a distance from said monoscopic endoscope to said region of interest based on said image signal and based on said defined relative distance between said light emitting end of said light patterning component and said distal end of said image pick-up element.

### Claim 19 (depends on 18)

The endoscopic system for stereo reconstruction according to claim 18, wherein said monoscopic endoscope includes said image pick-up element, and wherein said light patterning component is configured to fit at least partially into said monoscopic endoscope.
