# US 12,514,504 B2 · Optical fiber waveguide in an endoscopic system for hyperspectral, fluorescence, and laser mapping imaging

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,514,504 B2
- Document ID: US12514504B2
- Status: Granted
- Kind: B2
- Application number: 17/567,805
- Filed: 2022-01-03
- Published: 2022-04-28
- Granted: 2026-01-06
- Earliest claimed: 2019-06-20
- Assignees: Cilag GmbH International
- Applicants: Cilag GmbH International
- Inventors: Joshua D. Talbert; Donald M. Wichern
- Web page: https://patentgrep.com/patent/US12514504B2

## CPC

- A61B 5/6847: {mounted on an invasive device}
- A61B 1/00006: {of control signals}
- A61B 1/000095: {for image enhancement}
- A61B 1/043: {for fluorescence imaging}
- A61B 1/045: Control thereof
- A61B 1/05: characterised by the image sensor, e.g. camera, being in the distal end portion
- A61B 1/051: {Details of CCD assembly}
- A61B 1/0605: {for spatially modulated illumination}
- A61B 1/063: {for monochromatic or narrow-band illumination}
- A61B 1/0638: {providing two or more wavelengths}
- A61B 1/0655: {Control therefor}
- A61B 1/0669: {at proximal end of an endoscope}
- A61B 1/07: using light-conductive means, e.g. optical fibres
- A61B 5/0062: {Arrangements for scanning}
- A61B 5/0071: {by measuring fluorescence emission}
- A61B 5/0086: {using infrared radiation}
- A61B 5/1076: {for measuring dimensions inside body cavities, e.g. using catheters (A61B3/1005 takes precedence)}
- G02B 6/0006: {Coupling light into the fibre (in general G02B6/4298)}
- G02B 6/0008: {the light being emitted at the end of the fibre}
- G02B 6/04: formed by bundles of fibres (G02B6/24 takes precedence)
- G02B 6/06: the relative position of the fibres being the same at both ends, e.g. for transporting images
- G06T 7/0012: {Biomedical image inspection}
- H04N 7/18: Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N 23/54: Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils
- H04N 23/56: provided with illuminating means
- H04N 23/73: by influencing the exposure time
- H04N 23/74: by influencing the scene brightness using illuminating means
- A61B 1/0005: {combining images e.g. side-by-side, superimposed or tiled}
- A61B 1/0646: {with illumination filters}
- A61B 1/307: for the urinary organs, e.g. urethroscopes or cystoscopes
- A61B 5/0075: {by spectroscopy, i.e. measuring spectra, e.g. Raman spectroscopy, infrared absorption spectroscopy (A61B5/0071 takes precedence)}
- A61B 5/0261: {using optical means, e.g. infrared light}
- A61B 5/4887: {Locating particular structures in or on the body}
- A61B 5/489: {Blood vessels}
- A61B 5/4893: {Nerves}
- A61B 2562/0233: Special features of optical sensors or probes classified in A61B5/00
- A61B 2562/223: Optical cables therefor
- G06T 2207/10064: Fluorescence image
- G06T 2207/10068: Endoscopic image
- G06T 2207/20221: Image fusion; Image merging
- G06T 2207/30004: Biomedical image processing
- H04N 23/555: {for picking-up images in sites, inaccessible due to their dimensions or hazardous conditions, e.g. endoscopes or borescopes}
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Optical fiber waveguide for communicating electromagnetic radiation pulsed by an emitter in an endoscopic imaging system. A system includes an emitter for emitting pulses of electromagnetic radiation and an endoscope comprising an image sensor for sensing reflected electromagnetic radiation. The system includes a waveguide communicating the pulses of electromagnetic radiation from the emitter to the endoscope. The system is such that at least a portion of the pulses of electromagnetic radiation emitted by the emitter comprises one or more of a hyperspectral emission, a fluorescence emission, and/or a laser mapping pattern.

## Claims

### Claim 1

A system comprising:
an endoscope;
an emitter that emits electromagnetic radiation, wherein the emitter comprises a plurality of electromagnetic sources;
an image sensor;
a waveguide that receives the electromagnetic radiation pulsed by the emitter and carries the electromagnetic radiation to a distal end of the endoscope, wherein the waveguide comprises a plurality of optical fibers; and
a controller in communication with the emitter and the image sensor;
wherein the plurality of electromagnetic sources of the emitter comprises:
a visible source tuned to pulse broadband electromagnetic radiation only within a visible waveband of the electromagnetic spectrum;
a first multispectral source tuned to pulse narrowband visible electromagnetic radiation only within a visible waveband that is 20 nm wide or less without use of a filter;
a second multispectral source tuned to pulse narrowband infrared electromagnetic radiation only within an infrared waveband that is 20 nm wide or less without use of a filter; and
a fluorescence source tuned to pulse a fluorescence excitation wavelength of electromagnetic radiation;
wherein the controller instructs the plurality of electromagnetic sources of the emitter to independently actuate each of the plurality of electromagnetic sources according to a pulse cycle;
wherein the pulse cycle comprises actuating each of the plurality of electromagnetic sources in a repeating pattern, and wherein one of the plurality of electromagnetic sources within the repeating pattern is actuated per frame on a successive frame basis;
wherein electromagnetic radiation emitted by each of the first multispectral source and the second multispectral source elicits a spectral response from a tissue;
wherein each wavelength within the visible waveband of the first multispectral source and the infrared waveband of the second multispectral source elicits a different spectral response;
wherein the image sensor receives the elicited spectral response and reads out spectral data;
wherein the plurality of optical fibers of the waveguide is arranged such that each of the plurality of optical fibers receives substantially an equivalent portion of the electromagnetic radiation emitted by the emitter; and
wherein the emitter provides energy to the plurality of electromagnetic sources such that the substantially equivalent portion of the electromagnetic radiation received by each of the plurality of optical fibers remains below a burnout threshold for the plurality of optical fibers.

### Claim 2 (depends on 1)

The system of claim 1, wherein the image sensor comprises two independent image sensors; and
wherein an image signal processor outputs three-dimensional imaging data based on data output by the two independent image sensors.

### Claim 3 (depends on 1)

The system of claim 1, wherein the plurality of electromagnetic sources further comprises a laser mapping source that pulses electromagnetic radiation in a mapping pattern;
wherein the image sensor outputs a laser mapping exposure frame in response to the emitter cycling the laser mapping source on and off; and
wherein the laser mapping exposure frame comprises data for calculating one or more of a three-dimensional topographical map of a scene, a dimension of one or more objects within the scene, or a distance.

### Claim 4 (depends on 1)

The system of claim 1, wherein the plurality of electromagnetic sources further comprises a laser mapping source that pulses electromagnetic radiation in a mapping pattern comprising one or more of a raster grid of discrete points, an occupancy grid map, a dot array, horizontal hashing, or vertical hashing.

### Claim 5 (depends on 1)

The system of claim 1, wherein the emitter is located remote from the endoscope, and wherein the waveguide communicates the electromagnetic radiation from the emitter to a distal end of the endoscope for illuminating a light-deficient environment.

### Claim 6 (depends on 1)

The system of claim 1, further comprising a collection region, wherein each of the plurality of electromagnetic sources of the emitter is aimed at the collection region, and wherein the waveguide communicates the electromagnetic radiation from the collection region to a distal end of the endoscope.

### Claim 7 (depends on 1)

The system of claim 1, further comprising an intervening optical element disposed between the emitter and the waveguide, wherein the intervening optical element is configured to collect emissions from the plurality of electromagnetic sources prior to the emission being received by the waveguide.

### Claim 8 (depends on 1)

The system of claim 1, wherein the waveguide comprises one of:
a single optical fiber; or
an optical fiber bundle comprising a plurality of optical fibers.

### Claim 9 (depends on 1)

The system of claim 1, further comprising a lumen of the endoscope comprising a distal end, and wherein the distal end of the lumen is configured for insertion into a light deficient environment for visualization, and wherein:
the waveguide is an optical fiber bundle comprising a plurality of optical fibers;
the plurality of optical fibers are disposed within the lumen and terminate at the distal end of the lumen; and
the plurality of optical fibers are aimed in at least two different directions at the distal end of the lumen such that a light cone generated by the electromagnetic radiation exiting the plurality of optical fibers has an increased area.

### Claim 10 (depends on 1)

The system of claim 1, wherein the controller provides instructions to the emitter to independently actuate each of the plurality of electromagnetic sources, and wherein the controller synchronizes timing of the image sensor and the emitter.

### Claim 11 (depends on 1)

The system of claim 1, wherein the controller causes the image sensor to sense an exposure frame in response to an emission by at least one of the plurality of electromagnetic sources, and wherein the image sensor senses a plurality of exposure frames comprising:
a color exposure frame in response to an emission by the visible source;
a visible multispectral exposure frame in response to an emission by the first multispectral source;
an infrared multispectral exposure frame in response to an emission by the second multispectral source; and
a fluorescence exposure frame in response to an emission by the fluorescence source.

### Claim 12 (depends on 11)

The system of claim 11, wherein:
the color exposure frame comprises data depicting a scene;
the visible multispectral exposure frame and the infrared multispectral exposure frame each comprise data indicating a spectral response of one or more objects within the scene; and
the fluorescence exposure frame comprises data indicating a fluorescence relaxation wavelength sensed by the image sensor.

### Claim 13 (depends on 1)

The system of claim 1, wherein the system provides visualization during a robotic surgical procedure, and wherein the controller communicates data sensed by the image sensor to one or more processors configured to execute the robotic surgical procedure.

### Claim 14 (depends on 1)

The system of claim 1, wherein the controller adjusts the pulse cycle to emphasize or de-emphasize aspects of a scene as requested by a user.

### Claim 15 (depends on 1)

The system of claim 1, wherein the controller is configured to:
receive multispectral data that is sensed by the image sensor in response to an emission by one or more of the first multispectral source or the second multispectral source; and
provide the multispectral data to a corresponding multispectral system configured to identify one or more of a disease, a tissue condition, a chemical process, or a tissue type based on the multispectral data.

### Claim 16 (depends on 1)

The system of claim 1, wherein the controller is configured to:
receive fluorescence data that is sensed by the image sensor in response to an emission by the fluorescence source; and
provide the fluorescence data to a corresponding fluorescence system configured to identify one or more of a disease, a tissue condition, a chemical process, or a tissue type based on the fluorescence.

### Claim 17 (depends on 1)

The system of claim 1, wherein the fluorescence source comprises one or more independent electromagnetic sources that are independently actuatable by a controller, and wherein the independent electromagnetic sources comprise one or more of:
an electromagnetic source that pulses electromagnetic radiation within a waveband from about 770 nm to about 795 nm without use of a filter;
an electromagnetic source that pulses electromagnetic radiation within a waveband from about 790 nm to about 815 nm without use of a filter; or
an electromagnetic source that pulses electromagnetic radiation within a waveband from about 790 nm to about 795 nm without use of a filter.

### Claim 18 (depends on 1)

The system of claim 1, wherein each of the first multispectral source and the second multispectral source comprises one or more independent electromagnetic sources that are independently actuatable by a controller, and wherein the independent electromagnetic sources comprise one or more of:
an electromagnetic that pulses electromagnetic radiation within a waveband from about 513 nm to about 545 nm without use of a filter;
an electromagnetic that pulses electromagnetic radiation within a waveband from about 565 nm to about 585 nm without use of a filter; or
an electromagnetic that pulses electromagnetic radiation within a waveband from about 900 nm to about 1000 nm without use of a filter.

### Claim 19 (depends on 1)

The system of claim 1, wherein:
each of the first multispectral source and the second multispectral source is selected by the controller to elicit a spectral response; and
the fluorescence excitation wavelength is selected by the controller to fluorescence one or more of a reagent or the tissue within the scene.

### Claim 20 (depends on 1)

The system of claim 1, further comprising an image signal processor in communication with the controller, wherein the image signal processor renders the output video stream in accordance with the user input; and
wherein at least a portion of a plurality of frames in the output video stream comprises an overlay.