# US 2025/0143652 A1 · Method, processor, and medical observation device using two color images and color cameras for fluorescence and white-light

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0143652 A1
- Document ID: US20250143652A1
- Status: Published application
- Kind: A1
- Application number: 18/864,581
- Filed: 2023-05-15
- Published: 2025-05-08
- Earliest claimed: 2022-05-13
- Applicants: Leica Instruments (Singapore) Pte. Ltd.
- Inventors: George THEMELIS; Kyriakos PENTARAKIS
- Web page: https://patentgrep.com/patent/US20250143652A1

## CPC

- A61B 5/7425: {Displaying combinations of multiple images regardless of image source, e.g. displaying a reference anatomical image with a live image}
- A61B 1/00009: {of image signals during a use of endoscope}
- A61B 1/000095: {for image enhancement}
- A61B 1/0005: {combining images e.g. side-by-side, superimposed or tiled}
- A61B 1/043: {for fluorescence imaging}
- A61B 1/0638: {providing two or more wavelengths}
- A61B 5/0071: {by measuring fluorescence emission}
- A61B 5/0075: {by spectroscopy, i.e. measuring spectra, e.g. Raman spectroscopy, infrared absorption spectroscopy (A61B5/0071 takes precedence)}
- A61B 5/0077: {Devices for viewing the surface of the body, e.g. camera, magnifying lens}
- G02B 21/0012: {Surgical microscopes (counterbalanced structures for surgical microscopes G02B7/001)}
- G02B 21/16: adapted for ultraviolet illumination {; Fluorescence microscopes (G02B21/0076 takes precedence)}
- G02B 21/22: Stereoscopic arrangements
- G02B 21/367: {providing an output produced by processing a plurality of individual source images, e.g. image tiling, montage, composite images, depth sectioning, image comparison}
- G06T 5/50: using two or more images, e.g. averaging or subtraction
- G01N 21/6458: {Fluorescence microscopy (fluorescence microscopes per se G02B21/0076 and G02B21/16)}
- G06T 2207/10024: Color image
- G06T 2207/10056: Microscopic image
- G06T 2207/10064: Fluorescence image
- G06T 2207/10068: Endoscopic image
- G06T 2207/20221: Image fusion; Image merging
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G01N: INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES (measuring or testing apparatus or processes other than immunoassay, involving enzymes or microorganisms C12M, C12Q)

## Abstract

A computer-implemented image processing method for generating a digital output color image of an object includes retrieving a digital white-light color image of the object recorded in a first imaged spectrum, and retrieving a digital fluorescence-light color image of the object recorded in a second imaged spectrum. The second imaged spectrum overlaps a fluorescence emission spectrum of at least one fluorophore. The second imaged spectrum is different from the first imaged spectrum. Both the first imaged spectrum and the second imaged spectrum overlap a visible spectrum. The method further includes generating the digital output color image by combining the digital fluorescence-light color image and the digital white-light color image.

## Claims

### Claim 1

A computer-implemented image processing method for generating a digital output color image of an object, the method comprising:
retrieving a digital white-light color image of the object recorded in a first imaged spectrum;
retrieving a digital fluorescence-light color image of the object recorded in a second imaged spectrum, the second imaged spectrum overlapping with a fluorescence emission spectrum of at least one fluorophore, the second imaged spectrum being different from the first imaged spectrum, both the first imaged spectrum and the second imaged spectrum overlapping with a visible spectrum; and
generating the digital output color image by combining the digital fluorescence-light color image and the digital white-light color image.

### Claim 2 (depends on 1)

The computer-implemented image processing method according to claim 1, wherein the first imaged spectrum and the second imaged spectrum are complementary to one another.

### Claim 3 (depends on 2)

The computer-implemented image processing method according to claim 2, wherein
the digital white-light color image is represented in a first color space using at least three first color bands;
the digital fluorescence-light color image is represented in a second color space comprising at least three second color bands;
the digital output color image is generated in a third color space comprising at least three third color bands;
the first color bands and the second color bands are mapped onto the third color bands of the digital output color image using a linear transformation, and
wherein each first color band of the first color bands and each second color band of the second color bands are input as separate color bands into the linear transformation.

### Claim 4 (depends on 3)

The computer-implemented image processing method according to claim 3, wherein
the linear transformation comprises a color conversion matrix having a dimension of a number X times a number Y,
the number X being a sum of a quantity of the first color bands and a quantity of the second color bands,
the number Y being a quantity of third color bands in the third color space.

### Claim 5 (depends on 3)

The computer-implemented image processing method according to claim 3, wherein the first color space and the second color space are identical.

### Claim 6 (depends on 5)

The computer-implemented image processing method according to claim 5, wherein the first imaged spectrum comprises a first sub-band in a first color band of a color space, the second imaged spectrum comprises a second sub-band in the color band, and the first sub-band and the second sub-band are complementary to one another.

### Claim 7 (depends on 6)

The computer-implemented image processing method according to claim 6, wherein a color band of the third color space comprises the first sub-band and the second sub-band.

### Claim 8 (depends on 1)

The computer-implemented image processing method according to claim 1, wherein the second imaged spectrum comprises near infrared (NIR) wavelengths.

### Claim 9 (depends on 1)

The computer-implemented image processing method according to claim 1, wherein the digital fluorescence-light color image and the digital white-light color image are processed jointly as a digital multispectral image comprising at least five color bands.

### Claim 10 (depends on 1)

A method for operating a medical observation device, the method comprising:
carrying out the computer-implemented image processing method according to claim 1;
recording the digital white-light color image using a white-light color camera; and
recording the digital fluorescence-light color image using a fluorescence-light color camera.

### Claim 11 (depends on 10)

The method according to claim 10, wherein the white-light color camera and the fluorescence-light color camera are synchronized with respect to at least one of an exposure time or a gain.

### Claim 12

An image processor for a microscope or endoscope, the image processor being configured to:
retrieve a digital white-light color image of an object recorded in a first imaged spectrum;
retrieve a digital fluorescence-light color image of the object recorded in a second imaged spectrum, the second imaged spectrum overlapping with a fluorescence emission spectrum of at least one fluorophore, the second imaged spectrum being different from the first imaged spectrum, both the first imaged spectrum and the second imaged spectrum overlapping with a visible spectrum; and
generate a digital output color image by combining the digital fluorescence-light color image and the digital white-light color image.

### Claim 13 (depends on 12)

A medical observation device, comprising
an image processor according to claim 12;
a fluorescence-light color camera configured to record the digital fluorescence-light color image; and
a white-light color camera configured to record the digital white-light color image.

### Claim 14

A method using a fluorescence-light color camera in a medical observation device, the method comprising:
recording part of the spectrum of a digital output color image generated by the medical observation device, the medical observation device comprising a white-light color camera configured to record another part of the spectrum of the digital output color image.

### Claim 15 (depends on 1)

A non-transitory computer-readable medium having a computer program stored thereon, the computer program, when executed by a computer, facilitating performance of the method of claim 1.
