# US 10,244,972 B2 · Fluorescence observation device, endoscopic system, processor device, and operation method > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,244,972 B2 - Document ID: US10244972B2 - Status: Granted - Kind: B2 - Application number: 15/041,553 - Filed: 2016-02-11 - Published: 2016-06-09 - Granted: 2019-04-02 - Earliest claimed: 2013-09-27 - Assignees: FUJIFILM Corporation - Applicants: FUJIFILM Corporation - Inventors: Shunsuke Tominaga - Web page: https://patentgrep.com/patent/US10244972B2 ## CPC - A61B 5/14556: {by fluorescence (A61B5/14555 takes precedence)} - A61B 1/000094: {extracting biological structures} - A61B 1/043: {for fluorescence imaging} - A61B 1/0638: {providing two or more wavelengths} - A61B 1/0646: {with illumination filters} - A61B 5/14546: {for measuring analytes not otherwise provided for, e.g. ions, cytochromes} - G02B 23/2461: {Illumination} - A61B 1/00188: {with focusing or zooming features} - A61B 5/14539: {for measuring pH} - A61B 5/7425: {Displaying combinations of multiple images regardless of image source, e.g. displaying a reference anatomical image with a live image} - G01N 21/6456: {Spatial resolved fluorescence measurements; Imaging} - G02B 21/16: adapted for ultraviolet illumination {; Fluorescence microscopes (G02B21/0076 takes precedence)} - G02B 26/008: {in the form of devices for effecting sequential colour changes, e.g. colour wheels} - A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D) - G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS - G01N: INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES (measuring or testing apparatus or processes other than immunoassay, involving enzymes or microorganisms C12M, C12Q) ## Abstract A fluorescence observation device includes an oxygen saturation calculation section, a reference region setting section, a region-of-interest setting section, a normalized fluorescence intensity calculation section, and a fluorescent image generation section. The oxygen saturation calculation section calculates the oxygen saturation of the subject for each pixel. The reference region setting section sets a reference region of the subject based on the oxygen saturation. The region-of-interest setting section sets a region of interest of the subject. The normalized fluorescence intensity calculation section calculates a normalized fluorescence intensity indicating the normalized emission intensity of the fluorescence by dividing the region-of-interest fluorescence intensity, which is calculated using the pixel value of the region of interest, by the reference fluorescence intensity calculated using the pixel value of the reference region of a fluorescent image signal obtained by imaging the subject with the fluorescence. The fluorescent image generation section generates a fluorescent image based on the normalized fluorescence intensity. ## Claims ### Claim 1 A fluorescence observation device, comprising: a signal light source that irradiates a subject with signal light having a wavelength band where an absorption coefficient changes with an oxygen saturation of blood hemoglobin; an excitation light source that irradiates the subject with excitation light for emitting fluorescence by exciting a fluorescent material contained in the subject; an image sensor that images the subject with the signal light and outputs a first image signal and that images the subject with the fluorescence and outputs a second image signal; and a processor unit that calculates an oxygen saturation of the subject for each pixel based on the first image signal, sets a reference region of the subject based on the oxygen saturation, sets a region of interest of the subject, calculates a normalized fluorescence intensity indicating a normalized emission intensity of the fluorescence by dividing a region-of-interest fluorescence intensity, which is calculated using a pixel value of the region of interest of the subject in the second image signal, by a reference fluorescence intensity calculated using a pixel value of the reference region of the subject in the second image signal, and generates a fluorescent image of the region of interest which is pseudo colored based on the normalized fluorescence intensity. ### Claim 2 (depends on 1) The fluorescence observation device according to claim 1, wherein the processor unit sets the region of interest based on the oxygen saturation. ### Claim 3 (depends on 2) The fluorescence observation device according to claim 2, wherein the processor unit sets a region where the oxygen saturation falls within a specific range as the reference region. ### Claim 4 (depends on 2) The fluorescence observation device according to claim 2, further comprising: a display unit that displays a fluorescent image, wherein the processor unit obtains a plurality of fluorescent images by imaging the same subject at two or more different times, and displays the plurality of fluorescent images in time series on the display unit. ### Claim 5 (depends on 1) The fluorescence observation device according to claim 1, wherein the processor unit sets the region of interest based on shape information of the subject. ### Claim 6 (depends on 5) The fluorescence observation device according to claim 5, wherein the processor unit sets a region where the oxygen saturation falls within a specific range as the reference region. ### Claim 7 (depends on 5) The fluorescence observation device according to claim 5, further comprising: a display unit that displays a fluorescent image, wherein the processor unit obtains a plurality of fluorescent images by imaging the same subject at two or more different times, and displays the plurality of fluorescent images in time series on the display unit. ### Claim 8 (depends on 1) The fluorescence observation device according to claim 1, wherein the processor unit sets a region where the oxygen saturation falls within a specific range as the reference region. ### Claim 9 (depends on 8) The fluorescence observation device according to claim 8, further comprising: a display unit that displays a fluorescent image, wherein the processor unit obtains a plurality of fluorescent images by imaging the same subject at two or more different times, and displays the plurality of fluorescent images in time series on the display unit. ### Claim 10 (depends on 1) The fluorescence observation device according to claim 1, further comprising: a display unit that displays a fluorescent image, wherein the processor unit obtains a plurality of fluorescent images by imaging the same subject at two or more different times, and displays the plurality of fluorescent images in time series on the display unit. ### Claim 11 (depends on 1) The fluorescence observation device according to claim 1, wherein the processor unit calculates the normalized fluorescence intensity using the region of interest set at a specific time of imaging and the reference region set at each time of imaging. ### Claim 12 A fluorescence observation device, comprising: an illumination light source that irradiates a subject, at least a part of which is colored with a colorant, with illumination light by which a color due to the colorant can be identified; an excitation light source that irradiates the subject with excitation light for emitting fluorescence by exciting a fluorescent material contained in the subject; an image sensor that images the subject with the illumination light and outputs a first image signal and that images the subject with the fluorescence and outputs a second image signal; and a processor unit that sets a reference region according to a color due to the colorant, sets a region of interest of the subject, calculates a normalized fluorescence intensity indicating a normalized emission intensity of the fluorescence by dividing a region-of-interest fluorescence intensity, which is calculated using a pixel value of the region of interest of the subject in the second image signal, by a reference fluorescence intensity calculated using a pixel value of the reference region of the subject in the second image signal, and generates a fluorescent image of the region of interest which is pseudo colored based on the normalized fluorescence intensity. ### Claim 13 (depends on 12) The fluorescence observation device according to claim 12, wherein the processor unit sets the region of interest according to a color due to the colorant. ### Claim 14 (depends on 12) The fluorescence observation device according to claim 12, wherein the colorant is a pH indicator that changes with pH of the subject. ### Claim 15 (depends on 14) The fluorescence observation device according to claim 14, wherein the processor unit sets a region where the pH is equal to or greater than a specific value as the reference region. ### Claim 16 (depends on 12) The fluorescence observation device according to claim 12, wherein the colorant contains at least one of indigo carmine, toluidine blue, methylene blue, Lugol's solution, crystal violet, fluorescein, acridine orange, indocyanine green, or acetic acid. ### Claim 17 (depends on 12) The fluorescence observation device according to claim 12, wherein the processor unit generates the fluorescent image of the region of interest which is pseudo-colored, by using the second image signal obtained from the subject with fluorescence before the colorant is administered to the subject and the first image signal obtained from the subject with the illumination light after the colorant is administered to the subject. ### Claim 18 An endoscopic system, comprising: a signal light source that irradiates a subject with signal light having a wavelength band where an absorption coefficient changes with an oxygen saturation of blood hemoglobin; an excitation light source that irradiates the subject with excitation light for emitting fluorescence by exciting a fluorescent material contained in the subject; an image sensor that images the subject with the signal light and outputs a first image signal and that images the subject with the fluorescence and outputs a second image signal; and processor unit that calculates an oxygen saturation of the subject for each pixel based on the first image signal, sets a reference region of the subject based on the oxygen saturation, sets a region of interest of the subject, calculates a normalized fluorescence intensity indicating a normalized emission intensity of the fluorescence by dividing a region-of-interest fluorescence intensity, which is calculated using a pixel value of the region of interest of the subject in the second image signal, by a reference fluorescence intensity calculated using a pixel value of the reference region of the subject in the second image signal, and generates a fluorescent image of the region of interest which is pseudo colored based on the normalized fluorescence intensity. ### Claim 19 A processor device of an endoscopic system including a signal light source that irradiates a subject with signal light having a wavelength band where an absorption coefficient changes with an oxygen saturation of blood hemoglobin, an excitation light source that irradiates the subject with excitation light for emitting fluorescence by exciting a fluorescent material contained in the subject, and an image sensor that images the subject with the signal light and outputs a first image signal and that images the subject with the fluorescence and outputs a second image signal, the processor device comprising: a processor unit that calculates an oxygen saturation of the subject for each pixel based on the first image signal, sets a reference region of the subject based on the oxygen saturation, sets a region of interest of the subject, calculates a normalized fluorescence intensity indicating a normalized emission intensity of the fluorescence by dividing a region-of-interest fluorescence intensity, which is calculated using a pixel value of the region of interest of the subject in the second image signal, by a reference fluorescence intensity calculated using a pixel value of the reference region of the subject in the second image signal, and generates a fluorescent image of the region of interest which is pseudo colored based on the normalized fluorescence intensity. ### Claim 20 An operation method of a device including a signal light source that irradiates a subject with signal light having a wavelength band where an absorption coefficient changes with an oxygen saturation of blood hemoglobin, an excitation light source that irradiates the subject with excitation light for emitting fluorescence by exciting a fluorescent material contained in the subject, and an image sensor that images the subject with the signal light and outputs a first image signal and that images the subject with the fluorescence and outputs a second image signal, the operation method comprising: an oxygen saturation calculation step of calculating an oxygen saturation of the subject for each pixel based on the first image signal; a reference region setting step of setting a reference region of the subject based on the oxygen saturation; a region-of-interest setting step of setting a region of interest of the subject; a normalized fluorescence intensity calculation step of calculating a normalized fluorescence intensity indicating a normalized emission intensity of the fluorescence by dividing a region-of-interest fluorescence intensity, which is calculated using a pixel value of the region of interest of the subject in the second image signal, by a reference fluorescence intensity calculated using a pixel value of the reference region of the subject in the second image signal; and a fluorescent image generation step of generating a fluorescent image of the region of interest which is pseudo colored based on the normalized fluorescence intensity.