# US 2019/0167083 A1 · Endoscope system > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2019/0167083 A1 - Document ID: US20190167083A1 - Status: Published application - Kind: A1 - Application number: 16/272,312 - Filed: 2019-02-11 - Published: 2019-06-06 - Earliest claimed: 2016-09-06 - Assignees: Olympus Corporation - Applicants: Olympus Corporation - Inventors: Toshiaki WATANABE - Web page: https://patentgrep.com/patent/US20190167083A1 ## CPC - A61B 1/043: {for fluorescence imaging} - A61B 1/00: Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes (examination of body cavities or body tracts using ultrasonic, sonic or infrasonic waves A61B8/12; endoscopic instruments for taking cell samples or for biopsy A61B10/04); Illuminating arrangements therefor (for the eyes A61B3/00) - A61B 1/00163: {Optical arrangements (A61B1/002, A61B1/06 take precedence)} - A61B 1/05: characterised by the image sensor, e.g. camera, being in the distal end portion - A61B 1/0655: {Control therefor} - G02B 21/367: {providing an output produced by processing a plurality of individual source images, e.g. image tiling, montage, composite images, depth sectioning, image comparison} - G02B 23/2484: {Arrangements in relation to a camera or imaging device (processing or control of video signals generated by an endoscope H04N23/60, H04N23/70)} - G02B 23/26: using light guides {(for illumination G02B23/2469)} - A61B 1/00096: {Optical elements} - G02B 21/16: adapted for ultraviolet illumination {; Fluorescence microscopes (G02B21/0076 takes precedence)} - G02B 23/2461: {Illumination} - A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D) - G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS ## Abstract An endoscope system includes: a light source apparatus configured to emit excitation light for exciting a fluorescent medical agent and illuminating light; an image sensor configured to pick up an image of each of fluorescence emitted in response to application of the excitation light to an object present inside a body cavity of a subject to which the fluorescent medical agent is administered and reflected light emitted in response to application of the illuminating light to the object; and a mixed image generating circuit configured to generate an observation image in which a first image that is an image obtained by performing image pickup of the reflected light by the image sensor, and a second image that is an image indicating a site of emission of the fluorescence in the object are mixed in a set of pixel arrays that do not overlap each other and each have periodicity. ## Claims ### Claim 1 An endoscope system comprising: a light source apparatus configured to be capable of emitting excitation light for exciting a fluorescent medical agent administered to a subject and illuminating light for illuminating an inside of a body cavity of the subject; an image sensor configured to pick up an image of each of fluorescence emitted in response to application of the excitation light to an object present inside the body cavity of the subject to which the fluorescent medical agent is administered and reflected light emitted in response to application of the illuminating light to the object; and a mixed image generating circuit configured to generate an observation image in which a first image that is an image obtained by performing image pickup of the reflected light by the image sensor, and a second image that is an image indicating a site of emission of the fluorescence in the object are mixed in a set of pixel arrays that do not overlap each other and each have periodicity. ### Claim 2 (depends on 1) The endoscope system according to claim 1, further comprising a control circuit configured to generate a control signal for extracting a first pixel group from respective pixels included in the first image and extracting a second pixel group from respective pixels included in the second image, according to the set of pixel arrays that do not overlap each other and each have periodicity and output the control signal to the mixed image generating section. ### Claim 3 (depends on 2) The endoscope system according to claim 2, wherein the control circuit causes the first pixel group to be extracted according to a first checkered pixel array of the set of pixel arrays and causes the second pixel group to be extracted according to a second checkered pixel array of the set of pixel arrays. ### Claim 4 (depends on 2) The endoscope system according to claim 2, wherein the control circuit causes the first pixel group to be extracted according to a first vertically striped pixel array of the set of pixel arrays and causes the second pixel group to be extracted according to a second vertically striped pixel array of the set of pixel arrays. ### Claim 5 (depends on 2) The endoscope system according to claim 2, wherein the control circuit causes the first pixel group to be extracted according to a first horizontally striped pixel array of the set of pixel arrays and causes the second pixel group to be extracted according to a second horizontally striped pixel array of the set of pixel arrays. ### Claim 6 (depends on 2) The endoscope system according to claim 2, wherein: the control circuit generates a control signal for extracting a pixel present at a predetermined position in each of small areas of 2×2 pixels obtained as a result of the first image being divided into the small areas, as a pixel belonging to the first pixel group and extracting respective pixels present at positions other than the predetermined position in each of small areas of 2×2 pixels obtained as a result of the second image being divided into the small areas, as pixels belonging to the second pixel group; and the endoscope system further includes an input interface enabling providing an instruction for changing a ratio between the first pixel group and the second pixel group to the control circuit. ### Claim 7 (depends on 1) The endoscope system according to claim 1, further comprising a superimposed image generating circuit configured to generate a superimposed image in which the first image and a fluorescence image that is an image obtained by performing image pickup of the fluorescence by the image sensor are superimposed on each other, as the second image. ### Claim 8 (depends on 7) The endoscope system according to claim 7, wherein the superimposed image generating circuit and the mixed image generating circuit are configured integrally. ### Claim 9 (depends on 7) The endoscope system according to claim 7, wherein: the control circuit generates a control signal for extracting a pixel present at a predetermined position in each of small areas of 2×2 pixels obtained as a result of the first image being divided into the small areas, as a pixel belonging to the first pixel group and extracting respective pixels present at positions other than the predetermined position in each of small areas of 2×2 pixels obtained as a result of the superimposed image being divided into the small areas, as pixels belonging to the second pixel group; and when the superimposed image generating circuit generates the superimposed image, the superimposed image generating circuit sets a weight coefficient applied to the fluorescence image, based on the control signal from the control circuit. ### Claim 10 (depends on 2) The endoscope system according to claim 2, wherein the light source apparatus sets a light amount for the illuminating light based on a control signal from the control circuit. ### Claim 11 (depends on 6) The endoscope system according to claim 6, wherein the input interface is configured to enable setting a type of surgical operation performed for the subject and/or a type of the fluorescent medical agent. ### Claim 12 (depends on 1) The endoscope system according to claim 1, further comprising a contour enhancement processing circuit configured to perform contour enhancement processing for enhancing a contour in the first image and output the first image subjected to the contour enhancement processing to the mixed image generating circuit. ### Claim 13 (depends on 1) The endoscope system according to claim 1, further comprising a contour enhancement processing circuit configured to perform contour enhancement processing for enhancing a contour in the observation image generated by the mixed image generating circuit.