# US 11,998,165 B2 · Image processing device and method of operating same > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,998,165 B2 - Document ID: US11998165B2 - Status: Granted - Kind: B2 - Application number: 18/046,793 - Filed: 2022-10-14 - Published: 2023-03-02 - Granted: 2024-06-04 - Earliest claimed: 2020-04-17 - Assignees: FUJIFILM Corporation - Applicants: FUJIFILM Corporation - Inventors: Norimasa Shigeta - Web page: https://patentgrep.com/patent/US11998165B2 ## CPC - A61B 1/00009: {of image signals during a use of endoscope} - A61B 1/000094: {extracting biological structures} - A61B 1/06: with illuminating arrangements - G06T 11/10: Texturing; Colouring; Generation of textures or colours (retouching, inpainting or scratch removal G06T5/77) - G16H 20/40: relating to mechanical, radiation or invasive therapies, e.g. surgery, laser therapy, dialysis or acupuncture - G16H 30/20: for handling medical images, e.g. DICOM, HL7 or PACS - G16H 30/40: for processing medical images, e.g. editing - G16H 40/63: for local operation - A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D) - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA ## Abstract An image processing device including an image processor, which acquires an endoscopic image, calculates biological information on the basis of the endoscopic image, sets a reference value of the biological information, generates a biological information image obtained by forming the biological information as an image so that a low value region equal to or lower than the reference value and the other region are distinguishable from each other, determines that the reference value is not appropriate in a case where a quasi-low value region in which the biological information is higher than the reference value and equal to or lower than a preset set value is present in the biological information image, and performs a notification regarding the reference value. ## Claims ### Claim 1 An image processing device comprising: an image processor configured to: acquire an endoscopic image obtained by imaging a subject with an endoscope; calculate biological information on the basis of the endoscopic image; set a reference value of the biological information; generate a biological information image obtained by forming the biological information as an image so that a low value region equal to or lower than the reference value and the other region are distinguishable from each other; generate a display image in which the biological information image is superimposed on the endoscopic image; determine that the reference value is not appropriate in a case where a quasi-low value region in which the biological information is higher than the reference value and equal to or lower than a preset set value is present in the biological information image; and perform a notification regarding the reference value in a case where it is determined the reference value is not appropriate. ### Claim 2 (depends on 1) The image processing device according to claim 1, wherein the image processor is further configured to generate reference value color correspondence information in which a region where the biological information is equal to or lower than the reference value is associated with a specific color, and generate the biological information image on the basis of the reference value color correspondence information. ### Claim 3 (depends on 2) The image processing device according to claim 2, wherein the image processor is further configured to generate a display image by using a reference value color bar obtained by forming the reference value color correspondence information as an image, and a reference value index indicating the reference value. ### Claim 4 (depends on 3) The image processing device according to claim 3, wherein the image processor is further configured to, in a case where the reference value is set, generate the display image by using the reference value index indicating the set reference value. ### Claim 5 (depends on 3) The image processing device according to claim 3, wherein the image processor is further configured to calculate an average value of the biological information in the endoscopic image, and generate the display image by using the reference value color bar and an average value index indicating the average value. ### Claim 6 (depends on 1) The image processing device according to claim 1, wherein the image processor is further configured to, in a case where the reference value is set, generate reference value color correspondence information on the basis of the set reference value. ### Claim 7 (depends on 1) The image processing device according to claim 1, wherein the image processor is connected to a display that displays the display image and a display image storage that stores the display image, and the image processor is further configured to perform a control of thumbnail-displaying the display image stored in the display image storage on the display. ### Claim 8 (depends on 7) The image processing device according to claim 7, wherein the image processor is further configured to, in a case where the reference value is set, perform a control of displaying the display image to be thumbnail-displayed on the display after changing the display image on the basis of the reference value. ### Claim 9 (depends on 1) The image processing device according to claim 1, wherein the image processor is further configured to, in a case where the quasi-low value region is present in a preset ratio or more in the biological information image, determine that the reference value is not appropriate. ### Claim 10 (depends on 1) The image processing device according to claim 1, wherein the image processor is further configured to, in a case where the quasi-low value region continues to be present for a preset time or more, determine that the reference value is not appropriate. ### Claim 11 (depends on 1) The image processing device according to claim 1, wherein the image processor is further configured to, in a case where it is not determined that the reference value is not appropriate, perform a notification that the reference value is appropriate. ### Claim 12 (depends on 1) The image processing device according to claim 1, wherein the image processor is further configured to recognize a site of the subject on the basis of the endoscopic image, and set the reference value on the basis of the site. ### Claim 13 (depends on 1) The image processing device according to claim 1, wherein the image processor is further configured to, in a case where the image processor determines that the reference value is not appropriate, switch and set the reference value to a higher value. ### Claim 14 (depends on 1) The image processing device according to claim 1, wherein the image processor is further configured to, in a case where the reference value and the set value satisfy a preset condition, change and set the reference value to a preset value that is higher than the reference value before a change and does not exceed the set value. ### Claim 15 (depends on 1) The image processing device according to claim 1, wherein the biological information is an oxygen saturation of the subject. ### Claim 16 A method of operating an image processing device including an image processor, the method comprising: acquiring an endoscopic image obtained by imaging a subject with an endoscope; calculating biological information on the basis of the endoscopic image; setting a reference value of the biological information; generating a biological information image obtained by forming the biological information as an image so that a low value region equal to or lower than the reference value and the other region are distinguishable from each other; generating a display image in which the biological information image is superimposed on the endoscopic image; determining that the reference value is not appropriate in a case where a quasi-low value region in which the biological information is higher than the reference value and equal to or lower than a preset set value is present in the biological information image; and performing a notification regarding the reference value in a case where it is determined the reference value is not appropriate.