# US 2025/0082174 A1 · Medical information processing system, medical information processing method, and program > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2025/0082174 A1 - Document ID: US20250082174A1 - Status: Published application - Kind: A1 - Application number: 18/728,491 - Filed: 2023-01-16 - Published: 2025-03-13 - Earliest claimed: 2022-01-31 - Assignees: Sony Group Corporation - Applicants: Sony Group Corporation - Inventors: Keisuke UYAMA - Web page: https://patentgrep.com/patent/US20250082174A1 ## CPC - A61B 1/00009: {of image signals during a use of endoscope} - A61B 1/05: characterised by the image sensor, e.g. camera, being in the distal end portion - A61B 1/0005: {combining images e.g. side-by-side, superimposed or tiled} - A61B 1/00194: {adapted for three-dimensional imaging} - A61B 1/043: {for fluorescence imaging} - A61B 1/046: {for infrared imaging} - A61B 90/361: {Image-producing devices, e.g. surgical cameras} - G06T 7/579: from motion - G06T 11/00: Two-dimensional [2D] image generation - G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)} - G16H 30/20: for handling medical images, e.g. DICOM, HL7 or PACS - G16H 30/40: for processing medical images, e.g. editing - G16H 50/20: for computer-aided diagnosis, e.g. based on medical expert systems - G16H 50/50: for simulation or modelling of medical disorders - A61B 90/20: Surgical microscopes characterised by non-optical aspects - A61B 90/30: Devices for illuminating a surgical field, the devices having an interrelation with other surgical devices or with a surgical procedure - A61B 2034/2048: {using an accelerometer or inertia sensor} - A61B 2090/376: {using X-rays, e.g. fluoroscopy} - G06T 2200/24: involving graphical user interfaces [GUIs] - G06T 2207/10068: Endoscopic image - G06T 2210/41: Medical - A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D) - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA ## Abstract The present technology relates to a medical information processing system, a medical information processing method, and a program that enable a user to recognize reliability of additional information provided using three-dimensional information in a patient's body generated by SLAM or the like. Three-dimensional information including a three-dimensional map of an operative field of a patient is generated, reliability of the three-dimensional information is determined, and a presentation form of additional information provided using the three-dimensional information is changed on the basis of the reliability. ## Claims ### Claim 1 A medical information processing system comprising: a three-dimensional information generation unit that generates three-dimensional information including a three-dimensional map of an operative field of a patient; a reliability determination unit that determines reliability of the three-dimensional information; and a presentation control unit that changes a presentation form of additional information provided using the three-dimensional information on a basis of reliability determined by the reliability determination unit. ### Claim 2 (depends on 1) The medical information processing system according to claim 1, wherein the additional information is information indicating a three-dimensional position on the three-dimensional map. ### Claim 3 (depends on 2) The medical information processing system according to claim 2, wherein the additional information is information superimposed on a captured image obtained by capturing the operative field. ### Claim 4 (depends on 1) The medical information processing system according to claim 1, wherein the reliability determination unit determines the reliability by a stepwise value. ### Claim 5 (depends on 3) The medical information processing system according to claim 3, wherein the additional information is an additional image superimposed on a position on the captured image corresponding to the three-dimensional position. ### Claim 6 (depends on 5) The medical information processing system according to claim 5, wherein the presentation control unit changes a form of the additional image as a presentation form of the additional information. ### Claim 7 (depends on 6) The medical information processing system according to claim 6, wherein the presentation control unit changes a density, a color, a thickness, or a presentation state of the additional image as a form of the additional image. ### Claim 8 (depends on 6) The medical information processing system according to claim 6, wherein the reliability determination unit determines the reliability on a basis of an elapsed time from setting of the captured image, and the presentation control unit changes a form of the additional image on a basis of the reliability. ### Claim 9 (depends on 3) The medical information processing system according to claim 3, further comprising a two-dimensional position calculation unit that calculates a position on the captured image on which the additional information is superimposed, wherein the two-dimensional position calculation unit changes processing of calculating a position on the captured image on which the additional information is superimposed according to the reliability. ### Claim 10 (depends on 9) The medical information processing system according to claim 9, wherein the two-dimensional position calculation unit performs a change to one of first processing of calculating the position on the captured image on which the additional information is superimposed using the three-dimensional map and second processing of calculating the position on the captured image on which the additional information is superimposed without using the three-dimensional map. ### Claim 11 (depends on 10) The medical information processing system according to claim 10, wherein the presentation control unit presents a fact that the position on the captured image on which the additional information is superimposed is calculated by the second processing in a case where the reliability determination unit determines that the reliability is the reliability in a case of a situation in which a change to the second processing is performed. ### Claim 12 (depends on 1) The medical information processing system according to claim 1, further comprising an image accumulation unit that stores a captured image for a certain period obtained by capturing the operative field, wherein the three-dimensional information generation unit generates the three-dimensional map using the captured image stored in the image accumulation unit in a case where data of the three-dimensional map is insufficient at a time at which the additional information is set. ### Claim 13 (depends on 12) The medical information processing system according to claim 12, wherein the reliability determination unit determines a status of data of the three-dimensional map as the reliability, and the presentation control unit presents a fact that the additional information is presented using the three-dimensional map generated using the captured image stored in the image accumulation unit in a case where the reliability determination unit determines that the reliability is the reliability in a case where data of the three-dimensional map is insufficient. ### Claim 14 A medical information processing method of a medical information processing system including: a three-dimensional information generation unit; a reliability determination unit; and a presentation control unit, wherein the three-dimensional information generation unit generates three-dimensional information including a three-dimensional map of an operative field of a patient, the reliability determination unit determines reliability of the three-dimensional information, and the presentation control unit changes a presentation form of additional information provided using the three-dimensional information on a basis of the reliability. ### Claim 15 A program that causes a computer to function as: a three-dimensional information generation unit that generates three-dimensional information including a three-dimensional map of an operative field of a patient; a reliability determination unit that determines reliability of the three-dimensional information; and a presentation control unit that changes a presentation form of additional information provided using the three-dimensional information on a basis of reliability determined by the reliability determination unit.