# US 10,307,051 B2 · Image processing device, method of image processing, and surgical microscope > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,307,051 B2 - Document ID: US10307051B2 - Status: Granted - Kind: B2 - Application number: 15/522,106 - Filed: 2016-09-30 - Published: 2018-01-11 - Granted: 2019-06-04 - Earliest claimed: 2015-10-15 - Assignees: Sony Corporation - Applicants: Sony Corporation - Inventors: Tomoyuki Ootsuki - Web page: https://patentgrep.com/patent/US10307051B2 ## CPC - A61B 3/0025: {characterised by electronic signal processing, e.g. eye models} - A61B 3/10: Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions - A61B 3/102: {for optical coherence tomography [OCT]} - A61B 3/107: for determining the shape or measuring the curvature of the cornea - A61B 3/13: Ophthalmic microscopes - A61F 9/007: Methods or devices for eye surgery - A61F 9/00736: {Instruments for removal of intra-ocular material or intra-ocular injection, e.g. cataract instruments (A61F9/008 takes precedence)} - G06T 7/0016: {involving temporal comparison} - G06T 7/60: Analysis of geometric attributes - A61B 2017/00119: {alarm; indicating an abnormal situation} - A61B 2017/00199: {with a console, e.g. a control panel with a display} - A61F 2009/00851: {Optical coherence topography [OCT]} - G06T 2207/10101: Optical tomography; Optical coherence tomography [OCT] - G06T 2207/30041: Eye; Retina; Ophthalmic - A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D) - A61F: FILTERS IMPLANTABLE INTO BLOOD VESSELS; PROSTHESES; DEVICES PROVIDING PATENCY TO, OR PREVENTING COLLAPSING OF, TUBULAR STRUCTURES OF THE BODY, e.g. STENTS; ORTHOPAEDIC, NURSING OR CONTRACEPTIVE DEVICES; FOMENTATION; TREATMENT OR PROTECTION OF EYES OR EARS; BANDAGES, DRESSINGS OR ABSORBENT PADS; FIRST-AID KITS (dental prosthetics A61C) - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL ## Abstract The present technology relates to an image processing device, a method of image processing, and a surgical microscope that can detect and report a dangerous condition on the basis of a tomographic image during eye surgery. An image processing device includes: a dangerous condition detection unit configured to detect a dangerous condition on the basis of a tomographic image of an eye acquired during surgery of the eye; and a control information generation unit configured to generate and output control information used to manage the detected dangerous condition. The present technology is applicable to, for example, a surgical system used for eye surgery or other surgical procedures. ## Claims ### Claim 1 An image processing device comprising: processing circuitry configured to obtain, along one or more tomographic planes, a tomographic image of an eye, the tomographic image being acquired during surgery of the eye, calculate a risk parameter based on positions of anatomical structures of the eye that are derived from the tomographic image and from a position of a surgical instrument to detect a dangerous condition on the basis of the tomographic image of an eye acquired during surgery of the eye; and generate and output control information that, upon the risk parameter passing a predetermined threshold, signals a warning to a user, displays the tomographic image of the detected dangerous condition, and/or initiates a change to an irrigation fluid pressure or the position of the surgical instrument that reduces a likelihood of complications resulting from the detected dangerous condition. ### Claim 2 (depends on 1) The image processing device according to claim 1, wherein the processing circuitry calculates the risk parameter on the basis of the tomographic image of the eye and detects the dangerous condition on the basis of the risk parameter. ### Claim 3 (depends on 2) The image processing device according to claim 2, wherein the processing circuitry calculates a distance from a corneal vertex to an iridocorneal angle as the risk parameter and detects the dangerous condition. ### Claim 4 (depends on 1) The image processing device according to claim 1, wherein the processing circuitry detects a shallow anterior chamber as the dangerous condition. ### Claim 5 (depends on 2) The image processing device according to claim 2, wherein the processing circuitry calculates a distance from a corneal vertex to a lower end of a posterior capsule as the risk parameter and detects the dangerous condition. ### Claim 6 (depends on 1) The image processing device according to claim 1, wherein the processing circuitry detects an infusion misdirection syndrome (IMS) risk as the dangerous condition. ### Claim 7 (depends on 2) The image processing device according to claim 2, wherein the dangerous condition detection unit calculates a distance from a specific portion of an implant to an upper end of a capsule as the risk parameter and detects the dangerous condition. ### Claim 8 (depends on 1) The image processing device according to claim 1, wherein the processing circuitry detects implant misplacement as the dangerous condition. ### Claim 9 (depends on 2) The image processing device according to claim 2, wherein the processing circuitry calculates a distance from a position of an incision of a cornea to an iris as the risk parameter and detects the dangerous condition. ### Claim 10 (depends on 1) The image processing device according to claim 1, wherein the processing circuitry detects an iris prolapse risk as the dangerous condition. ### Claim 11 (depends on 1) The image processing device according to claim 1, wherein the processing circuitry detects posterior capsule rupture as the dangerous condition. ### Claim 12 (depends on 1) The image processing device according to claim 1, wherein the dangerous condition detection unit detects nucleus drop as the dangerous condition. ### Claim 13 (depends on 1) The image processing device according to claim 1, wherein the processing circuitry is further to determine a capture plane of the tomographic image of the eye to be acquired on the basis of a front image of the eye. ### Claim 14 (depends on 13) The image processing device according to claim 13, wherein the processing circuitry determines a plane passing through a center position of a range of a cornea as the capture plane. ### Claim 15 (depends on 13) The image processing device according to claim 13, wherein the processing circuitry determines a plane passing through a tip of a surgical tool and being parallel to a longitudinal direction of the surgical tool as the capture plane. ### Claim 16 (depends on 13) The image processing device according to claim 13, wherein the processing circuitry determines a plane passing through a specific portion of an implant as the capture plane. ### Claim 17 (depends on 13) The image processing device according to claim 13, wherein the processing circuitry determines the capture plane of the tomographic image of the eye further on the basis of the tomographic image acquired previously. ### Claim 18 (depends on 13) The image processing device according to claim 13, wherein the processing circuitry dynamically determines the capture plane of the tomographic image of the eye to be acquired during surgery of the eye. ### Claim 19 (depends on 1) The image processing device according to claim 1, wherein the processing circuitry generates and outputs reporting information used to report the dangerous condition to a surgeon as the control information used to reduce the likelihood of complications resulting from the dangerous condition. ### Claim 20 (depends on 19) The image processing device according to claim 19, wherein the processing circuitry displays a moving image or a still image of the acquired tomographic image as the reporting information. ### Claim 21 (depends on 1) The image processing device according to claim 1, wherein the processing circuitry generates and outputs device control information used to control an external device as the control information used to reduce the likelihood of complications resulting from the dangerous condition. ### Claim 22 A method of image processing, the method comprising the steps of: Obtaining, along one or more tomographic planes, a tomographic image of an eye, the tomographic image being acquired during surgery of the eye, calculating a risk parameter based on positions of anatomical structures of the eye that are derived from the tomographic image and from a position of a surgical instrument, and detecting, by image processing circuitry, a dangerous condition on the basis of the tomographic image of an eye acquired during surgery of the eye; and generating and outputting, by the image processing circuitry, control information that, upon the risk parameter passing a predetermined threshold, signals a warning to a user, displays the tomographic image of the detected dangerous condition, and/or initiates a change to an irrigation fluid pressure or the position of the surgical instrument that reduces a likelihood of complications resulting from the detected dangerous condition. ### Claim 23 A surgical microscope comprising: a tomographic imager configured to capture, along one or more tomographic planes, a tomographic image of an eye, during surgery of the eye; and processing circuitry configured to calculate a risk parameter based on positions of anatomical structures of the eye that are derived from the tomographic image and from a position of a surgical instrument detect a dangerous condition on the basis of the tomographic image of the eye acquired during surgery, and generate and output control information that, upon the risk parameter passing a predetermined threshold, signals a warning to a user, displays the tomographic image of the detected dangerous condition, and/or initiates a change to an irrigation fluid pressure or the position of the surgical instrument that reduces a likelihood of complications resulting from the detected dangerous condition.