# US 11,026,762 B2 · Medical observation device, processing method, and medical observation system > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,026,762 B2 - Document ID: US11026762B2 - Status: Granted - Kind: B2 - Application number: 16/614,801 - Filed: 2018-03-02 - Published: 2020-06-25 - Granted: 2021-06-08 - Earliest claimed: 2017-05-26 - Assignees: Sony Olympus Medical Solutions Inc. - Applicants: Sony Olympus Medical Solutions Inc. - Inventors: Seiji Kuramoto - Web page: https://patentgrep.com/patent/US11026762B2 ## CPC - A61B 90/20: Surgical microscopes characterised by non-optical aspects - A61B 90/25: Supports therefor - A61B 34/74: {Manipulators with manual electric input means} - A61B 90/50: Supports for surgical instruments, e.g. articulated arms - G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback} - H04N 23/66: Remote control of cameras or camera parts, e.g. by remote control devices - A61B 2017/00203: {with speech control or speech recognition} - A61B 2017/00207: {with hand gesture control or hand gesture recognition} - A61B 2017/00212: {using remote controls} - A61B 2017/00216: {with eye tracking or head position tracking control} - A61B 2017/00221: {with wireless transmission of data, e.g. by infrared radiation or radiowaves} - A61B 2090/508: {with releasable brake mechanisms} - A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D) - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract Provided is a medical observation device which includes a detection unit configured to detect a pressing operation based on an operation signal according to the pressing operation which is output from an external operation device equipped with a switch pressed by a mouth, and a processing unit configured to perform a process corresponding to the detected pressing operation. The process corresponding to the pressing operation includes some or all of a process related to an imaging operation of an imaging device, a process related to a display of a medical captured image which is captured in the imaging device, and an identification process of identifying a user's input indicating the process related to the imaging operation or the process related to the display of the medical captured image. ## Claims ### Claim 1 A medical observation device, comprising: processing circuitry configured to detect a pressing operation based on an operation signal according to the pressing operation output from an external operation device equipped with a switch pressed by a mouth; and perform a process of controlling the medical observation device corresponding to the detected pressing operation, wherein the process corresponding to the pressing operation includes some or all of a process related to an imaging operation of an imaging device, a process related to a display of a medical captured image which is captured in the imaging device, and an identification process of identifying a user's input indicating the process related to the imaging operation or the process related to the display of the medical captured image, the processing circuitry is further configured to switch to a mode for performing the identification process based on the detection of the pressing operation, perform a process corresponding to the user's input identified by the identification process, perform a voice recognition process of recognizing voice, as the identification process, on a voice signal output from a voice input device, and perform a process corresponding to the recognized voice. ### Claim 2 (depends on 1) The medical observation device according to claim 1, wherein the voice input device is provided in the external operation device. ### Claim 3 (depends on 1) The medical observation device according to claim 1, wherein the processing circuitry is configured to perform a process associated to the pressing operation as the process corresponding to the pressing operation. ### Claim 4 (depends on 1) The medical observation device according to claim 1, wherein the processing circuitry is configured to: determine the process corresponding to the detected pressing operation based on the operation signal, and perform the determined process corresponding to the pressing operation. ### Claim 5 (depends on 4) The medical observation device according to claim 4, wherein the processing circuitry is configured to: determine a type of the pressing operation based on the operation signal, and determine a process associated to the determined type of the pressing operation as the process corresponding to the pressing operation. ### Claim 6 (depends on 1) The medical observation device according to claim 1, wherein the process related to the imaging operation of the imaging device includes one or two or more processes of changing a zoom magnification, adjusting a focus position, changing an imaging position, changing a focal depth, and changing an observation mode. ### Claim 7 (depends on 1) The medical observation device according to claim 1, wherein the process related to a display of the medical captured image includes one or both of changing a display mode of a screen and changing a color mode. ### Claim 8 (depends on 1) The medical observation device according to claim 1, wherein the processing circuitry is configured to stop the process being performed corresponding to the pressing operation based on the operation signal output from the external operation device. ### Claim 9 (depends on 1) The medical observation device according to claim 1, comprising: an arm configured by a plurality of links connected to each other by joint portions; and the imaging device supported by the arm. ### Claim 10 (depends on 1) The medical observation device according to claim 1, further comprising: the external operation device including the switch. ### Claim 11 A medical observation device, comprising: processing circuitry configured to detect a pressing operation based on an operation signal according to the pressing operation output from an external operation device equipped with a switch pressed by a mouth; and perform a process of controlling the medical observation device corresponding to the detected pressing operation, wherein the process corresponding to the pressing operation includes some or all of a process related to an imaging operation of an imaging device, a process related to a display of a medical captured image which is captured in the imaging device, and an identification process of identifying a user's input indicating the process related to the imaging operation or the process related to the display of the medical captured image, the processing circuitry is further configured to switch to a mode for performing the identification process based on the detection of the pressing operation, perform a process corresponding to the user's input identified by the identification process, perform a line-of-vision recognition process, as the identification process, in which a line of vision of a recognition target is recognized, and perform a process corresponding to the recognized line-of-vision. ### Claim 12 (depends on 11) The medical observation device according to claim 11, wherein the processing circuitry is configured to set an operator who uses the external operation device as the recognition target. ### Claim 13 (depends on 11) The medical observation device according to claim 11, further comprising: the external operation device including the switch. ### Claim 14 (depends on 11) The medical observation device according to claim 11, comprising: an arm configured by a plurality of links connected to each other by joint portions; and the imaging device supported by the arm. ### Claim 15 A medical observation device, comprising: processing circuitry configured to detect a pressing operation based on an operation signal according to the pressing operation output from an external operation device equipped with a switch pressed by a mouth; and perform a process of controlling the medical observation device corresponding to the detected pressing operation, wherein the process corresponding to the pressing operation includes some or all of a process related to an imaging operation of an imaging device, a process related to a display of a medical captured image which is captured in the imaging device, and an identification process of identifying a user's input indicating the process related to the imaging operation or the process related to the display of the medical captured image, the processing circuitry is further configured to switch to a mode for performing the identification process based on the detection of the pressing operation, perform a process corresponding to the user's input identified by the identification process; perform a motion recognition process, as the identification process, in which a motion of a recognition target is recognized, and perform a process corresponding to the recognized motion. ### Claim 16 (depends on 15) The medical observation device according to claim 15, wherein a movement of the recognition target is recognized in the motion recognition process. ### Claim 17 (depends on 15) The medical observation device according to claim 15, wherein the motion recognition process is a gesture recognition process in which a gesture of the recognition target is recognized. ### Claim 18 (depends on 15) The medical observation device according to claim 15, further comprising: the external operation device including the switch. ### Claim 19 (depends on 15) The medical observation device according to claim 15, comprising: an arm configured by a plurality of links connected to each other by joint portions; and the imaging device supported by the arm.