# US 11,298,099 B2 · Method for controlling the operation of a medical apparatus, operating device, operating system, medical apparatus, computer program and electronically readable data carrier > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,298,099 B2 - Document ID: US11298099B2 - Status: Granted - Kind: B2 - Application number: 17/041,662 - Filed: 2019-04-02 - Published: 2021-01-14 - Granted: 2022-04-12 - Earliest claimed: 2018-04-11 - Assignees: Siemens Healthcare GmbH - Applicants: Siemens Healthcare GmbH - Inventors: Gerben Ten Cate; Robert Kagermeier - Web page: https://patentgrep.com/patent/US11298099B2 ## CPC - A61B 6/548: {Remote control of the apparatus or devices} - A61B 5/6889: {Rooms} - A61B 6/467: {characterised by special input means} - A61B 6/547: {involving tracking of position of the device or parts of the device} - G06F 3/0484: for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range - G06F 3/0488: using a touch-screen or digitiser, e.g. input of commands through traced gestures - G06N 20/00: Machine learning - G16H 30/20: for handling medical images, e.g. DICOM, HL7 or PACS - G16H 40/20: for the management or administration of healthcare resources or facilities, e.g. managing hospital staff or surgery rooms - G16H 40/67: for remote operation - G16H 50/20: for computer-aided diagnosis, e.g. based on medical expert systems - A61B 5/0013: {Medical image data (A61B1/00011, A61B6/56, A61B8/56 take precedence)} - A61B 6/0407: {Supports, e.g. tables or beds, for the body or parts of the body} - A61B 6/462: {characterised by constructional features of the display} - A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D) - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS - G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA ## Abstract A method is for controlling the operation of a medical apparatus. The method includes determining input data including patient data relating to a patient, operational status data relating to operational status of the medical apparatus, position data describing position of at least one of the wireless, handheld mobile operating device and the patient in relation to the medical apparatus, and workflow data describing at least one of a medical apparatus workflow and a current position in the medical apparatus workflow; determining, using an artificial intelligence analysis algorithm, at least one of a subsequent operating action of an operator of the wireless, handheld mobile operating device and prediction data describing an item of information needed next by the operator; and at least one of selecting and adapting a user interface to be displayed on the touch screen, based upon the prediction data and displaying the user interface on the touch screen. ## Claims ### Claim 1 A method for controlling the operation of a medical apparatus via a wireless, handheld mobile operating device including a touch screen, with a plurality of functions of a medical apparatus workflow being realized via the wireless, handheld mobile operating devices for at least one of an examination and a treatment process of a patient with the medical apparatus, the method comprising: determining input data describing a current operational situation, the input data including patient data relating to the patient, operational status data relating to operational status of the medical apparatus, position data describing position of at least one of the wireless, handheld mobile operating device and the patient in relation to the medical apparatus, and workflow data describing at least one of a medical apparatus workflow and a current position in the medical apparatus workflow; determining, using an artificial intelligence analysis algorithm, at least one of a subsequent operating action of an operator of the wireless, handheld mobile operating device and prediction data describing an item of information needed next by the operator; and at least one of selecting the user interface to be displayed and adapting the user interface to be displayed, based upon the prediction data and then displaying the user interface after being at least one of selected and adapted, wherein the workflow data of at least partly already completed workflow steps of the medical apparatus workflow, are determined descriptively. ### Claim 2 (depends on 1) The method of claim 1, wherein, a deep learning method is used for training the artificial intelligence analysis algorithm. ### Claim 3 (depends on 2) The method of claim 2, wherein, during the use of the wireless, handheld mobile operating device, operating data describing operating actions of the operator is recorded as training data and is assigned to current input data, and wherein the training data is used for further training of the artificial intelligence analysis algorithm. ### Claim 4 (depends on 2) The method of claim 2, wherein the operator is identified, and wherein at least one of a user-specific analysis algorithm is used and an identity of the operator is taken into account, in the at least one of the selecting and adapting of the user interface. ### Claim 5 (depends on 2) The method of claim 2, wherein the selecting and display of a user interface takes place triggered by a trigger signal indicating a placement of the wireless, handheld mobile operating device in a utilization position. ### Claim 6 (depends on 5) The method of claim 5, wherein the trigger signal is determined by evaluating position data indicating at least one of the position of the wireless, handheld mobile operating device and movement data indicating the movement of the wireless, handheld mobile operating device. ### Claim 7 (depends on 1) The method of claim 1, wherein, during the use of the wireless, handheld mobile operating device, operating data describing operating actions of the operator is recorded as training data and is assigned to current input data, and wherein the training data is used for further training of the artificial intelligence analysis algorithm. ### Claim 8 (depends on 1) The method of claim 1, wherein the operator is identified, and wherein at least one of a user-specific artificial intelligence analysis algorithm is used and an identity of the operator is taken into account, in the at least one of the selecting and adapting of the user interface. ### Claim 9 (depends on 1) The method of claim 1, wherein the selecting and display of a user interface takes place triggered by a trigger signal indicating a placement of the wireless, handheld mobile operating device in a utilization position. ### Claim 10 (depends on 9) The method of claim 9, wherein the trigger signal is determined by evaluating position data indicating at least one of the position of the wireless, handheld mobile operating device and movement data indicating the movement of the wireless, handheld mobile operating device. ### Claim 11 (depends on 1) The method of claim 1, wherein the artificial intelligence analysis algorithm is also configured for determining an item of error information as prediction data upon mutually contradictory input data being used, and wherein upon a presence of an item of error information being determined, an output describing the error information occurs in the user interface to be displayed. ### Claim 12 (depends on 1) The method of claim 1, wherein the medical apparatus is an imaging apparatus. ### Claim 13 A wireless handheld, mobile operating device for controlling the operation of a medical apparatus comprising: a touch Screen; and a controller configured for: determining input data describing a current operational situation, the input data including patient data relating to the patient, operational status data relating to operational status of the medical apparatus, position data describing position of at least one of the wireless, handheld mobile operating device and the patient in relation to the medical apparatus, and workflow data describing at least one of a medical apparatus workflow and a current position in the medical apparatus workflow; determining, using an artificial intelligence analysis algorithm, at least one of a subsequent operating action of an operator of the wireless, handheld mobile operating device and prediction data describing an item of information needed next by the operator; and at least one of selecting the user interface to be displayed and adapting the user interface to be displayed, based upon the prediction data and then displaying the user interface after being at least one of selected and adapted, wherein the workflow data of at least partly already completed workflow steps of the medical apparatus workflow, are determined descriptively. ### Claim 14 (depends on 13) An operating system for controlling the operation of a medical apparatus including the wireless handheld, mobile operating device of claim 13, comprising: a controller of the wireless handheld, mobile operating device; and a controller of the medical apparatus. ### Claim 15 (depends on 14) A medical apparatus, comprising the operating system of claim 14. ### Claim 16 (depends on 1) A non-transitory computer program product, storing a computer program to carry out the method of claim 1 when executed on a controller of a wireless handheld, mobile operating device. ### Claim 17 (depends on 1) A non-transitory electronically readable data carrier storing a computer program to carry out the method of claim 1 when executed on a controller of an operating system for controlling the operation of a medical apparatus.