System for checking instrument state of a surgical robotic arm
AssigneeCovidien LP
InventorDwight Meglan
Life of this patent
Estimating the term…
Abstract
A surgical robotic system includes: a surgical console having a display and a user input device configured to generate a user input and a surgical robotic arm having a surgical instrument configured to treat tissue and being actuatable in response to the user input; and a video camera configured to capture video data that is displayed on the display. The system also includes a control tower coupled to the surgical console and the surgical robotic arm. The control tower is configured to: process the user input to control the surgical instrument and to record the user input as input data; train a machine learning system using the input data and the video data; and execute the at least one machine learning system to determine probability of failure of the surgical instrument.
Claims18
A surgical robotic system comprising:
- a surgical console including a display and a user input device configured to generate a user input;
- a surgical robotic arm including a surgical instrument configured to treat tissue and being actuatable in response to the user input;
- a video camera configured to capture video data that is displayed on the display;
- and
- a control tower coupled to the surgical console and the surgical robotic arm, the control tower including a computer and configured to:
- process the user input to control the surgical instrument and to record the user input as input data;
- train locally on the computer at least one machine learning system using the input data and annotated video data, wherein the annotated video data is generated by annotating the video data using procedure data;
- execute the at least one machine learning system in real time to determine probability of failure of the surgical instrument;
- and
- display a warning on at least one of the display of the surgical console or a display of the control tower in response to probability of failure of the surgical instrument exceeding a threshold.
A surgical robotic system comprising:
- a surgical console including a display and a user input device configured to generate a user input;
- a surgical robotic arm including:
- a surgical instrument configured to treat tissue and being actuatable in response to the user input;
- and
- a sensor configured to measure at least one parameter of the surgical instrument and to output sensor data;
- a video camera configured to capture video data that is displayed on the display;
- and
- a control tower coupled to the surgical console and the surgical robotic arm, the control tower including a computer and configured to:
- process the user input to control the surgical instrument and to record the user input as input data;
- train at least one machine learning system using the input data, the sensor data, and annotated video data, wherein the annotated video data is generated by annotating the video data using procedure data;
- execute the at least one machine learning system in real time to determine probability of failure of the surgical instrument;
- and
- display a warning on at least one of the display of the surgical console or a display of the control tower in response to probability of failure of the surgical instrument exceeding a threshold.
A method for controlling a surgical robotic system, the method comprising:
- generating a user input through a user input device of a surgical console and recording input data;
- processing the user input to generate a movement command at a control tower coupled to the surgical console;
- transmitting the movement command to a surgical robotic arm, the surgical robotic arm including a surgical instrument configured to treat tissue and being actuatable in response to the user input;
- capturing video data through a video camera;
- measuring using a sensor at least one parameter of the surgical instrument to output sensor data;
- training at least one machine learning system using the input data, the sensor data, and annotated video data, wherein the annotated video data is generated by annotating the video data using procedure data;
- executing the at least one machine learning system in real time to determine probability of failure of the surgical instrument;
- and
- displaying a warning on at least one of the display of the surgical console or a display of the control tower in response to probability of failure of the surgical instrument exceeding a threshold.
Dependencies are inferred from the claim text.