Back to results
US 11,446,092 B2Granted
Methods and systems for using computer-vision to enhance surgical tool control during surgeries
AssigneeDigital Surgery Limited
InventorsAndre Chow, Danail Stoyanov, Imanol Luengo Muntion, Petros Giataganas, Jean Nehme
Life of this patent
Estimating the term…
Abstract
The present disclosure relates to systems and methods that use computer-vision processing systems to improve patient safety during surgical procedures. Computer-vision processing systems may train machine-learning models using machine-learning techniques. The machine-learning techniques can be executed to train the machine-learning models to recognize, classify, and interpret objects within a live video feed. Certain embodiments of the present disclosure can control (or facilitate control of) surgical tools during surgical procedures using the trained machine-learning models.
Claims20
A computer-implemented method comprising:
- receiving one or more data streams, each of the one or more data streams having been generated at and received from an electronic device configured and positioned to capture live video within a field of view during a particular surgical procedure being performed using one or more surgical tools, the one or more data streams including a sequence of images of the live video within the field of view;
- inputting the one or more data streams into a model trained to recognize surgical tools from image data;
- in response to inputting the one or more data streams into the model, detecting a surgical tool from the sequence of images of the one or more data streams, the surgical tool configured to perform a plurality of functions, the plurality of functions including a first function and a second function different than the first function, the detection of the surgical tool being performed by utilizing the model to recognize the surgical tool from the sequence of images of the live video, and the detection of the surgical tool indicating that the surgical tool is within the field of view;
- in response to detecting the surgical tool within the field of view, outputting a first set of commands for controlling the surgical tool to perform or to regulate performance of the first function;
- and
- in response to detecting that the surgical tool is no longer within the field of view, outputting a second set of commands for controlling the surgical tool to cease or to regulate performance of the first function, and for controlling the surgical tool with respect to the second function.
3 more elements
A system, comprising:
- one or more data processors;
- and
- a non-transitory computer-readable storage medium containing instructions which, when executed on the one or more data processors, cause the one or more data processors to perform operations comprising:
- receiving one or more data streams, each of the one or more data streams having been generated at and received from an electronic device configured and positioned to capture live video within a field of view during a particular surgical procedure being performed using one or more surgical tools, the one or more data streams including a sequence of images of the live video within the field of view;
- inputting the one or more data streams into a model trained to recognize surgical tools from image data;
- in response to inputting the one or more data streams into the model, detecting a surgical tool from the sequence of images of the one or more data streams, the surgical tool configured to perform a plurality of functions, the plurality of functions including a first function and a second function different than the first function, the detection of the surgical tool being performed by utilizing the model to recognize the surgical tool from the sequence of images of the live video, and the detection of the surgical tool indicating that the surgical tool is within the field of view;
- in response to detecting the surgical tool within the field of view, outputting a first set of commands for controlling the surgical tool to perform or to regulate performance of the first function;
- and
- in response to detecting that the surgical tool is no longer within the field of view, outputting a second set of commands for controlling the surgical tool to cease or to regulate performance of the first function, and for controlling the surgical tool with respect to the second function.
6 more elements
A computer program product tangibly embodied in a non-transitory machine-readable storage medium, including instructions configured to cause a data processing apparatus to perform operations comprising:
- receiving one or more data streams, each of the one or more data streams having been generated at and received from an electronic device configured and positioned to capture live video within a field of view during a particular surgical procedure being performed using one or more surgical tools, the one or more data streams including a sequence of images of the live video within the field of view;
- inputting the one or more data streams into a model trained to recognize surgical tools from image data;
- in response to inputting the one or more data streams into the model, detecting a surgical tool from the sequence of images of the one or more data streams, the surgical tool configured to perform a plurality of functions, the plurality of functions including a first function and a second function different than the first function, the detection of the surgical tool being performed by utilizing the model to recognize the surgical tool from the sequence of images of the live video, and the detection of the surgical tool indicating that the surgical tool is within the field of view;
- in response to detecting the surgical tool within the field of view, outputting a first set of commands for controlling the surgical tool to perform or to regulate performance of the first function;
- and
- in response to detecting that the surgical tool is no longer within the field of view, outputting a second set of commands for controlling the surgical tool to cease or to regulate performance of the first function, and for controlling the surgical tool with respect to the second function.
3 more elements
Dependencies are inferred from the claim text.