Surgical instrument recognition from surgical videos
AssigneeVerb Surgical Inc.
InventorsBokai ZHANG, Darrick STURGEON, Arjun SHANKAR, Varun GOEL, Jocelyn BARKER
Life of this patent
Estimating the term…
Loading patent…
AssigneeVerb Surgical Inc.
InventorsBokai ZHANG, Darrick STURGEON, Arjun SHANKAR, Varun GOEL, Jocelyn BARKER
Estimating the term…
A machine learning model has two stages. In a first stage, features from one or more frames of a surgical video are extracted, wherein the features include presence of a surgical instrument and type of the surgical instrument. A second stage analyzes the surgical video based on the extracted features to recognize a video segment, wherein the recognized video segment includes a detected presence of the surgical instrument, and where the video segment is recognized by a multi-stage temporal convolution network (MS-TCN) or a vision transformer. Other aspects are also described and claimed.
A system comprising:
A method performed by a programmed computer for recognizing instruments in a surgical video, the method comprising:
An article of manufacture comprising memory having stored therein instructions that configure a computing device recognize instruments in a surgical video by:
Dependencies are inferred from the claim text.