Multi-view medical activity recognition systems and methods
AssigneeIntuitive Surgical Operations, Inc.
InventorsOmid Mohareri, Adam T. Schmidt, Aidean Sharghi Karganroodi
Life of this patent
Estimating the term…
Abstract
Multi-view medical activity recognition systems and methods are described herein. In certain illustrative examples, a system accesses a plurality of data streams representing imagery of a scene of a medical session captured by a plurality of sensors from a plurality of viewpoints. The system temporally aligns the plurality of data streams and determines, using a viewpoint agnostic machine learning model and based on the plurality of data streams, an activity within the scene.
Claims21
A system comprising:
- a memory storing instructions;
- a processor communicatively coupled to the memory and configured to execute the instructions to:
- access a plurality of data streams representing imagery of a scene of a medical session captured by a plurality of sensors from a plurality of viewpoints, the plurality of sensors including a dynamic sensor capturing the imagery from a dynamic viewpoint that changes during the medical session;
- temporally align the plurality of data streams;
- and
- determine, using a viewpoint agnostic machine learning model and based on the plurality of data streams, an activity within the scene.
A method comprising:
- accessing, by a processor, a plurality of data streams representing imagery of a scene of a medical session captured by a plurality of sensors from a plurality of viewpoints, the plurality of sensors including a dynamic sensor capturing the imagery from a dynamic viewpoint that changes during the medical session;
- temporally aligning, by the processor, the plurality of data streams;
- and
- determining, by the processor, using a viewpoint agnostic machine learning model and based on the plurality of data streams, an activity within the scene.
A non-transitory computer-readable medium storing instructions executable by a processor to:
- Access a plurality of data streams representing imagery of a scene of a medical session captured by a plurality of sensors from a plurality of viewpoints, the plurality of sensors including a dynamic sensor capturing the imagery from a dynamic viewpoint that changes during the medical session;
- temporally align the plurality of data streams;
- and
- determine, using a viewpoint agnostic machine learning model and based on the plurality of data streams, an activity within the scene.
21-26. (canceled)
Dependencies are inferred from the claim text.