Medical device and operation method thereof
AssigneeFUJIFILM Corporation
InventorYusuke MACHII
Life of this patent
Estimating the term…
Abstract
Virtual field-of-view information in a Viewer coordinate system is estimated from an observation video. A first field-of-view 3D organ model is acquired by changing a 3D organ model into a first field-of-view display mode based on the virtual field-of-view information. The first field-of-view 3D organ model and the 3D organ model are displayed. The virtual field-of-view information is estimated by using any of a learning model that has been trained using the observation video and the virtual field-of-view information, coordinate information of a robot arm, or a field-of-view detection sensor.
Claims14
A medical device comprising:
- a processor,
- wherein the processor
- acquires an observation video of an observation target including an observation target organ currently being observed,
- estimates virtual field-of-view information of the observation target from the observation video,
- acquires a 3D organ model corresponding to the observation target organ,
- acquires a first field-of-view 3D organ model by changing the 3D organ model into a first field-of-view display mode based on the virtual field-of-view information,
- displays the first field-of-view 3D organ model and the 3D organ model, and
- estimates the virtual field-of-view information by using any of a learning model that has been trained using the observation video and the virtual field-of-view information, coordinate information of a robot arm, or a field-of-view detection sensor.
An operation method of a medical device, the operation method comprising:
- a step of acquiring an observation video of an observation target including an observation target organ currently being observed;
- a step of estimating virtual field-of-view information of the observation target from the observation video;
- a step of acquiring a 3D organ model corresponding to the observation target organ;
- a step of acquiring a first field-of-view 3D organ model by changing the 3D organ model into a first field-of-view display mode based on the virtual field-of-view information;
- and
- a step of displaying the first field-of-view 3D organ model and the 3D organ model,
- wherein the virtual field-of-view information is estimated by using any of a learning model that has been trained using the observation video and the virtual field-of-view information, coordinate information of a robot arm, or a field-of-view detection sensor.
Dependencies are inferred from the claim text.