System, information storage medium, and information processing method

A computer-readable non-transitory information storage medium storing a program for causing a computer to at least execute:

• acquiring a pre-treatment image, in which at least one energy device and at least one biological tissue are imaged, in which a state before application of energy from the at least one energy device is imaged, and that is captured by a camera that captures an image of a surgical field, and acquiring information regarding an energy supply amount to the at least one energy device,
• estimating an estimated heat diffusion region in the pre-treatment image by processing based on a trained model, the estimated heat diffusion region being an estimated range of reach of energy from the at least one energy device after application of the energy based on the energy supply amount, the trained model being trained to output a heat diffusion region from a training device tissue image or a training tissue image, the heat diffusion region being a range of reach of heat from the at least one energy device, the training device tissue image being an image in which the at least one energy device and the at least one biological tissue are imaged, the training tissue image being an image in which the at least one biological tissue is imaged, and superimposing the estimated heat diffusion region on a captured image of the camera and displaying the captured image with the superimposed estimated heat diffusion region on a display;
• extracting, from the pre-treatment image, tissue information regarding a biological tissue that is imaged in the pre-treatment image,
• extracting, from the pre-treatment image, device information regarding the at least one energy device that is imaged in the pre-treatment image,
• estimating, based on the device information and the tissue information, the estimated heat diffusion region in a treatment target tissue to be treated by the at least one energy device,
• estimating regions of the treatment target tissue and the at least one energy device in the pre-treatment image based on the tissue information and the device information,
• estimating, based on the estimated regions of the treatment target tissue and the at least one energy device, at least one of a tension applied to a biological tissue imaged in the pre-treatment image and a gripping amount of the at least one energy device as an estimation result, and
• estimating the estimated heat diffusion region based on the estimation result, the tissue information, and the information regarding the energy supply amount.

An information processing method, comprising:

• acquiring a pre-treatment image, in which at least one energy device and at least one biological tissue are imaged, in which a state before application of energy from the at least one energy device is imaged, and that is captured by a camera that captures an image of a surgical field, and acquiring information regarding an energy supply amount to the at least one energy device,
• estimating an estimated heat diffusion region in the pre-treatment image by processing based on a trained model, the estimated heat diffusion region being an estimated range of reach of energy from the at least one energy device after application of the energy based on the energy supply amount, the trained model being trained to output a heat diffusion region from a training device tissue image or a training tissue image, the heat diffusion region being a range of reach of heat from the at least one energy device, the training device tissue image being an image in which the at least one energy device and the at least one biological tissue are imaged, the training tissue image being an image in which the at least one biological tissue is imaged,
• superimposing the estimated heat diffusion region on a captured image of the camera and displaying the captured image with the superimposed estimated heat diffusion region on a display,
• extracting, from the pre-treatment image, tissue information regarding a biological tissue that is imaged in the pre-treatment image,
• extracting, from the pre-treatment image, device information regarding the at least one energy device that is imaged in the pre-treatment image,
• estimating, based on the device information and the tissue information, the estimated heat diffusion region in a treatment target tissue to be treated by the at least one energy device,
• estimating regions of the treatment target tissue and the at least one energy device in the pre-treatment image based on the tissue information and the device information,
• estimating, based on the estimated regions of the treatment target tissue and the at least one energy device, at least one of a tension applied to a biological tissue imaged in the pre-treatment image and a gripping amount of the at least one energy device as an estimation result, and
• estimating the estimated heat diffusion region based on the estimation result, the tissue information, and the information regarding the energy supply amount.