Interpolation of medical images

A system configured to generate a medical image, the system

• comprising:
• a computer database having a set of images containing internal tissue of an anatomical object of a plurality of patients,
• an encoder configured to receive an input image and generate a content vector as an output, the content vector representing what features of the anatomical object are present in the input image;
• and
• a decoder configured to receive the content vector to generate an interpolated image as an output;
• processing circuitry coupled to the database;
• and
• memory coupled to the processing circuitry and having instructions stored therein that are executable by the processing circuitry to cause the system to perform operations including:
• obtaining a first two-dimensional image of an anatomical object;
• using the encoder, extracting first information associated with the anatomical object from the first image, the first information containing the content vector of the first image;
• obtaining a second two-dimensional image of the anatomical object;
• using the encoder, extracting second information associated with the anatomical object from the second image, the second information containing the content vector of the second image;
• interpolating the first and second information to generate an interpolated content vector;
• using the decoder, generating the medical image based on the interpolated content vector,
• generating the medical image based on the interpolated content vector and predetermined information that is associated with images of anatomical objects of a type that is a type of the anatomical object.

A system configured to generate a medical image, the system

• comprising:
• a neural network pre-trained with a set of non-optical images containing an anatomical object of a plurality of patients, the neural network including:
• a encoder configured to receive an input image and generate a content vector as an output, the content vector representing what features of the anatomical object are present in the input image;
• and
• a decoder configured to receive the content vector to generate an interpolated image as an output;
• processing circuitry coupled to the neural network and programmed to execute the following instructions:
• obtaining a first non-optical image of an anatomical object containing internal features under a skin;
• using the encoder of the neural network, extracting the content vector associated with the anatomical object from the first image;
• obtaining a second non-optical image of the anatomical object containing internal features under a skin;
• using the encoder of the neural network, extracting information associated with the anatomical object from the second image, the information containing the content vector of the second image;
• interpolating the information from the first and second images to generate an interpolated content vector;
• using the decoder of the neural network, generating the medical image based on the interpolated content vector.