Methods and systems for radiotherapy treatment planning using deep learning engines

A non-transitory computer-readable storage medium that includes a set of instructions which, in response to execution by a processor of a computer system, cause the processor to perform a method of perform radiotherapy treatment planning using a deep learning engine that includes a first processing pathway, a second processing pathway and a third processing pathway, wherein the method comprises:

• obtaining first image data associated with a first resolution level and a patient;
• generating first feature data by processing the first image data using a first set of one or more convolution layers included in the first processing pathway, wherein the first image data is a first input of the first processing pathway;
• generating second feature data by processing second image data associated with a second resolution level using a second set of one or more convolution layers included in the second processing pathway, wherein the second image data is a second input of the second processing pathway and is generated based on the first image data but without being processed by the first set of one or more convolution layers included in the first processing pathway;
• downsampling the first image data or the second image data to generate third image data associated with a third resolution level;
• generating third feature data by processing the third image data using a third set of one or more convolution layers included in the third processing pathway, wherein the first resolution level, the second resolution level and the third resolution level are different, and the third image data is a third input of the third processing pathway but without being processed by the first set of one or more convolution layers included in the first processing pathway or the second set of one or more convolution layers included in the second processing pathway;
• generating a first combined set of feature data associated with the second resolution level based on the second feature data and the third feature data, and a second combined set of feature data associated with the first resolution level based on the first feature data and the first combined set;
• and
• based on the second combined set, generating output data associated with radiotherapy treatment of the patient.

A computer system configured to perform radiotherapy treatment planning using a deep learning engine that includes a first processing pathway, a second processing pathway and a third processing pathway, wherein the computer system comprises:

• a processor and a non-transitory computer-readable medium having stored thereon instructions that, when executed by the processor, cause the processor to:
• obtain first image data associated with a first resolution level and a patient;
• generate first feature data by processing the first image data using a first set of one or more convolution layers included in the first processing pathway, wherein the first image data is a first input of the first processing pathway;
• generate second feature data by processing the second image data associated with a second resolution level using a second set of one or more convolution layers included in the second processing pathway, wherein the second image data is a second input of the second processing pathway and is generated based on the first image data but without being processed by the first set of one or more convolution layers included in the first processing pathway;
• downsample the first image data or the second image data to generate third image data associated with a third resolution level;
• generate third feature data by processing the third image data using a third set of one or more convolution layers included in the third processing pathway, wherein the first resolution level, the second resolution level and the third resolution level are different, and the third image data is a third input of the third processing pathway but without being processed by the first set of one or more convolution layers included in the first processing pathway or the second set of one or more convolution layers included in the second processing pathway;
• generate a first combined set of feature data associated with the second resolution level based on the second feature data and the third feature data, and a second combined set of feature data associated with the first resolution level based on the first feature data and the first combined set;
• and
• based on the second combined set, generate output data associated with radiotherapy treatment of the patient.