Systems and methods for cross-modality image segmentation

A method for segmenting a medical image, comprising:

• receiving the medical image acquired by an image acquisition device;
• receiving, from a training device, a plurality of learning networks jointly trained using first training images of a first imaging modality and second training images of a second imaging modality,
• wherein the plurality of learning networks are jointly trained with a cross-modality learning network using a loss function constructed using outputs by the cross-modality learning network and the plurality of learning networks;
• and
• segmenting, by a processor, the medical image using a segmentation network selected from the plurality of learning networks.

A non-transitory computer-readable medium having a computer program stored thereon, wherein the computer program, when executed by at least one processor, performs a method for segmenting a medical image, the method comprising:

• receiving the medical image acquired by an image acquisition device;
• receiving a plurality of learning networks jointly trained using first training images of a first imaging modality and second training images of a second imaging modality,
• wherein the plurality of learning networks are jointly trained with a cross-modality learning network using a loss function constructed using outputs by the cross-modality learning network and the plurality of learning networks;
• and
• segmenting the medical image using a segmentation network selected from the plurality of learning networks.