Dynamic imaging and motion artifact reduction through deep learning

A deep learning system for motion artifact reduction in medical imaging data, the deep learning system comprising:

• a computing device comprising a processor, a memory, an input/output circuitry, and a data store;
• a deep learning module configured to receive input data;
• and
• a deep neural network comprising a transformer neural network configured to receive input image data comprising a target image, a prior image, and a subsequent image, the transformer neural network configured to mitigate a temporal aspect of at least one motion artifact in the input image data, and to provide a transformer output related to the input data, and a synthesis neural network configured to receive the transformer output, and to provide at least one output image having a reduced motion artifact relative to the input image data;
• wherein the deep neural network was trained using training input data comprising input image data that is at least one of low resolution and blurry from at least one of dynamic imaging and motion artifacts and using training output data comprising ground truth image data;
• and
• wherein the transformer neural network comprises a temporal stage and a multiscale stage, in which the temporal stage comprises a forward convolutional long short-term memory (ConvLSTM) network and a backward ConvLSTM network, each forward and backward ConvLSTM network comprising a plurality of ConvLSTM and rectified linear unit (ConvLSTMReLU) blocks in which each rectified linear unit corresponds to an activation function and each block produces a block output, and the multiscale stage comprises a plurality of convolutional neural networks disposed in parallel and coupled to a concatenation block, each CNN being configured to receive the input image wherein a resulting CNN output is received by the concatenation block, and a separate CNN that is configured to receive a concatenation output from the concatenation block and in which the synthesis neural network comprises an encoder circuitry and a decoder circuitry, wherein the encoder circuitry is configured to receive a plurality of temporal features from the block outputs of the temporal stage and a multiscale stage output which is the concatenation output from the multiscale stage as the transformer output.