Back to results
US 11,690,579 B2Granted
Attention-driven image domain translation
AssigneeShanghai United Imaging Intelligence Co., Ltd.
InventorsSrikrishna Karanam, Ziyan Wu, Terrence Chen
Life of this patent
Estimating the term…
Abstract
An apparatus is configured to receive input image data corresponding to output image data of a first radiology scanner device, translate the input image data into a format corresponding to output image data of a second radiology scanner device and generate an output image corresponding to the translated input image data on a post processing imaging device associated with the first radiology scanner device. Medical images from a new scanner can be translate to look as if they came from a scanner of another vendor.
Claims17
An apparatus comprising a processor, the processor configured to:
- receive input image data corresponding to output image data of a first radiology scanner device;
- translate the input image data into a format corresponding to output image data of a second radiology scanner device by:
- in a first training phase, training a discriminator of a Generative Adversarial Network (GAN) to classify between images of the first radiology scanner device and images of the second radiology scanner device;
- generating a target attention image map using a prediction of the discriminator trained in the first phase;
- and
- in a second training phase, training the discriminator with an input image corresponding to a real input image of the first radiology scanner device, a synthesized image generated by the generator of the GAN, and a set of images corresponding to real images of the second radiology scanner device;
- determining a degree of similarity between the synthesized image and the set of real images;
- determining a degree of dissimilarity between the real input image and the set of real images;
- generating an attention map based on the determined similarity between the synthesized image and the set of real images and the determined dissimilarity between the real input image and the set of real images;
- determining a degree of similarity between the target attention image map generated in the first training phase and the attention map generated in the second training phase;
- and
- training the GAN using the determined degree of similarity;
- and
- generate an output image corresponding to the translated input image data on a post processing imaging device associated with the first radiology scanner device.
11 more elements
A method comprising:
- receiving input image data corresponding to output image data of a first radiology scanner device;
- translating the input image data into a format corresponding to output image data of a second radiology scanner device by:
- in a first training phase, training a discriminator of a Generative Adversarial Network (GAN) to classify between images of the first radiology scanner device and images of the second radiology scanner device;
- generating a target attention image map using a prediction of the discriminator trained in the first phase;
- and
- in a second training phase, training the discriminator with an input image corresponding to a real input image of the first radiology scanner device, a synthesized image generated by the generator of the GAN, and a set of images corresponding to real images of the second radiology scanner device;
- determining a degree of similarity between the synthesized image and the set of real images;
- determining a degree of dissimilarity between the real input image and the set of real images;
- generating an attention map based on the determined similarity between the synthesized image and the set of real images and the determined dissimilarity between the real input image and the set of real images;
- determining a degree of similarity between the target attention image map generated in the first training phase and the attention map generated in the second training phase;
- and
- training the GAN using the determined degree of similarity;
- and
- generating an output image corresponding to the translated input image data on a post processing imaging device associated with the first radiology scanner device.
11 more elements
Dependencies are inferred from the claim text.