Back to results
US 12,749,179 B2Granted
Medical image augmentation
AssigneeCanon Kabushiki Kaisha
InventorSonia Dahdouh
Life of this patent
Estimating the term…
Abstract
A medical imaging system includes a data storage resource to store probability data representing probability information for a location of a feature of interest in an anatomical region. The system further includes processing circuitry to receive medical image data representing a medical image of the anatomical region, retrieve the probability data from the data storage resource, process the medical image data to perform an image augmentation operation on the received medical image for a feature of interest based on the probability information for the location of the feature of interest in the anatomical region.
Claims18
A medical imaging system, comprising:
- a data storage resource configured to store probability data representing probability information for a location of at least one feature of interest in an anatomical region;
- and
- processing circuitry configured to:
- receive medical image data representing a medical image of the anatomical region;
- determine a presence of a particular feature of interest by processing the received medical image data;
- retrieve the probability data from the data storage resource;
- and
- process the medical image data to perform at least one image augmentation operation on the medical image represented by the received medical image data for the particular feature of interest, wherein the at least one image augmentation operation comprises:
- removing the particular feature of interest from the medical image to form a removed patch and performing an image data reconstruction process on the removed patch using image data obtained from a further patch of the medical image or image data from a reference patch of a reference image, wherein the further patch or the reference patch is selected based on a spatial relationship between the removed patch and the further patch or the reference patch, and/or is based on symmetry information of the anatomical region,
- wherein the image data reconstruction process includes a region inpainting process of inpainting the removed patch, and the region inpainting process uses image data representing a lesion-free patch of the medical image or a lesion-free patch of the reference image to inpaint the removed patch,
- wherein the processing circuitry is further configured to obtain image data representative of the particular feature of interest, and perform a transformation on the obtained image data to produce a transformed feature of interest for augmenting to the medical image, and
- wherein the augmenting comprises adding the transformed feature of interest to the medical image based on the probability data.
9 more elements
A method of augmenting an image, the method comprising:
- receiving medical image data representing a medical image of an anatomical region;
- retrieving probability data from a data storage circuitry, wherein the probability data is representative of probability information for a location of at least one feature of interest in the anatomical region;
- determine a presence of a particular feature of interest by processing the received medical image data;
- and
- processing the medical image data to perform at least one image augmentation operation on the medical image represented by the received medical image data for the particular feature of interest, wherein the at least one image augmentation operation comprises
- removing the particular feature of interest from the medical image to form a removed patch and performing an image data reconstruction process on the removed patch using image data obtained from a further patch of the medical image or image data from a reference patch of a reference image, wherein the further patch or the reference patch is selected based on a spatial relationship between the removed patch and the further patch or the reference patch, and/or is based on symmetry information of the anatomical region,
- wherein the image data reconstruction process includes a region inpainting process of inpainting the removed patch, and the region inpainting process uses image data representing a lesion-free patch of the medical image or a lesion-free patch of the reference image to inpaint the removed patch,
- wherein the method further comprises obtaining image data representative of the particular feature of interest, and performing a transformation on the obtained image data to produce a transformed feature of interest for augmenting to the medical image, and
- wherein the augmenting comprises adding the transformed feature of interest to the medical image based on the probability data.
6 more elements
A non-transitory computer-readable medium storing instructions that, when executed by processing circuitry, cause the processing circuitry to:
- receive medical image data representing a medical image of an anatomical region;
- retrieve probability data from a data storage circuitry, wherein the probability data is representative of probability information for a location of a feature of interest in the anatomical region;
- determine a presence of a particular feature of interest by processing the received medical image data;
- and
- process the medical image data to perform at least one image augmentation operation on the medical image represented by the received medical image data for the particular feature of interest, wherein the at least one image augmentation operation comprises
- removing the particular feature of interest from the medical image to form a removed patch and performing an image data reconstruction process on the removed patch using image data obtained from a further patch of the medical image or image data from a reference patch of a reference image, wherein the further patch or the reference patch is selected based on a spatial relationship between the removed patch and the further patch or the reference patch, and/or is based on symmetry information of the anatomical region,
- wherein the image data reconstruction process includes a region inpainting process of inpainting the removed patch, and the region inpainting process uses image data representing a lesion-free patch of the medical image or a lesion-free patch of the reference image to inpaint the removed patch,
- wherein the processing circuitry is further configured to obtain image data representative of the particular feature of interest, and perform a transformation on the obtained image data to produce a transformed feature of interest for augmenting to the medical image, and
- wherein the augmenting comprises adding the transformed feature of interest to the medical image based on the probability data.
6 more elements
Dependencies are inferred from the claim text.