Generating synthetic image data
AssigneeSynapse Technology Corporation
InventorsIan Cinnamon, Bruno Brasil Ferrari Faviero, Simanta Gautam
Life of this patent
Estimating the term…
Abstract
According to an aspect, a method comprises: generating a 2D projection from a 3D representation of an object, wherein the 2D projection comprises an edgemapped projection of the 3D representation, generating, with a generative adversarial neural network (GAN), and based on the edgemapped projection, a simulated image of the object, wherein the simulated image appears as though the object has been scanned by a detection device, combining the simulated image of the object with a background image to form a synthesized image, wherein the background image was captured by a detection device, and outputting the synthesized image.
Claims20
A method for generating synthesized images performed by a computing system, the method comprising:
- obtaining an image of a baggage item captured by a scanning device of a security system;
- obtaining an image of an object;
- generating, by a generative adversarial network (GAN) and based on the image of the object, a simulated image of the object such that the simulated image of the object comprises one or more image characteristics corresponding to one or more characteristics of images of the object that were captured by scanning devices;
- generating a synthesized image based on the image of the baggage item and the simulated image of the object, wherein generating the synthesized image comprises:
- selecting an insertion location within the baggage item in the image of the baggage item;
- and
- inserting the simulated image of the object at the insertion location such that the simulated image of the object is within the baggage item in the image of the baggage item, thereby generating the synthesized image;
- transforming at least one aspect of the simulated image of the object within the synthesized image in accordance with one or more aspects of the image of the baggage item, thereby generating a transformed synthesized image;
- and
- after generating the transformed synthesized image, training an object detection algorithm with the transformed synthesized image.
A system for generating synthesized images, the system comprising:
- at least one processor;
- and
- a non-transitory computer-readable storage medium comprising instructions that are executable by the at least one processor to cause the system to:
- obtain an image of a baggage item captured by a scanning device of a security system;
- obtain an image of an object;
- generate, by a generative adversarial network (GAN) and based on the image of the object, a simulated image of the object such that the simulated image of the object comprises one or more image characteristics corresponding to one or more characteristics of images of the object that were captured by scanning devices;
- generate a synthesized image based on the image of the baggage item and the simulated image of the object, wherein to generate the synthesized image comprises:
- selecting an insertion location within the baggage item in the image of the baggage item;
- and
- inserting the simulated image of the object at the insertion location such that the simulated image of the object is within the baggage item in the image of the baggage item, thereby generating the synthesized image;
- transform at least one aspect of the simulated image of the object within the synthesized image in accordance with one or more aspects of the image of the baggage item, thereby generating a transformed synthesized image;
- and
- after generating the transformed synthesized image, train an object detection algorithm with the transformed synthesized image.
A non-transitory computer-readable storage medium comprising instructions that are executable by at least one processor to cause a computing system to:
- obtain an image of a baggage item captured by a scanning device of a security system;
- obtain an image of an object;
- generate, by a generative adversarial network (GAN) and based on the image of the object, a simulated image of the object such that the simulated image of the object comprises one or more image characteristics corresponding to one or more characteristics of images of the object that were captured by scanning devices;
- generate a synthesized image based on the image of the baggage item and the simulated image of the object, wherein to generate the synthesized image comprises:
- selecting an insertion location within the baggage item in the image of the baggage item;
- and
- inserting the simulated image of the object at the insertion location such that the simulated image of the object is within the baggage item in the image of the baggage item, thereby generating the synthesized image;
- transform at least one aspect of the simulated image of the object within the synthesized image in accordance with one or more aspects of the image of the baggage item, thereby generating a transformed synthesized image;
- and
- after generating the transformed synthesized image, train an object detection algorithm with the transformed synthesized image.
Dependencies are inferred from the claim text.