Device and method for processing partially encrypted image data based on deep learning

A device for deep learning-based partially encrypted image data processing, comprising:

• a memory storing a plurality of instructions;
• and
• a processor configured to execute the instructions,
• wherein the processor is configured to:
• receive a first image;
• partially encrypt at least a portion of the first image using a Double Random Phase Encoding (DRPE) scheme to generate a second image in the form of complex numbers;
• extract a first feature map and a second feature map by respectively inputting a real component and an imaginary component of the second image into a first encoder and a second encoder;
• generate caption information by inputting a feature vector, generated by concatenating and flattening the first feature map and the second feature map, into a transformer-based caption generation model;
• generate classification information by inputting the second image into a Vision Transformer (ViT)-based classification model;
• and
• transmit at least one of the caption information and the classification information to an external terminal or output it through a display.