Method and apparatus for processing image based on optical communication, and computer-readable recording medium with program therefor

An optical communication-based image processing method comprising:

• capturing an image of at least one moving light emitting element by using a rolling shutter camera, when sensing data collected from at least one measurement sensor is encoded and transmitted through the at least one moving light emitting element;
• inputting the captured light emitting element image to a pre-trained image correction model;
• outputting a light emitting element image captured at a capturing time or a light emitting element image with a corrected distortion area from the image correction model, based on whether the rolling shutter camera has moved relative to the at least one light emitting element at the capturing time;
• and
• decoding the encoded sensing data based on the output light emitting element image captured at the capturing time or the output light emitting element image with the corrected distortion area,
• training the image correction mode, before the inputting, wherein the training comprises:
• receiving at least one training light emitting element image obtained by capturing at least one training light element through the rolling shutter camera and at least one reference light emitting element image;
• determining whether the rolling shutter camera has moved relative to the at least one training light emitting element at the capturing time, based on whether the shapes of edges of adjacent stripes in a stripe pattern of the captured training light emitting element image are uniform;
• and
• correcting a distortion area of the training light emitting element image captured by the rolling shutter camera which has moved relatively, based on the reference light emitting element image.

A computer-readable recording medium recording a program to be executed on a computer,

• wherein the program includes an executable instruction which when executed by a processor, causes the processor to perform:
• capturing an image of at least one moving light emitting element by using a rolling shutter camera, when sensing data collected from at least one measurement sensor is encoded and transmitted through the at least one moving light emitting element;
• inputting the captured light emitting element image to a pre-trained image correction model;
• outputting a light emitting element image captured at a capturing time or a light emitting element image with a corrected distortion area from the image correction model, based on whether the rolling shutter camera has moved relative to the at least one light emitting element at the capturing time;
• and
• decoding the encoded sensing data based on the output light emitting element image captured at the capturing time or the output light emitting element image with the corrected distortion area,
• wherein the program further includes an executable instruction which causes the processor to train the image correction model, before the inputting,
• wherein the training comprises:
• receiving at least one training light emitting element image obtained by capturing at least one training light element through the rolling shutter camera and at least one reference light emitting element image;
• determining whether the rolling shutter camera has moved relative to the at least one training light emitting element at the capturing time, based on whether the shapes of edges of adjacent stripes in a stripe pattern of the captured training light emitting element image are uniform;
• and
• correcting a distortion area of the training light emitting element image captured by the rolling shutter camera which has moved relatively, based on the reference light emitting element image.