Optical character recognition (OCR) enhancement via inertial measurement unit (IMU)-supported super-resolution imaging

A non-transitory program storage device, comprising instructions stored thereon, to cause one or more processors to:

• obtain a first video image stream from a first image capture device, wherein the first video image stream comprises a first plurality of captured images;
• obtain a first positional information data stream from a positional sensor, wherein the first positional information data stream comprises data indicative of a position of the first image capture device during the capture of the first plurality of captured images;
• identify a location of a region of interest (ROI) in a first image of the first plurality of captured images, wherein the ROI includes textual information;
• track the location of the ROI in a second image of the first plurality of captured images, based, at least in part, on the data from the first positional information data stream indicative of the position of the first image capture device during the capture of the second image, wherein the second image is captured after the first image;
• and
• reconstruct a super-resolution (SR) version of the ROI based, at least in part, on aligning and fusing the ROI in the first image with the ROI in the second image.

An image processing method, comprising:

• obtaining a first video image stream from a first image capture device, wherein the first video image stream comprises a first plurality of captured images;
• obtaining a first positional information data stream from a positional sensor, wherein the first positional information data stream comprises data indicative of a position of the first image capture device during the capture of the first plurality of captured images;
• identifying a location of a region of interest (ROI) in a first image of the first plurality of captured images, wherein the ROI includes textual information;
• tracking the location of the ROI in a number, n, of additional images of the first plurality of captured images, based, at least in part, on the data from the first positional information data stream indicative of the position of the first image capture device during the capture of the n additional images;
• reconstructing a super-resolution (SR) version of the ROI based, at least in part, on an output of a neural network (NN) configured to align and fuse the ROI in the first image with the ROI in each of the n additional images;
• and
• performing optical character recognition (OCR) on the textual information in the reconstructed SR version of the ROI.