Changing in real-time the perspective of objects captured in images

An image capturing device for processing an image, the device comprising:

• a processor;
• and
• a non-transitory computer-readable storage medium storing computer-executable instructions which when executed by the processor cause the processor to perform steps comprising:
• automatically capturing a first image including an object from a captured perspective;
• identifying a plurality of candidate edges from the first image;
• creating a plurality of candidate object areas in the first image, each of the plurality of candidate object areas comprised of a different set of candidate edges from the plurality of candidate edges and potentially enclosing the object included in the first image;
• calculating, for each of the plurality of candidate object areas, an object score indicative of a likelihood that the candidate object area represents the object included in the first image;
• selecting, from the plurality of candidate object areas, a number of candidate object areas based on the selected candidate object areas having the highest object scores among the plurality of candidate object areas, the number of selected candidate object areas more than one and less than the plurality of candidate object areas;
• calculating, for each of the selected candidate object areas, a similarity score indicative of a similarity between the selected candidate object area and an object captured in a second image, the second image automatically captured by the image capturing device prior to the first image;
• calculating, for each of the selected candidate object areas, a total score based on the object score and the similarity score calculated for the selected candidate object area;
• identifying, from the selected candidate object areas, a candidate object area as the object included in the first image based on the total score calculated for the identified candidate object area being the highest among the selected candidate object areas;
• generating a corrected image of the object included in the first image based on the identified candidate object area, the corrected image showing the object included in the first image transformed to a corrected perspective;
• and
• displaying the corrected image.

A computer program product stored on a non-transitory computer-readable storage medium having computer-executable instructions which when executed by a processor cause the processor to perform steps comprising:

• automatically capturing, by an image capturing device, a first image including an object from a captured perspective;
• identifying a plurality of candidate edges from the first image;
• creating a plurality of candidate object areas in the first image, each of the plurality of candidate object areas comprised of a different set of candidate edges from the plurality of candidate edges and potentially enclosing the object included in the first image;
• calculating, for each of the plurality of candidate object areas, an object score indicative of a likelihood that the candidate object area represents the object included in the first image;
• selecting, from the plurality of candidate object areas, a number of candidate object areas based on the selected candidate object areas having the highest object scores among the plurality of candidate object areas, the number of selected candidate object areas more than one and less than the plurality of candidate object areas;
• calculating, for each of the selected candidate object areas, a similarity score indicative of a similarity between the selected candidate object area and an object captured in a second image, the second image automatically captured by the image capture device prior to the first image;
• calculating, for each of the selected candidate object areas, a total score based on the object score and the similarity score calculated for the selected candidate object area;
• identifying, from the selected candidate object areas, a candidate object area as the object included in the first image based on the total score calculated for the identified candidate object area being the highest among the selected candidate object areas;
• generating a corrected image of the object included in the first image based on the identified candidate object area, the corrected image showing the object included in the first image transformed to a corrected perspective;
• and
• displaying the corrected image.