Image motion estimation method and related apparatus

An image motion estimation method, applied to an electronic device, a first application being installed on the electronic device, and the method comprising:

• obtaining a rendering instruction delivered by the first application, the rendering instruction being used for instructing a GPU to render image frames of the first application, and the image frames of the first application comprising a first image frame and a second image frame;
• identifying, from the rendering instruction, a pixel location of a first object in the first image frame and a pixel location of a second object in the first image frame, wherein types of the first object and the second object are different;
• identifying, from the rendering instruction, a pixel location of the first object in the second image frame and a pixel location of the second object in the second image frame;
• determining a motion vector of the pixel locations of the first object between the first image frame and the second image frame by using an optical flow motion estimation method;
• obtaining a first transform matrix and first depth information of the first image frame, and a second transform matrix and second depth information of the second image frame;
• and
• determining a motion vector of the pixel locations of the second object between the first image frame and the second image frame by using a 3D playfield motion estimation method based on the first transform matrix, the first depth information, the second transform matrix, and the second depth information.

An electronic device, comprising:

• a memory storing a computer program comprising instructions;
• and
• a processor configured to execute the instructions to cause the electronic device to implement operations comprising:
• obtaining a rendering instruction delivered by a first application, the rendering instruction being used for instructing a graphics processing unit GPU to render image frames of the first application, and the image frames of the first application comprising a first image frame and a second image frame;
• identifying, from the rendering instruction, a pixel location of a first object in the first image frame and a pixel location of a second object in the first image frame, where types of the first object and the second object are different;
• identifying, from the rendering instruction, a pixel location of the first object in the second image frame and a pixel location of the second object in the second image frame;
• determining a motion vector of the pixel locations of the first object between the first image frame and the second image frame by using an optical flow motion estimation method;
• and
• obtaining native motion vector information of the first application, and determining, from the native motion vector information, a motion vector of the pixel locations of the second object between the first image frame and the second image frame, wherein the native motion vector information is playfield motion vector information between the first image frame and the second image frame and determined by the first application by using a 3D playfield estimation method.