Method and system of video coding using display modification input

A computer-implemented system comprising:

• at least one display;
• at least one memory to store frames of a video sequence and object data of at least one object on the frames;
• at least one processor communicatively coupled to the at least one of the memory and display;
• and
• an encoder operated by the at least one processor and operated by:
• obtaining temporal display content information of image data of frames of a frame sequence and comprising the object data wherein the object data is of at least one object being moved from frame to frame due to user or automatic input to an application providing the temporal display content information, wherein the at least one object is defined before encoding and for at least one reason that is not solely for encoding;
• obtaining pixel image data of the frames to encode the frame sequence;
• and
• determining at least one motion vector associated with the at least one object based, at least in part, on the temporal display content information.

A computer-readable medium having stored thereon instructions that when executed cause a computing device to operate by:

• obtaining temporal display content information of image data of frames of a frame sequence and comprising object data of at least one object being moved from frame to frame due to user or automatic input to an application providing the temporal display content information, wherein the at least one object is defined before encoding and for at least one reason that is not solely for encoding;
• obtaining pixel image data of the frames to encode the frame sequence;
• and
• determining at least one motion vector associated with the at least one object based, at least in part, on the temporal display content information.