Image prediction system

An image prediction system that generates a future prediction image based on an observation image, the image prediction system comprising:

• a gaze unit;
• a working memory unit;
• a control unit;
• and
• a generation model unit, wherein
• the gaze unit includes:
• a location-based gaze region determination unit that generates a difference for each pixel between an observation image and a prediction image for a region including an object in the observation image, generates a rectangular region including the object and determines the rectangular region as a first gaze region candidate,
• a gaze control unit that receives information related to the first gaze region candidate and selects one of the first gaze region candidate as a first gaze region under a predetermined condition, and
• a first storage unit that stores information on the first gaze region as a gaze state,
• the generation model unit
• generates a prediction image of the first gaze region,
• the working memory unit,
• when a difference in the first gaze region between the observation image and the prediction image is equal to or less than a predetermined value, sets the first gaze region as a second gaze region, and includes a second storage unit that stores the information on the second gaze region as a memory state,
• the generation model unit
• generates the prediction image of the first gaze region and outputs the prediction image to the gaze control unit, and
• generates a prediction image of the second gaze region and outputs the prediction image to the working memory unit, and
• the control unit
• integrates the prediction image of the first gaze region from the gaze unit and the prediction image of the second gaze region from the working memory unit to generate a prediction image for the observation image.