Dynamic image processing device for head mounted display, dynamic image processing method for head mounted display and head mounted display system

A dynamic image processing method for a head mounted display worn on a head of a user and comprising an imaging device that captures an image at a frame interval and a display screen, the dynamic image processing method comprising:

• detecting an attitude of the imaging device affixed to the head of the user for each of a plurality of image frames captured by the imaging device;
• calculating a first image deviation amount in yawing and pitching directions of the imaging device between the image frames captured by the imaging device based on the detected attitudes of the imaging device;
• setting a position and a size of a position deviation searching region in a past image based on the first image deviation amount;
• calculating a second image deviation amount between the past image and a current frame image by performing pattern matching in the position deviation searching region;
• correcting the past image based on the second image deviation amount;
• and
• synthesizing the past image that is corrected and the current frame image.

A head mounted display system comprising:

• a head mounted display worn on a head of a user and comprising an imaging device that captures an image at a frame interval and a display screen;
• and
• a dynamic image processing device that displays the image captured by the imaging device on the display screen, wherein the dynamic image processing device includes a processor configured to:
• detect an attitude of the imaging device affixed to the head of the user for each of a plurality of image frames captured by the imaging device,
• calculate a first image deviation amount in yawing and pitching directions of the imaging device between the image frames captured by the imaging device based on the detected attitudes of the imaging device,
• set a position and a size of a position deviation searching region in a past image based on the first image deviation amount,
• calculate a second image deviation amount between the past image and a current frame image by performing pattern matching in the position deviation searching region,
• correct the past image based on the second image deviation amount;
• and
• synthesize the past image that is corrected and the current frame image.

A dynamic image processing device for a head mounted display worn on a head of a user and comprising an imaging device that captures an image at a frame interval and a display screen, the dynamic image processing device comprising:

• at least one processor configured to:
• detect an attitude of the imaging device affixed to the head of the user;
• calculate a first image deviation amount in yawing and pitching directions of the imaging device between the image frames captured by the imaging device based on the detected attitudes of the imaging device;
• calculate a second image deviation amount between a past image based on one or a plurality of frame images captured by the imaging device in the past and a current frame image captured by the imaging device by performing pattern matching between the past image that is corrected based on the first image deviation amount and the current frame image;
• correct the past image based on the second image deviation amount;
• and
• synthesize the past image that is corrected and the current frame image.