Image processing apparatus, image processing method and storage medium to suitably clip a subject region from a moving image

An image processing method using an image processing apparatus, the method comprising:

• detecting a subject in a moving image;
• clipping a region corresponding to the subject detected from each frame image composing the moving image;
• and
• setting a planned clipping region to be newly clipped based on at least one of a position and a size of a region corresponding to the subject which is the region already clipped by the clipping unit and a region corresponding to the subject which is the region to be clipped by the clipping unit, wherein,
• setting a region corresponding to the subject comprises adding a play region on an outer side of the subject from a center of gravity of the subject as a center considering a shake occurring when the subject is imaged;
• and
• allowing a size of the added play region to be changed according to the position and the size of the region corresponding to the subject or is a certain size.

A non-transitory computer-readable storage medium having a program stored thereon for controlling a computer to perform image processing performed in an image processing apparatus, wherein the program controls the computer to perform the functions of:

• a detecting unit which detects a subject in a moving image;
• a clipping unit which clips a region corresponding to the subject detected by the detecting unit from each frame image composing the moving image;
• and
• a setting unit which sets a planned clipping region to be newly clipped by the clipping unit based on at least one of a position and a size of a region corresponding to the subject which is the region already clipped by the clipping unit and a region corresponding to the subject which is the region to be clipped by the clipping unit, wherein,
• the setting unit sets a region corresponding to the subject adding a play region on an outer side of the subject from a center of gravity of the subject as a center considering a shake occurring when the subject is imaged;
• and
• a size of the added play region may be changed according to the position and the size of the region corresponding to the subject or is a certain size.

An image processing apparatus comprising:

• a detecting unit which detects a subject in a moving image;
• a clipping unit which clips a region corresponding to the subject detected by the detecting unit from each frame image composing the moving image;
• and
• a setting unit which sets a planned clipping region to be newly clipped by the clipping unit based on at least one of a position and a size of a region corresponding to the subject which is the region already clipped by the clipping unit and a region corresponding to the subject which is the region to be clipped by the clipping unit, wherein,
• the setting unit determines whether there is a center of gravity of the region corresponding to the subject clipped from a first frame image which is one frame image before a second frame image among a plurality of frame images composing the moving image in the detected region corresponding to the subject;
• when the setting unit determines there is the center of gravity of the region corresponding to the subject clipped from the first frame image in the region corresponding to the subject, the setting unit sets the center of gravity of the region corresponding to the subject clipped from the first frame image as the center of gravity of the planned clipping region newly clipped from the second frame image;
• when the setting unit determines the center of gravity of the region corresponding to the subject clipped from the first frame image is not in the region corresponding to the subject, the setting unit sets the center of gravity of the planned clipping region newly clipped from the second frame image based on a linear interpolation condition.

An image processing method using an image processing apparatus, the method comprising:

• detecting a subject in a moving image;
• clipping a region corresponding to the subject detected from each frame image composing the moving image;
• and
• setting a planned clipping region to be newly clipped based on at least one of a position and a size of a region corresponding to the subject which is the region already clipped by the clipping unit and a region corresponding to the subject which is the region to be clipped by the clipping unit, wherein,
• said setting comprises determining whether there is a center of gravity of the region corresponding to the subject clipped from a first frame image which is one frame image before a second frame image among a plurality of frame images composing the moving image in the detected region corresponding to the subject;
• when it is determined that there is the center of gravity of the region corresponding to the subject clipped from the first frame image in the region corresponding to the subject, said setting further comprises setting the center of gravity of the region corresponding to the subject clipped from the first frame image as the center of gravity of the planned clipping region newly clipped from the second frame image;
• when it is determined that the center of gravity of the region corresponding to the subject clipped from the first frame image is not in the region corresponding to the subject, said setting further comprises setting the center of gravity of the planned clipping region newly clipped from the second frame image based on a linear interpolation condition.

A non-transitory computer-readable storage medium having a program stored thereon for controlling a computer to perform image processing performed in an image processing apparatus, wherein the program controls the computer to perform the functions of:

• a detecting unit which detects a subject in a moving image;
• a clipping unit which clips a region corresponding to the subject detected by the detecting unit from each frame image composing the moving image;
• and
• a setting unit which sets a planned clipping region to be newly clipped by the clipping unit based on at least one of a position and a size of a region corresponding to the subject which is the region already clipped by the clipping unit and a region corresponding to the subject which is the region to be clipped by the clipping unit, wherein,
• the setting unit determines whether there is a center of gravity of the region corresponding to the subject clipped from a first frame image which is one frame image before a second frame image among a plurality of frame images composing the moving image in the detected region corresponding to the subject;
• when the setting unit determines there is the center of gravity of the region corresponding to the subject clipped from the first frame image in the region corresponding to the subject, the setting unit sets the center of gravity of the region corresponding to the subject clipped from the first frame image as the center of gravity of the planned clipping region newly clipped from the second frame image;
• when the setting unit determines the center of gravity of the region corresponding to the subject clipped from the first frame image is not in the region corresponding to the subject, the setting unit sets the center of gravity of the planned clipping region newly clipped from the second frame image based on a linear interpolation condition.