Image processing apparatus, image processing method, and image capture apparatus

An image processing apparatus comprising:

• one or more processors that execute a program stored in a memory and thus function as:
• a subject detection unit configured to apply subject detection processing to an image by using a learning model generated based on machine learning;
• and
• a selection unit configured to select, from learning models that are stored in a storage device for storing a plurality of learning models for use in the subject detection processing, a learning model to be used by the subject detection unit in accordance with characteristics of the image to which the subject detection processing is to be applied, wherein
• the selection unit selects a first learning model when applying the subject detection processing to an image shot by using a first optical system, the first learning model being acquired by performing machine learning using images corresponding to the first optical system,
• the selection unit selects a second learning model when applying the subject detection processing to an image shot by using a second optical system, the second learning model being acquired by performing machine learning using images corresponding to the second optical system, and
• the first optical system and the second optical system are used in a same image capture apparatus.

An image capture apparatus comprising

• an image processing apparatus that comprises:
• one or more processors that execute a program stored in a memory and thus function as:
• a subject detection unit configured to apply subject detection processing to an image by using a learning model generated based on machine learning;
• and
• a selection unit configured to select, from learning models that are stored in a storage device for storing a plurality of learning models for use in the subject detection processing, a learning model to be used by the subject detection unit in accordance with characteristics of the image to which the subject detection processing is to be applied,
• wherein the selection unit selects a first learning model when applying the subject detection processing to an image generated in a moving image shooting mode, the first learning model being acquired by performing machine learning using images corresponding to the moving image shooting mode, and
• the selection unit selects a second learning model when applying the subject detection processing to an image generated in a still image shooting mode, the second learning model being acquired by performing machine learning using images corresponding to the still image shooting mode.

An image processing method executed by an image processing apparatus, comprising:

• applying subject detection processing to an image by using a learning model generated based on machine learning;
• and
• selecting, in accordance with characteristics of the image to which the subject detection processing is to be applied, a learning model to be used in the subject detection processing to be applied to the image from a storage device for storing a plurality of learning models for use in the subject detection processing,
• wherein in the selecting, a first learning model is selected when the subject detection processing is applied to an image generated by a first image sensor, the first learning model being acquired by performing machine learning using images corresponding to the first image sensor,
• in the selecting, a second learning model is selected when the subject detection processing is applied to an image generated by a second image sensor, the second learning model being acquired by performing machine learning using images corresponding to the second image sensor, and
• the first image sensor and the second image sensor are provided in a same image capture apparatus.

A non-transitory computer-readable medium storing thereon a program for causing a computer to function as an image processing apparatus comprising:

• a subject detection unit configured to apply subject detection processing to an image by using a learning model generated based on machine learning;
• and
• a selection unit configured to select, from learning models that are stored in a storage device for storing a plurality of learning models for use in the subject detection processing, a learning model to be used by the subject detection unit in accordance with characteristics of the image to which the subject detection processing is to be applied,
• wherein the selection unit selects a first learning model when applying the subject detection processing to an image generated by a first image sensor, the first learning model being acquired by performing machine learning using images corresponding to the first image sensor,
• the selection unit selects a second learning model when applying the subject detection processing to an image generated by a second image sensor, the second learning model being acquired by performing machine learning using images corresponding to the second image sensor, and
• the first image sensor and the second image sensor are provided in a same image capture apparatus.

A non-transitory computer-readable medium storing thereon a program for causing a computer included in an image capture apparatus to function as an image processing apparatus that is included in the image capture apparatus and comprises:

• a subject detection unit configured to apply subject detection processing to an image by using a learning model generated based on machine learning;
• and
• a selection unit configured to select, from learning models that are stored in a storage device for storing a plurality of learning models for use in the subject detection processing, a learning model to be used by the subject detection unit in accordance with characteristics of the image to which the subject detection processing is to be applied,
• wherein the selection unit selects a first learning model when applying the subject detection processing to an image generated in a moving image shooting mode, the first learning model being acquired by performing machine learning using images corresponding to the moving image shooting mode, and
• the selection unit selects a second learning model when applying the subject detection processing to an image generated in a still image shooting mode, the second learning model being acquired by performing machine learning using images corresponding to the still image shooting mode.

A method executed by an image processing apparatus provided in an image capture apparatus comprising:

• applying subject detection processing to an image by using a learning model generated based on machine learning;
• and
• selecting, from learning models that are stored in a storage device for storing a plurality of learning models for use in the subject detection processing, a learning model to be used by the subject detection unit in accordance with characteristics of the image to which the subject detection processing is to be applied,
• wherein in the selecting, a first learning model is selected when the subject detection processing is applied to an image generated in a moving image shooting mode, the first learning model being acquired by performing machine learning using images corresponding to the moving image shooting mode, and
• in the selecting, a second learning model is selected when the subject detection processing is applied to an image generated in a still image shooting mode, the second learning model being acquired by performing machine learning using images corresponding to the still image shooting mode.

An image processing method executed by an image processing apparatus, comprising:

• applying subject detection processing to an image by using a learning model generated based on machine learning;
• and
• selecting, from learning models that are stored in a storage device for storing a plurality of learning models for use in the subject detection processing, a learning model to be used by the subject detection unit in accordance with characteristics of the image to which the subject detection processing is to be applied, wherein
• in the selecting, a first learning model is selected when the subject detection processing is applied to an image shot by using a first optical system, the first learning model being acquired by performing machine learning using images corresponding to the first optical system,
• in the selecting, a second learning model is selected when the subject detection processing is applied to an image shot by using a second optical system, the second learning model being acquired by performing machine learning using images corresponding to the second optical system, and
• the first optical system and the second optical system are used in a same image capture apparatus.

A non-transitory computer-readable medium storing thereon a program for causing a computer to function as an image processing apparatus comprising:

• a subject detection unit configured to apply subject detection processing to an image by using a learning model generated based on machine learning;
• and
• a selection unit configured to select, from learning models that are stored in a storage device for storing a plurality of learning models for use in the subject detection processing, a learning model to be used by the subject detection unit in accordance with characteristics of the image to which the subject detection processing is to be applied, wherein
• the selection unit selects a first learning model when applying the subject detection processing to an image shot by using a first optical system, the first learning model being acquired by performing machine learning using images corresponding to the first optical system,
• the selection unit selects a second learning model when applying the subject detection processing to an image shot by using a second optical system, the second learning model being acquired by performing machine learning using images corresponding to the second optical system, and
• the first optical system and the second optical system are used in a same image capture apparatus.