Method and apparatus for training multimodal large model, and method and apparatus for image question answering

An electronic device, comprising:

• at least one processor;
• and
• a memory communicatively connected with the at least one processor;
• wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform a method for training multimodal large model, wherein the method for training multimodal large model comprises:
• obtaining an initial sample image, a sample object in the initial sample image, and a location information of the sample object;
• obtaining a target sample image including a sample visual marker based on the initial sample image and a target image region corresponding to the initial sample image;
• obtaining a sample question corresponding to the target sample image based on the sample visual marker, and obtaining a sample answer corresponding to the sample question;
• training an initial multimodal large model based on a target training sample constituted by the target sample image, the sample question and the sample answer to obtain a target multimodal large model.

A non-transitory computer readable storage medium with computer instructions stored thereon, wherein the computer instructions are used for causing a method for training multimodal large model, wherein the method for training multimodal large model comprises:

• obtaining an initial sample image, a sample object in the initial sample image, and a location information of the sample object;
• obtaining a target sample image including a sample visual marker based on the initial sample image and a target image region corresponding to the initial sample image;
• obtaining a sample question corresponding to the target sample image based on the sample visual marker, and obtaining a sample answer corresponding to the sample question;
• training an initial multimodal large model based on a target training sample constituted by the target sample image, the sample question and the sample answer to obtain a target multimodal large model.