Apparatus for generating annotated image information using multimodal input data, apparatus for training an artificial intelligence model using annotated image information, and methods thereof

A method for providing a user interface (UI) for generating training data for an artificial intelligence (AI) model, the method comprising:

• providing, for display via the UI, image information that depicts an object, a set of operations of the object, and a process associated with the set of operations;
• providing, for display via the UI, text information that describes the object, the set of operations of the object, and the process associated with the set of operations;
• receiving, via the UI, a first touch input in association with the image information, and a second touch input in association with the text information to associate respective image information of the image information with corresponding text information of the text information;
• and
• generating association information that associates the respective image information with the corresponding text information, based on the first touch input and the second touch input,
• wherein the image information is associated with an instructional video regarding the object, and wherein the text information corresponds to at least one of a product manual associated with the object, or captions associated with the instructional video.

A non-transitory computer-readable medium storing instructions, the instructions comprising:

• one or more instructions that, when executed by one or more processors of a device for training an artificial intelligence (AI) model, cause the one or more processors to:
• provide, for display via the UI, image information that depicts an object, a set of operations of the object, and a process associated with the set of operations;
• provide, for display via the UI, text information that describes the object, the set of operations of the object, and the process associated with the set of operations;
• receive, via the UI, a first touch input in association with the image information, and a second touch input in association with the text information to associate respective image information of the image information with corresponding text information of the text information;
• and
• generate association information that associates the respective image information with the corresponding text information, based on the first touch input and the second touch input,
• wherein the image information is associated with an instructional video regarding the object, and
• wherein the text information corresponds to at least one of a product manual associated with the object or captions associated with the instructional video.