Method and computer system for inference using a vision-language model based on cached information associated with input prompt

A computer system to perform inference using a vision-language model (VLM), the VLM being pretrained to sequentially generate inference results for consecutive inputs according to an input prompt, the computer system comprising:

• at least one processor configured to execute computer-readable instructions on the computer system,
• wherein the at least one processor is configured to cache information associated with the input prompt acquired during an operation for generating a first inference result for a first input among the consecutive inputs to the VLM, to maintain the cached information after the first inference result is generated, and to generate a second inference result for a second input following the first input among the consecutive inputs to the VLM, based on the cached information.