Image inference method, computer device, and storage medium

A computer device comprising:

• a storage device;
• at least one processor;
• and
• the storage device storing one or more programs, which when executed by the at least one processor, cause the at least one processor to:
• receive an inference request for inferring an image, and detect whether the inference request is correct;
• in response that the inference request is correct, determine a target collocation scheme for the image according to the inference request and a preset weight table, the target collocation scheme comprising a hardware accelerator in an idle state and an estimated time duration of inferring the image;
• update a usage state of the hardware accelerator in the target collocation scheme from the idle state to be an in use state, and inferring the image according to the target collocation scheme;
• when the inferring of the image is completed, update the usage state of the hardware accelerator in the target collocation scheme from the in use state to be the idle state;
• obtain an actual time duration of inferring the image, and update the estimated time duration to be the actual time duration.

A non-transitory storage medium having stored thereon at least one computer-readable instructions, which when executed by a processor of a computer device, causes the processor to perform an image inference method, wherein the method comprises:

• receiving an inference request for inferring an image, and detecting whether the inference request is correct;
• in response that the inference request is correct, determining a target collocation scheme for the image according to the inference request and a preset weight table, the target collocation scheme comprising a hardware accelerator in an idle state and an estimated time duration of inferring the image;
• updating a usage state of the hardware accelerator in the target collocation scheme from the idle state to be an in use state, and inferring the image according to the target collocation scheme;
• when the inferring of the image is completed, updating the usage state of the hardware accelerator in the target collocation scheme from the in use state to be the idle state;
• obtaining an actual time duration of inferring the image, and updating the estimated time duration to be the actual time duration.