Data collection techniques for security and safety of ai-based applications

A system comprising:

• a memory;
• and
• a set of one or more processing devices coupled to the memory, wherein the set of one or more processing devices is to perform operations comprising:
• detecting a user query pertaining to one or more artificial intelligence (AI) models of a system, wherein each of the one or more AI models are supported by a plurality of services associated with the system, each of the plurality of services running via at least one computing resource;
• receiving, from each computing resource running a respective service of the plurality of services, performance data reflecting a performance of an operation pertaining to the user query by the respective service and state data reflecting a state of the computing resource based on the performance of the operation;
• generating a mapping between the performance data and the state data received from each computing resource;
• and
• performing one or more of a threat detection operation or a security enforcement operation based on the generated mapping.

A non-transitory computer readable storage medium comprising instructions that, when executed by a processing device, cause the processing device to perform operations comprising:

• detecting a user query pertaining to one or more artificial intelligence (AI) models of a system, wherein each of the one or more AI models are supported by a plurality of services associated with the system, each of the plurality of services running via at least one computing resource;
• receiving, from each computing resource running a respective service of the plurality of services, performance data reflecting a performance of an operation pertaining to the user query by the respective service and state data reflecting a state of the computing resource based on the performance of the operation;
• generating a mapping between the performance data and the state data received from each computing resource;
• and
• performing one or more of a threat detection operation or a security enforcement operation based on the generated mapping.